This Is How Airbnb Adopted HTTP Streaming to Save 84 Million USD in Costs
Discover more from System Design Newsletter
This Is How Airbnb Adopted HTTP Streaming to Save 84 Million USD in Costs
#7: Read Now - Awesome Web Optimisation Technique (6 minutes)
Get the powerful template to approach system design for FREE on newsletter sign-up:
A 100 ms delay in website load time decreases sales by 1%. That’s an 84 million USD loss per year for Airbnb.1
Airbnb switched to HTTP streaming to improve its page load performance. It reduced the first contentful paint (FCP) metric by 100 milliseconds on every page.
The FCP measures the time from the start of the page load to the screen render.
This post outlines how Airbnb reduced latency by 100 ms with HTTP streaming. Consider sharing this post with somebody who wants to study modern web development.
What Is Critical Rendering Path?
I will give you an overview of the critical rendering path.
A browser performs a sequence of events before the screen render. This sequence of events is called the critical rendering path.
The browser receives HTML and CSS from the server. Then it translates HTML and CSS into DOM and CSSOM. This is called parsing.
Document Object Model (DOM) is the browser's internal representation of markup. CSS Object Model (CSSOM) is the browser's internal representation of styles. And they are independent tree data structures.
The browser parses HTML incrementally. So, DOM construction is incremental.
But the browser blocks the screen until the server sends CSS files. Also parsing CSS is not incremental.
The browser then combines the DOM and CSSOM to create the render tree.
The determination of the dimensions and node locations by browser is called layout.
The browser finally renders the individual nodes to the screen. This is called painting.
What Is HTTP Streaming?
I will teach you HTTP streaming with an analogy. Imagine there is a water tap and a tube. And you want to fill the tube with water. There are 2 options:
Buffering: Take a cup and fill it with water from the tap. And then pour it down the tube. This is called buffering. Everything happens in sequence. In computing, the server writes the entire response into a buffer. And then sends it to the browser.
Streaming: Connect the tap to the tube. And fill it with water. This is called streaming. Many steps happen in parallel. In computing, the server breaks the response into chunks. And sends it out as soon as they are ready. The browser handles the received chunks. This speeds up things. A popular method for HTTP streaming is Chunked transfer encoding.
How Airbnb Optimised Critical Rendering Path?
According to the performance golden rule, 90% load time of most websites is on the front end. Yet many websites today rely on buffering. Because they want to avoid extra engineering effort to enable streaming.
A switch to streaming might not be worth it if the page content depends on a slow backend query. Because nothing gets rendered until that query finishes. But Airbnb found a universal use case for HTTP streaming to improve performance.
And they reduced their network waterfall by switching to streaming. A waterfall happens when a network request triggers another request.
Here is what they found. The browser sat idle until the server created the entire HTML. Also their website needed to load external files (fonts, CSS, JavaScript) to render. But the browser downloaded the external files only after it received the entire HTML. So, this resulted in a cascade of requests (waterfall). And poor performance.
The browser parsed HTML incrementally. So, they used early flush to stream HTML to the browser.
Here's how they did it. Split the HTML document into 2 chunks and send them separately. They sent the HTML <header> in the first chunk. And it allowed the browser to download external files as soon as it parsed the first chunk.
In the meantime, the server generated the remaining HTML. And this reduced the network waterfall.
<html>
<head>
<title>Your Page</title>
<link rel="stylesheet" href="your.css" />
<script src="script.js" defer></script>
</head>
Flush
<body>
...
</body>
</html>But a problem remained - the user saw a blank page until the HTML <body> tag arrived. So, they rendered a loading state if there was no data. And the browser fetched data.
But this created a new problem - they sent an extra network request to fetch data. So, they streamed a third chunk of data instead. It goes only after all the visible content and doesn't block render. This eliminated an extra network request.
They used JavaScript to detect the data chunk arrival. And MutationObserver to observe DOM changes. After that insert data into the application's network data store.
Node.js (Express framework) ran on the server. They rewrote their React component to enable streaming. And rendered the entire HTML document as 3 separate React components.
But they ran into a few problems with enabling HTTP streaming. And resolved the problems by:
Disabling response buffering in nginx
Disabling Nagle's algorithm in the haproxy load balancer. This allowed chunks to reach the browser unaltered
Takeaways
The takeaways from this case study are:
Stream HTML. It allows incremental construction of the page. And enables the early discovery of external files
Code split CSS files. And inline critical styles. This improves performance
Move non-critical JavaScript out from the critical rendering path. And download JavaScript after the initial render. Because JavaScript parsing is blocking
Stream HTML. And request-response approach for the remaining content. This keeps it simple
Google Search uses HTTP streaming to load the headers even before the user types in a full query. This speeds up their render times.
Do you know any websites that use HTTP streaming? Leave a comment.
Consider subscribing to get simplified case studies delivered straight to your inbox:
Readership
A huge thank you to everybody who supports this newsletter. Our goal was to reach 5,000 subscribers by 30 September. And we hit 5,523+ subscribers already - Welcome new readers!
So let’s up it: 6,000 subscribers by 30 September. Nothing is more exciting than seeing this community grow.
Further Read
Read this post summary: Twitter Thread, LinkedIn Post, and Substack Notes.
Last Week: 🚀 Catch up on the latest posts!
Are you interested in writing great software? And improving your soft skills? Consider subscribing to the Refactoring newsletter by
. He also built an awesome community around it.Disclaimer: I put a referral link. Because I'd love free access to paid content.
Reader Praise
Word-of-mouth referrals like yours help this community grow - Thank you.
Get featured in the newsletter: Write your feedback on this post. And tag me on Twitter, LinkedIn, and Substack Notes. Or, you can reply to this email with anonymous feedback.
References
Victor (2023). Improving Performance with HTTP Streaming. [online] The Airbnb Tech Blog. Available at: https://medium.com/airbnb-engineering/improving-performance-with-http-streaming-ba9e72c66408.
www.stevesouders.com. (n.d.). Flushing the Document Early | High-Performance Web Sites. [online] Available at: https://www.stevesouders.com/blog/2009/05/18/flushing-the-document-early/ [Accessed 9 Sep. 2023].
Optimization, W. (2013). Flush HTML Early and Often - flushing HTML to speed up start render times and page rendering. [online] WebSiteOptimization.com. Available at: https://www.websiteoptimization.com/speed/tweak/flush/ [Accessed 9 Sep. 2023].
developer.mozilla.org. (n.d.). Populating the page: how browsers work - Web Performance | MDN. [online] Available at: https://developer.mozilla.org/en-US/docs/Web/Performance/How_browsers_work.
www.youtube.com. (n.d.). Critical rendering path - Crash course on web performance (Fluent 2013). [online] Available at: youtube.com [Accessed 9 Sep. 2023].
Tests done at Amazon in 2007 revealed that for every 100ms increase in load time, sales would decrease by 1%. Airbnb's annual revenue is $8.4B. So, a 100ms delay would cost Airbnb 84 million USD per year. The user behavior might be different from the studies and the numbers are subject to vary.
This Is How Airbnb Adopted HTTP Streaming to Save 84 Million USD in Costs
Loved this short but informative read! Very helpful and also appreciated the code example.
Thanks NK!