Facebook's new commenting system: engineered for real-time updates, reduced latency

Facebook's new commenting system: engineered for real-time updates, reduced latency

Summary: Facebook's new commenting system, which the company said today that it rolled out a couple of weeks ago, does more than just bring an IM-like conversation to the comments that appear under wall posts on Facebook pages.The system lightens the load on Facebook's servers by utilizing a "write locally, read globally" approach to managing the traffic of people who are just reading content vs.

SHARE:

Facebook's new commenting system, which the company said today that it rolled out a couple of weeks ago, does more than just bring an IM-like conversation to the comments that appear under wall posts on Facebook pages.

The system lightens the load on Facebook's servers by utilizing a "write locally, read globally" approach to managing the traffic of people who are just reading content vs. traffic from those who are posting comments to that content.

In a post on Facebook's Engineering blog today, the company's Ken Deeter posted a behind-the-scenes look at how FB is directing traffic to save server space and decrease latency. To understand the challenges that FB engineers were facing, Deeter noted that every minute, the site serves more than 100 million pieces of content that may receive comments. In that same minute, users hammer out 650,000 comments - all of which need to be routed to the pages of people who are viewing that comment. He wrote:

To be able to push information about comments to viewers, we need to know who may be viewing the piece of content that each new comment pertains to. Because we serve 100 million pieces of content per minute, we needed a system that could keep track of this "who's looking at what" information, but also handle the incredible rate at which this information changed.

Storing these one-to-one, viewer-to-content associations in a database is relatively easy. Keeping up with 16 million new associations per second is not.Up until this point, Facebook engineering had built up infrastructure optimized for many more reads than writes. But now we had flipped the game. Every page load now requires multiple writes (one for each piece of content being displayed). Each write of a comment requires a read (to figure out the recipients of an update). We realized that we were building something that was fundamentally backwards from most of our other systems.

The "write locally, read globally" approach means that the company is "deploying distributed storage tiers" to manage the "writes" but less frequently has to collect info from across its data centers. Deeter's example does a better job of explaining it:

For example, when a user loads his News Feed through a request to our data center in Virginia, the system writes to a storage tier in the same data center, recording the fact that the user is now viewing certain pieces of content so that we can push them new comments. When someone enters a comment, we fetch the viewership information from all of our data centers across the country, combine the information, then push the updates out. In practice, this means we have to perform multiple cross-country reads for every comment produced. But it works because our commenting rate is significantly lower than our viewing rate. Reading globally saves us from having to replicate a high volume of writes across data centers, saving expensive, long-distance bandwidth.

Bottom line: the next time you see a new comment magically appear on a post while you're either hammering out your own comment or scrolling along just catching up on your friends' latest adventures, know that the Facebook engineers literally flipped the entire process on its head to make it better.

Topics: Social Enterprise, Data Centers, Hardware, Storage

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Talkback

5 comments
Log in or register to join the discussion
  • RE: Facebook's new commenting system: engineered for real-time updates, reduced latency

    Hopefully this new comment system will be better than systems like Topix, a company many newspapers are thankfully getting away from. With speech comes responsibility and using Topix for an example they never grasped that which makes for a mess. A comment system is intended for comments to stay on point without brutal reputation destroying attacks on other people. Papers and websites have to find a balance and hold people accountable. I have seen way too many comment systems where there is a legit newsstory going on and then because a site lacks registration or moderation go off on some tyrant where racial slurs occur, attacks on private citizens, etc. Facebook has great technology so hopefully they will set a new standard. I have to say a commenting system like Disqus or LiveFrye isn't bad, it will be interesting to see if Facebook can top that.
    candlewax
    • RE: Facebook's new commenting system: engineered for real-time updates, reduced latency

      I found your site via yahoo thanks for the post. I will bookmark it for future reference. Thanks <a href="http://www.perfectreplicawatch.co.uk/replica-patek-philippe-c-130.html">patek philippe replica</a>
      biasedfans
  • RE: Facebook's new commenting system: engineered for real-time updates, reduced latency

    Thanks for this wonderful blog. It really aroused my interest to go over and read it again. Your article conveys to the knowledgeable minds of the readers.
    <a href="http://www.perfectreplicawatch.co.uk/watch-accessories-c-134.html">watch accessories</a>
    biasedfans
  • louis vuitton outlet

    hfadfg<p><a href="http://www.gelvlouisvuittonoutlet.org" title="louis vuitton outlet"><strong>louis vuitton outlet</strong></a> leads you to bags collection of wide, such as LV bags and LV handbag etc. They are main name in luxury and style. It is excellent quality, fine Italian technology and extraordinary beauty.<a href="http://www.gelvlouisvuittonoutlet.org" title="louis vuitton online"><strong>louis vuitton online</strong></a> as a professional LV Earrings online supplier, we have enjoyed the fullest respect for our in-time delivery, moderated price and superior quality.</p>

    <p>The choices are likely to be basically countless seeing that <a href="http://www.golvlouisvuittonbags.com" title="louis vuitton outlet"><strong>louis vuitton outlet</strong></a> occurs with the help of completely new and also incredible concepts once in a while.Carry these <a href="http://www.golvlouisvuittonbags.com" title="louis vuitton purses"><strong>louis vuitton purses</strong></a> of slouched styles with all your laidback looks this season and beyond.?It's the time to treat yourself now.</p>

    <p>any <a href="http://www.illouisvuittonoutlet.com" title="louis vuitton outlet"><strong>louis vuitton outlet</strong></a> New backpack features usa a function grownup overall look. Varied piece allows that it is captivated me within the approve and also further than your body.LV has been the symbol of fashion and nobility for quite a long time. The <a href="http://www.illouisvuittonoutlet.com" title="louis vuitton online"><strong>louis vuitton online</strong></a> shop has become so famous all around the world recently.<a href="http://www.illouisvuittonoutlet.com" title="louis vuitton outlet online"><strong>louis vuitton outlet online</strong></a> Cupertino M56398 is manufactured out of monogram Canvas,natural cowhide clippings along with elaborate tissage cells lining cause it to be quite specific.</p>

    <p>LV bags in the <a href="http://www.iulouisvuittonoutlet.net" title="louis vuitton outlet"><strong>louis vuitton outlet</strong></a> are a feminine update on an urban classic. With plenty of room for all of your essentials this covetable carryall will take you through the weekend in style.If you feel more and more online shopping department store thinned Market,then do a local version of their own. When the gradual opening of <a href="http://www.iulouisvuittonoutlet.net" title="louis vuitton outlet online"><strong>louis vuitton outlet online</strong></a>. Public will be increasingly in popularity.<a href="http://www.iulouisvuittonoutlet.net" title="louis vuitton online"><strong>louis vuitton online</strong></a> shop sounds like a melody to most people all over the world. It is apparent to us all that Louis Vuitton has enjoyed its global prevalent selling for ages.</p>

    <p>Almost no one can resist the temptation of LV Bags.There established many online <a href="http://www.llouisvuittonoutlet.org" title="louis vuitton outlet"><strong>louis vuitton outlet</strong></a> recently with the aim of making people's shopping more convenient.Is without a doubt <a href="http://www.llouisvuittonoutlet.org" title="louis vuitton online"><strong>louis vuitton online</strong></a> seriously is present? Is it possible to offer an outlet designed for Louis Vuitton merchandise speaks out?</p>

    <p>This collection focus more on color selection compared with other LV handbags. Cute and sunshine design style increases its charm. <a href="http://www.louisvuitton-outletonline.info" title="louis vuitton outlet online"><strong>louis vuitton outlet online</strong></a> provides you the very famous luxury worldwide brand.Here is a world of <a href="http://www.louisvuitton-outletonline.info" title="louis vuitton outlet"><strong>louis vuitton outlet</strong></a> where you can find all kinds of new style and fashion Louis Vuitton bags. We really want to lead the trend and let our customer in the pursuit of luxury and fashion, satisfied the needs of customers.<a href="http://www.louisvuitton-outletonline.info" title="louis vuitton online"><strong>louis vuitton online</strong></a> shop sounds like a melody to most people all over the world. It is apparent to us all that Louis Vuitton has enjoyed its global prevalent selling for ages.</p>
    factoryoutlet
  • coach outlet

    kjgha<p><a href="http://www.coachfactorystoreoutlete.net" title="coach factory outlet"><strong>coach factory outlet</strong></a> offers you the modern and very comfortable coach bags. Since many women often do not know things and are daily buses to challenge their handbags handbag, also comprehensive.products of <a href="http://www.coachfactorystoreoutlete.net" title="coach factory store"><strong>coach factory store</strong></a> as well as can easily hand bags, mens totes, internet business bags, luggage, wallets, and also regularly produce unique set increased coach clutches model effect.You will easily notice the unfold zippers of this <a href="http://www.coachfactorystoreoutlete.net" title="coach factory outlet store"><strong>coach factory outlet store</strong></a>. That is the decoration. There are some inside pockets for you as well. They are easy to match your clothes and to carry.Many fashionable women match with practical Coach Purses which will make the street shopping become relaxed,and make every person can enjoy more diversiform combination in <a href="http://www.coachfactorystoreoutlete.net" title="coach factory outlet online"><strong>coach factory outlet online</strong></a>.</p>

    <p>Attention! <a href="http://www.godocoachoutlet.org" title="coach outlet"><strong>coach outlet</strong></a> is offering new products at favorable prices for August. Brighter colors, finer looks and newer designs, all bring you a whole new summer.The <a href="http://www.godocoachoutlet.org" title="coach factory outlet"><strong>coach factory outlet</strong></a> has been in business for many years. You can log in to find more information about its products and services.There are some practical and beautiful items for sale at <a href="http://www.godocoachoutlet.org" title="coach factory outlet online"><strong>coach factory outlet online</strong></a> for your selection. Do not miss it and have one for a try.</p>

    <p>If you do not know design can be the most fashionable this fall, consider a glance on <a href="http://www.coachfactoryonlines.net" title="coach factory outlet"><strong>coach factory outlet</strong></a>! This summer, you have a wide range of options, because there are numerous designs, you can find from.Attention! <a href="http://www.coachfactoryonlines.net" title="coach outlet"><strong>coach outlet</strong></a> is offering new products at favorable prices for August. Brighter colors, finer looks and newer designs, all bring you a whole new summer.<a href="http://www.coachfactoryonlines.net" title="coach factory"><strong>coach factory</strong></a> Outlet are leading the international market all the time, because men and women choose to buy these Coach Products to use for leisure, work or travel than any other designer brands.Each and every woman wants to possess a coach bag. <a href="http://www.coachfactoryonlines.net" title="coach factory outlet online"><strong>coach factory outlet online</strong></a> This brand of handbags will not price you a great deal of cash.</p>

    <p>On establishing contact with a <a href="http://www.coachhoutlet.com" title="coach outlet"><strong>coach outlet</strong></a> hire agency, a few clarifications would need to be put to rest prior to working out a deal.Modern designs and faddish shapes make Coach products enjoy high reputations around the world. <a href="http://www.coachhoutlet.com" title="coach factory outlet"><strong>coach factory outlet</strong></a> a shopping place just for you.<a href="http://www.coachhoutlet.com" title="coach factory"><strong>coach factory</strong></a> not only supply with the highest quality crystal at reasonable price but also provide good after-sales service. Companies operating purposes: science and technology in order to survive, credibility and development, strict quality control.There are some practical and beautiful items for sale at? <a href="http://www.coachhoutlet.com" title="coach factory outlet online"><strong>coach factory outlet online</strong></a> for your selection. Do not miss it and have one for a try.</p>

    <p><a href="http://www.coachhoutlet.net" title="coach outlet"><strong>coach outlet</strong></a> has become a popular shopping experience for consumers around the world, and a desirable distribution channel for manufacturer's and retailers.Coach is a leading American designer and maker of luxury lifestyle handbags and accessories.There is no doubt that here <a href="http://www.coachhoutlet.net" title="coach factory outlet"><strong>coach factory outlet</strong></a> is the exact place you should visit.There are different kinds of crossbody bags within marketplace nowadays. Even so it is not possible to beat the timeless design jointly with traditional elegance of the Bags at the <a href="http://www.coachhoutlet.net" title="coach factory outlet online"><strong>coach factory outlet online</strong></a>.After graduating from university, my cousin came back to my hometown from USA last month. She told me that <a href="http://www.coachhoutlet.net" title="coach outlet store"><strong>coach outlet store</strong></a> is very popular among her classmate.</p>

    <p><a href="http://www.coachoutletonlinee.net" title="coach outlet online"><strong>coach outlet online</strong></a> is your smart choice when you want to get the discount Coach accessory. You can find the exact Coach Bags and other accessory you want at a low price that's right for you. My dear friends, let the <a href="http://www.coachoutletonlinee.net" title="coach outlet online"><strong>coach outlet online</strong></a> pave your way into the world of high fashion with their ultimate fashion factory.<a href="http://www.coachoutletonlinee.net" title="coach outlet"><strong>coach outlet</strong></a> handbags You can not just save your cash but also your time inside a convenient way to obtain the exact same bags product and do not be concerned the shippment of one's products.If you desire to go to <a href="http://www.coachoutletonlinee.net" title="coach factory outlet"><strong>coach factory outlet</strong></a>, but have no idea in which to go, you can research online. It is no doubt that there is drastically information and details about it for the reference.Tens of millions of girls all more than the world feel that Coach Classic C Tote Bag Beige really are a needed accessory. <a href="http://www.coachoutletonlinee.net" title="coach factory"><strong>coach factory</strong></a> outlet provides you the most common designer handbag with many discounts.</p>

    <p><a href="http://www.coachfactorysoutlets.com" title="coach factory outlet"><strong>coach factory outlet</strong></a> has a big heart and a healthy appetite, and a wicked swing with a chainsaw. After a knee injury ended his career as a defensive lineman in college, Coach salvaged his Physical Education degree(barely)and landed a job teaching health at the local high school in his hometown of Savannah.<a href="http://www.coachfactorysoutlets.com" title="coach outlet"><strong>coach outlet</strong></a> handbags's special design and fashion is certainly and so eye-catching, I hope you are able to get much more attention towards the Cheap Coach Crossbody.Are you searching for a cool and stylish coach bag? The <a href="http://www.coachfactorysoutlets.com" title="coach factory outlet online"><strong>coach factory outlet online</strong></a> Online is your first priority.Here's your new way to look sophisticated styles. Carry the hot <a href="http://www.coachfactorysoutlets.com" title="coach factory outlet store"><strong>coach factory outlet store</strong></a> of this summer and be the true trendsetter!</p>

    <p>customers are not only interested in handbags and purses, but also fond of?shoes and jewelry which is sold at the <a href="http://www.coachoutletsstoree.com" title="coach outlet"><strong>coach outlet</strong></a>.Mainly because products are rattling straight forward, locomotion, to see our own elements connected with <a href="http://www.coachoutletsstoree.com" title="coach factory outlet"><strong>coach factory outlet</strong></a> you can actually just make an effort to accomplish without this.There are some practical and beautiful items for sale at? <a href="http://www.coachoutletsstoree.com" title="coach factory outlet online"><strong>coach factory outlet online</strong></a> for your selection. Do not miss it and have one for a try.</p>
    factoryoutlet