Short clip: Technorati serves up sub-second responses

October 28, 2008, 2:20pm PDT | Length: 00:01:38
Dorion Carroll, vice president of engineering for Technorati, says that while the active blogosphere is between 15 and 30 million blogs, there they around 130 million indexed altogether. The challenge for their small technical team is to sift through that ever-expanding amount of data, while serving up sub-second response times.

Transcript

Short clip: Technorati serves up sub-second responses

watch ticking

>>

Host: The technology doesn't always work the way you want it, too, though. Technority phonetic has faced criticism for technical problems. Index outages, search results that are stale. How do you handle that?

>>

Interviewee: We had outages. We've blogged about them. We tried to share, you know, a little bit of the pain that we felt. We've grown tremendously. When I started four years ago, we were indexing about three and a half million blogs. Today, sort of cumulatively, I think over the five years that the company's been in existence, we've indexed over 130 million. Now, a lot of those blogs are dormant. They're, they're not active anymore. The active blogosphere is probably between 15 and 30 million blogs, and that's really what makes up the core of what we're tying to do. Now, we have all of the rest of this data hanging around, and that's been part of the challenge for us is how can we scale our architecture to deal with this massive amount of data while at the same time being able to serve up sub-second response time queries for things that are less than a minute old. And these are the kinds of challenges that I'm very proud to say the team has been able to address. I think we've probably gone through five major architectural overhauls in the four years that I've been there, and, you know, it's like changing a tires on a, on a speedster while you're racing cross country. And it's a non-trivial problem. Technority is a small company. We're about 38 people right now. Only have of those people are in the technical organization. So it's an amazingly talented group of people that are trying to tackle a really large problem, and no, I can't say we do it a hundred percent of the time, but we really try our hardest.

watch ticking

==== Transcribed by Automatic Sync Technologies ====

Short clip: Technorati reducing costs during weekend downtime

Short clip: Technorati reducing costs during weekend downtime

Dorion Carroll, vice president of engineering for Technorati, explains that because bloggers...

Short clips: Technorati on sifting through splogs

Short clips: Technorati on sifting through splogs

Dorion Carroll, vice president of engineering for Technorati, discusses the challenges inherent...

Technorati VP of engineering: Dorion Carroll

Technorati VP of engineering: Dorion Carroll

Dorion Carroll, vice president of engineering for Technorati, talks to ZDNet correspondent Sumi...

Short clip: 1-800 Flowers blooms with blogs, social networks

Short clip: 1-800 Flowers blooms with blogs, social networks

Steve Bozzo, CIO of 1-800 Flowers, discusses innovative technologies the company is working on...

Short clip: Blogging about the Kentucky Derby

Short clip: Blogging about the Kentucky Derby

Jay Rollins, the vice president of information technology at Churchill Downs, discusses how the...

Monte Ford, CIO, American Airlines

Monte Ford, CIO, American Airlines

Monte Ford, CIO of American Airlines talks to ZDNet’s Sumi Das about developing a new passenger...

Shadman Zafar, CIO, Verizon Telecom

Shadman Zafar, CIO, Verizon Telecom

Shadman Zafar, CIO of Verizon Telecom talks to ZDNet correspondent Sumi Das about the company’s...

Short clip: Sony converges electronics and entertainment

Short clip: Sony converges electronics and entertainment

Drew Martin, CIO of Sony Electronics, talks about the convergence of content and consumer...

Talkback - Tell Us What You Think

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

White Papers, Webcasts, & Resources

Facebook Activity