Elasticsearch + Logstash unite

Elasticsearch + Logstash unite

Summary: Elasticsearch acquires Logstash, providing an integrated platform for search-based querying of log file data.

TOPICS: Big Data

Open source search and analytics vendor Elasticsearch, which provides a RESTful Web service programming interface atop Apache Lucene, has acquired the vendor of one of its most prevalent companion tools, Logstash.  

Logstash has long integrated with Elasticsearch to provide an open source platform for searching through log file data. That may sound like a scenario limited to operational IT, but in point of fact, a "log file" can be any data file where each data item contains some kind of time and date information.

Logstash's creator, Jordan Sissel, has now joined Elasticsearch just as version 1.2 of Logstash is being released. In a recent conversation with ZDNet, Sissel, a system adminsitrator by trade, explained that his motivation for creating Logstash was to make exploration and discovery with log file data as easy as ad hoc data spelunking can be with Microsoft Excel. Sissel wanted to concentrate on that scenario and not get bogged down with building his own search platform. As such, he built Logstash atop Elasticsearch

Another open source project, Kibana, also offers Excel-like data visualization capabilities with Elasticsearch data. Kibana's creator, Rashid Khan, had previously joined Elasticsearch, much as Sissel is doing today. Elasticsearch, Kibana and Logstash have been used together much in the past and now all three are under the Elasticsearch corporate umbrella, providing for tight integration between the tools, along with continued support for standalone functionality.

Topic: Big Data

Andrew Brust

About Andrew Brust

Andrew J. Brust has worked in the software industry for 25 years as a developer, consultant, entrepreneur and CTO, specializing in application development, databases and business intelligence technology.

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.


Log in or register to start the discussion