Elastic Adds Support for Spark, Spark SQL, and Storm to Hadoop Connector
(firmenpresse) - MOUNTAIN VIEW, CA and AMSTERDAM, THE NETHERLANDS -- (Marketwired) -- 06/24/15 -- , the company behind the popular open source projects , , and with more than 20 million downloads, today released version 2.1 of its Hadoop connector, , adding support for Spark, Spark SQL, and Storm.
While Hadoop provides value as a high-scale, low-cost storage medium for doing batch analytics, it was not designed for real-time data availability or responsive queries. Elasticsearch for Apache Hadoop makes it simple for businesses to index, query, and backup data from Hadoop into Elasticsearch, adding the capabilities of a scalable, real-time search and analytics engine to their Hadoop platform -- whether it's for internal or external applications, or for performing back-office system monitoring, security, and log analysis. With the release of Elasticsearch for Apache Hadoop 2.1, Elastic's Hadoop connector now supports Spark, Spark SQL, and Storm, in addition to native integration with MapReduce, Hive, Pig, and Cascading. It is also certified with Cloudera, Databricks, Hortonworks, and MapR.
"We see Hadoop being used more and more in our customer base, especially in industries that deal with vast amounts of varied data, like financial services, healthcare, and telecommunications. With added support for Spark, Spark SQL, and Storm, Elasticsearch for Apache Hadoop 2.1 provides Elastic's rich search and analytics to the next-generation run-times in the Hadoop ecosystem," said Costin Leau, Hadoop engineering lead at Elastic.
"We use Spark to process large batches of sensor data that we then index in Elasticsearch to predict, and in turn, prevent equipment failure for our industrial and manufacturing customers," said Roy Russo, vice president of engineering at Predikto, Inc. "Spark helped us improve our ETL processes by a factor of 10, and thanks to Elasticsearch for Apache Hadoop, we are able to get real-time insights, build dynamic dashboards, and plot maps with Elasticsearch's rich querying capabilities and GeoJSON support."
, including push down translation of Spark SQL to Elasticsearch Query DSL
, providing the ability to read/write data to Elasticsearch via Spout (read streams) and Bolt (write streams)
, including:
Basic HTTP authentication allowing Hadoop jobs running against a restricted Elasticsearch cluster to identify themselves
SSL/TLS support for cryptographic connections between Elasticsearch and Hadoop, enabling data-sensitive environments to transparently encrypt the data at transport level to prevent snooping and preserve data confidentiality
PKI support for -enabled Elasticsearch clusters
Elasticsearch for Apache Hadoop.
for the webinar.
the blog.
Founded in 2012 by the people behind the Elasticsearch and Apache Lucene open source projects, Elastic provides real-time insights and makes massive amounts of structured and unstructured data usable for developers and enterprises. By focusing on scalability, ease-of-use, and ease-of-integration, Elasticsearch, Logstash, and Kibana power many of the world's leading mobile, social, consumer and business applications. Since its initial release, the open source stack has achieved more than 20 million cumulative downloads.
Elastic is backed by Benchmark Capital, Index Ventures, and NEA with headquarters in Amsterdam and Mountain View, California, and offices and employees around the world. To learn more, visit .
Amy White
US: 650-260-5857
EMEA: +31 20 794 7300
Themen in dieser Pressemitteilung:
Unternehmensinformation / Kurzprofil:
Datum: 24.06.2015 - 16:00 Uhr
Sprache: Deutsch
News-ID 402785
Anzahl Zeichen: 0
contact information:
Town:
MOUNTAIN VIEW, CA and AMSTERDAM, THE NETHERLANDS
Kategorie:
Diese Pressemitteilung wurde bisher 226 mal aufgerufen.
Die Pressemitteilung mit dem Titel:
"Elastic Adds Support for Spark, Spark SQL, and Storm to Hadoop Connector"
steht unter der journalistisch-redaktionellen Verantwortung von
Elastic (Nachricht senden)
Beachten Sie bitte die weiteren Informationen zum Haftungsauschluß (gemäß TMG - TeleMedianGesetz) und dem Datenschutz (gemäß der DSGVO).
