Hadoop

(redirected from Apache Hadoop)
Also found in: Wikipedia.

Hadoop

An open source big data framework from the Apache Software Foundation designed to handle huge amounts of data on clusters of servers. The storage is handled by the Hadoop Distributed File System (HDFS), and the data are sorted and summarized in parallel by Hadoop MapReduce, a version of Google's MapReduce. Required Java files are included in Hadoop Common, and Hadoop YARN provides the cluster management.

Originally written for the Nutch Web crawler for spidering the Web, in 2008, Yahoo!'s Search Webmap was the first very large implementation of Hadoop running on 10,000 Linux servers. Search Webmap ran in a third less time than Yahoo!'s previous search engine.

The Hadoop name comes from a favorite stuffed elephant of the son of the developer Doug Cutting. See Google File System, MapReduce and Spark.
Copyright © 1981-2019 by The Computer Language Company Inc. All Rights reserved. THIS DEFINITION IS FOR PERSONAL USE ONLY. All other reproduction is strictly prohibited without permission from the publisher.
References in periodicals archive ?
Arcadia Data's architecture delivers faster and deeper insights from modern data platforms like cloud object stores, Apache Kafka and Apache Hadoop. Arcadia's patent-pending ArcEngine technology enables enterprises to generate insights in use cases like data lakes, cybersecurity, IoT and customer intelligence.
(2) Resource Manager and Job scheduler for Apache Hadoop / Spark applications, which allocate and mange distributed computing resources, including CPU and memory
Powered by Apache Hadoop and enabled by the company's ecosystem, HDP enables Nissan Motor to use big data applications that require cross-functional data analysis, such as analysing the battery usage in electric vehicles and quality management of vehicles with the intention of ensuring that users have a smooth and seamless enhanced driving experience.
This acquisition builds on Syncsort's strengths in delivering key mainframe data to Big Data platforms like Apache Hadoop, Apache Spark and Splunk, while simultaneously increasing efficiency and lowering costs on the mainframe.
IBM has built Spark into the core of its platforms including Watson, Commerce, Analytics, Systems, Cloud as well as more than 30 offerings including IBM BigInsights for Apache Hadoop, IBM Analytics on Apache Spark, Spark with Power Systems, Watson Analytics, SPSS Modeler and IBM Stream Computing.
• Fundamentals of Apache Hadoop and data ETL (extract, transform, load), ingestion, and processing with Hadoop
Headquartered in Woodcliff Lake, New Jersey Syncsort provides enterprise-grade software that spans "Big Iron to Big Data," including fast-growing analytical platforms such as Apache Hadoop, Splunk, Apache Spark, and the cloud, as well as more mature platforms such as the IBM z Systems mainframe.
When the Apache Hadoop project started, MapReduce V1 was the only choice as a Compute model (Execution Engine) on Hadoop.
Data Science Technologies (DST), a subsidiary of StorIT Distribution, has announced a new distribution partnership with MapR Technologies, provider of Apache Hadoop.
Apache Hadoop has enabled businesses of all sizes to utilize big data cost-effectively and re-allocate the limited space in the Enterprise Data Warehouse only for that data that needs to travel first class.
Cloudera Enterprise, the foundation for Cloudera's enterprise data hub offering, includes Cloudera's complete and tested distribution of Apache Hadoop. Reportedly, It is the most widely adopted Hadoop-based platform in the world, with Cloudera being the most prolific contributor to the open source Hadoop ecosystem.