Hadoop and its Relation with Cloud
Hadoop is an open source, distributed processing framework that is used to develop software for reliable, scalable, distributed computing; the kind of distributed computing that is needed to nurture the growth of big data. It manages the processing of data and storage for big data applications that runs in clustered systems. The emerging ecosystem of big data technologies tactically places Hadoop in the centre. These technologies are used to support advanced analytics initiatives that include predictive analytics, data mining, and machine learning applications.
At core, Hadoop utilizes modules such as Hadoop Distributed File System (HDFS), Hadoop MapReduce and Hadoop YARN. HDFS is a file system that is distributed by EMC, Intel and IBM to provide high throughput access to application data. The motive is to distribute the processing of large data sets over clusters of low-cost computers. Similarly, Hadoop MapReduce is a component that allows users to distribute large sets of data over a series of computers for parallel processing, while Hadoop YARN is a skeletal framework that manages job scheduling and the management of cluster resources.
Since cloud technology is ideally suitable to deliver the required computation power for big data applications; merging it with the Hadoop framework eases the processing of large, parallel data sets. It can also recourse enormous amounts of computing power that can be scaled as needed. Hadoop can be looked at as a platform that runs on cloud computing and provides users with distributed data mining, complementing the growth of data-driven technologies and cloud infrastructures.
Check Out : Top Cloud Tech Startups in Europe
By Linda H. Butler, VP of Medical Affairs/CMO/CMIO, Rex...
By Laura Cruz, Global CIO, MDC Partners
By Greg Morrison, SVP & CIO, Cox Enterprises
By Lowell Gilvin, Chief Process Officer, Jabil
By Joe LaFeir, SVP, IS&S (Information Systems & Solutions),...
By Gerri Martin-Flickinger, CIO, Adobe Systems
By Aaron Weis, VP & CIO, Axalta Coating Systems
By Levon Hooks, CIO-Global Corporate Solutions, JLL
By Steve Bein, VP-GIS, Michael Baker International
By Sam Schoelen, Chief Information Technology Officer,...
By Georgios Kyriakopoulos, VP of Equity Research, SunTrust...
By David Sliter, VP & GM of Communications, Media &...
By Julie Stafford, SVP Strategic Consulting, Tangoe
By Dan Adam, CIO, Extreme Networks
By Scott Craig, Vice President of Product Marketing, Lexmark...
By Aaron Gette, CIO, The Bay Club Company
By Dr. Volker G. Hildebrand, Global VP, SAP Hybris
By Meerah Rajavel, CIO, Forcepoint
By Philip Loftus, SVP IT & CIO, SSM Health
By Christy Hartner, SVP, Commerce Bank