DataTorrent RTS Core Engine -- An Open Source Platform for Streaming and Batch Processing

By CIOReview | Tuesday, December 15, 2015

SANTA CLARA, CA: Solace Systems integrates with DataTorrent to enable real time analytic solutions. The strategic affiliation between both the companies now provides complete real time analytic solutions. Solace Systems manufacturer of software and hardware message routers provides data movement technology whereas DataTorrent provides a platform for big data which is built on Hadoop for streaming and batch processing.  

DataTorrent RTS core engine, the flagship product of DataTorrent is an open source implementation of Apache Apex and also a platform for unified stream and batch processing. One of its key features - Hadoop, is an open source software framework for storing data and processing a large volume of data. Hadoop solidifies its role as the enterprise’s big data operating system. Two of the most important advances in Hadoop 2 are the introduction of HDFS Federation and YARN; which form the data management layer of Hadoop.

Yet Another Resource Negotiator (YARN) is the pre-requisite for Enterprise Hadoop which provides resource management and a central platform to deliver various operations (security, data governance) across Hadoop cluster. YARN also allows multiple data processing engines like real-time streaming, data science and batch processing to manage data stored in a single platform.  

HDFS- Hadoop Distributed File System is a java based file system for storing large quantity of data. Solace’s messaging product enables movement of very large quantity of insights from various sources into DataTorrent Real-Time Strategy (RTS). The partnership between Solace Systems and DataTorrent offers flexibility to store the large volume of data. They can scale up to capture as much as data delivered by Solace.

 “Competitive pressures in the evolving big data market are driving demand for real-time streaming and data ingestion tools that can seamlessly integrate valuable insights into business operations,” asserts Charu Madan, Director of Business Development, DataTorrent.

The joint solution delivered by Solace and DataTorrent assists many customers to deploy and integrate the technology with their business.  Solace technology supplies very large volume of data, collects it from various sources, which is later analyzed by DataTorrent’s technology immediately as it is collected. 

“DataTorrent’s innovative technology gives companies the power to analyze information when it’s most valuable, immediately as its being collected,” notes Denis King, Senior VP, Global Field Operations and Strategic Alliances, Solace Systems.