BI Professionals Spends Far Too Much Time on Organizing Data: Study

By CIOReview | Tuesday, July 7, 2015

FREMONT, CA: A recent survey commissioned by Xplenty, provider of data integration platform states that around one third of the Business Intelligence (BI) professionals spend 50 to 90 percent of  their time on cleaning raw data for analytics.

The study aims to understand the challenges revolving around BI professionals and raw data analytics, especially on Extract, Transform and Load (ETL) process. The focus includes preference for on-premise or cloud-based solutions, perceived challenges, and the amount of time spent on ETL. ETL is the process of extracting data from homogeneous or heterogeneous data sources, transforming the data for storing it in proper format or structure for querying and analysis purpose, and loading the data into the final target – such as a database, data store, data mart, or data warehouse. In an article for eWeek Darryl K. Taft points out, 97 percent of the surveyed agreed that ETL was critical for their business intelligence efforts.

In the survey where more than 200 BI professionals participated, 51 percent of the respondents who currently uses ETL tools are already considering migrating to the cloud while the rest are already cloud based. “Cloud ETL offers a host of benefits over on-premise, from increased agility in resource deployment to reduced costs. As such, the cloud is an increasingly attractive option from both a performance and operational perspective,” explains Yaniv Mor, CEO and co-founder of Xplenty, in a statement.

According to the professionals, biggest challenges faced in making data  analytics-ready are integrating data from different platforms (51 percent), followed by transforming, cleansing and formatting incoming data (39 percent), integrating relational and non-relational data (32 percent), and the sheer volume of data that needs to be managed (21 percent) at any given time.

“Reformatting, cleansing and consolidating large volumes of data from multiple sources can be overwhelming,” adds Mor. “BI professionals are still struggling with the best approach to shorten the time between integration and analytics. As a result, businesses are often slow to unlock their data’s true potential for revenue or operational improvements.”

The Xplenty survey was done with a motive to understand the challenges BI professionals face in preparing raw data for analytics. More than around 200 BI professionals participated in the survey.