Karmasphere Survey Reveals Shortage Of Big Data Skilled Professionals

Drives the Need for Collaborative Self-Service Access to Hadoop

Cupertino, CA – June 20, 2012 – Karmasphere™, the leader in Big Data Insights, today announced the results of a recent survey bringing fresh insights around current Big Data Analytics market trends. The survey, entitled “Trends and Insights into Big Data Analytics”, summarizes 376 individual responses and reveals that the shortage of Big Data skilled professionals is driving the need for collaborative self-service access to Hadoop across companies of all sizes.

The Need for Self-Service Big Data Analytics

According to the survey, 60% of respondents agree that data analysts in their organizations lack the technical skills to analyze data on Hadoop. Seventy percent (70%) agreed to the need for self-service access to Hadoop, defined as the ability to grab raw, unstructured detailed data and then create ad hoc queries and find insights, and nearly 37% of those strongly agreed to this need. According to the survey, over half (52%) of respondents either have Hadoop in production or have a Hadoop cluster running. These professionals indicate an even more acute need for self-service access to Hadoop with 81% expressing this need.

Big Data Teams are Cross-Functional

The survey also revealed that Big Data teams are typically cross-functional and composed of data analysts, IT, BI and line-of-business analysts. Survey respondents indicated an average of 60 business user members assigned to Big Data teams, and an average of 17 data analysts, 21 system administrators and 8 BI specialists.

“This survey reinforces what many of us have long presumed, that self-service Hadoop access is the key to unlocking the power of Hadoop for everyone in the business. These data professionals want an easy, graphical and intuitive way to grab their data, explore their data and create actionable insights that can be shared in a collaborative way with their team members,” said Rich Guth, CMO, Karmasphere.

Marketing and Product Optimization are Key Drivers for Big Data Analytics

Although it’s clear from the survey that all departments benefit from Big Data analysis on Hadoop, according to respondents, marketing is the department gaining the most. Twenty-two (22) percent choose marketing as the number one department benefiting from Big Data, 19% choose engineering, and product management and operations tied with 14% each.

SQL is the Prevailing Skill Set for Analytics

The survey shows that nearly two thirds, 74%, choose SQL, as the pervasive skill set for Big Data Analytics, with Java coming in second with Fifty-eight percent (58%).

Big Data is Growing

The survey also confirmed that vast amounts of data are being held in Hadoop clusters. Thirteen percent (13%) of respondents indicated they are storing 100 or more Terabytes of data in their Hadoop cluster, 6% indicated 41-100 Terabytes of data, nearly 50% said they are storing between 2-40 Terabyes of data and 32% indicated they are storing 1 Terabyte of data.

About the Survey

The survey was conducted between May 5-15, 2012 and includes insights from data professionals from a variety of companies of all sizes. A total of 376 respondents completed the survey. The complete report “Trends and Insights into Big Data Analytics” is available online.

About Karmasphere

Karmasphere delivers a fully leveraged world for Big Data Insight that is deep, unconstrained, and accessible for data driven companies seeking new sources of future business opportunity. With the advent of Hadoop, businesses can now affordably analyze massive amounts of Big Data across their web, mobile, social, sensor, video, and call center interactions without the limitations of having to use sampled data or expensive and proprietary approaches. Karmasphere customers benefit from data insights that uplift revenue, customer satisfaction and competitive advantage. The Karmasphere 2.0 Collaborative Analytics Workspace provides users across the company with self-service access to Big Data Analytics on Hadoop including analytic projects, visualizations, and everyday-to-sophisticated analysis through a social, web-based interface that facilitates team collaboration. Open and based on Apache Hadoop standards, it leverages existing analytic skills and models, integrates with traditional BI and existing applications and supports key Hadoop distributions including: Amazon Elastic Map Reduce, Cloudera, HortonWorks, IBM, and MapR Technologies. Learn more at http://www.karmasphere.com.