Discover Performance

HP Software's community for IT leaders // June 2012

Keep everything: The new data imperative

Big data expert and author Edd Dumbill explains why being data-driven means never throwing anything away, and tells you how to successfully make the cultural shift that will get there.

Enterprises are increasingly driven by data. Drawing competitive advantage from the rapidly growing body of data that businesses collect is not just a trend, it’s the new baseline.

The resulting data-first philosophy means abandoning many long-held beliefs and best practices for collecting and using information, explains Edd Dumbill, author of the recent ebook, "Planning for Big Data," and program chairman for the Strata Conference at O'Reilly Media. One of the most critical changes an organization must adopt, says Dumbill, is to stop throwing data away.
The traditional way of processing raw data is to immediately extract what’s relevant for your analytics systems, such as accounting or inventory, and then view only what provides recognized business intelligence value—sales by product or by branch, for instance. The rest ends up in the virtual trash.
In a data-driven organization, Dumbill explains, there is no garbage data. The proper way to handle analytics is to put a view on the data at the point of analysis, not at the point of storage.

"When you store everything, you have all of the data at your disposal and you increase the chance of finding those moments of savings or opportunity," Dumbill says. "Even data that ultimately constitutes an error is valuable to have. If you throw it out, you'll never be able to chase it down and eliminate the problem."

When cultures collide

A startup can embed a data-driven culture from Day 1. But for long-established organizations, the transition will be more difficult. Dumbill offers the following advice to organizations that want to make the transition to a data-driven culture as painless as possible:

  • Put curious thinkers in downstream roles and give them the freedom to see what they can find. Entrepreneurial thinking, most often found in business development or product development roles, now needs to be equally valued in data analytics.
  • Make sure key managers are receptive to the data discoveries that bubble up from big data analysis, even ones that seem ordinary. All improvements are worth pursuing.
  • Reassure employees that data analytics are designed to help them, not embarrass them. Data analysis can cast a very harsh and unforgiving light. Mitigate defensiveness by discussing data goals early and often.
  • Make data self-service, for as many employees as possible. By providing a data platform where people can export data and look at it for themselves, organizations drill home the importance of the data-driven cultural shift, and they may reap many new insights in the process.
  • Create visualization tools that will give non-statisticians a way to understand the data that's important to them. There are very few people who know how to read data in a statistical way. So if you want to drive the business through data, you need to find ways to bridge that data-literacy gap.
  • When possible, provision your data visualization as special purpose mobile apps. Mobile devices such as iPhones and iPads have proven to be very effective delivery methods for special-purpose applications. By working within this trend, you give your apps the best chance of finding strong adoption in the organization.

First steps

Read more on how to overcome the challenges of moving to a data-driven business philosophy in “Big data’s big changes can start small,” posted on the Discover Performance blog.
Learn more about Edd Dumbill's free ebook, "Planning for Big Data: A CIO's Handbook to the Changing Data Landscape," at the O'Reilly store. For more on using business analytics that can truly monetize data, visit For more on solutions to managing big data and extracting intelligence from unstructured information, visit


IT leader assessment

This tool evaluates the correlation between IT attributes and business success and, based on how your answers compare with average scores, will advise you where to invest in IT.

It is based on data HP collected from 650 global companies about a range of IT characteristics (server capacities, approach to information management, security, BYOD, etc.) and how they correlate to revenue gain. This assessment will compare your answers to the average scores in that study.

There are 12 questions that will require an estimated 10 minutes of your time. You'll receive a summary of your rating upon completion.

Let's get started

Please select an answer.


Your answer:
Your score:
Average score:
Revenue leaders' score:


Please select an answer.



Your score:
Average score:
Revenue leaders' score:

Get detailed results:


Popular tags


Discover Performance Weekly

HP Software’s Paul Muller hosts a weekly video digging into the hottest IT issues. Check out the latest episodes.

Big Data as key to change management

Change is hard—and risky—in any IT organization. Learn how better analytics makes things smoother and more successful.

Enterprise 20/20

Marketing 20/20

Welcome to a new reality of split-second decisions and marketing by the numbers.

Mobility 20/20

Looking toward the era when everyone — and everything — is connected.

Introduction to Enterprise 20/20

What will a successful enterprise look like in the future?

CIO 20/20

Challenges and opportunities for the CIO of the future.

Dev Center 20/20

How will we organize development centers for the apps that will power our enterprises?

IT Operations 20/20

How can you achieve the data center of the future?

Employee 20/20

What the workforce of 2020 can expect from IT, and what IT can expect from the workforce.

Security 20/20

Preparing today for tomorrow’s threats.

Data Center 20/20

The innovation and revenue engine of the enterprise.

Read more

HP Software related

Most read articles

Discover Performance


Tweets @ HPITperformance