From data gathering to competitive strategy: The evolution of big data

• 

  Article

  Big data challenges CIOs while boosting careers

  Learn how Ritchie, Perretta and their respective IT departments used information management to craft a completive strategy before the big data term was coined. Read Now

• 

  Article

  Five questions to answer before confronting big data

  Uncovering the secrets lurking in large-scale data sets might be the next best hope for outdoing the competition, but first, IT needs to crack the code. Before you throw your hat into the big data ring, here are five questions to consider, including whether the tools you're using now for BI will cut it for big data. Read Now

• 

  Article

  Employee analysis skills make or break a big data strategy

  It takes a village to mine data. That's analyst firm CEB's take on developing a big data plan of attack: Get a broad base of employees on board, particularly "informed skeptics." Here, read a sampling of questions that First Data Corp. uses to measure employees' "analytical maturity." Read Now

• 

  Article

  Gartner's IT essentials for a competitive strategy around big data

  Leadership -- on both the IT and business sides -- is key for getting big data projects off the ground. In this two-part SearchCIO tip, Gartner analyst Doug Laney lays out the steps CIOs must take to make IT departments big-data enabled and the basic business rules for capitalizing on big data. Read Now

1Watch big data evolve before your eyes

Are you on the front lines of harnessing large data sets? These videos offer advice for crafting a competitive strategy around big data.

• Video

  Next-generation BI and big data trends

  IT once thought there was too much information and not enough data, but that mind-set has shifted: CIOs now have too much data and not enough information. Watch Now

• Video

  Generating business value from data tools

  Sears Holding Corp. chief technology officer Phil Shelley is working toward making Sears a real-time digital enterprise. That includes the migration of workloads off mainframes, implementing large-scale private open source cloud computing, and using Hadoop. Watch Now

• Video

  Data-sharing initiatives drive innovation in health care

  Cathy Bruno, vice president and CIO at Eastern Maine Healthcare Systems, is improving public health through innovations in data sharing, mobility and analytics. Watch Now

2Big data in traction: The challenges

Statistician Nate Silver, crowned the big data expert by his political colleagues following the 2012 election, believes that while bigger, richer and more granular data sets offer deeper insights and greater business value, they also come with challenges that make uncovering those insights more difficult than before.

Silver unlocked the potential of large data sets when he accurately predicted nearly all of the results of the 2012 presidential campaign. Following on his success, IT leaders are spending more time focusing on competitive strategies for utilizing big data.

• Article

  Big data challenges explained by Nate Silver

  You've worked with your colleagues to identify a business opportunity using big data. You've done the impossible and assembled a team of data scientists. In other words, you've followed the best practices, yet your big data program is still going nowhere. You are not alone. Big data management is hard to do. Read Now

• Article

  Data silos plague BI efforts

  "Out damned silo, out!" has been IT's anguished plea since BI emerged on the scene decades ago. Yet data silos are still an albatross for CIOs, especially in the case of big data. But vanquishing data silos is a risk, as David Gallaher, IT service manager of the National Snow and Ice Data Center for NASA, puts it: "We want to let people look at the data, but we have to make damn sure they can't change it." Read Now

• Article

  Data hoarding and bias slow big data progress

  Many a hard-driver has pegged his or her career on keeping knowledge close to the vest. But for a successful big data strategy, sharing is king. Changing this hoarding mentality is one of many behavioral challenges that need to be addressed, along with the belief that the data has to be of perfect quality before it is analyzed. Read Now

• Article

  Big data vet Martin Leach talks infrastructure

  Analysts will tell you that reaping benefits from big data is all about changing the IT and business culture. That's true, but there are still plenty of nuts-and-bolts problems to solve, such as infrastructure, as a CIO veteran from the genome project explains. Where are the good plumbers when you need them? Read Now

• Article

  Using data to predict the future poses problems for IT

  Now that the volume, velocity and variety of data -- or big data -- are becoming the norm for many businesses, the value of a good predictive analytics practice has appreciated. This is easier said than done, as data scientist from the world's leading universities can attest. Read Now

• Article

  Data wars on the horizon

  Data -- gathering, processing and mining it -- could mean the difference between the haves and the have-nots in terms of productivity and business agility, not to mention profit. To avoid falling into the latter category, CIOs must get their own data house in order before entering the data-gathering battlefield. Read Now

• Article

  Is personal data privacy at risk with big data?

  In the rush to capitalize on big data, privacy issues are often overlooked. They won't be for long. Make sure, as you build a competitive strategy around big data, that you don't expose information unduly. Read Now

3Big data: Some terms to know

Brush up on some of the basics of a big data strategy with the terminology below.

• Definition

  3Vs (volume, variety and velocity)

  3Vs (volume, variety and velocity) are three defining properties of big data. Volume refers to the sheer amount of data, variety refers to the number of types of data and velocity refers to the speed of processing.  Read Now

• Definition

  Big Data as a Service (BDaaS)

  Big data as a service (BDaaS) is the delivery of statistical analysis tools or information by an outside provider that helps organizations understand and use insights gained from large information sets in order to gain a competitive advantage. Read Now

• Definition

  CRM analytics

  CRM (customer relationship management) analytics comprises all programming that analyzes data about customers and presents it to help facilitate and streamline better business decisions. Read Now

• Definition

  data-driven disaster

  A data-driven disaster is a serious problem caused by one or more ineffective data analysis processes.  Read Now

• Definition

  NoSQL (Not Only SQL)

  NoSQL is an approach to database design that can accomodate a wide variety of data models, including key-value, document, columnar and graph formats. NoSQL, which stand for "not only SQL," is an alternative to traditional relational databases in which data is placed in tables and data schema is carefully designed before the database is built.  Read Now

• Definition

  real-time analytics

  Real-time analytics is the use of, or the capacity to use, data and related resources as soon as the data enters the system.  Read Now

4Big data in action: The case studies

For companies such as Land O'Lakes Inc. and its CIO, Barry Libenson, keeping up with an increase in population, and therefore increase in customers, is all about productivity. Using big data and predictive analytics, agricultural companies can utilize valuable information to keep up with changing business environments.

The new initiative not only involves integrating diverse data from disparate sources but also putting sophisticated and easy-to-consume analytics right into the hands of the company's internal sales and marketing team, as well as into the hands of the cooperatives and farmers it distributes to.

• Article

  'Dirty data' gives Land O'Lakes an advantage

  Talk about hitting pay dirt with big data! The IT team at Land O'Lakes used "dirty data," or data that could contain errors, to help its farm customers and leave competitors in the dust. By combining internal customer data with reams of external data, the business can better predict what crops will yield the highest value -- down to the acre. Read Now

• Article

  Ancestory.com reinvents legacy systems with Hadoop

  If Ancestry.com's data store (currently 4 petabytes) doesn't meet the threshold for big data, its newest venture will. Genealogy by autosomal DNA test will rely on data from a person's whole genome. Specifically, Ancestry.com will analyze the 700,000 different points along the genome. Meeting that need required reinventing Ancestry.com's traditional systems for processing and storing data. Read Now

• Article

  Chief scientist's role in big data analytics

  Mok Oh talks about his use of big data analytics during his tenure as chief data scientist at PayPal. Hint: It goes way beyond tracking transactional data. The ultimate goal is to fathom the human subconscious by looking at who buys what, when and why. Read Now

• Article

  Miami Dolphins use mobile to get fans to the stadium

  Are you ready for some football? How about a service that can map the best route to the stadium based on current traffic patterns, send mobile alerts on which gate to enter for the shortest wait time, and offer real-time discounts on food and drink based on consumption habits? With analytics technology, this Bud really is for you. It will all become a reality under Miami Dolphins CIO Tery Howard's big data plan. Read Now

• Article

  Leveraging a semantic database at State Street

  State Street Corp. Chief Scientist David Saul talks about the challenges and tradeoffs of getting a semantic database off the ground, and how semantic technology could produce really big benefits for many companies, thanks to his and others' efforts now under way to develop standards. Read Now

• Article

  Data discovery in the hands of users

  With more than 1 billion active users on its site every month, Facebook decided it was time to build a better data discovery mousetrap. That ultimately meant swapping out a homegrown reporting system and BI vendor tool set for data discovery tools that put the power of big data in the hands of business users. Read Now

5Big data storage and technologies: A quiz for CIOs

Changes in the way organizations collect, store and analyze information are transforming the way CIOs view big data. With massive amounts of data to account for, CIOs must equip their team with the tools and resources necessary for gathering data and finding value, and develop a plan for properly maintaining all that information.

Are you following the latest big data trends and staying hip to the infosphere? Where are you storing data? Are you analyzing information thoroughly? In this quiz, brush up on some of our recent stories and test your big data knowledge.

• Article

  Big data trends, storage and technologies: An IT quiz for CIOs

  Is your organization on top of the latest big data trends? Take our latest IT quiz for CIOs to test your knowledge of data analysis and storage. Read Now

6Big data on the horizon

According to our CIO expert Harvey Koeppel, we hear a lot these days about the "Big Data Frontier." By now, we all have a reasonable understanding of what we mean by "big" -- terabytes, petabytes, exabytes and so on. We certainly know what we mean by "data" -- fields, records, files, marts, warehouses, rows, columns, tables, blobs, structured data, unstructured data, etc. But what about the "frontier"?

Koeppel explains that big data will not only help us do a better job of anticipating our future -- it will be a significant enabler in creating our future.

• Article

  The future of big data

  Every two days, we create as much information as we did from the dawn of civilization up until 2003. Where will big data lead us? As Koeppel lays out in this CIO Matters column: someplace big. He advises CIOs to look to the moon landing as an example of the many downstream breakthroughs that could come from harnessing the power of data. Read Now

• Article

  CIOs rely on data presentations to make informed decisions

  The work CIOs do to gather, store and analyze big data will be for naught without data presentations that influence business decisions. CIOs might want to page special-effects phenom James Cameron. After all, the world we all understand is 3-D, and moving pictures with sound pass for real experience. Read Now

• Article

  Data mining challenges to come

  One way to allow data to reveal itself is to tap into the strongest human analytical sense -- our vision. But it won't be easy to build front-end visualization interfaces that present the data in ways we humans can easily apprehend and interact with. Read Now

• Article

  Why collect big data?

  In his quest for a state he calls Analytics 3.0, former PayPal Chief Scientist Mok Oh ponders the enormity of big data and what it will take to wring value from all this information. "Natural languages, analog-to-digital conversions and making sure there is very little lost in translation -- maybe that is Analytics 3.0!" Eureka? Read Now

• Article

  CIOs turn to metadata practices

  Metadata has been seen as secondary to analytics and data management programs at many companies, but with the advent of 'big data,' that's changing.  Read Now

• Article

  Information is the next big company asset

  CIOs by definition understand the value of information technology. Now, the rest of the world is on the case, marrying the field of information and economics. Welcome to infonomics. Read Now