Breaking down big data

Baffled by big data and how it can be used to inform strategic decision making? Understanding the four elements that give data its transformative power can help businesses decipher their digital information

Data is the differentiator. That’s what you will read in any contemporary business journal. Yet, despite the urgency associated with the term ‘data’ (and more recently, ‘big data’), it can often feel opaque and therefore difficult to formulate into a coherent strategy. Business leaders’ ability to see over the hill and make mission-critical decisions is more crucial than ever, but that hill is now obscured by a glut of digital information and savvy adversaries.

The margins between success and failure are shrinking. Recent decades are littered with stories of businesses that failed to see the digital transformation in their industries coming. The ones that have been successful, however, understand that they must become more adept at leveraging their data if they are to rival their highly agile, data-driven competitors. Market research firm, Forrester, estimates that these ‘insights-driven’ companies are poised to wrestle around $1.2tn USD away from their rivals by 2020.

At a basic level, data can be used to reduce costs and improve internal processes. Its true value, however, is defined by how these businesses collect, manage and use it intuitively to gather insights.

The good news is that the technology is already here. Now, it’s about asking the right questions and, for those who are responsible for making business decisions based on data, learning how to analyse information as quickly as possible.

The four elements behind data’s transformative power

This begins by understanding the four elements that give data its transformative power: size, format, age, and discovery. By using these categories as a framework, businesses can decipher their digital information in a way that informs better decision making and allows them to gain that all-important competitive advantage.

1. Size matters

‘Big data’ simply means lots of it. The sheer scale of today’s networks and online platforms has provided organisations with an immense volume of metrics per device. Gartner’s oft-cited estimate that 20 billion ‘things’ will be connected to the internet by 2020 gives some indication of the scope. But the trend towards comnectivity is creating an unassailable challenge in statistical inference. From the myriad data now available, it is easy to infer things that either do not hold up in the real world, or that might not be that interesting to a particular organisation. 

Collecting and analysing all this information – let alone determining what’s useful and what isn’t – is impossible with human analysis alone. Even legacy IT systems are unable cope with the velocity, volume and variety (the three Vs) of today’s data sets.

For a growing number of organisations, then, the solution is machine learning. While the technology might seem like another arcane concept, its use and benefits can already be found in many aspects of everyday life, from spam filters on a web browser to emails that offer recommendations or discounts for online retailers. Machine learning tools are simply sophisticated computer programmes that use algorithms to perform increasingly accurate analyses of the data that they collect.

One of the best examples of this is Google’s AlphaGo system, a computer programme that recently beat the world’s best player at strategy game, Go. Google’s system works by analysing previous moves and combinations – which can amount to millions – effectively making it a stronger player with each new game. The parallels in commerce are easy to identify. For online retailers, each new piece of data allows them to build a more accurate picture of their customers’ buying habits.

2. Form follows function

Contemporary data can be grouped into one of two categories: structured or unstructured. Structured data is conventional information that is clearly defined and easily accessible through sophisticated database query languages. A great example is an online banking system that records account transaction information including the date, amount, payee details, and a short description such as the source of the money.

The world, however, has moved on from structured numeric data to non-structured, non-numeric, multimedia-type data, which includes text, image, video, and animation. A Twitter user will post a combination of these – a photo, gif or video, and an opinion – the latter being a piece of subjective information that would be gathered by performing what tech circles refer to as ‘sentiment analysis’.

Online retailers offer a great example of how unstructured data can be used to market accurately to each customer. Here is one elaborate, yet possible, scenario: when a customer enters a retail outlet with their mobile phone, their movement can be tracked. The store might not know who the customer is as that would depend on whether it recognises their mobile number, but it has the ability to record which sections they visit and how much time they spend in each area. Security cameras eventually pair up the customer’s image with their phone so that the store can recognise them in the future.

If, during their next visit, the customer were to walk past a particular product they had previously looked at (as indicated by the data) the retail outlet could send a text message offering an incentivising discount. The store could also have a system in place that tracks competitor prices, allowing it to perform a price comparison and offer an adjusted price in real time. Once the customer purchases an item, the store could then take advantage of further selling opportunities for related products.

3. Age is but a number

Much of the data now in play is immediate. In the past, it took months or even years to run a decision-analysis project – from collecting the data to cleaning it up, loading it in databases, building models, learning new insights, and finally taking action. By the time a decision had been made, the data would often be stale.

Now, though, the cycle time of analysis has been reduced to seconds or even real time, and often to great effect. In the retail store example above, obtaining price comparisons once a customer has left the building would be much less effective.   

4. The voyage of discovery

While lots of progress has been made in the field of data collection, including the process of uploading it to networks for online access (in a cloud for example) a hugely important development has been the ability to put descriptions of the data – so-called ‘meta information’(or information about information) – in formats that machines can find automatically. This allows analysts, or data analytics systems, to determine relevant information in real time, creating a virtual supply chain from many different sources that can then be put together on demand.

This is where data lakes come in. As virtual cloud data storage facilities, they are capable of holding vast amounts of big data. In theory, the billions of devices now connected to networks can feed their digital information into these sophisticated repositories for the purpose of processing and extracting insights. Our online retailer, for example, can store transactional customer data with tweets in which customers have provided feedback on certain items, returns or offers.

Collectively, these four elements have produced a new world of data analytics that helps form the

basis of better decision making – something that was simply impossible only a decade ago. But to truly compete with the world’s leading insights-driven organisations, business leaders must first develop a bird’s-eye view of their data, where systems aren’t just integrated, but business functions also share in a common strategic goal. Whatever is coming over that hill, their survival may depend on it.

Ashok Suppiah is the Founder and CEO of Mitra Innovation, a specialist in digital transformation and software development.

You may also like...

employee wellbeing

Breathe easy: how to prepare for workplace presentations

Presentations can be daunting for even the most confident employee; fear of standing up in front of colleagues can quite easily make your heart race. Luckily, Carolyn Cowan is on hand with some timely tips on how to keep the worries at bay so you can focus fully on acing that important presentation

Read More »
New curriculum

A shorter route to an MBA opens up at LBS

London Business School (LBS) has announced the launch of a new one-year MBA for candidates who graduated three or more years ago with a master’s in management (MiM) degree from a reputable institution

Read More »