Big data is big news these days. But most organisations just end up hoarding vast reams of data, leaving them with a massive repository of unstructured – or “dark” – data that is of little use to anyone.
Given the potential benefits of big data, it’s crucial that we find better ways to gather, store and analyse data in order to make the most of it.
Stories of big data successes have triggered significant investments in big data initiatives. This has prompted many organisations to gather significant volumes of external and internal data into so-called “data lakes.” These are repositories that contain data in any format, whether structured, like databases, or unstructured, like emails or audio and video.
As a result, the growth in the amount of data being generated, collected and stored continues at an exponential rate.
Read the full article on The Conversation.