Big Data : A Big Problem or a Technology Name ?

Anurag Sharma
4 min readSep 17, 2020

Wondering how much time we use the term “Big Data” as the technology perspective ? Whether it is right to say it as technology is the very important question . Let’s go to a interesting journey in which we together find out what is actually the term “Big Data” is depicting .So tighten up the belt and get ready for a interesting ride !!!

Let’s firstly understand what is the data ?

source : Visualstudiomagazine.com

Everything around us that we see , touch , hear , experience from our six senses is the data or input . Let’s say you are now reading my blog it’s a data, you are chatting with your friend on whatsapp , it’s a data, you are posting image on facebook or instagram it’s a data .So how much we are surrounded from the world of data, and how much data we are producing daily we can’t imagine!!

So , the basic unit of data is produced by the user daily in the form of the images , videos , audios , chat messages etc .

Now , My next question is how much amount of data world creates daily ?

  • 1.7MB of data is created every second by every person during 2020.
  • In the last two years alone, the astonishing 90% of the world’s data has been created.
  • 2.5 quintillion bytes of data are produced by humans every day.
  • 463 exabytes of data will be generated each day by humans as of 2025.
  • 95 million photos and videos are shared every day on Instagram.
  • By the end of 2020, 44 zettabytes will make up the entire digital universe.
  • Every day, 306.4 billion emails are sent, and 5 million Tweets are made.

Source : https://techjury.net/blog/how-much-data-is-created-every-day/

Looking at the above stats we can calculate from the small data used by a user and multiplying it by the whole world’s population , we guys are creating such a large Heap of data .

And here we are coming to our main topic of interest , this huge heap of data that we create daily is known as the “Big Data”.

Source: analyticsinsight.net

So, What can we do with such huge amount of data ?

Most probably your answer is to store it in some of the hard disk that is created by the Companies such as the DELL , IBM etc .

Note: We can’t remove any user’s data from the databases and the hard disks because think If a user needs its previous posts on linkedin to view and for analysis , if LinkedIn remove the posts of the user , then there is a bad impact on their reputation and company’s Market Value .

We are creating around 2.5 Exabytes of data everyday as in the stats mentioned above and the Interesting Fact is that largest hard disk made is of the size of 15 TB !!! Slowly , Slowly we are feeling that how big the ‘big data’ problem is !

So, How we can incorporate this much amount of data ?

Probably the companies like IBM can create the huge size of hard disks for the companies like Facebook , Instagram and Google . But if they do they will encounter three main problems respectively :

  1. Costing Problem : The price of the hard disk that will be created are sky touching and for the Companies it is not so much Profitable to use it for storing the data and think of the case when a hard disk get Corrupted , it will become a huge loss for the Companies like Facebook , Instagram etc.
  2. Velocity : The data first comes in the RAM then it goes to the Hard disk for storage Like in our PC’s data we insert from notepad first save in the RAM , them goes to the Hard disk for the Storage . But this Going of the data from one location to another takes much time like a day or a two day for such a huge sets of data .
  3. Large Volumes : Our Companies are encountering the data in the exponential growth by the consumer , So one Hard disk can’t be so big to incorporate all the data that we all are giving to it.

For handling these large Volumes of data is the problem in itself , That’s Why we are talking about from the start that these Big Data is a huge problem.

CONCLUSION :

In this blog we have seen that the storage of “Big Data” for the processing and analysis purpose is such a big problem of Future and today’s , how much our data consumptions are increasing day by day . Can there be any measures to solve this giant problem of BIG DATA ?

To know the answer Follow me on the medium and wait for next post , I will definitely come up with the interesting and mind blowing posts on the awesome Technologies !!!

That’s all from my side this time 😎 , Bye and take Care !!

PEACE 😊

--

--