Data is becoming one heck of a challenge to solve. Take a example of our Product ThingsHiFi- a 5KW Solar Grid-Tie UPS. This device send data every 30 seconds to ThingsCloud. On a daily basis we will have
(30/60)*60*24 = 2,880 insertions
Each data packet is around 6K byte, which makes
2880*6k= 17.2 mb/per day
For one month,
17.2 *30 = 516 mb/per device/per day
You can see where I’m going from here, even if we have a modest 1000 devices, then we will be looking around 500 gigs of data per month. Right now we are exploring different architectures to process this data. Also, inserted record has around 10 values.
So, per month per device it is
2880*10*30 = 864,000 values
Now, with 100 devices, it would be 86 million values, which needs to be queried. Suddenly from nowhere we need to work on big data …!!!