- Jun 6, 2020
- 11,559
- 4,422
HI, All
I'm making an app that show the charts of realtime data from sensors. It's educational project for schools.
Some sensors are slow, 1-5 point per second. But most sensors are fast, 100 points per second, as simple ADC measurement is fast.
It should be up to 12 sensors lines on one chart.
I store points into SQLite db.
Minimal time step on the chart should be 0.1 second.
Problem is that fast sensors in several seconds flood the db with thousands of records and charting is getting slower each second. As all info should be got by SQL requests group from the same db.
If to set the time step of X-axes = 1 sec - no problem to update the chart, but 0.1 s step is impossible - fast chart moving is getting slower and PC is freezing. RAM consumption from 300MB per process is going 1GB+...
How to process such realtime data of such volumes correctly ? Without visual interface freeze.
I'm making an app that show the charts of realtime data from sensors. It's educational project for schools.
Some sensors are slow, 1-5 point per second. But most sensors are fast, 100 points per second, as simple ADC measurement is fast.
It should be up to 12 sensors lines on one chart.
I store points into SQLite db.
Minimal time step on the chart should be 0.1 second.
Problem is that fast sensors in several seconds flood the db with thousands of records and charting is getting slower each second. As all info should be got by SQL requests group from the same db.
If to set the time step of X-axes = 1 sec - no problem to update the chart, but 0.1 s step is impossible - fast chart moving is getting slower and PC is freezing. RAM consumption from 300MB per process is going 1GB+...
How to process such realtime data of such volumes correctly ? Without visual interface freeze.
برای دیدن لینک ها باید ثبت نام کنید