Data logging high refresh rate

So I succeeded before in using nodered - influxdb and IOT dashboard (grafana) together to log data. 
I have a customer who wants to add new data to the database every 250µs... The data would come from a 4-20mA sensor on the IO card of the ctrlX. 

The data doesn't need to be stored for long, one day is enough. So please advise what the possibilities are? 
Can I make the data layer faster if necessairy? What about node red? What about influx db? 

Best reply by Sgilk

Hi Dave407 ,

The data needs to be updated in the database every 250µs, or the data needs to be collected at that rate? The first option is not going to be feasible. The datalayer, Node-RED and InfluxDB will not update at that rate. The second option is even going to be fairly difficult.

The solution I'd recommend is to buffer the data and push it in a bulk array to the database every few seconds. How you buffer the data is the next question...

What I/O card is being used? Would it be possible to buffer some data on the card?

What ctrlX CORE is being used? Even with the ctrlX CORE x7, I believe the current EtherCAT update rate is at 500µs.

See: Push oversampled arrays to InfluxDB 

View original
10 replies