How long I can record stream before I need to export it?


#1

The push API has 1 hour buffer, but it seems that I can record few days stream and then export the data via Datasift Web UI “Tasks” panel.

I would like to know how long I can safely record a stream via “Tasks” UI before I need to manually export the stream to prevent data loss?


#2

You can record your data for as long as you like before you export it - we will store it indefinitely. The recording/exporting service does not currently use Push Delivery, though when you do use Push, this 1 hour buffer is how long we continue trying to deliver data for - if we are unable to deliver an interaction to your Push endpoint within an hour, it will be discarded.


#3

Thanks!