If I have a recorded stream I understand Datasift will process delete messages on that.
However, if I have already downloaded a copy before you process a delete, is there is an implied responsibility for me as a customer to continually re-download the recorded stream and diff with my local copy in order to identify these deletes?
Not sure what the retention policy is you would advise on here. What would Twitter require as a minimum?
The re-download approach I outlined sounds horrid and so would be better facilitated if Datasift maintain a “deletes-since-last-download” file to alert me to any delete messages that I would have to apply to my local copy.