I have the following potential use case: I create a stream via the online interface (not through the API). Then I want to have that stream recorded every hour and have those results exported to an Amazon S3 bucket every hour. I then process the results of the export as needed on my own server.
My questions are:
- How can I automate/program the periodic export?
- How can I identify each file so that I know to which time-period it belongs(in the exports I have done, all the files have the same name: r-part-00000.csv)?