we started testing Datasift Streaming API to replace our current use of Twitter’s Streaming API (the 1% free pipe) and we noticed that the volume of tweets is not at all 100 times higher than the free 1% from Twitter.
For example, our filter on Twitter would be “X,Y”, meaning that we look for tweets containing both X and Y keywords. On DataSift we use
twitter.text contains_all “X,Y”
We know that the DataSift version is not exactly the same. We should still have a much higher volume with DataSift. Right now we get about 200 tweets/hour from Twitter Streaming API and only 450 tweets/hour from DataSift.
Could someone help us understand this?