Removing Duplicates


Hi, some twitter users tweet the same tweet multiple times. Is there a way to retrive only the first tweet and not to retrieve the duplicates? I could not find a solution browsing the documentation.Thanks


If a user Tweets the same content twice, Twitter classifies it as two separate Tweets. Unfortunately there is currently no way to prevent yourself from receiving these two Tweets if they both match your CSDL filter.

The best I can suggest for now is to perform deduplication on your side when you see that one user has posted the same content twice.


Hi Jason, just to thank you for the prompt reply!