Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>One approach would be to use the <a href="https://dev.twitter.com/streaming/reference/post/statuses/filter" rel="nofollow">streaming API</a> (or perhaps the more specific <a href="https://dev.twitter.com/streaming/userstreams" rel="nofollow">user streams</a>, if that's better suited to your application) to start collecting all tweets as they occur from your target user(s) without having to bother with the traditional rate limits, and then use the REST API to backfill those users' historical tweets. </p> <p>Granted, you only have 350 authenticated requests per hour, but if you run your harvester around the clock, that's still 1,680,000 tweets per day (350 requests/hour * 24 hours/day * 200 tweets/request). </p> <p>So, for example, if you decided to pull 1,000 tweets per user per day (5 API calls @ 200 tweets per call), you could run through 1,680 user timelines per day (70 timelines per hour). Then, on the next day, begin where you left off by harvesting the next 1,000 tweets using the oldest status ID per user as the <code>max_id</code> parameter in your <a href="http://dev.twitter.com/doc/get/statuses/user_timeline" rel="nofollow">statuses/user_timeline</a> request. </p> <p>The streaming API will keep you abreast of any new statuses your target users tweet, and the REST API calls will pretty quickly, in about four days, start running into Twitter's fetch limit for those users' historical tweets. After that, you can add additional users to fetch going forward from the streaming endpoint by adding them to the <code>follow</code> list, and you can stop fetching historical tweets for those users that have maxed out, and start fetching a new target group's tweets.</p>
    singulars
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. VO
      singulars
      1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload