• chickentendrils [any, comrade/them]
    ·
    edit-2
    2 years ago

    HTTP APIs can be queried, eg you can ask for tweets from a specific user (probably) and get just formatted text with the contents of their tweets, and maybe some key stats about the tweet if you want.

    Scraping works like a normal web browser, so any images or other stuff like tweets from random other people which you'd see in your browser as a normal user gets sent to a theoretical bot. It basically is forced to be as resource intensive as a normal user, or it would be identifiable and they can stop what they can identify. I'd imagine people will probably just scrape by emulating the mobile app though, that's usually easier when a site/service has it.