there's like thousands of crawlers going through every post ever made to add to their data sets and boy let me tell you, they don't care if you add in a robots.txt file.

A better question would be is "how valuable will the twitter data set be when it's inevitably filled with chatGPT shit"