Robots.txt Report
Reporting when relevant companies update robots.txt files
Featured
6 Votes
Description
This X (formerly Twitter) bot reports when relevant companies update robots.txt files. For a list of currently tracked companies, check the pinned post (DM for requests to be added). The robots.txt diff is uploaded in the post when a change is detected.