The /llms.txt file, helping language models use your website github.com 4 points by mooreds 16 hours ago
TimorousBestie 13 hours ago LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.
LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.