On Reddit, a user wondered why Google seemed to be playing a double game regarding the LLMs.txt file. Response from John Mueller: “When an AI platform that brings you clients tells you they need the file for your site, I recommend taking the time to create it. »
Further on, he specifies that the basic optimization remains not to block AI agents, if you obviously want these agents to be able to browse your site.
Source : Reddit