https://llms.fyi weekly 1 https://llms.fyi/learn weekly 0.8 https://llms.fyi/examples monthly 0.8 https://llms.fyi/validate monthly 0.8 https://llms.fyi/robots-checker monthly 0.8 https://llms.fyi/bots monthly 0.8 https://llms.fyi/learn/does-llms-txt-work 2026-07-05T00:00:00.000Z monthly 0.7 https://llms.fyi/learn/llms-txt-vs-robots-txt 2026-07-05T00:00:00.000Z monthly 0.7 https://llms.fyi/learn/llms-txt-for-shopify 2026-07-04T00:00:00.000Z monthly 0.7 https://llms.fyi/learn/llms-txt-for-squarespace 2026-07-04T00:00:00.000Z monthly 0.7 https://llms.fyi/learn/llms-txt-for-webflow 2026-07-04T00:00:00.000Z monthly 0.7 https://llms.fyi/learn/llms-txt-for-wordpress 2026-07-04T00:00:00.000Z monthly 0.7 https://llms.fyi/learn/what-is-llms-txt 2026-02-23T00:00:00.000Z monthly 0.7 https://llms.fyi/bots/gptbot monthly 0.7 https://llms.fyi/bots/oai-searchbot monthly 0.7 https://llms.fyi/bots/chatgpt-user monthly 0.7 https://llms.fyi/bots/claudebot monthly 0.7 https://llms.fyi/bots/claude-user monthly 0.7 https://llms.fyi/bots/claude-searchbot monthly 0.7 https://llms.fyi/bots/perplexitybot monthly 0.7 https://llms.fyi/bots/perplexity-user monthly 0.7 https://llms.fyi/bots/ccbot monthly 0.7 https://llms.fyi/bots/google-extended monthly 0.7 https://llms.fyi/bots/applebot-extended monthly 0.7 https://llms.fyi/bots/bytespider monthly 0.7 https://llms.fyi/bots/amazonbot monthly 0.7 https://llms.fyi/bots/meta-externalagent monthly 0.7 https://llms.fyi/privacy yearly 0.3 https://llms.fyi/terms yearly 0.3