Eudoxia

Free tool · runs in your browser

AI robots.txt generator

Choose which AI assistants can read your site. Allow the bots that put you in AI answers, and decide separately about AI training. Get a ready-to-use robots.txt.

Quick setup
AI answer bots (put you in AI answers)
AI training bots (use content to train models)

Your robots.txt

Upload to your website's root so it opens at yoursite.com/robots.txt.

User-agent: *
Allow: /

# --- AI assistants ---

User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: PerplexityBot
User-agent: Claude-SearchBot
Allow: /

User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: Applebot-Extended
Disallow: /
⚡ Pro · coming soon

Keep your robots.txt right, automatically

Which would you use? (optional)

Planned price: from $29/month for 3 websites. Early-access members get a launch discount. No spam. Unsubscribe any time.

Now see if AI actually recommends you

The free Eudoxia Score check asks AI assistants the questions your customers ask, and shows who they recommend instead of you.

Questions

Should I block AI training bots?

That's your choice. Blocking training bots (GPTBot, ClaudeBot, Google-Extended, Applebot-Extended) stops your content being used to train models, and doesn't stop you appearing in AI answers, as long as you allow the answer bots.

Will this replace my existing robots.txt?

Paste your current rules into the “existing rules” box and they'll be kept. The AI section is added alongside them.

Where does robots.txt go?

In the root of your website, so it opens at yoursite.com/robots.txt. Many website builders and SEO plugins have a robots.txt editor.

Guides for this tool

More free tools