reddit.com
Scanned
Access by AI user-agent
Parsed from the site’s robots.txt. “Inherited” means no rule names the agent and it falls back to User-agent: *.
OpenAI
GPTBotinherited
Training crawler
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
OAI-SearchBotinherited
Search / answer index
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
ChatGPT-Userinherited
On-demand user fetch
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Anthropic
ClaudeBotinherited
Training crawler
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Claude-Userinherited
On-demand user fetch
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Claude-SearchBotinherited
Search / answer index
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Google AI
Google-Extendedinherited
Training crawler
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Perplexity
PerplexityBotinherited
Search / answer index
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Perplexity-Userinherited
On-demand user fetch
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
ByteDance
Bytespiderinherited
Training crawler
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Common Crawl
CCBotinherited
Training crawler
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked
Meta
Meta-ExternalAgentinherited
Training crawler
inherits User-agent: *
Disallow: /
Unspecifiedeffective: blocked