Skip to content
SIbotaccess

ebay.com

Scanned

/api/site/ebay.com

Access by AI user-agent

Parsed from the site’s robots.txt. “Inherited” means no rule names the agent and it falls back to User-agent: *.

OpenAI

GPTBot
Training crawler
Disallow: /
Allow: /adchoice
Allow: /authenticity-guarantee
Allow: /motors/blog
Allow: /motors/diy
Partial
OAI-SearchBot
Search / answer index
Disallow: /*_kw
Disallow: /*?maspect
Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
Disallow: /*redirect=mobile
Disallow: /*redirect%3Dmobile
Disallow: /*rt%3Dnc
Allow: /ads.txt
Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
+204 more disallow rules
Partial
ChatGPT-User
On-demand user fetch
Disallow: /*_kw
Disallow: /*?maspect
Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
Disallow: /*redirect=mobile
Disallow: /*redirect%3Dmobile
Disallow: /*rt%3Dnc
Allow: /ads.txt
Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
+204 more disallow rules
Partial

Anthropic

ClaudeBot
Training crawler
Disallow: /
Allow: /adchoice
Allow: /authenticity-guarantee
Allow: /motors/blog
Allow: /motors/diy
Partial
Claude-User
On-demand user fetch
Disallow: /*_kw
Disallow: /*?maspect
Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
Disallow: /*redirect=mobile
Disallow: /*redirect%3Dmobile
Disallow: /*rt%3Dnc
Allow: /ads.txt
Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
+204 more disallow rules
Partial
Claude-SearchBot
Search / answer index
Disallow: /*_kw
Disallow: /*?maspect
Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
Disallow: /*redirect=mobile
Disallow: /*redirect%3Dmobile
Disallow: /*rt%3Dnc
Allow: /ads.txt
Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
+204 more disallow rules
Partial

Google AI

Google-Extendedinherited
Training crawler
inherits User-agent: *
Disallow: /*_kw
Disallow: /*?maspect
Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
Disallow: /*redirect=mobile
Disallow: /*redirect%3Dmobile
Disallow: /*rt%3Dnc
Allow: /ads.txt
Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
+210 more disallow rules
Unspecifiedeffective: partial

Perplexity

PerplexityBot
Search / answer index
Disallow: /
Allow: /adchoice
Allow: /authenticity-guarantee
Allow: /motors/blog
Allow: /motors/diy
Partial
Perplexity-Userinherited
On-demand user fetch
inherits User-agent: *
Disallow: /*_kw
Disallow: /*?maspect
Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
Disallow: /*redirect=mobile
Disallow: /*redirect%3Dmobile
Disallow: /*rt%3Dnc
Allow: /ads.txt
Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
+210 more disallow rules
Unspecifiedeffective: partial

ByteDance

Bytespider
Training crawler
Disallow: /
Allow: /adchoice
Allow: /authenticity-guarantee
Allow: /motors/blog
Allow: /motors/diy
Partial

Common Crawl

CCBot
Training crawler
Disallow: /
Allow: /adchoice
Allow: /authenticity-guarantee
Allow: /motors/blog
Allow: /motors/diy
Partial

Meta

Meta-ExternalAgent
Training crawler
Disallow: /
Allow: /adchoice
Allow: /authenticity-guarantee
Allow: /motors/blog
Allow: /motors/diy
Partial
Back to the directory