Skip to content
SIbotaccess

expedia.com

Scanned

/api/site/expedia.com

Access by AI user-agent

Parsed from the site’s robots.txt. “Inherited” means no rule names the agent and it falls back to User-agent: *.

OpenAI

GPTBotinherited
Training crawler
inherits User-agent: *
Disallow: /Hotel-Search
Disallow: /hotel-search
Disallow: /search?
Disallow: /*/search?
Disallow: /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow: /LastBooking/ElapsedTime
+46 more disallow rules
Unspecifiedeffective: partial
OAI-SearchBot
Search / answer index
Disallow: /p/home
Disallow: /*/p/home
Disallow: /auth/
Disallow: /*/auth/
Disallow: /*/sso/
Disallow: /cl/*
Allow: /
Partial
ChatGPT-User
On-demand user fetch
Disallow: /p/home
Disallow: /*/p/home
Disallow: /auth/
Disallow: /*/auth/
Disallow: /*/sso/
Disallow: /cl/*
Allow: /
Partial

Anthropic

ClaudeBotinherited
Training crawler
inherits User-agent: *
Disallow: /Hotel-Search
Disallow: /hotel-search
Disallow: /search?
Disallow: /*/search?
Disallow: /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow: /LastBooking/ElapsedTime
+46 more disallow rules
Unspecifiedeffective: partial
Claude-User
On-demand user fetch
Disallow: /p/home
Disallow: /*/p/home
Disallow: /auth/
Disallow: /*/auth/
Disallow: /*/sso/
Disallow: /cl/*
Allow: /
Partial
Claude-SearchBot
Search / answer index
Disallow: /p/home
Disallow: /*/p/home
Disallow: /auth/
Disallow: /*/auth/
Disallow: /*/sso/
Disallow: /cl/*
Allow: /
Partial

Google AI

Google-Extendedinherited
Training crawler
inherits User-agent: *
Disallow: /Hotel-Search
Disallow: /hotel-search
Disallow: /search?
Disallow: /*/search?
Disallow: /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow: /LastBooking/ElapsedTime
+46 more disallow rules
Unspecifiedeffective: partial

Perplexity

PerplexityBot
Search / answer index
Disallow: /p/home
Disallow: /*/p/home
Disallow: /auth/
Disallow: /*/auth/
Disallow: /*/sso/
Disallow: /cl/*
Allow: /
Partial
Perplexity-User
On-demand user fetch
Disallow: /p/home
Disallow: /*/p/home
Disallow: /auth/
Disallow: /*/auth/
Disallow: /*/sso/
Disallow: /cl/*
Allow: /
Partial

ByteDance

Bytespiderinherited
Training crawler
inherits User-agent: *
Disallow: /Hotel-Search
Disallow: /hotel-search
Disallow: /search?
Disallow: /*/search?
Disallow: /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow: /LastBooking/ElapsedTime
+46 more disallow rules
Unspecifiedeffective: partial

Common Crawl

CCBotinherited
Training crawler
inherits User-agent: *
Disallow: /Hotel-Search
Disallow: /hotel-search
Disallow: /search?
Disallow: /*/search?
Disallow: /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow: /LastBooking/ElapsedTime
+46 more disallow rules
Unspecifiedeffective: partial

Meta

Meta-ExternalAgentinherited
Training crawler
inherits User-agent: *
Disallow: /Hotel-Search
Disallow: /hotel-search
Disallow: /search?
Disallow: /*/search?
Disallow: /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow: /LastBooking/ElapsedTime
+46 more disallow rules
Unspecifiedeffective: partial
Back to the directory