◎OAI-SearchBotChatGPT search · Search
◎ChatGPT-UserChatGPT reading a page for a user · User request
◎GPTBotOpenAI model training · Training
✳PerplexityBotPerplexity answers · Search
✳Perplexity-UserPerplexity reading a page for a user · User request
✺Claude-SearchBotClaude search · Search
✺Claude-UserClaude reading a page for a user · User request
✺ClaudeBotAnthropic model training · Training
◆BingbotBing, ChatGPT search and Copilot · Search
GGooglebotGoogle Search and AI Overviews · Search
GGoogle-ExtendedGemini training (robots.txt only) · Training
ApplebotSiri and Spotlight · Search
Applebot-ExtendedApple Intelligence training (robots.txt only) · Training
aAmazonbotAlexa answers · Search
∞meta-externalagentMeta AI · Training
DDuckAssistBotDuckDuckGo AI answers · Search
MMistralAI-UserLe Chat reading a page for a user · User request
BBytespiderByteDance model training · Training
CCCBotOpen dataset used by many AI models · Training