Read your /robots.txt and check the rules for each AI user-agent — GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot, Google-Extended, ChatGPT-User and others. A Disallow rule matching '/' blocks that agent. Because the agents do different jobs (training, search indexing, live user fetches), you must check each one; blocking one does not block the others. The Can AI Read This? tool fetches your live robots.txt and reports every major AI crawler at once.
No — the most common mistake. GPTBot is OpenAI's TRAINING crawler; ChatGPT SEARCH results come from a different agent, OAI-SearchBot, and live requests from ChatGPT-User. Block only GPTBot and ChatGPT can still cite you in search. But block OAI-SearchBot (or blanket-block all OpenAI agents) and you remove yourself from ChatGPT search answers and lose that referral traffic.
Can AI Read This? — check every AI crawler at once →Operated by Last Minute Deals HQ LLC. This page is a plain-language answer; the linked service is live and machine-payable.