{"id":1211,"date":"2026-11-17T04:57:39","date_gmt":"2026-11-17T09:57:39","guid":{"rendered":"https:\/\/launchclub.ai\/blog\/?p=1211"},"modified":"2026-11-17T04:57:39","modified_gmt":"2026-11-17T09:57:39","slug":"how-to-block-ai-crawlers","status":"publish","type":"post","link":"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/","title":{"rendered":"How to Block AI Crawlers (and When You Should Not)"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">To block AI crawlers, add rules to your site&#8217;s robots.txt file that disallow the specific AI user agents you want to keep out, such as GPTBot or ClaudeBot, and use firewall or bot management rules for crawlers that do not follow robots.txt. The important decision is which ones to block. Most AI companies now run separate bots for model training, for search indexing and for fetching pages when a user asks. If you block AI crawlers without separating those roles, you can disappear from AI answers that would otherwise cite and link to you.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This guide lists the main AI crawlers, explains how to block AI crawlers selectively, and helps you decide what to allow.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-1-1024x576.png\" alt=\"robots.txt rules used to block AI crawlers\" class=\"wp-image-1229\" srcset=\"https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-1-1024x576.png 1024w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-1-300x169.png 300w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-1-768x432.png 768w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-1.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Why_sites_block_AI_crawlers\"><\/span>Why sites block AI crawlers<span class=\"ez-toc-section-end\"><\/span><\/h2><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_90 ez-toc-wrap-left counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Jump Around<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Why_sites_block_AI_crawlers\" >Why sites block AI crawlers<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#The_three_kinds_of_AI_crawlers\" >The three kinds of AI crawlers<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Main_AI_crawlers_and_what_they_do\" >Main AI crawlers and what they do<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_to_block_AI_crawlers_with_robotstxt\" >How to block AI crawlers with robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#What_robotstxt_cannot_do\" >What robots.txt cannot do<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_to_block_AI_crawlers_at_the_firewall\" >How to block AI crawlers at the firewall<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Should_you_block_AI_crawlers\" >Should you block AI crawlers?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Three_sample_robotstxt_policies\" >Three sample robots.txt policies<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Maximum_visibility\" >Maximum visibility<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Opt_out_of_training_stay_in_search\" >Opt out of training, stay in search<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Opt_out_of_everything_you_can\" >Opt out of everything you can<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_to_block_AI_crawlers_on_common_platforms\" >How to block AI crawlers on common platforms<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_to_verify_that_a_bot_is_real\" >How to verify that a bot is real<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Should_publishers_block_AI_crawlers\" >Should publishers block AI crawlers?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Googles_AI_features_are_a_special_case\" >Google&#8217;s AI features are a special case<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_to_check_which_AI_crawlers_visit_your_site\" >How to check which AI crawlers visit your site<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Common_mistakes_when_you_block_AI_crawlers\" >Common mistakes when you block AI crawlers<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_to_decide_step_by_step\" >How to decide, step by step<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-19\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Keeping_your_robotstxt_up_to_date\" >Keeping your robots.txt up to date<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-20\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#FAQ_how_to_block_AI_crawlers\" >FAQ: how to block AI crawlers<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-21\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_do_I_block_AI_crawlers_from_my_website\" >How do I block AI crawlers from my website?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-22\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Will_blocking_GPTBot_remove_me_from_ChatGPT\" >Will blocking GPTBot remove me from ChatGPT?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-23\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Does_blocking_Google-Extended_affect_Google_Search\" >Does blocking Google-Extended affect Google Search?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-24\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Do_all_AI_crawlers_respect_robotstxt\" >Do all AI crawlers respect robots.txt?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-25\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Should_a_business_block_AI_crawlers\" >Should a business block AI crawlers?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-26\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#How_often_should_I_update_my_AI_crawler_rules\" >How often should I update my AI crawler rules?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-27\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Can_I_block_AI_crawlers_from_only_part_of_my_site\" >Can I block AI crawlers from only part of my site?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-28\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Will_blocking_AI_crawlers_reduce_my_server_costs\" >Will blocking AI crawlers reduce my server costs?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-29\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Does_blocking_AI_crawlers_remove_my_content_from_existing_models\" >Does blocking AI crawlers remove my content from existing models?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-30\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Do_I_need_to_tell_anyone_before_I_block_AI_crawlers\" >Do I need to tell anyone before I block AI crawlers?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-31\" href=\"https:\/\/launchclub.ai\/blog\/how-to-block-ai-crawlers\/#Is_there_a_standard_file_for_AI_permissions_beyond_robotstxt\" >Is there a standard file for AI permissions beyond robots.txt?<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n\n\n\n\n<p class=\"wp-block-paragraph\">Publishers and businesses block AI crawlers for a few reasons:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>They do not want their content used to train AI models without permission or payment.<\/li>\n\n\n\n<li>Heavy crawling adds server load and bandwidth costs.<\/li>\n\n\n\n<li>They want to protect paid or proprietary content.<\/li>\n\n\n\n<li>They are negotiating licensing deals and want bargaining power.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Those are reasonable goals. The tradeoff is visibility. AI assistants increasingly answer questions with citations and links. If their search crawlers cannot read your pages, they cannot cite you, and a competitor gets mentioned instead.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"The_three_kinds_of_AI_crawlers\"><\/span>The three kinds of AI crawlers<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Most major AI companies now separate their bots by purpose:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Training crawlers collect content that may be used to train future models.<\/li>\n\n\n\n<li>Search crawlers index pages so the assistant can find and cite them when answering questions.<\/li>\n\n\n\n<li>User-triggered fetchers retrieve a page when a person using the assistant asks about it or shares a link.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Blocking a training crawler does not stop the search crawler, and the reverse is also true. That gives you fine-grained control, but only if you name the right bots.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Main_AI_crawlers_and_what_they_do\"><\/span>Main AI crawlers and what they do<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<div style=\"overflow-x:auto;margin:1.5em 0;\"><table style=\"width:100%;border-collapse:collapse;color:#d6d8dd;font-size:15px;line-height:1.5;\">\n<thead>\n<tr>\n<th style=\"background:#0b1a4a;color:#ffffff;text-align:left;padding:10px 12px;border:1px solid #24345f;border-bottom:2px solid #02e95b;font-weight:600;\">Company<\/th>\n<th style=\"background:#0b1a4a;color:#ffffff;text-align:left;padding:10px 12px;border:1px solid #24345f;border-bottom:2px solid #02e95b;font-weight:600;\">User agent<\/th>\n<th style=\"background:#0b1a4a;color:#ffffff;text-align:left;padding:10px 12px;border:1px solid #24345f;border-bottom:2px solid #02e95b;font-weight:600;\">Purpose<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">OpenAI<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">GPTBot<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Collects content that may be used to train models<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">OpenAI<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">OAI-SearchBot<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Indexes pages for ChatGPT search results and citations<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">OpenAI<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">ChatGPT-User<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Fetches pages for user actions in ChatGPT<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Anthropic<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">ClaudeBot<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Collects content that may be used to train models<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Anthropic<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Claude-SearchBot<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Indexes content to improve Claude&#8217;s search results<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Anthropic<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Claude-User<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Fetches pages when a Claude user asks a question<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Perplexity<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">PerplexityBot<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Indexes pages for Perplexity answers<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Perplexity<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Perplexity-User<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Fetches pages for user requests<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Google<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Google-Extended<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">A control token for whether Google may use your content for Gemini models and grounding<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Apple<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Applebot-Extended<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">A control token for Apple&#8217;s use of content in AI training<\/td>\n<\/tr>\n<tr>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Common Crawl<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">CCBot<\/td>\n<td style=\"color:#d6d8dd;padding:10px 12px;border:1px solid #24345f;vertical-align:top;\">Builds a public web archive that many AI developers use<\/td>\n<\/tr>\n<\/tbody>\n<\/table><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Companies add and rename bots over time, so check each company&#8217;s own documentation before you edit robots.txt. OpenAI documents its crawlers in its <a href=\"https:\/\/developers.openai.com\/api\/docs\/bots\" target=\"_blank\" rel=\"noopener\">bots overview<\/a>, and Anthropic explains its crawlers in its help center.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_to_block_AI_crawlers_with_robotstxt\"><\/span>How to block AI crawlers with robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt sits at the root of your domain, for example example.com\/robots.txt. Each rule names a user agent and the paths it may not crawl. To block a single crawler from your whole site:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>User-agent: GPTBot\nDisallow: \/<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">To block AI crawlers used for training while keeping search crawlers allowed, list each training bot separately:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>User-agent: GPTBot\nDisallow: \/\n\nUser-agent: ClaudeBot\nDisallow: \/\n\nUser-agent: Google-Extended\nDisallow: \/\n\nUser-agent: Applebot-Extended\nDisallow: \/\n\nUser-agent: CCBot\nDisallow: \/\n\nUser-agent: OAI-SearchBot\nAllow: \/\n\nUser-agent: Claude-SearchBot\nAllow: \/\n\nUser-agent: PerplexityBot\nAllow: \/<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">You can also block AI crawlers from specific folders only, such as a members area, by using a path instead of a slash. Apply rules on every subdomain that serves content, since each has its own robots.txt. Changes are not instant. OpenAI, for example, notes that its search systems can take around a day to reflect a robots.txt update.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_robotstxt_cannot_do\"><\/span>What robots.txt cannot do<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-2-1024x576.png\" alt=\"Weighing protection against visibility before you block AI crawlers\" class=\"wp-image-1230\" srcset=\"https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-2-1024x576.png 1024w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-2-300x169.png 300w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-2-768x432.png 768w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-2.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt is a request, not a lock. Reputable crawlers follow it, but nothing forces a bot to comply. Some user-triggered fetchers are treated differently. OpenAI says robots.txt rules may not apply to ChatGPT-User because a person initiated the action. Anthropic says its bots, including Claude-User, respect robots.txt. Behavior varies by company, so read each one&#8217;s documentation.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt also does not remove content already collected, and it does not stop other sites from quoting or summarizing your pages.<\/p>\n\n\n\n<aside class=\"lc-mid-cta\" aria-label=\"Free Reddit Opportunity Report\" style=\"background:#0b1a4a;border:1px solid #02e95b;border-radius:16px;padding:28px;margin:2.5em 0;display:flex;flex-wrap:wrap;gap:28px;align-items:center;font-family:Inter,sans-serif;\"><div style=\"flex:1 1 320px;min-width:0;display:flex;flex-direction:column;gap:12px;\"><span style=\"color:#02e95b;font-size:13px;font-weight:700;letter-spacing:0.12em;text-transform:uppercase;\">Free opportunity report<\/span><p style=\"margin:0;color:#ffffff;font-size:28px;line-height:1.2;font-weight:800;\">Is your business invisible to AI search?<\/p><p style=\"margin:0;color:#c4c8d2;font-size:16px;line-height:1.55;\">Run an opportunity report to see which Reddit threads rank for your keywords, which ones AI answers draw on, and where your brand is missing.<\/p><a href=\"https:\/\/launchclub.ai\/intelligence-report\" style=\"align-self:flex-start;background:#02e95b;color:#040d2b;font-weight:700;font-size:16px;text-decoration:none;padding:14px 24px;border-radius:10px;\">Run my free report<\/a><\/div><div aria-hidden=\"true\" style=\"flex:0 1 230px;background:#040d2b;border-radius:12px;padding:18px;display:flex;flex-direction:column;gap:12px;\"><span style=\"color:#a4a7ae;font-size:12px;font-weight:600;letter-spacing:0.08em;text-transform:uppercase;\">Where you show up<\/span><span style=\"color:#fff;font-size:14px;\">Google<\/span><span style=\"display:block;height:8px;border-radius:4px;background:#1a2a5c;\"><span style=\"display:block;width:55%;height:8px;border-radius:4px;background:#02e95b;\"><\/span><\/span><span style=\"color:#fff;font-size:14px;\">ChatGPT<\/span><span style=\"display:block;height:8px;border-radius:4px;background:#1a2a5c;\"><span style=\"display:block;width:22%;height:8px;border-radius:4px;background:#ff8a3d;\"><\/span><\/span><span style=\"color:#fff;font-size:14px;\">Perplexity<\/span><span style=\"display:block;height:8px;border-radius:4px;background:#1a2a5c;\"><span style=\"display:block;width:8%;height:8px;border-radius:4px;background:#ff8a3d;\"><\/span><\/span><\/div><\/aside>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_to_block_AI_crawlers_at_the_firewall\"><\/span>How to block AI crawlers at the firewall<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-3-1024x576.png\" alt=\"Firewall rules that block AI crawlers\" class=\"wp-image-1231\" srcset=\"https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-3-1024x576.png 1024w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-3-300x169.png 300w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-3-768x432.png 768w, https:\/\/launchclub.ai\/blog\/wp-content\/uploads\/2026\/11\/how-to-block-ai-crawlers-3.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">For stronger control, use a web application firewall or your CDN&#8217;s bot management. Many CDN and security providers now offer settings to block AI crawlers in one step, rules based on user agent or verified bot lists, and rate limiting for heavy crawlers. Some providers can verify bots against the IP ranges that AI companies publish, which helps catch impostors using a real bot&#8217;s name.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Be careful with broad firewall rules. Blocking by IP range can catch the wrong traffic, and some AI companies note that blocking their IPs can prevent their bots from reading your robots.txt at all, which makes your preferences harder to honor. Start with robots.txt, then add firewall rules for bots that ignore it or crawl too aggressively.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Should_you_block_AI_crawlers\"><\/span>Should you block AI crawlers?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">It depends on how your business makes money from content.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Publishers that earn from ad impressions or subscriptions may want to block AI crawlers used for training, and think carefully about search crawlers, since AI answers can reduce clicks.<\/li>\n\n\n\n<li>Businesses that sell products or services usually benefit from being cited. For them, blocking training crawlers is a reasonable choice, but blocking search crawlers or user fetchers mostly removes them from AI recommendations.<\/li>\n\n\n\n<li>Sites with private or paid content should block AI crawlers from those sections and use login protection, since robots.txt alone does not secure anything.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">A common middle path is to block AI crawlers used for training and allow those used for search and user requests. That keeps your pages eligible for citations and links in AI answers while opting out of future training where the company offers that choice. Our guide to <a href=\"https:\/\/launchclub.ai\/blog\/gptbot\/\">GPTBot<\/a> covers OpenAI&#8217;s crawlers in more depth.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Three_sample_robotstxt_policies\"><\/span>Three sample robots.txt policies<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Most sites end up with one of three approaches. Pick the one that fits your goals, then adjust the bot list to match current documentation.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Maximum_visibility\"><\/span>Maximum visibility<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Allow all reputable AI crawlers. This suits businesses that want to be recommended and cited as widely as possible and are comfortable with their public content being used for training. Your robots.txt does not need AI-specific rules at all, though listing the main search crawlers with Allow makes your intent clear.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Opt_out_of_training_stay_in_search\"><\/span>Opt out of training, stay in search<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Block AI crawlers that collect training data, such as GPTBot, ClaudeBot, Google-Extended, Applebot-Extended and CCBot, while allowing search crawlers and user fetchers such as OAI-SearchBot, Claude-SearchBot, Claude-User, PerplexityBot and Perplexity-User. This is the most common middle path for businesses and many publishers.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Opt_out_of_everything_you_can\"><\/span>Opt out of everything you can<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Block AI crawlers of every kind, including search and user agents, and add firewall rules for bots that ignore robots.txt. This suits sites whose business depends on readers visiting the site directly, or that have licensing concerns. Expect to disappear from many AI answers as a result.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_to_block_AI_crawlers_on_common_platforms\"><\/span>How to block AI crawlers on common platforms<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Where you edit robots.txt depends on your platform:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>WordPress. Many SEO plugins include a robots.txt editor in their settings. You can also upload a physical robots.txt file to the site root, which overrides the virtual one WordPress generates.<\/li>\n\n\n\n<li>Shopify. Stores can customize robots.txt through a theme template file, which lets you add rules for specific user agents.<\/li>\n\n\n\n<li>Website builders. Some hosted builders limit robots.txt editing. Check their help documentation, and use your CDN or domain provider&#8217;s bot settings if direct editing is not available.<\/li>\n\n\n\n<li>Custom sites. Edit the robots.txt file in your web root, or configure your framework to serve it.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">After any change, open yoursite.com\/robots.txt in a browser to confirm the live file shows your new rules.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_to_verify_that_a_bot_is_real\"><\/span>How to verify that a bot is real<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Anyone can put &#8220;GPTBot&#8221; or &#8220;ClaudeBot&#8221; in a user agent string. When you block AI crawlers or allow them, you are trusting that the name is honest. Several AI companies publish the IP ranges their crawlers use, so you or your security provider can confirm that a request claiming to be a known bot comes from the right network. Many CDN and firewall services do this automatically through verified bot lists. Unverified traffic using a well-known bot name is a common sign of scrapers trying to blend in.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Should_publishers_block_AI_crawlers\"><\/span>Should publishers block AI crawlers?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Publishers face the hardest version of this choice. AI answers can summarize articles and reduce clicks, which hurts ad and subscription revenue. At the same time, citations in AI answers can send readers and build brand recognition. Some publishers block AI crawlers broadly while they negotiate licensing agreements. Others block training but allow search to stay visible. A few allow everything and focus on the traffic that citations bring.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Whatever you choose, measure the effect. Track referral traffic from AI assistants, watch your crawl logs, and revisit the decision as AI products and licensing markets change. Our guide to <a href=\"https:\/\/launchclub.ai\/blog\/ai-referral-traffic\/\">AI referral traffic<\/a> explains how to see visits from assistants in analytics.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Whichever policy you choose, write it down in plain language for your team, including the date you set it and the reasons. That makes the next review faster and keeps rules from drifting as people change roles.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Googles_AI_features_are_a_special_case\"><\/span>Google&#8217;s AI features are a special case<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Google-Extended controls whether Google may use your content for its Gemini models and some grounding uses. It does not control Google Search, and Google&#8217;s AI Overviews and AI Mode are part of Search. To limit how your content appears in AI Overviews, you would need Search-level controls such as nosnippet, which also affect regular search snippets. Blocking Googlebot entirely removes you from Google Search. Our guide on <a href=\"https:\/\/launchclub.ai\/blog\/how-to-appear-in-google-ai-overviews\/\">how to appear in Google AI Overviews<\/a> explains how those features choose sources.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_to_check_which_AI_crawlers_visit_your_site\"><\/span>How to check which AI crawlers visit your site<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Look at your server logs or your CDN&#8217;s bot analytics and filter by the user agents in the table above. You will see which bots crawl, how often and which pages they request. This data helps you decide whether crawling is a real cost problem and which pages AI systems are most interested in. Remember that any bot can claim a well-known name, so verify important bots against published IP ranges where available.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Common_mistakes_when_you_block_AI_crawlers\"><\/span>Common mistakes when you block AI crawlers<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Blocking every bot with a wildcard rule, which also blocks search engines and removes the site from Google and Bing.<\/li>\n\n\n\n<li>Blocking only GPTBot and assuming ChatGPT can no longer see the site, when its search crawler and user fetcher are separate.<\/li>\n\n\n\n<li>Copying an old list of user agents from a blog post, which may include deprecated names and miss new ones.<\/li>\n\n\n\n<li>Forgetting subdomains, each of which needs its own robots.txt.<\/li>\n\n\n\n<li>Blocking AI crawlers by IP range so broadly that legitimate visitors or search engines get caught.<\/li>\n\n\n\n<li>Making the change without telling marketing, who then wonders why AI referral traffic dropped.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Most of these come from treating &#8220;AI&#8221; as one thing. Decide separately about training, search and user requests, and the right rules usually follow.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_to_decide_step_by_step\"><\/span>How to decide, step by step<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>List what your site earns from: ads, subscriptions, product sales, leads or reputation.<\/li>\n\n\n\n<li>Check your logs to see which AI bots visit and how much load they create.<\/li>\n\n\n\n<li>Check your analytics for traffic from AI assistants and what it converts to.<\/li>\n\n\n\n<li>Decide whether you want your content used for training, and set the training crawler rules to match.<\/li>\n\n\n\n<li>Decide whether you want to appear in AI answers, and set the search and user crawler rules to match.<\/li>\n\n\n\n<li>Add firewall rules only for bots that ignore robots.txt or crawl too aggressively.<\/li>\n\n\n\n<li>Review the results after a few months and adjust.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Following these steps keeps the choice to block AI crawlers tied to your business model rather than to headlines about AI.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Keeping_your_robotstxt_up_to_date\"><\/span>Keeping your robots.txt up to date<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">New AI crawlers appear regularly, and companies rename or split existing ones. Review your robots.txt every few months, compare it with each company&#8217;s current documentation, and check your logs for unfamiliar bots. Keep a comment in the file explaining your policy, so the next person who edits it understands why each rule exists. If your site has an llms.txt file, keep it consistent with your robots.txt choices. Our guide on <a href=\"https:\/\/launchclub.ai\/blog\/what-is-llms-txt\/\">what llms.txt is<\/a> explains that file.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"FAQ_how_to_block_AI_crawlers\"><\/span>FAQ: how to block AI crawlers<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_do_I_block_AI_crawlers_from_my_website\"><\/span>How do I block AI crawlers from my website?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Add Disallow rules for each AI user agent in your robots.txt file, and use firewall or CDN bot management for bots that ignore robots.txt.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Will_blocking_GPTBot_remove_me_from_ChatGPT\"><\/span>Will blocking GPTBot remove me from ChatGPT?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Blocking GPTBot opts you out of training. ChatGPT search uses OAI-SearchBot, so block that too only if you want to leave ChatGPT search results.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Does_blocking_Google-Extended_affect_Google_Search\"><\/span>Does blocking Google-Extended affect Google Search?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">No. Google-Extended controls use in Gemini models and some grounding. Google Search, including AI Overviews, follows Googlebot rules.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Do_all_AI_crawlers_respect_robotstxt\"><\/span>Do all AI crawlers respect robots.txt?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Major companies say their crawlers do, though user-triggered fetchers can be treated differently. Some smaller or unknown bots ignore it, which is why firewall rules exist.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Should_a_business_block_AI_crawlers\"><\/span>Should a business block AI crawlers?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Most businesses that want customers to find them should allow AI search crawlers and user fetchers. Blocking training crawlers is a separate choice with less impact on visibility.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_often_should_I_update_my_AI_crawler_rules\"><\/span>How often should I update my AI crawler rules?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Review them every few months, since AI companies add and rename crawlers regularly.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Can_I_block_AI_crawlers_from_only_part_of_my_site\"><\/span>Can I block AI crawlers from only part of my site?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Yes. Use a path in the Disallow rule, such as a members area or a folder of premium reports, and leave the rest of the site open. Remember that robots.txt is public, so it reveals which paths you consider sensitive.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Will_blocking_AI_crawlers_reduce_my_server_costs\"><\/span>Will blocking AI crawlers reduce my server costs?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">It can, if AI bots make up a large share of your crawl traffic. Check your logs first. For many small sites, AI crawling is modest and the visibility tradeoff matters more than the bandwidth.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Does_blocking_AI_crawlers_remove_my_content_from_existing_models\"><\/span>Does blocking AI crawlers remove my content from existing models?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">No. Robots.txt affects future crawling. Content collected before you added rules may already be part of earlier training data, and companies handle removal requests through their own processes.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Do_I_need_to_tell_anyone_before_I_block_AI_crawlers\"><\/span>Do I need to tell anyone before I block AI crawlers?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">There is no requirement, but tell your marketing, SEO and content teams. Changes to crawler access can shift traffic from AI assistants, and the people watching those numbers should know why.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Is_there_a_standard_file_for_AI_permissions_beyond_robotstxt\"><\/span>Is there a standard file for AI permissions beyond robots.txt?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt remains the main signal most AI companies follow. Some sites also publish an llms.txt file to guide AI tools toward useful content, and industry groups continue to discuss new standards for AI usage preferences.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Want to see where your customers are already asking?<\/strong> <a href=\"https:\/\/launchclub.ai\/intelligence-report\">Get a free Reddit Opportunity Report<\/a> showing which Reddit threads already rank for your keywords.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>How to block AI crawlers with robots.txt and firewall rules, which bots handle training versus search, and why blocking the wrong ones can remove you from AI answers.<\/p>\n","protected":false},"author":2,"featured_media":1228,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-1211","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai"],"acf":[],"_links":{"self":[{"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/posts\/1211","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/comments?post=1211"}],"version-history":[{"count":5,"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/posts\/1211\/revisions"}],"predecessor-version":[{"id":1264,"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/posts\/1211\/revisions\/1264"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/media\/1228"}],"wp:attachment":[{"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/media?parent=1211"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/categories?post=1211"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/launchclub.ai\/blog\/wp-json\/wp\/v2\/tags?post=1211"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}