Отчёт · 30 октября 2026 г.
Как ИИ-агенты видят befree.ru
11 из 12 ИИ-ботов могут открыть главную befree.ru и им это разрешено. Серьёзных проблем не нашли.
88/100
Видимость для ИИ-агентов
- Доступ для ботов
- 40/40
- Правила robots.txt
- 19/20
- Контент без JavaScript
- 10/20
- Разметка
- 9/10
- Служебные файлы
- 10/10
Главные проблемы
-
Важно
Часть контента видна только после JavaScript
Без JavaScript 175 слов, после рендера — 440 (40%). Остальное ИИ-боты, скорее всего, не увидят.
Как исправить. Проверьте, какие блоки подгружаются скриптами, и отдавайте важный текст сразу в HTML.
-
Мелочь
Обучение моделей запрещено в robots.txt
Запрещено для Bytespider. Это нормальный выбор, если он сознательный: на видимость в ИИ-поиске он не влияет.
Как исправить. Ничего не делайте, если хотите запрещать обучение. Если хотите попасть в обучающие данные — разрешите этих ботов.
Доступ по ботам
Мы зашли на главную под подписью (User-Agent) каждого бота и сравнили ответ с тем, что получает обычный браузер. Колонка robots.txt — что разрешают правила сайта.
| Бот | robots.txt | Доступ к главной | Ответ сервера |
|---|---|---|---|
| Поисковики | |||
GooglebotGoogle |
Разрешеногруппа Googlebot |
Видит страницу |
200 |
YandexBotЯндекс |
Разрешеногруппа Yandex |
Видит страницу |
200 |
BingbotMicrosoft |
Разрешеногруппа bingbot |
Видит страницу |
200 |
| ИИ-поиск | |||
YandexAdditionalBotЯндекс |
Разрешеногруппа Yandex |
Видит страницу |
200 |
OAI-SearchBotOpenAI |
Разрешеногруппа OAI-SearchBot |
Видит страницу |
200 |
Claude-SearchBotAnthropic |
Разрешеногруппа Claude-SearchBot |
Видит страницу |
200 |
PerplexityBotPerplexity |
Разрешеногруппа PerplexityBot |
Видит страницу |
200 |
| Агенты по запросу пользователя | |||
ChatGPT-UserOpenAI |
Разрешеногруппа ChatGPT-User |
Видит страницу |
200 |
Claude-UserAnthropic |
Разрешеногруппа Claude-User |
Видит страницу |
200 |
Perplexity-UserPerplexity |
Разрешеногруппа Perplexity-User |
Видит страницу |
200 |
| Обучение моделей | |||
GPTBotOpenAI |
Разрешеногруппа GPTBot |
Видит страницу |
200 |
ClaudeBotAnthropic |
Разрешеногруппа ClaudeBot |
Видит страницу |
200 |
CCBotCommon Crawl |
Разрешеногруппа CCBot |
Видит страницу |
200 |
BytespiderByteDance |
Запрещеногруппа Bytespider |
Видит страницу |
200 |
Разрешеногруппа meta-externalagent |
Видит страницу |
200 |
|
Google-ExtendedGoogle |
Разрешеногруппа Google-Extended |
нет своего робота |
|
Applebot-ExtendedApple |
Разрешеногруппа Applebot-Extended |
нет своего робота |
|
Для сравнения обычный браузер получил: ответ 200, 175 слов.
JavaScript: что видит бот без браузера
GPTBot, ClaudeBot, PerplexityBot и большинство ИИ-агентов не выполняют JavaScript: они читают только HTML, который отдал сервер. Мы сравнили HTML, который получил YandexAdditionalBot, со страницей после рендера в браузере.
Без JavaScript175 слов
В браузере440 слов
Часть контента — только после JavaScript — бот видит 40% текста.
Разметка главной
Так главную видит YandexAdditionalBot — без JavaScript.
- Title
- Befree – официальный сайт интернет-магазина одежды, обуви и аксессуаров
- Description
- Российский бренд одежды для женщин и мужчин. Создает коллекции одежды, обуви и аксессуаров. Бесплатная доставка по всей России при оплате онлайн!
- Язык
- ru
- Canonical
- нет
- Schema.org
- Organization, WebSite
- Meta robots
- не задано
Служебные файлы
- robots.txt
- есть 26243 байт, упомянуты: Googlebot, YandexBot, Bingbot, YandexAdditionalBot, OAI-SearchBot, Claude-SearchBot, PerplexityBot, ChatGPT-User, Claude-User, Perplexity-User, GPTBot, ClaudeBot, CCBot, Bytespider, meta-externalagent, Google-Extended, Applebot-Extended
- Sitemap
- есть индекс карт, 4 ссылки, указан в robots.txt
- Markdown для агентов
- есть отдаётся по Accept: text/markdown, 1271 слов
- llms.txt
- есть 1410 байт
Показать robots.txt
User-Agent: Yandex Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */befree Disallow: */Befree Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: */*.js Allow: */*.css Clean-param: gclid&&sortedBy&limit&city&token&orderBy&%3Br&r=r&yclid&size&ymclid&_openstat&frommarket&utm_source&utm_medium&utm_campaign&utm_content&utm_term&utm_email&utm_nooverride&utm_referrer&from&height&mindbox-message-key&mindbox-click-id User-Agent: Googlebot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Googlebot-image Disallow: User-Agent:* Allow: /storage/app/public Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: */*.js Allow: */*.css User-agent: OAI-SearchBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: ChatGPT-User Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Claude-SearchBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Claude-User Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: PerplexityBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: GigachatBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: DeepSeekBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Claude-SearchBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Claude-User Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: OAI-SearchBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: ChatGPT-User Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Google-Extended Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: bingbot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: adidxbot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: PerplexityBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Perplexity-User Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: GrokBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: Meta-ExternalAgent Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: MistralAI-User/1.0 Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /checkout/ Disallow: */catalogsearc Disallow: /reset-password Disallow: /profile Disallow: */*?orderB Disallow: */*?q= Disallow: /*category* Disallow: /*price* Disallow: /*?from=* Disallow: /*rss Disallow: /products/ Disallow: /subscribe Disallow: /thank-subscribe Disallow: *utm_ Disallow: *mindbox-click-id Disallow: *?ad= Disallow: /*from=adwords Disallow: /*_openstat Disallow: /*?token= Disallow: /*?section_id Disallow: /*?SECTION_ID Disallow: /*?p= Disallow: /*?location Disallow: /storage/content/blog/ Disallow: /storage/content/lookbook/ Disallow: /?text= Disallow: */mini-mini-mini Disallow: /delivery? Disallow: */podeli* Disallow: /about-mobile-app Allow: *?page=* Allow: *?height=* Allow: *?size=* Allow: *podeli* Allow: */*.js Allow: */*.css User-agent: DeepSeekBot Allow: /storage/settingspublic Allow: /cart$ Disallow: /account Disallow: */*?* Disallow: /*search* Disallow: /ch
История проверок
| Дата | Балл | ИИ-ботов видят |
|---|---|---|
| 30 октября в 22:48 | 88 | 11 |
| 15 октября в 23:47 | 88 | 11 |
Как мы проверяли
Мы подставляем подпись бота, но не его IP-адрес. Поэтому отчёт показывает, как сайт видит агент без проверки IP. Если антибот пропускает ботов по IP-адресам (так часто делают для Googlebot и YandexBot), реальная картина для этих ботов может быть лучше. Точную картину дают только логи сервера.
Проверяли с сервера в России. Наш сканер представляется как AICrawl/1.0 (+https://ai-crawl.app/about) и соблюдает robots.txt. Подписи ИИ-ботов используются только для одного запроса к главной странице. Капчи и защиту мы не обходим, а только фиксируем. Подробнее о методике.
Другие проверенные сайты
- 87 ushatava.ruИИ видят 12 из 12 · 30 окт
- 90 lime-shop.comИИ видят 12 из 12 · 30 окт
- 91 amdg.ruИИ видят 12 из 12 · 30 окт
- 85 kinopoisk.ruИИ видят 10 из 12 · 30 окт
- 41 sberbank.ruИИ видят 1 из 12 · 30 окт
- 94 pikabu.ruИИ видят 12 из 12 · 30 окт
- 97 ingate.ruИИ видят 12 из 12 · 30 окт
- 30 avito.ruИИ видят 0 из 12 · 30 окт
Это ваш сайт? Вы можете убрать эту страницу или запретить наш сканер в robots.txt.