На главную Инструменты Панель оптимизатора

Новости Реклама у нас Обратная связь

Бесплатная доска объявлений по всей России - Do-Ska.ru

15.06.2015 в 17:02 Открытия панели отпимизатора!

Google pr	16.06.2015

Яндекс ТиЦ	25.06.2019
поиск	28.06.2019
каталог	16.01.2018

Витрина ссылок[Добавить]

доска объявлений подать объявление Аквалайн Пермь

Анализ сайта

Войти или зарегистрироваться

Забыли пароль?

Главная Инструменты Анализ сайта

Данный инструмент поможет Вам Выполнить анализ сайта по наиболее значимым показателям сайта.

URL	toce.ru (WHOIS IP, WHOIS DOMAIN)
Заголовок	«ТОСЁ» - вкусные роллы в Самаре. Бесплатная доставка роллов. Японский ресторан в Самаре
Ключевые слова	японский ресторан, доставка роллов, суши, японская кухня
Описание	Доставка роллов и суши в Самаре: ☎ +7 846 202-22-23. Бесплатная доставка еды: пицца суши роллы на дом, на корпоратив, в офис. Вкусные роллы в Самаре, заказать прямо сейчас
Тэг h1	«ТОСЁ» – японский ресторан в Самаре
Размер страницы	205.51 Kb
Кодировка	UTF-8
IP сайта	45.130.41.252 Все сайты на IP
Скорость загрузки	164.14 Kb/s
Время загрузки	1.25 sec
Перенаправление	https://toce.ru/
Внутренние / внешние ссылки	Анализ
Анализ контента страницы	Выполнить
Посетителей за сутки по LI	?
Посетителей за месяц по LI	?
Сервер сайта	ssl.carp.beget.com
Расположение датацентра	Russia
Сервер	nginx-reuseport/1.21.1
Заработок	Вы можете зарабатывать на сайте более 150$

Постоянная ссылка на страницу

http://qoogoo.perm.ru/tools/analysis/toce.ru

Основные показатели сайта[ Скрыть ]

Яндекс ТиЦ: 0

Склей домена: Нет

С WWW

Без WWW

Яндекс Ранг: 0 из 6

Яндекс.Каталог: (не описан в каталоге)

Поднять ТиЦ регистрируя сайт в каталогах

Google PageRank: 0 из 10

Alexa Traffic Rank: ?

Alexa Traffic Rank (график):

Счетчик Live Internet:

Общие данные сайта[ Скрыть ]

Поддержка JavaScript отключена!

Поисковый трафик с Google[ Скрыть ]

Backlink History (Majestic SEO)[ Скрыть ]

Наличие сайта в каталогах[ Скрыть ]

Яндекс Каталог: (Нет)	Посмотреть	DMOZ:	Посмотреть
Google каталог:	Посмотреть	Mail.ru:	Посмотреть
Aport:	Посмотреть	Rambler Top 100:	Посмотреть

Проиндексировано страниц[ Скрыть ]

Яндекс:	Посмотреть	Google:	Посмотреть
Bing:	Посмотреть	Yahoo:	Посмотреть
Rambler:	Посмотреть

Ссылаются на сайт из[ Скрыть ]

Яндекс:	Посмотреть	Сайты из Я-Каталога:	Посмотреть
Яндекс блоги:	Посмотреть	Google:	Посмотреть
Google блоги:	Посмотреть	Yahoo:	Посмотреть
Bing:	Посмотреть	Rambler:	Посмотреть
Яндекс картинки:	Посмотреть	Google картинки:	Посмотреть

Дополнительная информация[ Скрыть ]

В кэше Google:	Посмотреть	В кэше Yandex:	Посмотреть
Похожие сайты в Google:	Посмотреть	История сайта:	Посмотреть
Упоминания в Ответы@Mail.ru:	Посмотреть	Поиск плагиата:	Посмотреть

Дополнительные инструменты[ Скрыть ]

Проверка валидности HTML:	Посмотреть	Проверка валидности CSS:	Посмотреть
Ping\Traceroute\DNS:	Посмотреть	Скорость загрузки страницы:	Посмотреть

Данные страницы[ Скрыть ]

Ответ сервера

Файл robots.txt, размер: 19.42 Kb , проверить на Яндекс.Вебмастер

User-Agent: *
Disallow: */index.php$
Disallow: /bitrix/
Disallow: /personal/
Disallow: */cgi-bin/
Disallow: /local/
Disallow: /test/
Disallow: /*show_include_exec_time=
Disallow: /*show_page_exec_time=
Disallow: /*show_sql_stat=
Disallow: /*bitrix_include_areas=
Disallow: /*clear_cache=
Disallow: /*clear_cache_session=
Disallow: /*ADD_TO_COMPARE_LIST
Disallow: /*ORDER_BY
Disallow: /*?print=
Disallow: /*?list_style=
Disallow: /*?sort=
Disallow: /*sort_by=
Disallow: /*?set_filter=
Disallow: /*?arrFilter=
Disallow: /*?order=
Disallow: /*&print=
Disallow: /*print_course=
Disallow: /*?action=
Disallow: /*&action=
Disallow: /*register=
Disallow: /*forgot_password=
Disallow: /*change_password=
Disallow: /*login=
Disallow: /*logout=
Disallow: /*auth=
Disallow: */auth/
Disallow: /*backurl=
Disallow: /*back_url=
Disallow: /*BACKURL=
Disallow: /*BACK_URL=
Disallow: /*back_url_admin*
Disallow: /*?utm_source=
Disallow: */order/
Disallow: /*download
Disallow: /test.php
Disallow: */filter/*/apply/
Disallow: /*setreg=
Disallow: /*logout
Disallow: */filter/
Disallow: /*sphrase_id
Disallow: */search/
Disallow: /*type=
Disallow: /*?product_id=
Disallow: /*?display=
Disallow: /*?view_mode=
Disallow: /*view=
Disallow: /*min_price=
Disallow: /*max_price=
Disallow: /*&page=
Disallow: /*?path=
Disallow: /*?route=
Disallow: /*?products_on_page=
Disallow: /*?PAGEN_1=1$
Disallow: /*?PAGEN_1=1/$
Disallow: /*?new=
Disallow: /*?edit=
Disallow: /*?preview=
Disallow: /*SHOWALL=
Disallow: /*SHOW_ALL=
Disallow: /*SHOWBY=
Disallow: /*SPHRASE_ID=
Disallow: /*TYPE=
Disallow: /*?utm*=
Disallow: /*&utm*=
Disallow: /*?VIEW=
Disallow: /*?SORT_TO=
Disallow: /*?SORT_FIELD=
Disallow: /*set_filter=
Disallow: */auth.php
Disallow: /*?alfaction=
Disallow: /*?oid=
Disallow: /*?name=
Disallow: /*?form_id=
Disallow: /*&form_id=
Disallow: /*?bxajaxid=
Disallow: /*&bxajaxid=
Disallow: /*?view_result=
Disallow: /*&view_result=
Disallow: */resize_cache/
Disallow: /*?linerow=
Disallow: /bitrix/panel/
Disallow: *?sort_ord=
Disallow: *?sort_dir=
Disallow: *?category_id=
Disallow: *?item_id=
Disallow: *?pn_pr=
Disallow: *?page=
Disallow: *?tab=
Disallow: *?display=
Disallow: *?linerow=
Disallow: *?year=
Disallow: *?oid=
Disallow: */filter/
Disallow: *showElements*
Disallow: *PAGEN_2*
Disallow: *?ORDER_ID=
Disallow: *how=*
Disallow: */form/?name=
Disallow: *?name=
Disallow: /*gclid*
Disallow: /*yclid*
Disallow: /*ymclid*
Disallow: /test*
Disallow: /404.php
Disallow: /api/*
Disallow: /*?RID*
Disallow: *?preview=
Disallow: *bitrix_*=
Disallow: *auth=
Disallow: /*?tag
Disallow: /*set_filter*
Disallow: /*?showElements=
Disallow: /*?tid*
Disallow: /*&tid*
Disallow: *?FILTER*=
Disallow: *?ei=
Disallow: *?p=
Disallow: *?q=
Disallow: *?tags=
Disallow: *B_ORDER=
Disallow: *BRAND=
Disallow: *CLEAR_CACHE=
Disallow: *SECTION_ID=
Disallow: *section_id=
Disallow: *SECTION[*]=
Disallow: *SHOW_ALL=
Disallow: *SHOWBY=
Disallow: *SORT=
Disallow: *SPHRASE_ID=
Disallow: *TYPE=
Disallow: /*?from*
Disallow: /*&from*
Disallow: /*block=*
Disallow: *r1=
Disallow: */?_ym_debug
Disallow: */apply/*
Disallow: *&by*
Disallow: *?by*
Disallow: *?id=*
Disallow: *?a=*
Disallow: *?amp*
Disallow: *IBLOCK_ID=*
Disallow: *RESULT_ID=*
Disallow: *PROPERTY=*
Disallow: *IN_STOCK=*
Disallow: *SECTION_CODE=*
Disallow: *SIZE=*
Disallow: *added=*
Disallow: *position=*
Disallow: *callibri=*
Disallow: *gtm_debug=*
Disallow: *placement=*
Disallow: *source=*
Disallow: *&adv=*
Disallow: *?adv=*
Disallow: *option=*
Disallow: *?hhtmFrom=*
Disallow: *?_r=*
Disallow: *sort_order=*
Allow: /upload/*
Allow: /bitrix/catalog_export/*.xml
Allow: /bitrix/components/
Allow: /bitrix/cache/
Allow: /bitrix/js/
Allow: /bitrix/templates/
Allow: /bitrix/*.js
Allow: /bitrix/*.css
Allow: /local/components/
Allow: /local/cache/
Allow: /local/js/
Allow: /local/templates/
Allow: /local/*.js
Allow: /local/*.css
Allow: /local/*.jpg
Allow: /local/*.jpeg
Allow: /local/*.png
Allow: /local/*.gif
Crawl-delay: 30
Sitemap: https://toce.ru/sitemap.xml
Sitemap: http://toce.ru/sitemap.xml

User-Agent: Yandex
Disallow: */index.php$
Disallow: /bitrix/
Disallow: /personal/
Disallow: */cgi-bin/
Disallow: /local/
Disallow: /test/
Disallow: /*show_include_exec_time=
Disallow: /*show_page_exec_time=
Disallow: /*show_sql_stat=
Disallow: /*bitrix_include_areas=
Disallow: /*clear_cache=
Disallow: /*clear_cache_session=
Disallow: /*ADD_TO_COMPARE_LIST
Disallow: /*ORDER_BY
Disallow: /*?print=
Disallow: /*?list_style=
Disallow: /*?sort=
Disallow: /*sort_by=
Disallow: /*?set_filter=
Disallow: /*?arrFilter=
Disallow: /*?order=
Disallow: /*&print=
Disallow: /*print_course=
Disallow: /*?action=
Disallow: /*&action=
Disallow: /*register=
Disallow: /*forgot_password=
Disallow: /*change_password=
Disallow: /*login=
Disallow: /*logout=
Disallow: /*auth=
Disallow: */auth/
Disallow: /*backurl=
Disallow: /*back_url=
Disallow: /*BACKURL=
Disallow: /*BACK_URL=
Disallow: /*back_url_admin*
Disallow: /*?utm_source=
Disallow: */order/
Disallow: /*download
Disallow: /test.php
Disallow: */filter/*/apply/
Disallow: /*setreg=
Disallow: /*logout
Disallow: */filter/
Disallow: /*sphrase_id
Disallow: */search/
Disallow: /*type=
Disallow: /*?product_id=
Disallow: /*?display=
Disallow: /*?view_mode=
Disallow: /*view=
Disallow: /*min_price=
Disallow: /*max_price=
Disallow: /*&page=
Disallow: /*?path=
Disallow: /*?route=
Disallow: /*?products_on_page=
Disallow: /*?PAGEN_1=1$
Disallow: /*?PAGEN_1=1/$
Disallow: /*?new=
Disallow: /*?edit=
Disallow: /*?preview=
Disallow: /*SHOWALL=
Disallow: /*SHOW_ALL=
Disallow: /*SHOWBY=
Disallow: /*SPHRASE_ID=
Disallow: /*TYPE=
Disallow: /*?utm*=
Disallow: /*&utm*=
Disallow: /*?VIEW=
Disallow: /*?SORT_TO=
Disallow: /*?SORT_FIELD=
Disallow: /*set_filter=
Disallow: */auth.php
Disallow: /*?alfaction=
Disallow: /*?oid=
Disallow: /*?name=
Disallow: /*?form_id=
Disallow: /*&form_id=
Disallow: /*?bxajaxid=
Disallow: /*&bxajaxid=
Disallow: /*?view_result=
Disallow: /*&view_result=
Disallow: */resize_cache/
Disallow: /*?linerow=
Disallow: /bitrix/panel/
Disallow: *?sort_ord=
Disallow: *?sort_dir=
Disallow: *?category_id=
Disallow: *?item_id=
Disallow: *?pn_pr=
Disallow: *?page=
Disallow: *?tab=
Disallow: *?display=
Disallow: *?linerow=
Disallow: *?year=
Disallow: *?oid=
Disallow: */filter/
Disallow: *showElements*
Disallow: *PAGEN_2*
Disallow: *?ORDER_ID=
Disallow: *how=*
Disallow: */form/?name=
Disallow: *?name=
Disallow: /*gclid*
Disallow: /*yclid*
Disallow: /*ymclid*
Disallow: /test*
Disallow: /404.php
Disallow: /api/*
Disallow: /*?RID*
Disallow: *?preview=
Disallow: *bitrix_*=
Disallow: *auth=
Disallow: /*?tag
Disallow: /*set_filter*
Disallow: /*?showElements=
Disallow: /*?tid*
Disallow: /*&tid*
Disallow: *?FILTER*=
Disallow: *?ei=
Disallow: *?p=
Disallow: *?q=
Disallow: *?tags=
Disallow: *B_ORDER=
Disallow: *BRAND=
Disallow: *CLEAR_CACHE=
Disallow: *SECTION_ID=
Disallow: *section_id=
Disallow: *SECTION[*]=
Disallow: *SHOW_ALL=
Disallow: *SHOWBY=
Disallow: *SORT=
Disallow: *SPHRASE_ID=
Disallow: *TYPE=
Disallow: /*?from*
Disallow: /*&from*
Disallow: /*block=*
Disallow: *r1=
Disallow: */?_ym_debug
Disallow: */apply/*
Disallow: *&by*
Disallow: *?by*
Disallow: *?id=*
Disallow: *?a=*
Disallow: *?amp*
Disallow: *IBLOCK_ID=*
Disallow: *RESULT_ID=*
Disallow: *PROPERTY=*
Disallow: *IN_STOCK=*
Disallow: *SECTION_CODE=*
Disallow: *SIZE=*
Disallow: *added=*
Disallow: *position=*
Disallow: *callibri=*
Disallow: *gtm_debug=*
Disallow: *placement=*
Disallow: *source=*
Disallow: *&adv=*
Disallow: *?adv=*
Disallow: *option=*
Disallow: *?hhtmFrom=*
Disallow: *?_r=*
Disallow: *sort_order=*
Allow: /upload/*
Allow: /bitrix/catalog_export/*.xml
Allow: /bitrix/components/
Allow: /bitrix/cache/
Allow: /bitrix/js/
Allow: /bitrix/templates/
Allow: /bitrix/*.js
Allow: /bitrix/*.css
Allow: /local/components/
Allow: /local/cache/
Allow: /local/js/
Allow: /local/templates/
Allow: /local/*.js
Allow: /local/*.css
Allow: /local/*.jpg
Allow: /local/*.jpeg
Allow: /local/*.png
Allow: /local/*.gif
Host: https://toce.ru
Sitemap: https://toce.ru/sitemap.xml
Clean-param: show_include_exec_time&show_page_exec_time&show_sql_stat&bitrix_include_areas&clear_cache&clear_cache_session&ADD_TO_COMPARE_LIST&ORDER_BY&print&list_style&sort&sort_by&set_filter&arrFilter
Clean-param: order&print_course&action®ister&forgot_password&change_password&login&logout&auth&backurl&back_url&BACKURL&BACK_URL&back_url_admin&utm_source&download&setreg&logout&sphrase_id&type&product_id
Clean-param: display&view_mode&view&min_price&max_price&page&path&route&products_on_page&PAGEN_1=1&new&edit&preview&SHOWALL&SHOW_ALL&SHOWBY&SPHRASE_ID&TYPE&utm&VIEW&SORT_TO&SORT_FIELD&set_filter&alfaction
Clean-param: oid&name&form_id&bxajaxid&bxajaxid&view_result&view_result&resize_cache&linerow&sort_ord&sort_dir&category_id&item_id&pn_pr&page&tab&display&linerow&year&oid&showElements&PAGEN_2&ORDER_ID&how
Clean-param: name&gclid&yclid&ymclid&RID&preview&bitrix_&auth&tag&set_filter&showElements&tid&FILTER&ei&p&q&tags&B_ORDER&BRAND&CLEAR_CACHE&SECTION_ID§ion_id&SHOW_ALL&SHOWBY&SORT&SPHRASE_ID&TYPE&from&block
Clean-param: r1&_ym_debug&by&id&a&&IBLOCK_ID&RESULT_ID&PROPERTY&IN_STOCK&SECTION_CODE&sort_order&_r&option&adv&source&placement>m_debug&callibri&position&added&SIZE

User-Agent: Googlebot
Disallow: */index.php$
Disallow: /bitrix/
Disallow: /personal/
Disallow: */cgi-bin/
Disallow: /local/
Disallow: /test/
Disallow: /*show_include_exec_time=
Disallow: /*show_page_exec_time=
Disallow: /*show_sql_stat=
Disallow: /*bitrix_include_areas=
Disallow: /*clear_cache=
Disallow: /*clear_cache_session=
Disallow: /*ADD_TO_COMPARE_LIST
Disallow: /*ORDER_BY
Disallow: /*?print=
Disallow: /*?list_style=
Disallow: /*?sort=
Disallow: /*sort_by=
Disallow: /*?set_filter=
Disallow: /*?arrFilter=
Disallow: /*?order=
Disallow: /*&print=
Disallow: /*print_course=
Disallow: /*?action=
Disallow: /*&action=
Disallow: /*register=
Disallow: /*forgot_password=
Disallow: /*change_password=
Disallow: /*login=
Disallow: /*logout=
Disallow: /*auth=
Disallow: */auth/
Disallow: /*backurl=
Disallow: /*back_url=
Disallow: /*BACKURL=
Disallow: /*BACK_URL=
Disallow: /*back_url_admin*
Disallow: /*?utm_source=
Disallow: */order/
Disallow: /*download
Disallow: /test.php
Disallow: */filter/*/apply/
Disallow: /*setreg=
Disallow: /*logout
Disallow: */filter/
Disallow: /*sphrase_id
Disallow: */search/
Disallow: /*type=
Disallow: /*?product_id=
Disallow: /*?display=
Disallow: /*?view_mode=
Disallow: /*view=
Disallow: /*min_price=
Disallow: /*max_price=
Disallow: /*&page=
Disallow: /*?path=
Disallow: /*?route=
Disallow: /*?products_on_page=
Disallow: /*?PAGEN_1=1$
Disallow: /*?PAGEN_1=1/$
Disallow: /*?new=
Disallow: /*?edit=
Disallow: /*?preview=
Disallow: /*SHOWALL=
Disallow: /*SHOW_ALL=
Disallow: /*SHOWBY=
Disallow: /*SPHRASE_ID=
Disallow: /*TYPE=
Disallow: /*?utm*=
Disallow: /*&utm*=
Disallow: /*?VIEW=
Disallow: /*?SORT_TO=
Disallow: /*?SORT_FIELD=
Disallow: /*set_filter=
Disallow: */auth.php
Disallow: /*?alfaction=
Disallow: /*?oid=
Disallow: /*?name=
Disallow: /*?form_id=
Disallow: /*&form_id=
Disallow: /*?bxajaxid=
Disallow: /*&bxajaxid=
Disallow: /*?view_result=
Disallow: /*&view_result=
Disallow: */resize_cache/
Disallow: /*?linerow=
Disallow: /bitrix/panel/
Disallow: *?sort_ord=
Disallow: *?sort_dir=
Disallow: *?category_id=
Disallow: *?item_id=
Disallow: *?pn_pr=
Disallow: *?page=
Disallow: *?tab=
Disallow: *?display=
Disallow: *?linerow=
Disallow: *?year=
Disallow: *?oid=
Disallow: */filter/
Disallow: *showElements*
Disallow: *PAGEN_2*
Disallow: *?ORDER_ID=
Disallow: *how=*
Disallow: */form/?name=
Disallow: *?name=
Disallow: /*gclid*
Disallow: /*yclid*
Disallow: /*ymclid*
Disallow: /test*
Disallow: /404.php
Disallow: /api/*
Disallow: /*?RID*
Disallow: *?preview=
Disallow: *bitrix_*=
Disallow: *auth=
Disallow: /*?tag
Disallow: /*set_filter*
Disallow: /*?showElements=
Disallow: /*?tid*
Disallow: /*&tid*
Disallow: *?FILTER*=
Disallow: *?ei=
Disallow: *?p=
Disallow: *?q=
Disallow: *?tags=
Disallow: *B_ORDER=
Disallow: *BRAND=
Disallow: *CLEAR_CACHE=
Disallow: *SECTION_ID=
Disallow: *section_id=
Disallow: *SECTION[*]=
Disallow: *SHOW_ALL=
Disallow: *SHOWBY=
Disallow: *SORT=
Disallow: *SPHRASE_ID=
Disallow: *TYPE=
Disallow: /*?from*
Disallow: /*&from*
Disallow: /*block=*
Disallow: *r1=
Disallow: */?_ym_debug
Disallow: */apply/*
Disallow: *&by*
Disallow: *?by*
Disallow: *?id=*
Disallow: *?a=*
Disallow: *?amp*
Disallow: *IBLOCK_ID=*
Disallow: *RESULT_ID=*
Disallow: *PROPERTY=*
Disallow: *IN_STOCK=*
Disallow: *SECTION_CODE=*
Disallow: *SIZE=*
Disallow: *added=*
Disallow: *position=*
Disallow: *callibri=*
Disallow: *gtm_debug=*
Disallow: *placement=*
Disallow: *source=*
Disallow: *&adv=*
Disallow: *?adv=*
Disallow: *option=*
Disallow: *?hhtmFrom=*
Disallow: *?_r=*
Disallow: *sort_order=*
Allow: /upload/*
Allow: /bitrix/catalog_export/*.xml
Allow: /bitrix/components/
Allow: /bitrix/cache/
Allow: /bitrix/js/
Allow: /bitrix/templates/
Allow: /bitrix/*.js
Allow: /bitrix/*.css
Allow: /local/components/
Allow: /local/cache/
Allow: /local/js/
Allow: /local/templates/
Allow: /local/*.js
Allow: /local/*.css
Allow: /local/*.jpg
Allow: /local/*.jpeg
Allow: /local/*.png
Allow: /local/*.gif

User-Agent: SemrushBot
Disallow: /

User-Agent: MJ12bot
Disallow: /

User-Agent: AhrefsBot
Disallow: /

User-Agent: gigabot
Disallow: /

User-Agent: Gigabot/2.0
Disallow: /

User-Agent: msnbot
Disallow: /

User-Agent: msnbot/1.0
Disallow: /

User-Agent: ia_archiver
Disallow: /

User-Agent: libwww-perl
Disallow: /

User-Agent: NetStat.Ru Agent
Disallow: /

User-Agent: WebAlta Crawler/1.3.25
Disallow: /

User-Agent: Yahoo!-MMCrawler/3.x
Disallow: /

User-Agent: MMCrawler/3.x
Disallow: /

User-Agent: NG/2.0
Disallow: /

User-Agent: slurp
Disallow: /

User-Agent: aipbot
Disallow: /

User-Agent: Alexibot
Disallow: /

User-Agent: GameSpyHTTP/1.0
Disallow: /

User-Agent: Aqua_Products
Disallow: /

User-Agent: asterias
Disallow: /

User-Agent: b2w/0.1
Disallow: /

User-Agent: BackDoorBot/1.0
Disallow: /

User-Agent: becomebot
Disallow: /

User-Agent: BlowFish/1.0
Disallow: /

User-Agent: Bookmark search tool
Disallow: /

User-Agent: BotALot
Disallow: /

User-Agent: BotRightHere
Disallow: /

User-Agent: BuiltBotTough
Disallow: /

User-Agent: Bullseye/1.0
Disallow: /

User-Agent: BunnySlippers
Disallow: /

User-Agent: CheeseBot
Disallow: /

User-Agent: CherryPicker
Disallow: /

User-Agent: CherryPickerElite/1.0
Disallow: /

User-Agent: CherryPickerSE/1.0
Disallow: /

User-Agent: Copernic
Disallow: /

User-Agent: CopyRightCheck
Disallow: /

User-Agent: cosmos
Disallow: /

User-Agent: Crescent
Disallow: /

User-Agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
Disallow: /

User-Agent: DittoSpyder
Disallow: /

User-Agent: EmailCollector
Disallow: /
Disallow: /

User-Agent: EmailSiphon
Disallow: /
Disallow: /

User-Agent: EmailWolf
Disallow: /

User-Agent: EroCrawler
Disallow: /

User-Agent: ExtractorPro
Disallow: /

User-Agent: FairAd Client
Disallow: /

User-Agent: Fasterfox
Disallow: /

User-Agent: Flaming AttackBot
Disallow: /

User-Agent: Foobot
Disallow: /

User-Agent: Gaisbot
Disallow: /

User-Agent: GetRight/4.2
Disallow: /

User-Agent: Harvest/1.5
Disallow: /

User-Agent: hloader
Disallow: /

User-Agent: httplib
Disallow: /

User-Agent: HTTrack 3.0
Disallow: /

User-Agent: humanlinks
Disallow: /

User-Agent: IconSurf
Disallow: /

User-Agent: InfoNaviRobot
Disallow: /

User-Agent: Iron33/1.0.2
Disallow: /

User-Agent: JennyBot
Disallow: /

User-Agent: Kenjin Spider
Disallow: /

User-Agent: Keyword Density/0.9
Disallow: /

User-Agent: larbin
Disallow: /

User-Agent: LexiBot
Disallow: /

User-Agent: libWeb/clsHTTP
Disallow: /

User-Agent: LinkextractorPro
Disallow: /

User-Agent: LinkScan/8.1a Unix
Disallow: /

User-Agent: LinkWalker
Disallow: /

User-Agent: LNSpiderguy
Disallow: /

User-Agent: lwp-trivial
Disallow: /

User-Agent: lwp-trivial/1.34
Disallow: /

User-Agent: Mata Hari
Disallow: /

User-Agent: Microsoft URL Control
Disallow: /

User-Agent: Microsoft URL Control - 5.01.4511
Disallow: /

User-Agent: Microsoft URL Control - 6.00.8169
Disallow: /

User-Agent: MIIxpc
Disallow: /

User-Agent: MIIxpc/4.2
Disallow: /

User-Agent: Mister PiX
Disallow: /

User-Agent: moget
Disallow: /

User-Agent: moget/2.1
Disallow: /

User-Agent: MSIECrawler
Disallow: /

User-Agent: NetAnts
Disallow: /

User-Agent: NICErsPRO
Disallow: /

User-Agent: Offline Explorer
Disallow: /

User-Agent: Openbot
Disallow: /

User-Agent: Openfind
Disallow: /

User-Agent: Openfind data gatherer
Disallow: /

User-Agent: Oracle Ultra Search
Disallow: /

User-Agent: PerMan
Disallow: /

User-Agent: ProPowerBot/2.14
Disallow: /

User-Agent: ProWebWalker
Disallow: /

User-Agent: psbot
Disallow: /

User-Agent: Python-urllib
Disallow: /

User-Agent: QueryN Metasearch
Disallow: /

User-Agent: Radiation Retriever 1.1
Disallow: /

User-Agent: RepoMonkey
Disallow: /

User-Agent: RepoMonkey Bait & Tackle/v1.01
Disallow: /

User-Agent: RMA
Disallow: /

User-Agent: searchpreview
Disallow: /

User-Agent: SiteSnagger
Disallow: /

User-Agent: SpankBot
Disallow: /

User-Agent: spanner
Disallow: /

User-Agent: SurveyBot
Disallow: /

User-Agent: suzuran
Disallow: /

User-Agent: Szukacz/1.4
Disallow: /

User-Agent: Teleport
Disallow: /

User-Agent: TeleportPro
Disallow: /

User-Agent: Telesoft
Disallow: /

User-Agent: The Intraformant
Disallow: /

User-Agent: TheNomad
Disallow: /

User-Agent: TightTwatBot
Disallow: /

User-Agent: toCrawl/UrlDispatcher
Disallow: /

User-Agent: True_Robot
Disallow: /

User-Agent: True_Robot/1.0
Disallow: /

User-Agent: turingos
Disallow: /

User-Agent: TurnitinBot
Disallow: /

User-Agent: TurnitinBot/1.5
Disallow: /

User-Agent: URL Control
Disallow: /

User-Agent: URL_Spider_Pro
Disallow: /

User-Agent: URLy Warning
Disallow: /

User-Agent: VCI
Disallow: /

User-Agent: VCI WebViewer VCI WebViewer Win32
Disallow: /

User-Agent: Web Image Collector
Disallow: /

User-Agent: WebAuto
Disallow: /

User-Agent: WebBandit
Disallow: /

User-Agent: WebBandit/3.50
Disallow: /

User-Agent: WebCapture 2.0
Disallow: /

User-Agent: WebCopier
Disallow: /

User-Agent: WebCopier v.2.2
Disallow: /

User-Agent: WebCopier v3.2a
Disallow: /

User-Agent: WebEnhancer
Disallow: /

User-Agent: WebSauger
Disallow: /

User-Agent: Website Quester
Disallow: /

User-Agent: Webster Pro
Disallow: /

User-Agent: WebStripper
Disallow: /

User-Agent: WebZip
Disallow: /
Disallow: /

User-Agent: WebZip/4.0
Disallow: /

User-Agent: WebZIP/4.21
Disallow: /

User-Agent: WebZIP/5.0
Disallow: /

User-Agent: Wget
Disallow: /

User-Agent: wget
Disallow: /

User-Agent: Wget/1.5.3
Disallow: /

User-Agent: Wget/1.6
Disallow: /

User-Agent: WWW-Collector-E
Disallow: /

User-Agent: Xenu's
Disallow: /

User-Agent: Xenu's Link Sleuth 1.1c
Disallow: /

User-Agent: Zeus
Disallow: /

User-Agent: Zeus 32297 Webster Pro V2.9 Win32
Disallow: /

User-Agent: Zeus Link Scout
Disallow: /