На главную Инструменты Панель оптимизатора

Новости Реклама у нас Обратная связь

Бесплатная доска объявлений по всей России - Do-Ska.ru

15.06.2015 в 17:02 Открытия панели отпимизатора!

Google pr	16.06.2015

Яндекс ТиЦ	22.03.2025
поиск	28.06.2019
каталог	16.01.2018

Витрина ссылок[Добавить]

доска объявлений подать объявление Аквалайн Пермь

Анализ сайта

Войти или зарегистрироваться

Забыли пароль?

Главная Инструменты Анализ сайта

Данный инструмент поможет Вам Выполнить анализ сайта по наиболее значимым показателям сайта.

URL	abdulibrahim.com (WHOIS IP, WHOIS DOMAIN)
Заголовок	Freelance Web Developer – Abdul – Just another WordPress site
Ключевые слова	(нет)
Описание	(нет)
Тэг h1	(нет)
Размер страницы	32.89 Kb
Кодировка	UTF-8
IP сайта	142.44.210.104 Все сайты на IP
Скорость загрузки	7.4 Kb/s
Время загрузки	4.45 sec
Перенаправление	https://www.abdulibrahim.com/
Внутренние / внешние ссылки	Анализ
Анализ контента страницы	Выполнить
Посетителей за сутки по LI	?
Посетителей за месяц по LI	?
Сервер сайта	vps-27cf5c09.vps.ovh.ca
Расположение датацентра	Canada
Сервер	Apache
Заработок	Вы можете зарабатывать на сайте более 150$

Постоянная ссылка на страницу

http://qoogoo.perm.ru/tools/analysis/abdulibrahim.com

Основные показатели сайта[ Скрыть ]

Яндекс ТиЦ: 0

Склей домена: Нет

С WWW

Без WWW

Яндекс Ранг: 0 из 6

Яндекс.Каталог: (не описан в каталоге)

Поднять ТиЦ регистрируя сайт в каталогах

Google PageRank: 0 из 10

Alexa Traffic Rank: ?

Alexa Traffic Rank (график):

Счетчик Live Internet:

Общие данные сайта[ Скрыть ]

Поддержка JavaScript отключена!

Поисковый трафик с Google[ Скрыть ]

Backlink History (Majestic SEO)[ Скрыть ]

Наличие сайта в каталогах[ Скрыть ]

Яндекс Каталог: (Нет)	Посмотреть	DMOZ:	Посмотреть
Google каталог:	Посмотреть	Mail.ru:	Посмотреть
Aport:	Посмотреть	Rambler Top 100:	Посмотреть

Проиндексировано страниц[ Скрыть ]

Яндекс:	Посмотреть	Google:	Посмотреть
Bing:	Посмотреть	Yahoo:	Посмотреть
Rambler:	Посмотреть

Ссылаются на сайт из[ Скрыть ]

Яндекс:	Посмотреть	Сайты из Я-Каталога:	Посмотреть
Яндекс блоги:	Посмотреть	Google:	Посмотреть
Google блоги:	Посмотреть	Yahoo:	Посмотреть
Bing:	Посмотреть	Rambler:	Посмотреть
Яндекс картинки:	Посмотреть	Google картинки:	Посмотреть

Дополнительная информация[ Скрыть ]

В кэше Google:	Посмотреть	В кэше Yandex:	Посмотреть
Похожие сайты в Google:	Посмотреть	История сайта:	Посмотреть
Упоминания в Ответы@Mail.ru:	Посмотреть	Поиск плагиата:	Посмотреть

Дополнительные инструменты[ Скрыть ]

Проверка валидности HTML:	Посмотреть	Проверка валидности CSS:	Посмотреть
Ping\Traceroute\DNS:	Посмотреть	Скорость загрузки страницы:	Посмотреть

Данные страницы[ Скрыть ]

Ответ сервера

Файл robots.txt, размер: 41.83 Kb , проверить на Яндекс.Вебмастер

# created 29-7-2024
#  https://abdulibrahim.com/  DA 18 PA 38  Spam 5    At 29-7-2024  ( https://letmepost.com/check-da-pa )

User-agent: *
Disallow: /production/

User-Agent: Googlebot
Allow:/

User-agent: Googlebot-Mobile
Allow:/

User-Agent: Googlebot-Video
Allow:/

User-Agent: Storebot-Google 
Allow:/

User-Agent: Mediapartners-Google
Allow:/

User-Agent: AdsBot-Google-Mobile
Allow:/

User-agent: AdsBot-Google
Allow:/

User-agent: Googlebot-Image
Allow:/

User-agent: Bingbot
Allow:/

User-agent: Bingbot
Allow: /

User-agent: Slurp
Allow: /

User-Agent: rogerbot
Disallow: /

User-Agent: dotbot
Disallow: /

User-agent: rogerbot/1.2
Disallow: /
User-agent: DotBot/1.1
Disallow: /

User-agent: dotbot
Disallow: /
User-agent: rogerbot
Disallow: /

User-agent: DotBot
Disallow: /

User-agent: Baiduspider
Disallow: /
User-agent: AhrefsBot
Disallow:/

User-agent: amazonbot
Disallow: /

User-agent: SemrushBot
Disallow: /
User-agent: yandex
Disallow: /

User-agent: MJ12bot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-SA
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: Bingbot
Allow: /

User-agent: msnbot
Allow: /

User-agent: adidxbot
Allow: /

User-Agent: rogerbot
Disallow: /

User-Agent: dotbot
Disallow: /

User-agent: dotbot
Disallow: /
User-agent: rogerbot
Disallow: /

User-agent: Baiduspider
Disallow: /
User-agent: AhrefsBot
Disallow:/
User-agent: seekport
Disallow: /
User-agent: Swiftbot
Disallow: /
User-agent: amazonbot
Disallow: /
User-agent: PaperLiBot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: yandex
Disallow: /
User-agent: garlik
Disallow: /
User-agent: hypefactors
Disallow: /
User-agent: weborama
Disallow: /
User-agent: dotbot
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: rogerbot/1.2
Disallow: /
User-agent: DotBot/1.1
Disallow: /
User-agent: sitecheck.internetseer.com
Disallow: /
User-agent: Zealbot
Disallow: /
User-agent: MSIECrawler
Disallow: /
User-agent: SiteSnagger
Disallow: /
User-agent: WebStripper
Disallow: /
User-agent: WebCopier
Disallow: /
User-agent: Fetch
Disallow: /
User-agent: Offline Explorer
Disallow: /
User-agent: Teleport
Disallow: /
User-agent: TeleportPro
Disallow: /
User-agent: WebZIP
Disallow: /
User-agent: linko
Disallow: /
User-agent: HTTrack
Disallow: /
User-agent: Microsoft.URL.Control
Disallow: /
User-agent: Xenu
Disallow: /
User-agent: larbin
Disallow: /
User-agent: libwww
Disallow: /
User-agent: ZyBORG
Disallow: /
User-agent: Download Ninja
Disallow: /
User-agent: grub-client
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: SEOkicks-Robot
Disallow: /
User-agent: SearchmetricsBot
Disallow: /
User-agent: seoscanners.net
Disallow: /

User-agent: MetaJobBot
Disallow: /

User-agent: Spiderbot
Disallow: /

User-agent: LinkStats
Disallow: /

User-agent: JobboerseBot
Disallow: /

User-agent: ICCrawler
Disallow: /

User-agent: Plista
Disallow: /
User-agent: WBSearchBot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SemrushBot-SA
Disallow: /

User-agent: Monsidobot 
Disallow: /

User-agent: MJ12bot
Disallow: /

# does not respect robots.txt, must be ip blocked
User-agent: SemrushBot
Disallow: /

# does not respect robots.txt, must be ip blocked
User-agent: AhrefsBot
Disallow: /

User-agent: DotBot
Disallow: /

User-agent: MegaIndex.ru
Disallow: /

User-agent: SEOkicks-Robot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: Sogou+web+spider
Disallow: /

User-agent: trendictionbot
Disallow: /

User-agent: ScoutJet
Disallow: /

User-agent: Gigabot
Disallow: /

User-agent: GigablasOpenSource
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: R6_CommentReader
Disallow: /

User-agent: coccocbot-web
Disallow: /

User-agent: SeznamBot
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SemrushBot-SA
Disallow: /

User-agent: ChangeDetection
Disallow: /

User-agent: rogerbot
Disallow: /

User-agent: WikiDo
Disallow: /

User-agent: MauiBot
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: BDCbot
Disallow: /

User-agent: brandwatch-crawler
Disallow: /

User-agent: Grammarly
Disallow: /

User-agent: BLEXBot
Disallow: /

#Bad Bots
User-agent: Rogerbot 
Disallow:/
User-agent: Exabot
Disallow:/ 
User-agent: MJ12bot 
Disallow:/
User-agent: Dotbot 
Disallow:/
User-agent: Gigabot 
Disallow:/
User-agent: AhrefsBot 
Disallow:/
User-agent: BlackWidow 
Disallow:/
User-agent: Bot\ [EMAIL="craftbot@yahoo.com"]mailto:craftbot@yahoo.com[/EMAIL]
Disallow:/ 
User-agent: ChinaClaw 
Disallow:/
User-agent: Custo 
Disallow:/
User-agent: DISCo 
Disallow:/
User-agent: Download\ Demon 
Disallow:/
User-agent: eCatch 
Disallow:/
User-agent: EirGrabber 
Disallow:/
User-agent: EmailSiphon 
Disallow:/
User-agent: EmailWolf 
Disallow:/
User-agent: Express\ WebPictures
Disallow:/ 
User-agent: ExtractorPro 
Disallow:/
User-agent: EyeNetIE 
Disallow:/
User-agent: FlashGet 
Disallow:/
User-agent: GetRight 
Disallow:/
User-agent: GetWeb! 
Disallow:/
User-agent: Go!Zilla 
Disallow:/
User-agent: Go-Ahead-Got-It 
Disallow:/
User-agent: GrabNet 
Disallow:/
User-agent: Grafula 
Disallow:/
User-agent: HMView 
Disallow:/
User-agent: HTTrack 
Disallow:/
User-agent: Image\ Stripper 
Disallow:/
User-agent: Image\ Sucker
Disallow:/ 
User-agent: Indy\ Library
Disallow:/
User-agent: InterGET 
Disallow:/
User-agent: Internet\ Ninja
Disallow:/ 
User-agent: JetCar 
Disallow:/
User-agent: JOC\ Web\ Spider 
Disallow:/
User-agent: larbin 
Disallow:/
User-agent: LeechFTP
Disallow:/ 
User-agent: Mass\ Downloader 
Disallow:/
User-agent: MIDown\ tool 
Disallow:/
User-agent: Mister\ PiX 
Disallow:/
User-agent: Navroad 
Disallow:/
User-agent: NearSite 
Disallow:/
User-agent: NetAnts 
Disallow:/
User-agent: NetSpider 
Disallow:/
User-agent: Net\ Vampire
Disallow:/ 
User-agent: NetZIP 
Disallow:/
User-agent: Octopus 
Disallow:/
User-agent: Offline\ Explorer 
Disallow:/
User-agent: Offline\ Navigator 
Disallow:/
User-agent: PageGrabber 
Disallow:/
User-agent: Papa\ Foto 
Disallow:/
User-agent: pavuk 
Disallow:/
User-agent: pcBrowser 
Disallow:/
User-agent: RealDownload 
Disallow:/
User-agent: ReGet 
Disallow:/
User-agent: SiteSnagger 
Disallow:/
User-agent: SmartDownload
Disallow:/ 
User-agent: SuperBot 
Disallow:/
User-agent: SuperHTTP 
Disallow:/
User-agent: Surfbot 
Disallow:/
User-agent: tAkeOut 
Disallow:/
User-agent: Teleport\ Pro 
Disallow:/
User-agent: VoidEYE 
Disallow:/
User-agent: Web\ Image\ Collector
Disallow:/ 
User-agent: Web\ Sucker
Disallow:/ 
User-agent: WebAuto 
Disallow:/
User-agent: WebCopier 
Disallow:/
User-agent: WebFetch 
Disallow:/
User-agent: WebGo\ IS 
Disallow:/
User-agent: WebLeacher 
Disallow:/
User-agent: WebReaper 
Disallow:/
User-agent: WebSauger 
Disallow:/
User-agent: Website\ eXtractor
Disallow:/ 
User-agent: Website\ Quester
Disallow:/ 
User-agent: WebStripper 
Disallow:/
User-agent: WebWhacker 
Disallow:/
User-agent: WebZIP 
Disallow:/
User-agent: Wget 
Disallow:/
User-agent: Widow 
Disallow:/
User-agent: WWWOFFLE 
Disallow:/
User-agent: Xaldon\ WebSpider 
Disallow:/
User-agent: Zeus
Disallow: /
User-agent: libwww-perl
Disallow:/
User-agent: libwwwperl
Disallow:/
User-agent: attach
Disallow:/
User-agent: ASPSeek
Disallow:/
User-agent: appie
Disallow:/
User-agent: AbachoBOT
Disallow:/
User-agent: autoemailspider
Disallow:/
User-agent: anarchie
Disallow:/
User-agent: antibot
Disallow:/
User-agent: asterias
Disallow:/
User-agent: B2w
Disallow:/
User-agent: BackWeb
Disallow:/
User-agent: BackDoorBot
Disallow:/
User-agent: Bandit
Disallow:/
User-agent: BatchFTP
Disallow:/
User-agent: Black\ Hole
Disallow:/
User-agent: Baidu
Disallow:/
User-agent: BlowFish
Disallow:/
User-agent: BuiltBotTough
Disallow:/
User-agent: Bot\ mailto
Disallow:/
User-agent: BotALot
Disallow:/
User-agent: Buddy
Disallow:/
User-agent: Bullseye
Disallow:/
User-agent: bumblebee
Disallow:/
User-agent: BunnySlippers
Disallow:/
User-agent: ClariaBot
Disallow:/
User-agent: curl
Disallow:/
User-agent: clsHTTP
Disallow:/
User-agent: ChinaClaw
Disallow:/
User-agent: CheeseBot
Disallow:/
User-agent: CherryPicker
Disallow:/
User-agent: Crescent
Disallow:/
User-agent: CherryPickerSE
Disallow:/
User-agent: CherryPickerElite
Disallow:/
User-agent: Collector
Disallow:/
User-agent: COAST\ WebMaster
Disallow:/
User-agent: cosmos
Disallow:/
User-agent: CopyRightCheck
Disallow:/
User-agent: ColdFusion
Disallow:/
User-agent: Copier
Disallow:/
User-agent: Crescent
Disallow:/
User-agent: DA
Disallow:/
User-agent: DTS\ Agent
Disallow:/
User-agent: DISCo\ Pump
Disallow:/
User-agent: DittoSpyder
Disallow:/
User-agent: Diamond
Disallow:/
User-agent: Download\ Demon
Disallow:/
User-agent: Download\ Wonder
Disallow:/
User-agent: Downloader
Disallow:/
User-agent: dloader
Disallow:/
User-agent: Drip
Disallow:/
User-agent: eCatch
Disallow:/
User-agent: EirGrabber
Disallow:/
User-agent: Express\ WebPictures
Disallow:/
User-agent: Extreme\ Picture\ Finder
Disallow:/
User-agent: EmailCollector
Disallow:/
User-agent: EmailSiphon
Disallow:/
User-agent: EmailWolf
Disallow:/
User-agent: EasyDL
Disallow:/
User-agent: EirGrabber
Disallow:/
User-agent: EroCrawler
Disallow:/
User-agent: ExtractorPro
Disallow:/
User-agent: EyeNetIE
Disallow:/
User-agent: FAST\ WebCrawler
Disallow:/
User-agent: FileHound
Disallow:/
User-agent: Fetch\ API\ Request
Disallow:/
User-agent: FlashGet
Disallow:/
User-agent: FlickBot
Disallow:/
User-agent: FrontPage
Disallow:/
User-agent: FreeFind.com
Disallow:/
User-agent: GetRight
Disallow:/
User-agent: GetSmart
Disallow:/
User-agent: Generic
Disallow:/
User-agent: Go!Zilla
Disallow:/
User-agent: Go-Ahead-Got-It
Disallow:/
User-agent: gotit
Disallow:/
User-agent: Grabber
Disallow:/
User-agent: GrabNet
Disallow:/
User-agent: Grafula
Disallow:/
User-agent: Gulliver
Disallow:/
User-agent: Harvest
Disallow:/
User-agent: HMView
Disallow:/
User-agent: Heretrix
Disallow:/
User-agent: HitboxDoctor
Disallow:/
User-agent: HTTPapp
Disallow:/
User-agent: HTTrack
Disallow:/
User-agent: HTTPTrack
Disallow:/
User-agent: HTTPviewer
Disallow:/
User-agent: httplib
Disallow:/
User-agent: httpfetcher
Disallow:/
User-agent: httpscraper
Disallow:/
User-agent: hloader
Disallow:/
User-agent: humanlinks
Disallow:/
User-agent: ia_archiver
Disallow:/
User-agent: InterGET
Disallow:/
User-agent: Internet\ Ninja
Disallow:/
User-agent: InfoNaviRobot
Disallow:/
User-agent: InternetSeer.com
Disallow:/
User-agent: Iria
Disallow:/
User-agent: IRLbot
Disallow:/
User-agent: JetCar
Disallow:/
User-agent: JOC
Disallow:/
User-agent: JOC\ Web\ Spider
Disallow:/
User-agent: JoBo
Disallow:/
User-agent: Java
Disallow:/
User-agent: JustView
Disallow:/
User-agent: Jonzilla
Disallow:/
User-agent: JennyBot
Disallow:/
User-agent: Kenjin\ Spider
Disallow:/
User-agent: Keyword\ Density
Disallow:/
User-agent: larbin
Disallow:/
User-agent: LeechFTP
Disallow:/
User-agent: Lachesis
Disallow:/
User-agent: LexiBot
Disallow:/
User-agent: libWeb
Disallow:/
User-agent: Libby_
Disallow:/
User-agent: LinkScan
Disallow:/
User-agent: LinkWalker
Disallow:/
User-agent: LinkextractorPro
Disallow:/
User-agent: lftp
Disallow:/
User-agent: likse
Disallow:/
User-agent: Link
Disallow:/
User-agent: lwp-trivial
Disallow:/
User-agent: lwp\ request
Disallow:/
User-agent: Magnet
Disallow:/
User-agent: Mag-Net
Disallow:/
User-agent: Mass\ Downloader
Disallow:/
User-agent: MIIxpc
Disallow:/
User-agent: Microsoft\ URL\ Control
Disallow:/
User-agent: MSFrontPage
Disallow:/
User-agent: MSIECrawler
Disallow:/
User-agent: MicrosoftURL
Disallow:/
User-agent: Missigua
Disallow:/
User-agent: Mewsoft\ Search\ Engine
Disallow:/
User-agent: moget
Disallow:/
User-agent: Mata\ Hari
Disallow:/
User-agent: Memo
Disallow:/
User-agent: Metacarta
Disallow:/
User-agent: Mercator
Disallow:/
User-agent: MIDown\ tool
Disallow:/
User-agent: MFC_Tear_Sample
Disallow:/
User-agent: Mirror
Disallow:/
User-agent: MIIxpc
Disallow:/
User-agent: Mister\ PiX
Disallow:/
User-agent: NationalDirectory\ WebSpider
Disallow:/
User-agent: NICErsPRO
Disallow:/
User-agent: Nikto
Disallow:/
User-agent: Navroad
Disallow:/
User-agent: NearSite
Disallow:/
User-agent: NetAnts
Disallow:/
User-agent: NetSpider
Disallow:/
User-agent: NICErsPRO
Disallow:/
User-agent: NetResearchServer
Disallow:/
User-agent: NetMechanic
Disallow:/
User-agent: Net\ Vampire
Disallow:/
User-agent: Net\ Probe
Disallow:/
User-agent: NetZip
Disallow:/
User-agent: nexuscache
Disallow:/
User-agent: Ninja
Disallow:/
User-agent: NPBot
Disallow:/
User-agent: our\ agent
Disallow:/
User-agent: onestop
Disallow:/
User-agent: oBot
Disallow:/
User-agent: Octopus
Disallow:/
User-agent: Offline\ Explorer
Disallow:/
User-agent: Openfind
Disallow:/
User-agent: Openfind\ data\ gatherer
Disallow:/
User-agent: OrangeBot
Disallow:/
User-agent: PageGrabber
Disallow:/
User-agent: Papa\ Foto
Disallow:/
User-agent: PHP\ version
Disallow:/
User-agent: PHP
Disallow:/
User-agent: PHPot
Disallow:/
User-agent: Perl
Disallow:/
User-agent: pcBrowser
Disallow:/
User-agent: pavuk
Disallow:/
User-agent: Pockey
Disallow:/
User-agent: Ping
Disallow:/
User-agent: PingALink\ Monitoring\ Services
Disallow:/
User-agent: ProWebWalker
Disallow:/
User-agent: ProPowerBot
Disallow:/
User-agent: Pump
Disallow:/
User-agent: Pompos
Disallow:/
User-agent: psbot
Disallow:/
User-agent: Python\ urllib
Disallow:/
User-agent: Python-urllib
Disallow:/
User-agent: QueryN
Disallow:/
User-agent: RealDownload
Disallow:/
User-agent: Reaper
Disallow:/
User-agent: Recorder
Disallow:/
User-agent: RepoMonkey
Disallow:/
User-agent: psycheclone
Disallow:/
User-agent: RMA
Disallow:/
User-agent: Rico
Disallow:/
User-agent: Robozilla
Disallow:/
User-agent: ReGet
Disallow:/
User-agent: Siphon
Disallow:/
User-agent: SiteSnagger
Disallow:/
User-agent: sitecheck.internetseer.com
Disallow:/
User-agent: SmartDownload
Disallow:/
User-agent: Snake
Disallow:/
User-agent: spanner
Disallow:/
User-agent: Stealer
Disallow:/
User-agent: SpaceBison
Disallow:/
User-agent: SpankBot
Disallow:/
User-agent: Spinne
Disallow:/
User-agent: Stripper
Disallow:/
User-agent: slysearch
Disallow:/
User-agent: Sucker
Disallow:/
User-agent: Snoopy
Disallow:/
User-agent: ScoutAbout
Disallow:/
User-agent: Scooter
Disallow:/
User-agent: SuperBot
Disallow:/
User-agent: SuperHTTP
Disallow:/
User-agent: Snapbot
Disallow:/
User-agent: Surfbot
Disallow:/
User-agent: suzuran
Disallow:/
User-agent: Szukacz
Disallow:/
User-agent: Sqworm
Disallow:/
User-agent: tAkeOut
Disallow:/
User-agent: Teleport\ Pro
Disallow:/
User-agent: Telesoft
Disallow:/
User-agent: TurnitinBot
Disallow:/
User-agent: turingos
Disallow:/
User-agent: toCrawl
Disallow:/
User-agent: TightTwatBot
Disallow:/
User-agent: True_Robot
Disallow:/
User-agent: The\ Intraformant
Disallow:/
User-agent: TheNomad
Disallow:/
User-agent: Titan
Disallow:/
User-agent: UrlDispatcher
Disallow:/
User-agent: URLy\ Warning
Disallow:/
User-agent: Vayala
Disallow:/
User-agent: Vagabondo
Disallow:/
User-agent: Vintage
Disallow:/
User-agent: Vacuum
Disallow:/
User-agent: VCI
Disallow:/
User-agent: VoidEYE
Disallow:/
User-agent: W3C_Validator
Disallow:/
User-agent: Webdownloader
Disallow:/
User-agent: Web\ Downloader
Disallow:/
User-agent: Webhook
Disallow:/
User-agent: Webmole
Disallow:/
User-agent: Webminer
Disallow:/
User-agent: Webmirror
Disallow:/
User-agent: Websucker
Disallow:/
User-agent: Websites
Disallow:/
User-agent: Web\ Image\ Collector
Disallow:/
User-agent: Web\ Sucker
Disallow:/
User-agent: WebAuto
Disallow:/
User-agent: WebCopier
Disallow:/
User-agent: WebFetch
Disallow:/
User-agent: WebReaper
Disallow:/
User-agent: WebSauger
Disallow:/
User-agent: Website
Disallow:/
User-agent: Webster
Disallow:/
User-agent: WebStripper
Disallow:/
User-agent: WebCopier
Disallow:/
User-agent: WebViewer
Disallow:/
User-agent: WebWhacker
Disallow:/
User-agent: WebEnhancer
Disallow:/
User-agent: Wells
Disallow:/
User-agent: WebZIP
Disallow:/
User-agent: Wget
Disallow:/
User-agent: Whacker
Disallow:/
User-agent: Widow
Disallow:/
User-agent: Xaldon
Disallow:/
User-agent: Wildsoft\ Surfer
Disallow:/
User-agent: WinHttpRequest
Disallow:/
User-agent: WinHttp
Disallow:/
User-agent: Webster\ Pro
Disallow:/
User-agent: Web\ Image\ Collector
Disallow:/
User-agent: WebZip
Disallow:/
User-agent: WebAuto
Disallow:/
User-agent: Website\ Quester
Disallow:/
User-agent: WWWOFFLE
Disallow:/
User-agent: WWW-Collector-E
Disallow:/
User-agent: Xaldon\ WebSpider
Disallow:/
User-agent: Xenu
Disallow:/
User-agent: Xara
Disallow:/
User-agent: Y!TunnelPro
Disallow:/
User-agent: YahooYSMcm
Disallow:/
User-agent: Zade
Disallow:/
User-agent: ZBot
Disallow:/
User-agent: Zeus
Disallow:/
User-agent: Rogerbot
Disallow:/ 
User-agent: Exabot 
Disallow:/
User-agent: MJ12bot 
Disallow:/
User-agent: Dotbot 
Disallow:/
User-agent: Gigabot
Disallow:/ 
User-agent: AhrefsBot
Disallow:/ 
User-agent: BlackWidow
Disallow:/ 
User-agent: Bot\ mailto:craftbot@yahoo.com 
Disallow:/
User-agent: ChinaClaw 
Disallow:/
User-agent: Custo 
Disallow:/
User-agent: DISCo 
Disallow:/
User-agent: Download\ Demon
Disallow:/ 
User-agent: eCatch 
Disallow:/
User-agent: EirGrabber 
Disallow:/
User-agent: EmailSiphon 
Disallow:/
User-agent: EmailWolf 
Disallow:/
User-agent: Express\ WebPictures 
Disallow:/
User-agent: ExtractorPro
Disallow:/ 
User-agent: EyeNetIE 
Disallow:/
User-agent: FlashGet 
Disallow:/
User-agent: GetRight 
Disallow:/
User-agent: GetWeb! 
Disallow:/
User-agent: Go!Zilla 
Disallow:/
User-agent: Go-Ahead-Got-It 
Disallow:/
User-agent: GrabNet 
Disallow:/
User-agent: Grafula 
Disallow:/
User-agent: HMView 
Disallow:/
User-agent: HTTrack 
Disallow:/
User-agent: Image\ Stripper 
Disallow:/
User-agent: Image\ Sucker 
Disallow:/
User-agent: Indy\ Library
Disallow:/
User-agent: InterGET 
Disallow:/
User-agent: Internet\ Ninja 
Disallow:/
User-agent: JetCar 
Disallow:/
User-agent: JOC\ Web\ Spider 
Disallow:/
User-agent: larbin 
Disallow:/
User-agent: LeechFTP 
Disallow:/
User-agent: Mass\ Downloader 
Disallow:/
User-agent: MIDown\ tool 
Disallow:/
User-agent: Mister\ PiX 
Disallow:/
User-agent: Navroad 
Disallow:/
User-agent: NearSite 
Disallow:/
User-agent: NetAnts 
Disallow:/
User-agent: NetSpider 
Disallow:/
User-agent: Net\ Vampire 
Disallow:/
User-agent: NetZIP 
Disallow:/
User-agent: Octopus 
Disallow:/
User-agent: Offline\ Explorer 
Disallow:/
User-agent: Offline\ Navigator
Disallow:/ 
User-agent: PageGrabber 
Disallow:/
User-agent: Papa\ Foto 
Disallow:/
User-agent: pavuk 
Disallow:/
User-agent: pcBrowser 
Disallow:/
User-agent: RealDownload 
Disallow:/
User-agent: ReGet 
Disallow:/
User-agent: SiteSnagger 
Disallow:/
User-agent: SmartDownload 
Disallow:/
User-agent: SuperBot 
Disallow:/
User-agent: SuperHTTP 
Disallow:/
User-agent: Surfbot 
Disallow:/
User-agent: tAkeOut 
Disallow:/
User-agent: Teleport\ Pro 
Disallow:/
User-agent: VoidEYE 
Disallow:/
User-agent: Web\ Image\ Collector 
Disallow:/
User-agent: Web\ Sucker 
Disallow:/
User-agent: WebAuto 
Disallow:/
User-agent: WebCopier 
Disallow:/
User-agent: WebFetch 
Disallow:/
User-agent: WebGo\ IS 
Disallow:/
User-agent: WebLeacher 
Disallow:/
User-agent: WebReaper 
Disallow:/
User-agent: WebSauger
Disallow:/ 
User-agent: Website\ eXtractor 
Disallow:/
User-agent: Website\ Quester
Disallow:/ 
User-agent: WebStripper 
Disallow:/
User-agent: WebWhacker 
Disallow:/
User-agent: WebZIP 
Disallow:/
User-agent: Wget 
Disallow:/
User-agent: Widow 
Disallow:/
User-agent: WWWOFFLE 
Disallow:/
User-agent: Xaldon\ WebSpider
Disallow:/

#Bad Bots
User-agent: 360Spider
Disallow:/
User-agent: 80legs
Disallow:/
User-agent: Abonti
Disallow:/
User-agent: Aboundex
Disallow:/
User-agent: Acunetix
Disallow:/
User-agent: ADmantX
Disallow:/
User-agent: AfD-Verbotsverfahren
Disallow:/
User-agent: AhrefsBot
Disallow:/
User-agent: AIBOT
Disallow:/
User-agent: AiHitBot
Disallow:/
User-agent: Aipbot
Disallow:/
User-agent: Alexibot
Disallow:/
User-agent: Alligator
Disallow:/
User-agent: AllSubmitter
Disallow:/
User-agent: Anarchie
Disallow:/
User-agent: Apexoo
Disallow:/
User-agent: ASPSeek
Disallow:/
User-agent: Asterias
Disallow:/
User-agent: Attach
Disallow:/
User-agent: autoemailspider
Disallow:/
User-agent: BackDoorBot
Disallow:/
User-agent: Backlink-Ceck
Disallow:/
User-agent: backlink-check
Disallow:/
User-agent: BacklinkCrawler
Disallow:/
User-agent: BackStreet
Disallow:/
User-agent: BackWeb
Disallow:/
User-agent: Badass
Disallow:/
User-agent: Bandit
Disallow:/
User-agent: Barkrowler
Disallow:/
User-agent: BatchFTP
Disallow:/
User-agent: Battleztar Bazinga
Disallow:/
User-agent: BBBike
Disallow:/
User-agent: BDFetch
Disallow:/
User-agent: BetaBot
Disallow:/
User-agent: Bigfoot
Disallow:/
User-agent: Bitacle
Disallow:/
User-agent: Blackboard
Disallow:/
User-agent: Black Hole
Disallow:/
User-agent: BlackWidow
Disallow:/
User-agent: BLEXBot
Disallow:/
User-agent: Blow
Disallow:/
User-agent: BlowFish
Disallow:/
User-agent: Boardreader
Disallow:/
User-agent: Bolt
Disallow:/
User-agent: BotALot
Disallow:/
User-agent: Brandprotect
Disallow:/
User-agent: Brandwatch
Disallow:/
User-agent: Bubing
Disallow:/
User-agent: Buddy
Disallow:/
User-agent: BuiltBotTough
Disallow:/
User-agent: BuiltWith
Disallow:/
User-agent: Bullseye
Disallow:/
User-agent: BunnySlippers
Disallow:/
User-agent: BuzzSumo
Disallow:/
User-agent: Calculon
Disallow:/
User-agent: CATExplorador
Disallow:/
User-agent: CazoodleBot
Disallow:/
User-agent: CCBot
Disallow:/
User-agent: Cegbfeieh
Disallow:/
User-agent: CheeseBot
Disallow:/
User-agent: CherryPicker
Disallow:/
User-agent: ChinaClaw
Disallow:/
User-agent: Chlooe
Disallow:/
User-agent: Claritybot
Disallow:/
User-agent: Cliqzbot
Disallow:/
User-agent: Cloud mapping
Disallow:/
User-agent: Cogentbot
Disallow:/
User-agent: cognitiveseo
Disallow:/
User-agent: Collector
Disallow:/
User-agent: com.plumanalytics
Disallow:/
User-agent: Copier
Disallow:/
User-agent: CopyRightCheck
Disallow:/
User-agent: Copyscape
Disallow:/
User-agent: Cosmos
Disallow:/
User-agent: Craftbot
Disallow:/
User-agent: CrazyWebCrawler
Disallow:/
User-agent: Crescent
Disallow:/
User-agent: CSHttp
Disallow:/
User-agent: Curious
Disallow:/
User-agent: Custo
Disallow:/
User-agent: DatabaseDriverMysqli
Disallow:/
User-agent: DataCha0s
Disallow:/
User-agent: DBLBot
Disallow:/
User-agent: demandbase-bot
Disallow:/
User-agent: Demon
Disallow:/
User-agent: Deusu
Disallow:/
User-agent: Devil
Disallow:/
User-agent: Digincore
Disallow:/
User-agent: DIIbot
Disallow:/
User-agent: Dirbuster
Disallow:/
User-agent: Disco
Disallow:/
User-agent: Discobot
Disallow:/
User-agent: Discoverybot
Disallow:/
User-agent: DittoSpyder
Disallow:/
User-agent: DomainAppender
Disallow:/
User-agent: DomainCrawler
Disallow:/
User-agent: DomainSigmaCrawler
Disallow:/
User-agent: DomainStatsBot
Disallow:/
User-agent: Dotbot
Disallow:/
User-agent: Download Wonder
Disallow:/
User-agent: Dragonfly
Disallow:/
User-agent: Drip
Disallow:/
User-agent: DTS Agent
Disallow:/
User-agent: EasyDL
Disallow:/
User-agent: Ebingbong
Disallow:/
User-agent: eCatch
Disallow:/
User-agent: ECCP/1.0
Disallow:/
User-agent: Ecxi
Disallow:/
User-agent: EirGrabber
Disallow:/
User-agent: EMail Siphon
Disallow:/
User-agent: EMail Wolf
Disallow:/
User-agent: EroCrawler
Disallow:/
User-agent: evc-batch
Disallow:/
User-agent: Evil
Disallow:/
User-agent: Exabot
Disallow:/
User-agent: Express WebPictures
Disallow:/
User-agent: ExtLinksBot
Disallow:/
User-agent: Extractor
Disallow:/
User-agent: ExtractorPro
Disallow:/
User-agent: Extreme Picture Finder
Disallow:/
User-agent: EyeNetIE
Disallow:/
User-agent: Ezooms
Disallow:/
User-agent: FDM
Disallow:/
User-agent: FHscan
Disallow:/
User-agent: Fimap
Disallow:/
User-agent: Firefox/7.0
Disallow:/
User-agent: FlashGet
Disallow:/
User-agent: Flunky
Disallow:/
User-agent: Foobot
Disallow:/
User-agent: fq
Disallow:/
User-agent: Freeuploader
Disallow:/
User-agent: FrontPage
Disallow:/
User-agent: Fyrebot
Disallow:/
User-agent: GalaxyBot
Disallow:/
User-agent: Genieo
Disallow:/
User-agent: GermCrawler
Disallow:/
User-agent: Getintent
Disallow:/
User-agent: GetRight
Disallow:/
User-agent: GetWeb
Disallow:/
User-agent: Gigablast
Disallow:/
User-agent: Gigabot
Disallow:/
User-agent: G-i-g-a-b-o-t
Disallow:/
User-agent: Go-Ahead-Got-It
Disallow:/
User-agent: Gotit
Disallow:/
User-agent: GoZilla
Disallow:/
User-agent: Go!Zilla
Disallow:/
User-agent: Grabber
Disallow:/
User-agent: GrabNet
Disallow:/
User-agent: Grafula
Disallow:/
User-agent: GrapeFX
Disallow:/
User-agent: GrapeshotCrawler
Disallow:/
User-agent: GridBot
Disallow:/
User-agent: GT::WWW
Disallow:/
User-agent: HaosouSpider
Disallow:/
User-agent: Harvest
Disallow:/
User-agent: Havij
Disallow:/
User-agent: HEADMasterSEO
Disallow:/
User-agent: Heritrix
Disallow:/
User-agent: Hloader
Disallow:/
User-agent: HMView
Disallow:/
User-agent: HTMLparser
Disallow:/
User-agent: HTTP::Lite
Disallow:/
User-agent: HTTrack
Disallow:/
User-agent: Humanlinks
Disallow:/
User-agent: HybridBot
Disallow:/
User-agent: Iblog
Disallow:/
User-agent: IDBot
Disallow:/
User-agent: Id-search
Disallow:/
User-agent: IlseBot
Disallow:/
User-agent: Image Fetch
Disallow:/
User-agent: Image Sucker
Disallow:/
User-agent: Indy Library
Disallow:/
User-agent: InfoNaviRobot
Disallow:/
User-agent: InfoTekies
Disallow:/
User-agent: instabid
Disallow:/
User-agent: Intelliseek
Disallow:/
User-agent: InterGET
Disallow:/
User-agent: Internet Ninja
Disallow:/
User-agent: InternetSeer
Disallow:/
User-agent: internetVista monitor
Disallow:/
User-agent: Iria
Disallow:/
User-agent: IRLbot
Disallow:/
User-agent: Iskanie
Disallow:/
User-agent: JamesBOT
Disallow:/
User-agent: Jbrofuzz
Disallow:/
User-agent: JennyBot
Disallow:/
User-agent: JetCar
Disallow:/
User-agent: JikeSpider
Disallow:/
User-agent: JOC Web Spider
Disallow:/
User-agent: Joomla
Disallow:/
User-agent: Jorgee
Disallow:/
User-agent: JustView
Disallow:/
User-agent: Jyxobot
Disallow:/
User-agent: Kenjin Spider
Disallow:/
User-agent: Keyword Density
Disallow:/
User-agent: Kozmosbot
Disallow:/
User-agent: Lanshanbot
Disallow:/
User-agent: Larbin
Disallow:/
User-agent: LeechFTP
Disallow:/
User-agent: LeechGet
Disallow:/
User-agent: LexiBot
Disallow:/
User-agent: Lftp
Disallow:/
User-agent: LibWeb
Disallow:/
User-agent: Libwhisker
Disallow:/
User-agent: Lightspeedsystems
Disallow:/
User-agent: Likse
Disallow:/
User-agent: Linkdexbot
Disallow:/
User-agent: LinkextractorPro
Disallow:/
User-agent: LinkpadBot
Disallow:/
User-agent: LinkScan
Disallow:/
User-agent: LinksManager
Disallow:/
User-agent: LinkWalker
Disallow:/
User-agent: LinqiaMetadataDownloaderBot
Disallow:/
User-agent: LinqiaRSSBot
Disallow:/
User-agent: LinqiaScrapeBot
Disallow:/
User-agent: Lipperhey
Disallow:/
User-agent: Litemage_walker
Disallow:/
User-agent: Lmspider
Disallow:/
User-agent: LNSpiderguy
Disallow:/
User-agent: Ltx71
Disallow:/
User-agent: lwp-request
Disallow:/
User-agent: LWP::Simple
Disallow:/
User-agent: lwp-trivial
Disallow:/
User-agent: Magnet
Disallow:/
User-agent: Mag-Net
Disallow:/
User-agent: magpie-crawler
Disallow:/
User-agent: Mail.ru
Disallow:/
User-agent: Majestic12
Disallow:/
User-agent: MarkMonitor
Disallow:/
User-agent: MarkWatch
Disallow:/
User-agent: Masscan
Disallow:/
User-agent: Mass Downloader
Disallow:/
User-agent: Mata Hari
Disallow:/
User-agent: Meanpathbot
Disallow:/
User-agent: mediawords
Disallow:/
User-agent: MegaIndex.ru
Disallow:/
User-agent: Metauri
Disallow:/
User-agent: MFC_Tear_Sample
Disallow:/
User-agent: Microsoft Data Access
Disallow:/
User-agent: Microsoft URL Control
Disallow:/
User-agent: MIDown tool
Disallow:/
User-agent: MIIxpc
Disallow:/
User-agent: Mister PiX
Disallow:/
User-agent: MJ12bot
Disallow:/
User-agent: Mojeek
Disallow:/
User-agent: Morfeus Fucking Scanner
Disallow:/
User-agent: MSFrontPage
Disallow:/
User-agent: MSIECrawler
Disallow:/
User-agent: Msrabot
Disallow:/
User-agent: MS Web Services Client Protocol
Disallow:/
User-agent: Musobot
Disallow:/
User-agent: Name Intelligence
Disallow:/
User-agent: Nameprotect
Disallow:/
User-agent: Navroad
Disallow:/
User-agent: NearSite
Disallow:/
User-agent: Needle
Disallow:/
User-agent: Nessus
Disallow:/
User-agent: NetAnts
Disallow:/
User-agent: Netcraft
Disallow:/
User-agent: netEstate NE Crawler
Disallow:/
User-agent: NetLyzer
Disallow:/
User-agent: NetMechanic
Disallow:/
User-agent: NetSpider
Disallow:/
User-agent: Nettrack
Disallow:/
User-agent: Net Vampire
Disallow:/
User-agent: Netvibes
Disallow:/
User-agent: NetZIP
Disallow:/
User-agent: NextGenSearchBot
Disallow:/
User-agent: Nibbler
Disallow:/
User-agent: NICErsPRO
Disallow:/
User-agent: Niki-bot
Disallow:/
User-agent: Nikto
Disallow:/
User-agent: NimbleCrawler
Disallow:/
User-agent: Ninja
Disallow:/
User-agent: Nmap
Disallow:/
User-agent: NPbot
Disallow:/
User-agent: Nutch
Disallow:/
User-agent: Octopus
Disallow:/
User-agent: Offline Explorer
Disallow:/
User-agent: Offline Navigator
Disallow:/
User-agent: Openfind
Disallow:/
User-agent: OpenLinkProfiler
Disallow:/
User-agent: Openvas
Disallow:/
User-agent: OrangeBot
Disallow:/
User-agent: OrangeSpider
Disallow:/
User-agent: OutfoxBot
Disallow:/
User-agent: PageAnalyzer
Disallow:/
User-agent: Page Analyzer
Disallow:/
User-agent: PageGrabber
Disallow:/
User-agent: page scorer
Disallow:/
User-agent: PageScorer
Disallow:/
User-agent: Panscient
Disallow:/
User-agent: Papa Foto
Disallow:/
User-agent: Pavuk
Disallow:/
User-agent: pcBrowser
Disallow:/
User-agent: PECL::HTTP
Disallow:/
User-agent: PeoplePal
Disallow:/
User-agent: PHPCrawl
Disallow:/
User-agent: Picscout
Disallow:/
User-agent: Picsearch
Disallow:/
User-agent: PictureFinder
Disallow:/
User-agent: Pimonster
Disallow:/
User-agent: Pi-Monster
Disallow:/
User-agent: Pixray
Disallow:/
User-agent: PleaseCrawl
Disallow:/
User-agent: plumanalytics
Disallow:/
User-agent: Pockey
Disallow:/
User-agent: POE-Component-Client-HTTP
Disallow:/
User-agent: Probethenet
Disallow:/
User-agent: ProPowerBot
Disallow:/
User-agent: ProWebWalker
Disallow:/
User-agent: Psbot
Disallow:/
User-agent: Pump
Disallow:/
User-agent: PyCurl
Disallow:/
User-agent: QueryN Metasearch
Disallow:/
User-agent: Qwantify
Disallow:/
User-agent: RankActive
Disallow:/
User-agent: RankActiveLinkBot
Disallow:/
User-agent: RankFlex
Disallow:/
User-agent: RankingBot
Disallow:/
User-agent: RankingBot2
Disallow:/
User-agent: Rankivabot
Disallow:/
User-agent: RankurBot
Disallow:/
User-agent: RealDownload
Disallow:/
User-agent: Reaper
Disallow:/
User-agent: RebelMouse
Disallow:/
User-agent: Recorder
Disallow:/
User-agent: RedesScrapy
Disallow:/
User-agent: ReGet
Disallow:/
User-agent: RepoMonkey
Disallow:/
User-agent: Ripper
Disallow:/
User-agent: RocketCrawler
Disallow:/
User-agent: Rogerbot
Disallow:/
User-agent: SalesIntelligent
Disallow:/
User-agent: SBIder
Disallow:/
User-agent: ScanAlert
Disallow:/
User-agent: Scanbot
Disallow:/
User-agent: Scrapy
Disallow:/
User-agent: Screaming
Disallow:/
User-agent: ScreenerBot
Disallow:/
User-agent: Searchestate
Disallow:/
User-agent: SearchmetricsBot
Disallow:/
User-agent: Semrush
Disallow:/
User-agent: SemrushBot
Disallow:/
User-agent: SEOkicks
Disallow:/
User-agent: SEOlyticsCrawler
Disallow:/
User-agent: Seomoz
Disallow:/
User-agent: SEOprofiler
Disallow:/
User-agent: seoscanners
Disallow:/
User-agent: SEOstats
Disallow:/
User-agent: sexsearcher
Disallow:/
User-agent: Seznam
Disallow:/
User-agent: SeznamBot
Disallow:/
User-agent: Siphon
Disallow:/
User-agent: SISTRIX
Disallow:/
User-agent: Sitebeam
Disallow:/
User-agent: SiteExplorer
Disallow:/
User-agent: Siteimprove
Disallow:/
User-agent: SiteLockSpider
Disallow:/
User-agent: SiteSnagger
Disallow:/
User-agent: SiteSucker
Disallow:/
User-agent: Site Sucker
Disallow:/
User-agent: Sitevigil
Disallow:/
User-agent: Slackbot-LinkExpanding
Disallow:/
User-agent: SlySearch
Disallow:/
User-agent: SmartDownload
Disallow:/
User-agent: Snake
Disallow:/
User-agent: Snapbot
Disallow:/
User-agent: Snoopy
Disallow:/
User-agent: SocialRankIOBot
Disallow:/
User-agent: Sogou web spider
Disallow:/
User-agent: Sosospider
Disallow:/
User-agent: Sottopop
Disallow:/
User-agent: SpaceBison
Disallow:/
User-agent: Spammen
Disallow:/
User-agent: SpankBot
Disallow:/
User-agent: Spanner
Disallow:/
User-agent: Spbot
Disallow:/
User-agent: Spinn3r
Disallow:/
User-agent: SputnikBot
Disallow:/
User-agent: Sqlmap
Disallow:/
User-agent: Sqlworm
Disallow:/
User-agent: Sqworm
Disallow:/
User-agent: Steeler
Disallow:/
User-agent: Stripper
Disallow:/
User-agent: Sucker
Disallow:/
User-agent: Sucuri
Disallow:/
User-agent: SuperBot
Disallow:/
User-agent: SuperHTTP
Disallow:/
User-agent: Surfbot
Disallow:/
User-agent: SurveyBot
Disallow:/
User-agent: Suzuran
Disallow:/
User-agent: Swiftbot
Disallow:/
User-agent: sysscan
Disallow:/
User-agent: Szukacz
Disallow:/
User-agent: T0PHackTeam
Disallow:/
User-agent: T8Abot
Disallow:/
User-agent: tAkeOut
Disallow:/
User-agent: Teleport
Disallow:/
User-agent: TeleportPro
Disallow:/
User-agent: Telesoft
Disallow:/
User-agent: Telesphoreo
Disallow:/
User-agent: Telesphorep
Disallow:/
User-agent: The Intraformant
Disallow:/
User-agent: TheNomad
Disallow:/
User-agent: TightTwatBot
Disallow:/
User-agent: Titan
Disallow:/
User-agent: Toata
Disallow:/
User-agent: Toweyabot
Disallow:/
User-agent: Trendiction
Disallow:/
User-agent: Trendictionbot
Disallow:/
User-agent: trendiction.com
Disallow:/
User-agent: trendiction.de
Disallow:/
User-agent: True_Robot
Disallow:/
User-agent: Turingos
Disallow:/
User-agent: Turnitin
Disallow:/
User-agent: TurnitinBot
Disallow:/
User-agent: TwengaBot
Disallow:/
User-agent: Twice
Disallow:/
User-agent: Typhoeus
Disallow:/
User-agent: UnisterBot
Disallow:/
User-agent: URLy.Warning
Disallow:/
User-agent: URLy Warning
Disallow:/
User-agent: Vacuum
Disallow:/
User-agent: Vagabondo
Disallow:/
User-agent: VB Project
Disallow:/
User-agent: VCI
Disallow:/
User-agent: VeriCiteCrawler
Disallow:/
User-agent: VidibleScraper
Disallow:/
User-agent: Virusdie
Disallow:/
User-agent: VoidEYE
Disallow:/
User-agent: Voil
Disallow:/
User-agent: Voltron
Disallow:/
User-agent: Wallpapers/3.0
Disallow:/
User-agent: WallpapersHD
Disallow:/
User-agent: WASALive-Bot
Disallow:/
User-agent: WBSearchBot
Disallow:/
User-agent: Webalta
Disallow:/
User-agent: WebAuto
Disallow:/
User-agent: Web Auto
Disallow:/
User-agent: WebBandit
Disallow:/
User-agent: WebCollage
Disallow:/
User-agent: Web Collage
Disallow:/
User-agent: WebCopier
Disallow:/
User-agent: WEBDAV
Disallow:/
User-agent: WebEnhancer
Disallow:/
User-agent: Web Enhancer
Disallow:/
User-agent: WebFetch
Disallow:/
User-agent: Web Fetch
Disallow:/
User-agent: WebFuck
Disallow:/
User-agent: Web Fuck
Disallow:/
User-agent: WebGo IS
Disallow:/
User-agent: WebImageCollector
Disallow:/
User-agent: WebLeacher
Disallow:/
User-agent: WebmasterWorldForumBot
Disallow:/
User-agent: webmeup-crawler
Disallow:/
User-agent: WebPix
Disallow:/
User-agent: Web Pix
Disallow:/
User-agent: WebReaper
Disallow:/
User-agent: WebSauger
Disallow:/
User-agent: Web Sauger
Disallow:/
User-agent: Webshag
Disallow:/
User-agent: WebsiteExtractor
Disallow:/
User-agent: WebsiteQuester
Disallow:/
User-agent: Website Quester
Disallow:/
User-agent: Webster
Disallow:/
User-agent: WebStripper
Disallow:/
User-agent: WebSucker
Disallow:/
User-agent: Web Sucker
Disallow:/
User-agent: WebWhacker
Disallow:/
User-agent: WebZIP
Disallow:/
User-agent: WeSEE
Disallow:/
User-agent: Whack
Disallow:/
User-agent: Whacker
Disallow:/
User-agent: Whatweb
Disallow:/
User-agent: Who.is Bot
Disallow:/
User-agent: Widow
Disallow:/
User-agent: WinHTTrack
Disallow:/
User-agent: WiseGuys Robot
Disallow:/
User-agent: WISENutbot
Disallow:/
User-agent: Wonderbot
Disallow:/
User-agent: Woobot
Disallow:/
User-agent: Wotbox
Disallow:/
User-agent: Wprecon
Disallow:/
User-agent: WPScan
Disallow:/
User-agent: WWW-Collector-E
Disallow:/
User-agent: WWW-Mechanize
Disallow:/
User-agent: WWW::Mechanize
Disallow:/
User-agent: WWWOFFLE
Disallow:/
User-agent: x09Mozilla
Disallow:/
User-agent: x22Mozilla
Disallow:/
User-agent: Xaldon_WebSpider
Disallow:/
User-agent: Xaldon WebSpider
Disallow:/
User-agent: Xenu
Disallow:/
User-agent: YoudaoBot
Disallow:/
User-agent: Zade
Disallow:/
User-agent: Zermelo
Disallow:/
User-agent: Zeus
Disallow:/
User-agent: zgrab
Disallow:/
User-agent: Zitebot
Disallow:/
User-agent: ZmEu
Disallow:/
User-agent: ZumBot
Disallow:/
User-agent: ZyBorg
Disallow:/ 
User-agent: asterias
Disallow:/
User-agent: BackDoorBot/1.0
Disallow:/
User-agent: Black Hole
Disallow:/
User-agent: BlowFish/1.0
Disallow:/
User-agent: BotALot
Disallow:/
User-agent: BuiltBotTough
Disallow:/
User-agent: Bullseye/1.0
Disallow:/
User-agent: BunnySlippers
Disallow:/
User-agent: Cegbfeieh
Disallow:/
User-agent: CheeseBot
Disallow:/
User-agent: CherryPicker
Disallow:/
User-agent: CherryPickerElite/1.0
Disallow:/
User-agent: CherryPickerSE/1.0
Disallow:/
User-agent: CopyRightCheck
Disallow:/
User-agent: cosmos
Disallow:/
User-agent: Crescent
Disallow:/
User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
Disallow:/
User-agent: DittoSpyder
Disallow:/
User-agent: EmailCollector
Disallow:/
User-agent: EmailSiphon
Disallow:/
User-agent: EmailWolf
Disallow:/
User-agent: EroCrawler
Disallow:/
User-agent: ExtractorPro
Disallow:/
User-agent: Foobot
Disallow:/
User-agent: Harvest/1.5
Disallow:/
User-agent: hloader
Disallow:/
User-agent: httplib
Disallow:/
User-agent: humanlinks
Disallow:/
User-agent: InfoNaviRobot
Disallow:/
User-agent: JennyBot
Disallow:/
User-agent: Kenjin Spider
Disallow:/
User-agent: Keyword Density/0.9
Disallow:/
User-agent: LexiBot
Disallow:/
User-agent: libWeb/clsHTTP
Disallow:/
User-agent: LinkextractorPro
Disallow:/
User-agent: LinkScan/8.1a Unix
Disallow:/
User-agent: LinkWalker
Disallow:/
User-agent: LNSpiderguy
Disallow:/
User-agent: lwp-trivial
Disallow:/
User-agent: lwp-trivial/1.34
Disallow:/
User-agent: Mata Hari
Disallow:/
User-agent: Microsoft URL Control - 5.01.4511
Disallow:/
User-agent: Microsoft URL Control - 6.00.8169
Disallow:/
User-agent: MIIxpc
Disallow:/
User-agent: MIIxpc/4.2
Disallow:/
User-agent: Mister PiX
Disallow:/
User-agent: moget
Disallow:/
User-agent: moget/2.1
Disallow:/
User-agent: mozilla/4
Disallow:/
User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
Disallow:/
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95)
Disallow:/
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 98)
Disallow:/
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT)
Disallow:/
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows XP)
Disallow:/
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 2000)
Disallow:/
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows ME)
Disallow:/
User-agent: mozilla/5
Disallow:/
User-agent: NetAnts
Disallow:/
User-agent: NICErsPRO
Disallow:/
User-agent: Offline Explorer
Disallow:/
User-agent: Openfind
Disallow:/
User-agent: Openfind data gathere
Disallow:/
User-agent: ProPowerBot/2.14
Disallow:/
User-agent: ProWebWalker
Disallow:/
User-agent: QueryN Metasearch
Disallow:/
User-agent: RepoMonkey
Disallow:/
User-agent: RepoMonkey Bait & Tackle/v1.01
Disallow:/
User-agent: RMA
Disallow:/
User-agent: SiteSnagger
Disallow:/
User-agent: SpankBot
Disallow:/
User-agent: spanner
Disallow:/
User-agent: suzuran
Disallow:/
User-agent: Szukacz/1.4
Disallow:/
User-agent: Teleport
Disallow:/
User-agent: TeleportPro
Disallow:/
User-agent: Telesoft
Disallow:/
User-agent: The Intraformant
Disallow:/
User-agent: TheNomad
Disallow:/
User-agent: TightTwatBot
Disallow:/
User-agent: Titan
Disallow:/
User-agent: toCrawl/UrlDispatcher
Disallow:/
User-agent: True_Robot
Disallow:/
User-agent: True_Robot/1.0
Disallow:/
User-agent: turingos
Disallow:/
User-agent: URLy Warning
Disallow:/
User-agent: VCI
Disallow:/
User-agent: VCI WebViewer VCI WebViewer Win32
Disallow:/
User-agent: Web Image Collector
Disallow:/
User-agent: WebAuto
Disallow:/
User-agent: WebBandit
Disallow:/
User-agent: WebBandit/3.50
Disallow:/
User-agent: WebCopier
Disallow:/
User-agent: WebEnhancer
Disallow:/
User-agent: WebmasterWorldForumBot
Disallow:/
User-agent: WebSauger
Disallow:/
User-agent: Website Quester
Disallow:/
User-agent: Webster Pro
Disallow:/
User-agent: WebStripper
Disallow:/
User-agent: WebZip
Disallow:/
User-agent: WebZip/4.0
Disallow:/
User-agent: Wget
Disallow:/
User-agent: Wget/1.5.3
Disallow:/
User-agent: Wget/1.6
Disallow:/
User-agent: WWW-Collector-E
Disallow:/
User-agent: Xenu's
Disallow:/
User-agent: Xenu's Link Sleuth 1.1c
Disallow:/
User-agent: Zeus
Disallow:/
User-agent: Zeus 32297 Webster Pro V2.9 Win32
Disallow:/