new false positives:
  • cubot r11
  • spider v7 build/lmy47i
  • spider v7 (MyCell Spider v7 from Bangladesh)
weekly bot updates:
  • adbot/1.0
  • ahrefssiteaudit
  • amazonadbot
  • amg-bot
  • ampxfbot
  • anybot
  • aranea web-crawled corpora project
  • backlinkcrawler
  • botelaire
  • chirpyhubbot
  • cookiebot
  • crawl/1.0
  • dataforseobot
  • diffeobot
  • digitalshadowsbot
  • discoverbot
  • dmasslinksafetybot
  • domcopbot
  • echocrawl
  • emeraldshield.com webbot
  • historyspider
  • iplogger crawler
  • mohawk crawler
  • mtrobot
  • mxbot
  • netresearchserver
  • openindexspider
  • pinllc search robot
  • rustbot
  • sellers.guide crawler by primis
  • snaplocalbot
  • test-deep-cocrawler
  • vdo.ai bot
  • wesee:search
  • whizebot
  • xaldon_webspider
  • xovibot
  • yaanibot
  • yelpbot
weekly new bots:
  • boitho.com-dc
  • msc crawl project radboud university
  • niocbot
  • open web analytics bot
  • quetextbot
  • rc-crawler
  • tokenspider
  • womlpefactory
  • yeti/1.0
Back
Top Bottom