User-agent: AhrefsBot
User-agent: Alexibot
User-agent: BlackWidow
User-agent: BLEXBot
User-agent: dotbot
User-agent: Jetbot
User-agent: MJ12bot
User-agent: Nutch
User-agent: rogerbot
User-agent: SemrushBot
User-agent: SemrushBot-SA
User-agent: Standford
User-agent: SurveyBot
User-agent: WebVac
User-agent: Xenu’s
User-agent: Xenu’s Link Sleuth 1.1c
Disallow: /