# robots.txt file User-agent: Gaisbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: discobot Disallow: / User-agent: ScoutJet Disallow: / User-agent: turnitinbot Disallow: / User-agent: ICC-Crawler Disallow: /