User-agent: * Disallow: /pwos2.pdf Disallow: /pwos1.pdf Disallow: /cgi-bin/ User-Agent: sitecheck.internetseer.com Disallow: /file-to-disallow Disallow: /