User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /policy/ Disallow: /xyzabc123.html Disallow: /*.PDF$ Disallow: /*.gif$ Disallow: /*.jpeg$ Disallow: /*.jpg$ Disallow: /*.js$