# All robots will spider the domain User-agent: * Disallow: # Disallow directory /video/ User-agent: * Disallow: /video/ # Disallow directory /stats/ User-agent: * Disallow: /stats/