#robots.txt for http://www.ads.duke.edu #Covers A&DS and Professional Services User-agent: * # Indicates all robots that respect robots.txt. Allow: /MP3 Disallow: / # No external robots allowed access to ANY of the sites we host.