# Robot and Agent Controls for http://www.BIG Images.com User-agent: * Disallow: /cgi-bin Disallow: /Connections Disallow: /stats Disallow: /plans Disallow: /exportXML Disallow: /bigtest Disallow: /pro Disallow: /feed2js Disallow: /ImagePages Disallow: /jclientupload1.9 Disallow: /lib Disallow: /logo Disallow: /quantum Disallow: /secondlife Disallow: /SitemapGenerator Disallow: /search Disallow: /software Disallow: /streetracergraphics Disallow: /wp Disallow: /_mmServerScripts Disallow: /_notes Disallow: /crm Disallow: /Old(8-20-06)_1-877-781-9301 Disallow: /slopassport Disallow: /bannerworks/index.html Disallow: /bannerworks/admin User-Agent: * Allow: /bannerworks/browser Disallow: /bannerworks2 User-agent: Mediapartners-Google* Disallow: # Added August 7, 2008 # Attempting to remove duplicate news and case-study content # in an effort to improve SEO. This means that the main articles are the only # place that will have its content, instead of it being on both tag and category pages also. User-agent: * Disallow: /1-877-781-9301/News_files/tag- Disallow: /1-877-781-9301/News_files/category- Disallow: /1-877-781-9301/Case_Studies_files/tag- Disallow: /1-877-781-9301/Case_Studies_files/category- # Do not allow Google to index the cusomization pages of BannerWorks. # 1) This removes duplicate content, and # 2) I want the user to land on the banner's image page. Customers can choose to customize. User-agent: * Disallow: /bannerworks/browser/?p=Customize_Your_Banner # Disallow some of the random stuff that Google says it tried to access User-agent: * # Google somehow accessed http://www.big-images.com/bannerworks/browser/function.mysql-connect # and http://www.big-images.com/banner-works/function.getimagesize. Wierd. Disallow: /bannerworks/browser/function.*