# /robots.txt file for http://psacake.com/ # mail webmaster@psacake.com for constructive criticism # Last update 5/21/2002 # Last update 1/2/2003 for ia_archiver and Googlebot-Image # Last update 10/9/2003 for Inktomi / Slurp because it's stupid # Last Update 3/6/2004 for GoogleBot Image and ia_archiver to not do the dogs and added PSBot # Last Update 12/31/2004 for TurnitinBot # Last Update 9/21/2005 comment out Slurp for now.. it's Yahoo! # Last Update 10/24/2005 add BecomeBot # Last Update 12/20/2005 add e-SocietyRobot User-agent: BecomeBot Disallow: / User-agent: WebReaper Disallow: / #User-agent: Slurp #Disallow: / User-Agent: psbot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: ia_archiver Disallow: /stanley/ Disallow: /stanley/small/ Disallow: /katy/ Disallow: /katy/small/ Disallow: /katy/big/ Disallow: /dogs/ Disallow: /dogs/small/ Disallow: /dogs/big/ User-agent: Googlebot-Image Disallow: /stanley/ Disallow: /stanley/small/ Disallow: /images/ Disallow: /web/images/ Disallow: /katy/ Disallow: /katy/small/ Disallow: /katy/big/ Disallow: /dogs/ Disallow: /dogs/small/ Disallow: /dogs/big/ User-agent: * Disallow: /admin/ Disallow: /sbttech/ Disallow: /cake/ Disallow: /cal/ Disallow: /fpdb/ Disallow: /glm/ Disallow: /images/ Disallow: /saveit/ Disallow: /_gen/ Disallow: /home/ Disallow: /report/ Disallow: /web/css/ Disallow: /web/play/ Disallow: /web/_speed/ Disallow: /web/software/ Disallow: /web/images/ Disallow: /web/o.htm Disallow: /web/_fg.asp Disallow: /web/_source.asp Disallow: /web/_last10.asp Disallow: /web/_scroll.hm Disallow: /sendlink.asp Disallow: /web/sendlink.asp Disallow: /web/search/ Disallow: /test/ Disallow: /todd/ Disallow: /stuff/ Disallow: /junk/ Disallow: /archive/ Disallow: /_grid/ Disallow: /neos/ Disallow: /web2/ Disallow: spam.htm Disallow: spam.asp Disallow: /web/db/ Disallow: /sean/ Disallow: /_data/