# First disallow all robots from accessing /tmp and /infinite User-agent: * Disallow: /wimb/FEC/ Disallow: /wimb/private/ Disallow: /wimb/photo/ Disallow: /wimb/root/ Disallow: /wimb/make/ Disallow: /wimb/cvs/ Disallow: /wimb/archive/ Disallow: /wimb/talks/janfeb2004/0121/ Disallow: /cms/testing/ Disallow: /castor/documents/ Disallow:/cms/testing/software/ltstruct/structdoxy/ Disallow:/cms/testing/results/production/ Disallow:/cms/testing/results/xcaltest/ Disallow:/cms/testing/results/negbpvolt/ Disallow:/exports # Now allow the 'smartrobot' access to /infinite anyway #User-agent: smartrobot #Disallow: /tmp/