# Prevent web robots from indexing certain pages User-agent: * Disallow: /spidertrap.html