Dynamic robots.txt (Apache) Rewrite requests for robots.txt to a dynamic file which generates robot directives.