# robots.txt for MPI-MP web development site # info on constructing this file on http://info.webcrawler.com/mak/projects/robots/robots.html User-agent: mpg-crawler Disallow: /leute/ Disallow: /nachrichten/ Disallow: /selbig/ Disallow: /portal_img/ Disallow: /fiehn/ Disallow: /bilder/ User-agent: * Disallow: /