24 lis 2012

Plik robots.txt

User-agent: *
Disallow: /zdjecia/new/
Disallow: /zdjecia/box/
User-agent: Googlebot-Image
Disallow: /zdjecia/box/
User-agent: e-SocietyRobot
Disallow: /
User-agent: psbot/0.1
Disallow: /
User-agent: twiceler
Disallow: /
User-agent: TMCrawler
Disallow: /
User-agent: Gigabot
Disallow: /
Noindex: /*?q=
Sitemap: http://.../mapa.xml