You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 

16 lines
310 B

  1. User-agent: *
  2. Disallow: /auth/
  3. Disallow: /rss
  4. Disallow: /search/
  5. Disallow: /stream
  6. Disallow: /feed
  7. Disallow: /ajax
  8. Disallow: /admin
  9. Disallow: /subscribe/
  10. Disallow: /tag/$
  11. Disallow: /page/$
  12. Disallow: /error/$
  13. Disallow: /settings/$
  14. Disallow: /content/$
  15. Disallow: /talk/$
  16. # Sitemap: http://example.com/sitemap.xml