You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

search-engines-indexation.en-us.md 1.1 kB

123456789101112131415161718192021222324252627282930313233343536373839
  1. ---
  2. date: "2019-12-31T13:55:00+05:00"
  3. title: "Advanced: Search Engines Indexation"
  4. slug: "search-engines-indexation"
  5. weight: 30
  6. toc: true
  7. draft: false
  8. menu:
  9. sidebar:
  10. parent: "advanced"
  11. name: "Search Engines Indexation"
  12. weight: 60
  13. identifier: "search-engines-indexation"
  14. ---
  15. # Search engines indexation of your Gitea installation
  16. By default your Gitea installation will be indexed by search engines.
  17. If you don't want your repository to be visible for search engines read further.
  18. ## Block search engines indexation using robots.txt
  19. To make Gitea serve a custom `robots.txt` (default: empty 404) for top level installations,
  20. create a file called `robots.txt` in the [`custom` folder or `CustomPath`]({{< relref "doc/advanced/customizing-gitea.en-us.md" >}})
  21. Examples on how to configure the `robots.txt` can be found at [https://moz.com/learn/seo/robotstxt](https://moz.com/learn/seo/robotstxt).
  22. ```txt
  23. User-agent: *
  24. Disallow: /
  25. ```
  26. If you installed Gitea in a subdirectory, you will need to create or edit the `robots.txt` in the top level directory.
  27. ```txt
  28. User-agent: *
  29. Disallow: /gitea/
  30. ```