Robots Configuration

General Config

User Agent

*

Sitemap Path

Crawl Delay

10

Allowed Paths

Excluded Pages

Excluded Paths

/

Excluded Tags