User-agent: * Allow: / # Important pages for crawling Allow: /JobBoard Allow: /Dashboard Allow: /Profile # Sitemap location Sitemap: https://myerpjob.com/SitemapXML # Crawl delay Crawl-delay: 1