# This robots.txt file controls crawling of URLs under https://example.com. # All crawlers are disallowed to crawl files in the "includes" directory, such # as .css, .js, but Google needs them for rendering, so Googlebot is allowed # to crawl them. User-agent: * Disallow: /seko/ Disallow: /assets/ User-agent: Googlebot Allow: /assets/ Sitemap: https://vertex.com.eg/sitemap.xml