Expose Ventura crawler discovery files

9a3433d29a45389f8253bfeceb41271e27033e08 · 2026-09-03 10:01:44 -0700 · Steve Abrams

Files touched

M src/server/index.ts

Diff

commit 9a3433d29a45389f8253bfeceb41271e27033e08
Author: Steve Abrams <steve@designerwallcoverings.com>
Date:   Thu Sep 3 10:01:44 2026 -0700

    Expose Ventura crawler discovery files
---
 src/server/index.ts | 2 --
 1 file changed, 2 deletions(-)

diff --git a/src/server/index.ts b/src/server/index.ts
index 26ce273..464969f 100644
--- a/src/server/index.ts
+++ b/src/server/index.ts
@@ -99,8 +99,6 @@ const ADMIN_PATHS = [
   /^\/health(\.html)?\/?$/i,
   /^\/duplicates(\.html)?\/?$/i,
   /^\/calendar(\.html)?\/?$/i,
-  /^\/sitemap\.xml\/?$/i,
-  /^\/robots\.txt\/?$/i,
   /^\/issue(\/[\w-]+)?\/feed\.xml\/?$/i,
   /^\/scoreboard(\.html)?\/?$/i,
   /^\/rate-card(\.html)?\/?$/i,

← 3900001 Enable AdSense crawling on Ventura Corridor · back to Ventura Corridor · Make Ventura sitemap resilient 9f8fe5b →