build-loop: correct the misleading 'cheap no-op' comment (unserved state = a real sitemap GET)

1a7632dd0cc0cbc1bd8444256d621b1bd83cb3c0 · 2026-07-28 10:24:22 -0700 · Steve Abrams

Files touched

M scripts/build-loop.sh

Diff

commit 1a7632dd0cc0cbc1bd8444256d621b1bd83cb3c0
Author: Steve Abrams <steve@designerwallcoverings.com>
Date:   Tue Jul 28 10:24:22 2026 -0700

    build-loop: correct the misleading 'cheap no-op' comment (unserved state = a real sitemap GET)
---
 scripts/build-loop.sh | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/scripts/build-loop.sh b/scripts/build-loop.sh
index acdecfcf..c39bc831 100644
--- a/scripts/build-loop.sh
+++ b/scripts/build-loop.sh
@@ -23,7 +23,10 @@ PSQL() { psql "$DATABASE_URL" -tAc "$1" 2>/dev/null; }
 CLI() { npx tsx src/cli.ts --adapter="$1" 2>&1 | grep -E '"published"|"pages"|Error|error|inactive|blocked|disallow' | head -3; }
 
 # NATIONWIDE — WEST COAST FIRST (Steve 2026-07-28), then the rest by volume.
-# Adapters filter by state; a state a builder doesn't serve is a cheap 0-published no-op.
+# Adapters filter by state AFTER fetching that state's sitemap — so an unserved state still
+# costs one real HTTPS GET (not free). National builders (dr-horton/lennar) serve most states
+# so the full $STATES sweep is mostly productive; limited-footprint builders pass a scoped
+# state list to sweep_adapter (2nd arg) to avoid no-yield sitemap GETs (WAF-bait). [Cody 2026-07-28]
 # CAP = communities/homes per (adapter,state) per sweep — deep enough to actually fill CA.
 CAP="${CAP:-120}"
 STATES="CA OR WA NV AZ ID HI TX FL NC GA SC TN CO OH PA VA UT IN MD MI MN MO AL OK KY LA NJ NM NY WI AR KS NE IA MS WV CT DE NH ME RI"

← 7c8f49be build-loop: scope David Weekley sweep to its 7 served states · back to Homesonspec · admin: Business Analysis page — full analysis + live metrics 72e78889 →