TK-10709: add paced Crexi accrual wrapper script (install of the launchd schedule stays a Steve-run paste)

e85e452462fd2406fc529bbeab10995a709dfb1f · 2026-08-26 07:09:08 -0700 · Steve Abrams

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Files touched

A scripts/crexi-accrual-cron.sh

Diff

commit e85e452462fd2406fc529bbeab10995a709dfb1f
Author: Steve Abrams <steve@designerwallcoverings.com>
Date:   Wed Aug 26 07:09:08 2026 -0700

    TK-10709: add paced Crexi accrual wrapper script (install of the launchd schedule stays a Steve-run paste)
    
    Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
---
 scripts/crexi-accrual-cron.sh | 16 ++++++++++++++++
 1 file changed, 16 insertions(+)

diff --git a/scripts/crexi-accrual-cron.sh b/scripts/crexi-accrual-cron.sh
new file mode 100755
index 0000000..888ee81
--- /dev/null
+++ b/scripts/crexi-accrual-cron.sh
@@ -0,0 +1,16 @@
+#!/bin/zsh
+# crexi-accrual-cron.sh — TK-10709 paced Crexi accrual/refresh wrapper.
+# NOT scheduled/installed. The launchd job that would call this is GATED and NOT approved — this
+# script only exists so that, IF Steve approves the schedule, install is a one-step paste.
+# Runs one paced, throttle-respecting batch across all CRE types. The scraper dedups by normalized
+# address across ALL sources, so re-runs only ADD genuinely-new listings (freshness) — never dupes.
+# $0 (openclaw local Chrome). Reversible: DELETE FROM broker_direct_listing WHERE source='crexi'.
+set -u
+PROJ="/Users/macstudio3/Projects/commercialrealestate"
+NODE="/opt/homebrew/bin/node"
+LOG="$PROJ/data/crexi-accrual-cron.log"
+cd "$PROJ" || exit 1
+echo "=== $(date -u +%Y-%m-%dT%H:%M:%SZ) crexi accrual run ===" >> "$LOG"
+# refresh the grid queue occasionally by letting the 24h TTL lapse; --type=all, modest paced budget.
+"$NODE" scripts/scrape-crexi-loopnet.js --type=all --pages=40 --limit=2000 --minutes=20 --apply >> "$LOG" 2>&1
+echo "--- done $(date -u +%Y-%m-%dT%H:%M:%SZ) ---" >> "$LOG"

← 5fb3d88 auto-data-snapshot: 2026-08-26T06:30:25 (11 data files) — da · back to Commercialrealestate · auto-data-snapshot: 2026-08-26T07:08:04 (1 data files) — dat 777bca5 →