← back to Dw Vendor Scrapers Local

README.md

26 lines

# dw-vendor-scrapers-local

Local working copy of select Kamatera DW vendor scrapers
(`/root/DW-Agents/vendor-scrapers/`) for editing + version control on Mac2.

- `scrape-coordonne.js`, `scrape-hollywood.js`, `recrawl-osborne.js` — read-only
  reference pulls of the deployed Kamatera scrapers.
- `recrawl-coordonne.js` — NEW (2026-06-10). Additive `all_images` re-crawl for
  the coordonne onboarding cohort. The original WP-API scraper captured only one
  hero image; this re-crawls each product PAGE and fills `all_images` + `specs`
  on existing rows (UPDATE only — never inserts, never publishes, never touches
  SKUs). Run `--canary 5` first to confirm the gallery selector against live HTML,
  then `--all --net-new` for the full pass. Deploy + run is Steve-gated.
- `recrawl-designers-guild.js` — NEW (2026-06-10). Additive `all_images` re-crawl
  for designers_guild. The deployed scraper grabs only the first `imageId`
  (`/image-nonwebp/600/<id>`); this re-crawls each product page and collects the
  product's FULL gallery via the `/image-nonwebp/1024/<id>` scoping heuristic
  (related-product cards only appear at 156/239 thumb sizes, so 1024 = own gallery).
  Verified 1→5 images on a sample, URLs HTTP 200. UPDATEs `vendor_catalog`
  (vendor_code='designers_guild') — never inserts/publishes/touches SKUs.
  `--net-new` = the 985 clean net-net-new rows (excludes 87 SKU-collisions incl.
  79 Ralph Lauren `PRL*`). Run `--canary 5` first. Deploy + run is Steve-gated
  (parked at `~/.claude/yolo-queue/pending-approval/designers_guild-recrawl.md`).

Local commits only. No push, no deploy.