← back to Dw Monitoring
rescrape-todo/arte-international.md
33 lines
# Arte International — Re-scrape TODO
**Status**: 133 affected SKUs. 9 already refreshed via PDP og:image extraction this pass. 124 remaining.
## What this pass accomplished
- Identified 9 affected SKUs that have `pattern_url` entries in `arte_rescrape` (`SKU` 37620-37623 Natura, 37640-37644 Gloria).
- Fetched each PDP, extracted `og:image`, HEAD-verified all 9 return 200, staged into `image_url_swap_proposals_2026_05_19_v2` with `source_table='arte_pdp_og_image'`.
- Updated `image_hashes` for the 2 unique URLs to `status='success'`.
## Remaining problem (124 SKUs)
- 124 of the 133 affected Arte SKUs do NOT appear in `arte_rescrape` (the only source of PDP URLs).
- `arte_catalog` rows for these SKUs store only the OLD dead Shopify CDN URL — never a vendor-CDN URL.
- The 1,416 rows with `edge.arte-international.com` URLs in `arte_catalog` are all OTHER SKUs (not the affected ones).
- Arte's sitemap.xml redirects to a 404 — no easy slug enumeration.
## Recommendation
Use the existing `arte-international-colorway-scraper` skill (located at `~/.claude/skills/arte-international-colorway-scraper/SKILL.md`) to do a full Arte vendor crawl. Critically, the skill should:
1. Walk every collection page (e.g., `/en/collections/metal-x-signum/`).
2. For each PDP URL discovered, parse the SKU from the URL and extract `og:image`.
3. UPSERT into `arte_rescrape` (which is keyed on `arte_sku`).
4. After the crawl, re-run a swap-proposal pass joining `image_url_swap_proposals_2026_05_19` → `arte_rescrape` to pick up newly available URLs.
## Affected SKU list (124 remaining)
`/tmp/arte_affected_skus.csv` minus the 9 already handled this pass.
## What I did this pass (Mac2)
Bash one-liner extracted og:image from each of the 9 PDPs via:
```bash
curl -s -A "Mozilla/5.0" --max-time 10 "$pdp_url" | \
grep -oE 'og:image"[^>]*content="[^"]+' | head -1 | sed 's/.*content="//'
```
This same approach works for any Arte PDP — the site is statically scrapable.