Guard main loop against unknown enabled sites instead of crashing on None unpack

17d6b96f529e90bf49ba3820fa76cd3f818d38a4 · 2026-05-18 20:09:03 -0700 · Steve Abrams

Files touched

M main.py

Diff

commit 17d6b96f529e90bf49ba3820fa76cd3f818d38a4
Author: Steve Abrams <steve@designerwallcoverings.com>
Date:   Mon May 18 20:09:03 2026 -0700

    Guard main loop against unknown enabled sites instead of crashing on None unpack
---
 main.py | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)

diff --git a/main.py b/main.py
index 4fed1cb..6b7e39f 100644
--- a/main.py
+++ b/main.py
@@ -58,8 +58,9 @@ def main():
 
     enabled_sites = [site["name"] for site in config["sites"] if site["enabled"]]
     for site in enabled_sites:
-        scraper_cls_factory, extractor_cls = scrapers.get(site)  # type: ignore
-        if scraper_cls_factory:
+        site_handlers = scrapers.get(site)
+        if site_handlers:
+            scraper_cls_factory, extractor_cls = site_handlers
             scraper_cls = scraper_cls_factory()
             extraction = extractor_cls(driver=scraper_cls.driver, config=config)
             df = run_scraper(scraper_cls, extraction, search_query)

← 384f264 Fix base extractor stub to build DataFrame from extracted da · back to FashionCrawler · Avoid re-raising caught exception via future.result() inside 98e65c4 →