check for the last file that downloads in case it fails part way through

10a043773f5ec619d7519fa38ba96a30188acad0 · 2024-07-19 22:16:10 -0700 · Alex Cheema

Files touched

M exo/inference/tinygrad/inference.py

Diff

commit 10a043773f5ec619d7519fa38ba96a30188acad0
Author: Alex Cheema <alexcheema123@gmail.com>
Date:   Fri Jul 19 22:16:10 2024 -0700

    check for the last file that downloads in case it fails part way through
---
 exo/inference/tinygrad/inference.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/exo/inference/tinygrad/inference.py b/exo/inference/tinygrad/inference.py
index 90ce2953..5d1b1485 100644
--- a/exo/inference/tinygrad/inference.py
+++ b/exo/inference/tinygrad/inference.py
@@ -173,7 +173,7 @@ class TinygradDynamicShardInferenceEngine(InferenceEngine):
         models_dir = Path(_cache_dir) / "tinygrad" / "downloads"
         model_path = models_dir / shard.model_id
         size = "8B"
-        if model_path.exists():
+        if Path(model_path / "model.safetensors.index.json").exists():
             model = model_path
         else:
             from tinygrad.helpers import fetch

← 1475c735 fix inference_state serialization. related: #40 #44 #45 · back to Exo · github workflow for tests ba1916a3 →