Forgot an abstractmethod

34019e460843338a998ee8815c0385d2452d71d5 · 2024-11-10 19:23:43 -0800 · Nel Nibcord

Files touched

M exo/inference/inference_engine.py

Diff

commit 34019e460843338a998ee8815c0385d2452d71d5
Author: Nel Nibcord <blindcrone@tuta.io>
Date:   Sun Nov 10 19:23:43 2024 -0800

    Forgot an abstractmethod
---
 exo/inference/inference_engine.py | 1 +
 1 file changed, 1 insertion(+)

diff --git a/exo/inference/inference_engine.py b/exo/inference/inference_engine.py
index 7d0ec01a..cb93c7a5 100644
--- a/exo/inference/inference_engine.py
+++ b/exo/inference/inference_engine.py
@@ -12,6 +12,7 @@ class InferenceEngine(ABC):
   async def encode(self, shard: Shard, prompt: str) -> np.ndarray:
     pass
   
+  @abstractmethod
   async def sample(self, x: np.ndarray) -> np.ndarray:
     pass

← 82cce440 Some initial inference engine refactors for enabling trainin · back to Exo · Changed model classname due to the sharding being done elsew 52b91de8 →