← back to Exo
README notice about api endpoint
1ec92b731efa57b1ac87ea57a3cf397247104cb0 · 2024-07-15 22:46:06 -0700 · Alex Cheema
Files touched
Diff
commit 1ec92b731efa57b1ac87ea57a3cf397247104cb0
Author: Alex Cheema <alexcheema123@gmail.com>
Date: Mon Jul 15 22:46:06 2024 -0700
README notice about api endpoint
---
README.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/README.md b/README.md
index 21297ff3..48392bbf 100644
--- a/README.md
+++ b/README.md
@@ -74,9 +74,9 @@ python3 main.py
That's it! No configuration required - exo will automatically discover the other device(s).
-A ChatGPT-like web interface will be available on each device on port 8000 http://localhost:8000.
+Until the below is fixed, the only way to access inference is via peer handles. See how it's done in [this example for Llama 3](examples/llama3_distributed.py).
-An API endpoint will be available on port 8001. Example usage:
+// A ChatGPT-like web interface will be available on each device on port 8000 http://localhost:8000 and Chat-GPT-compatible API on port 8001 (currently doesn't work see https://github.com/exo-explore/exo/issues/6).
```sh
curl -X POST http://localhost:8001/api/v1/chat -H "Content-Type: application/json" -d '{"messages": [{"role": "user", "content": "What is the meaning of life?"}]}'
← 108a904a Readme whitespace
·
back to Exo
·
(partially) restore exo node equality by forwarding prompts 1d5c28ae →