← back to Exo
redundant sh
93df43d07fdf8c9b6f08daee4f1a75279e4cdddc · 2024-07-20 00:11:05 -0700 · Alex Cheema
Files touched
Diff
commit 93df43d07fdf8c9b6f08daee4f1a75279e4cdddc
Author: Alex Cheema <alexcheema123@gmail.com>
Date: Sat Jul 20 00:11:05 2024 -0700
redundant sh
---
README.md | 8 ++------
1 file changed, 2 insertions(+), 6 deletions(-)
diff --git a/README.md b/README.md
index f947d5f0..6f4ed943 100644
--- a/README.md
+++ b/README.md
@@ -104,20 +104,16 @@ The native way to access models running on exo is using the exo library with pee
exo also starts a ChatGPT-compatible API endpoint on http://localhost:8000. Note: this is currently only supported by tail nodes (i.e. nodes selected to be at the end of the ring topology). Example request:
-```
+```sh
curl http://localhost:8000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
- "model": "llama-3-70b",
+ "model": "llama-3-8b",
"messages": [{"role": "user", "content": "What is the meaning of exo?"}],
"temperature": 0.7
}'
```
-```sh
-curl -X POST http://localhost:8001/api/v1/chat -H "Content-Type: application/json" -d '{"messages": [{"role": "user", "content": "What is the meaning of life?"}]}'
-```
-
## Debugging
Enable debug logs with the DEBUG environment variable (0-9).
← bf7aa51b rename to discovery integration test as thats all it checks
·
back to Exo
·
separate discovery and chatgpt api integration test 144af106 →