reduce chatgpt api response timeout in test

9d9d257eb2371b17183300456b9b8bae0c37db03 · 2024-07-20 19:19:28 -0700 · Alex Cheema

Files touched

M .github/workflows/test.yml

Diff

commit 9d9d257eb2371b17183300456b9b8bae0c37db03
Author: Alex Cheema <alexcheema123@gmail.com>
Date:   Sat Jul 20 19:19:28 2024 -0700

    reduce chatgpt api response timeout in test
---
 .github/workflows/test.yml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/.github/workflows/test.yml b/.github/workflows/test.yml
index f2e9223b..8adfe0e7 100644
--- a/.github/workflows/test.yml
+++ b/.github/workflows/test.yml
@@ -117,11 +117,11 @@ jobs:
         ls ~/.cache/huggingface/hub/models--mlx-community--Meta-Llama-3-8B-Instruct-4bit/**/* || true
 
         # Start first instance
-        DEBUG_DISCOVERY=9 DEBUG=9 python3 main.py --listen-port 5678 --broadcast-port 5679 --chatgpt-api-port 8000 --chatgpt-api-response-timeout-secs 1200 > output1.log 2>&1 &
+        DEBUG_DISCOVERY=9 DEBUG=9 python3 main.py --listen-port 5678 --broadcast-port 5679 --chatgpt-api-port 8000 --chatgpt-api-response-timeout-secs 900 > output1.log 2>&1 &
         PID1=$!
 
         # Start second instance
-        DEBUG_DISCOVERY=9 DEBUG=9 python3 main.py --listen-port 5679 --broadcast-port 5678 --chatgpt-api-port 8001 --chatgpt-api-response-timeout-secs 1200 > output2.log 2>&1 &
+        DEBUG_DISCOVERY=9 DEBUG=9 python3 main.py --listen-port 5679 --broadcast-port 5678 --chatgpt-api-port 8001 --chatgpt-api-response-timeout-secs 900 > output2.log 2>&1 &
         PID2=$!
 
         # Wait for discovery

← 8850187b tell the mofo in the workflow to keep responses concise · back to Exo · fix m2 ultra flops 1fcbe18b →