set max-generate-tokens to 250

a93092105ce833fb291e0a7b9d38438b36316b9f · 2024-12-14 19:10:03 +0000 · Alex Cheema

Files touched

M .github/workflows/bench_job.yml

Diff

commit a93092105ce833fb291e0a7b9d38438b36316b9f
Author: Alex Cheema <41707476+AlexCheema@users.noreply.github.com>
Date:   Sat Dec 14 19:10:03 2024 +0000

    set max-generate-tokens to 250
---
 .github/workflows/bench_job.yml | 1 +
 1 file changed, 1 insertion(+)

diff --git a/.github/workflows/bench_job.yml b/.github/workflows/bench_job.yml
index d40e9fd1..3bc2a6b1 100644
--- a/.github/workflows/bench_job.yml
+++ b/.github/workflows/bench_job.yml
@@ -124,6 +124,7 @@ jobs:
             --node-id-filter="${ALL_NODE_IDS}" \
             --interface-type-filter="Ethernet" \
             --disable-tui \
+            --max-generate-tokens 250 \
             --chatgpt-api-port 52415 > output1.log 2>&1 &
           PID1=$!

← 0c6ab353 increase timeout of http request in bench.py up to 10 mins · back to Exo · Only collect topology if peers changed 470f961f →