Fix AMD device capabilities fields

9cf6818f100262d723eaf101ab8b042d2f8456d1 · 2025-01-28 16:58:58 -0800 · Nirav Patel

Files touched

M exo/topology/device_capabilities.py

Diff

commit 9cf6818f100262d723eaf101ab8b042d2f8456d1
Author: Nirav Patel <nrp@frame.work>
Date:   Tue Jan 28 16:58:58 2025 -0800

    Fix AMD device capabilities fields
---
 exo/topology/device_capabilities.py | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/exo/topology/device_capabilities.py b/exo/topology/device_capabilities.py
index 1358923a..ae28e757 100644
--- a/exo/topology/device_capabilities.py
+++ b/exo/topology/device_capabilities.py
@@ -211,8 +211,8 @@ async def linux_device_capabilities() -> DeviceCapabilities:
 
     return DeviceCapabilities(
       model="Linux Box ({gpu_name})",
-      chip={gpu_name},
-      memory=gpu_memory_info.total // 2**20,
+      chip=gpu_name,
+      memory=gpu_memory_info // 2**20,
       flops=DeviceFlops(fp32=0, fp16=0, int8=0),
     )

← 9c1bea97 fix embed_tokens for last layer in qwen models · back to Exo · increase chatgpt api response timeout to 900 seconds 141de0d0 →