Hardware Requirement notes

c498930fa1e802993c5da1ddc7ea6b208e9c6d8b · 2024-10-01 11:41:03 +0200 · DevEmilio96

Files touched

M README.md

Diff

commit c498930fa1e802993c5da1ddc7ea6b208e9c6d8b
Author: DevEmilio96 <minima998@gmail.com>
Date:   Tue Oct 1 11:41:03 2024 +0200

    Hardware Requirement notes
---
 README.md | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/README.md b/README.md
index 0427fe0f..f99713eb 100644
--- a/README.md
+++ b/README.md
@@ -90,6 +90,8 @@ The current recommended way to install exo is from source.
 **Note**:  
 - For **MLX**, you can currently run **smaller models** such as **Llama-3.2-1B**, which are optimized for Apple Silicon hardware.
 - For **TinyGrad**, the **smallest model** currently supported is **Llama-3.1-8B**, which requires more robust hardware to run effectively.
+- **Hardware requirements are indicative**: The overall load is distributed across the **CPU, RAM**, and **GPU/VRAM**, not solely on the GPU. Therefore, your system's performance depends on its ability to handle this distribution effectively.
+- It is also **possible to run models in a cluster mode**, utilizing multiple devices to distribute the computation load across multiple machines or GPUs, enhancing performance.
 
 ### From source

← 8d0e8a8a Hardware Requirementes · back to Exo · Hardware Requirements 09e72162 →