Hardware Requirementes

8d0e8a8a360de07cd8ff34c6793d084811d65120 · 2024-10-01 11:36:01 +0200 · DevEmilio96
Files touched

M README.md
Diff

commit 8d0e8a8a360de07cd8ff34c6793d084811d65120
Author: DevEmilio96 <minima998@gmail.com>
Date:   Tue Oct 1 11:36:01 2024 +0200

    Hardware Requirementes
---
 README.md | 14 ++++++++++++++
 1 file changed, 14 insertions(+)

diff --git a/README.md b/README.md
index 27850679..0427fe0f 100644
--- a/README.md
+++ b/README.md
@@ -77,6 +77,20 @@ The current recommended way to install exo is from source.
   - CUDA (https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#cuda-cross-platform-installation) (test with `nvcc --version`)
   - cuDNN (https://developer.nvidia.com/cudnn-downloads) (test with [link](https://docs.nvidia.com/deeplearning/cudnn/latest/installation/linux.html#verifying-the-install-on-linux:~:text=at%20a%20time.-,Verifying%20the%20Install%20on%20Linux,Test%20passed!,-Upgrading%20From%20Older))
 
+### Hardware Requirements
+
+| Component          | MLX Requirements                                              | TinyGrad Requirements (for Llama-3.1-8B or similar)                    |
+|--------------------|---------------------------------------------------------------|------------------------------------------------------------------------|
+| **CPU**            | Apple Silicon (M1, M2, or later) only                         | Minimum: Intel Core i7-12700 or AMD Ryzen 7 5800X <br>Recommended: Intel Core i9-12900K or AMD Ryzen 9 5900X |
+| **GPU**            | Apple Silicon Integrated GPU                                  | Minimum: NVIDIA RTX 4070 (12 GB VRAM) or AMD RX 6800 (16 GB VRAM) <br>Recommended: NVIDIA RTX 4080 (16 GB VRAM) or AMD RX 7900 XT (20 GB VRAM) |
+| **RAM**            | Minimum: 16 GB <br>Recommended: 32 GB                         | Minimum: 32 GB <br>Recommended: 64 GB                                  |
+| **Storage**        | Minimum: 256 GB SSD <br>Recommended: 512 GB SSD               | Minimum: 512 GB SSD <br>Recommended: 1 TB SSD                          |
+| **Operating System**| macOS 11.0 (Big Sur) or later                                | macOS, Linux, or Windows                                               |
+
+**Note**:  
+- For **MLX**, you can currently run **smaller models** such as **Llama-3.2-1B**, which are optimized for Apple Silicon hardware.
+- For **TinyGrad**, the **smallest model** currently supported is **Llama-3.1-8B**, which requires more robust hardware to run effectively.
+
 ### From source
← c5b38f45 move tinychat inside exo package · back to Exo · Hardware Requirement notes c498930f →