give examples of device configurations in readme

1ccfdc3ca9b9a745776104c449b6bc8f076d1d01 · 2024-10-02 15:07:43 +0400 · Alex Cheema

Files touched

M README.md

Diff

commit 1ccfdc3ca9b9a745776104c449b6bc8f076d1d01
Author: Alex Cheema <alexcheema123@gmail.com>
Date:   Wed Oct 2 15:07:43 2024 +0400

    give examples of device configurations in readme
---
 README.md | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/README.md b/README.md
index 52347e92..e645b760 100644
--- a/README.md
+++ b/README.md
@@ -79,7 +79,10 @@ The current recommended way to install exo is from source.
 
 ### Hardware Requirements
 
-- The only requirement to run exo is to have enough memory across all your devices to fit the entire model into memory.
+- The only requirement to run exo is to have enough memory across all your devices to fit the entire model into memory. For example, if you are running llama 3.1 8B (fp16), you need 16GB of memory across all devices. Any of the following configurations would work since they each have more than 16GB of memory in total:
+  - 2 x 8GB M3 MacBook Airs
+  - 1 x 16GB NVIDIA RTX 4070 Ti Laptop
+  - 2 x Raspberry Pi 400 with 4GB of RAM each (running on CPU) + 1 x 8GB Mac Mini
 - exo is designed to run on devices with heterogeneous capabilities. For example, you can have some devices with powerful GPUs and others with integrated GPUs or even CPUs. Adding less capable devices will slow down individual inference latency but will increase the overall throughput of the cluster.
 
 ### From source

← 71e93a10 simplify hardware requirements in readme · back to Exo · also use tempdir for .exo_node_id to keep the dir clean 4923eb7e →