On every machine in the cluster install openmpi and mlx-lm:
conda install conda-forge::openmpi
pip install -U mlx-lmNext download the pipeline parallel run script. Download it to the same path on every machine:
SebastianBitsch
awni
/ mlx_distributed_deepseek.md
Last active
June 8, 2025 03:50
Run DeepSeek R1 or V3 with MLX Distributed