Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save olafgeibig/47a5a2f364902c56361fd16e36080af9 to your computer and use it in GitHub Desktop.
Save olafgeibig/47a5a2f364902c56361fd16e36080af9 to your computer and use it in GitHub Desktop.
mlx-vlm install failiure
```
uv run --with mlx-vlm mlx_vlm.generate --model gg-hf-gm/gemma-3n-E4B-it --max-tokens 100 --temperature 0.7 --prompt "Transcribe the following speech segment in English:"
× Failed to build `llvmlite==0.36.0`
├─▶ The build backend returned an error
╰─▶ Call to `setuptools.build_meta:__legacy__.build_wheel` failed (exit status: 1)
[stderr]
Traceback (most recent call last):
File "<string>", line 14, in <module>
File "/Users/olaf/.cache/uv/builds-v0/.tmpPmfozJ/lib/python3.12/site-packages/setuptools/build_meta.py", line 331, in
get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=[])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/olaf/.cache/uv/builds-v0/.tmpPmfozJ/lib/python3.12/site-packages/setuptools/build_meta.py", line 301, in
_get_build_requires
self.run_setup()
File "/Users/olaf/.cache/uv/builds-v0/.tmpPmfozJ/lib/python3.12/site-packages/setuptools/build_meta.py", line 512, in run_setup
super().run_setup(setup_script=setup_script)
File "/Users/olaf/.cache/uv/builds-v0/.tmpPmfozJ/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
exec(code, locals())
File "<string>", line 55, in <module>
File "<string>", line 52, in _guard_py_ver
RuntimeError: Cannot install on Python version 3.12.8; only versions >=3.6,<3.10 are supported.
hint: This usually indicates a problem with the package or the build environment.
help: `llvmlite` (v0.36.0) was included because `mlx-vlm` (v0.2.0) depends on `mlx-audio` (v0.2.3) which depends on `fastrtc` (v0.0.2.post4)
which depends on `librosa` (v0.11.0) which depends on `numba` (v0.53.1) which depends on `llvmlite`
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment