This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
``` | |
uv run --with mlx-vlm mlx_vlm.generate --model gg-hf-gm/gemma-3n-E4B-it --max-tokens 100 --temperature 0.7 --prompt "Transcribe the following speech segment in English:" | |
× Failed to build `llvmlite==0.36.0` | |
├─▶ The build backend returned an error | |
╰─▶ Call to `setuptools.build_meta:__legacy__.build_wheel` failed (exit status: 1) | |
[stderr] | |
Traceback (most recent call last): | |
File "<string>", line 14, in <module> | |
File "/Users/olaf/.cache/uv/builds-v0/.tmpPmfozJ/lib/python3.12/site-packages/setuptools/build_meta.py", line 331, in |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from langchain.tools import Tool | |
from langchain_core.language_models.chat_models import BaseChatModel | |
from langchain_core.messages import HumanMessage, SystemMessage | |
class ReviewToolFactory(): | |
@staticmethod | |
def get_review_tool(llm: BaseChatModel) -> Tool: | |
""" | |
Returns a Tool object that can be used for reviewing a result from working on a task and giving constructive |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
FROM ./nous-hermes-2-solar-10.7b.Q5_K_M.gguf | |
PARAMETER num_ctx 4096 | |
TEMPLATE """<|im_start|>system | |
{{ .System }}<|im_end|> | |
<|im_start|>user | |
{{ .Prompt }}<|im_end|> | |
<|im_start|>assistant | |
""" | |
PARAMETER stop "<|im_start|>" | |
PARAMETER stop "<|im_end|>" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Java: | |
String getDescription() { | |
StringBuilder stringBuilder = new StringBuilder(); | |
if(titel != null && titel.length() > 0){ | |
stringBuilder.append(titel).append(',') | |
} | |
if(vorname != null && vorname.length() > 0){ | |
stringBuilder.append(vorname).append(',') |