LLM Experiences
This revision is from 2024/10/04 21:28. You can Restore it.
Error Models
- Llama-medx_v3.1.Q8_0.gguf - Outputs an essay about a random subject not related to input.
- Qwen2.5-14B-Instruct-abliterated.Q8_0.gguf and Qwen2.5-14B-Instruct-uncensored.Q8_0.gguf - Abliterated replied in Chinese, uncensored generated an essay about a subject that was not related to input.
- solar-pro-preview-instruct - called the work marble, marpie and then said some weird stuff and then tried an arithmetic calculation that was never in the question.
- V2.5-Qwen-14b-Q8_0.gguf from Qwen replies in Chinese after simply saying Hi, even after system prompt telling it to match the language input.
Working Models
- pivot-0.1-evil-a.Q8_0.gguf - uncensored and evil
- NewMes-v15.Q8_0.gguf - medical LLM, seems ok
- internlm/internlm2_5-7b-chat-gguf - works well.
- UnslopNemo-v2-GGUF - displays as Rocinante-12B-v2d-Q8_0.gguf and works well
- Replete-LLM-V2.5-Qwen-14b-Q8_0.gguf - probably or probably not a successful fine tune of the default Qwen 14b 2.5 (all the Qwen models seem to reply in chinese sometimes)