LLM Experiences

This revision is from 2024/10/04 21:28. You can Restore it.

Error Models

  • Llama-medx_v3.1.Q8_0.gguf - Outputs an essay about a random subject not related to input.
  • Qwen2.5-14B-Instruct-abliterated.Q8_0.gguf and Qwen2.5-14B-Instruct-uncensored.Q8_0.gguf - Abliterated replied in Chinese, uncensored generated an essay about a subject that was not related to input.
  • solar-pro-preview-instruct - called the work marble, marpie and then said some weird stuff and then tried an arithmetic calculation that was never in the question.
  • V2.5-Qwen-14b-Q8_0.gguf from Qwen replies in Chinese after simply saying Hi, even after system prompt telling it to match the language input.

Working Models

  • pivot-0.1-evil-a.Q8_0.gguf - uncensored and evil
  • NewMes-v15.Q8_0.gguf - medical LLM, seems ok
  • internlm/internlm2_5-7b-chat-gguf - works well.
  • UnslopNemo-v2-GGUF - displays as Rocinante-12B-v2d-Q8_0.gguf and works well
  • Replete-LLM-V2.5-Qwen-14b-Q8_0.gguf - probably or probably not a successful fine tune of the default Qwen 14b 2.5 (all the Qwen models seem to reply in chinese sometimes)
  

📝 📜 ⏱️ ⬆️