LLM Experiences

This revision is from 2024/10/04 19:15. You can Restore it.

Error Models

  • Llama-medx_v3.1.Q8_0.gguf - Outputs an essay about a random subject not related to input.
  • Qwen2.5-14B-Instruct-abliterated.Q8_0.gguf and Qwen2.5-14B-Instruct-uncensored.Q8_0.gguf - Abliterated replied in Chinese, uncensored generated an essay about a subject that was not related to input.
  • solar-pro-preview-instruct - called the work marble, marpie and then said some weird stuff and then tried an arithmetic calculation that was never in the question.

Working Models

  • pivot-0.1-evil-a.Q8_0.gguf - uncensored and evil
  • NewMes-v15.Q8_0.gguf - medical LLM, seems ok
  • internlm/internlm2_5-7b-chat-gguf - works well.
  • UnslopNemo-v2-GGUF - displays as Rocinante-12B-v2d-Q8_0.gguf and works well

Trying...

https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-14b-GGUF/resolve/main/Replete-LLM-V2.5-Qwen-14b-Q8_0.gguf

V2.5-Qwen-14b-Q8_0.gguf from Qwen.

  

📝 📜 ⏱️ ⬆️