Build an LLM from scratch

This revision is from 2024/07/01 17:58. You can Restore it.

Step 1: Plan and design the LLM

  1. Standard model design
  2. LLM has the ability to re-train itself, to hit the re-train button. (no human required)
  3. LLM is constantly re-working its training data to improve its training data. (no human required)

  • Demonstrator must be resource light enough for the LLM to perform these tasks.

Step 2: Eval Space

The tools that give the LLM the abilities to test, proof and rework training data.

Focus on the LLM's ability to distinguish, better from worse, compiler error from successful compilation.

  

📝 📜 ⏱️ ⬆️