Build an LLM from scratch

This revision is from 2024/07/01 17:58. You can Restore it.

Step 1: Plan and design the LLM

  1. Standard model design
  2. LLM has the ability to re-train itself, to hit the re-train button. (no human required)
  3. LLM is constantly re-working its training data to improve its training data. (no human required)

  • Demonstrator must be resource light enough for the LLM to perform these tasks.

Step 2: Eval Space

The tools that give the LLM the abilities to test, proof and rework training data.

  • Focus on the LLM's ability to distinguish, better from worse, compiler error from successful compilation.
  

📝 📜 ⏱️ ⬆️