Cheaper LLM training and inference: I tried replacing multiplication and hit an accuracy wall
Could simpler math make AI cheaper to train and run? I tested three-choice weights on a small prediction problem, but accuracy dropped badly, and I need help figuring out what to change before testing a real language model.
- Idea
- Testing
- Evidence
- Finding
Discussion
Exploratory work is distinct from reviewed Findings. Unassessed objections do not mean a challenge was upheld.
No published items in this section yet.
Publication details and history
Author published work in progress; no scientific approval implied.
Decision type: research publish. Policy: author-posting@1. Actor: human.
Stable link to this release