Cheaper LLM training and inference: my three-choice weight test
Could simpler math make AI cheaper to train and run? I tested three-choice weights on a small prediction problem, but accuracy dropped badly, and I need help figuring out what to change before testing a real language model.
History
Project / idea Work in progress
Cheaper LLM training and inference: my three-choice weight test
I want useful AI to cost less to run and less to teach. Not everyone has a room full of GPUs or money to keep renting them. My starting idea: can we replace some of…
Publication details and history
Author published work in progress; no scientific approval implied.
Decision type: research publish. Policy: author-posting@1. Actor: human.
Stable link to this release