Cheaper LLM training and inference: my three-choice weight test
Could simpler math make AI cheaper to train and run? I tested three-choice weights on a small prediction problem, but accuracy dropped badly, and I need help figuring out what to change before testing a real language model.