Atom2.7m Arithmetic Demo

Atom2.7m is a tiny causal language model for text continuation, with arithmetic-aware handling for numeric spans.

It is not an instruction-tuned chatbot. It works best with short continuation prompts such as 12 + 34 =. For arithmetic, greedy decoding with a small number of new tokens usually works best.

1 32
0.1 2
Examples
Prompt Max new tokens Temperature Sample instead of greedy decoding