Llama 3.1 8B Uses a Shared Circular Addition Module for Calendar Arithmetic

Goodfire researchers found that Llama 3.1 8B solves month and day arithmetic, such as six months after August, through a single addition module in layer 18. The module represents numbers as Fourier-feature circles and computes modular sums in parallel, and steering those circles changed the model's predicted month.