A character-level transformer with multi-head causal self-attention, layer norm, residuals and Adam, trained in this tab on whatever text you paste, with its attention shown as it reads.
Rows are the character being predicted, columns the characters it may look back at. The upper triangle is masked, because a causal model cannot read ahead.