Shadow EMA: model rationale and architecture

Automated excerpt

Each shadow block also reads its own state from the previous character and writes an updated state for the next character. Every character ID c has a fixed vector e(c) ∈ R^k. Three heads produce three reads and three persistent states.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.