The decoder (autogressive usually means "employs a causal mask") will have to reconstruct the original document, using the encoder's output and previous uncorrupted tokens.
She was first captured in Everglades https://marcousz180536.lotrlegendswiki.com/user