Transformer Architecture Risk