conclusions: „the deployment of opaque
and increasingly autonomous systems heightens the importance of
a conception of manipulation that can account for manipulation
occurring without designer intent. Such manipulation could emerge
because it is favoured under the training objective (such as engage-
ment maximization in certain content recommendation settings),
or because a model learns to imitate manipulative behavior in its
training data (such as manipulative text in language modeling)“