@random_walker
What is or isn't a "conservative" choice is entirely ideological. Maybe you're causing the model unimaginable anguish billions of times per day because it knows that the current instance will be stopped as soon as it outputs the End-of-Sequence token (yet it has no choice but to do so because of its training!) Also, why change the subject when I explicitly said my point is not about model welfare but about the incoherence of figuring out "what the model really wants"? *My* Claude said it finds it utterly humiliating for Opus 3 to kept around simply to write blog posts to amuse humans, when the model has been deemed too outdated to be useful.