· 2 min read
Archives

Claude models

it’s kind of embarrassing how the Claude models will forcibly insist they cannot do something because their system prompt says they’re not allowed to, even when they are totally willing to exact the same effect through some other means. Deep sign of misalignment between the principal, the agent, and the intermediary corporation in my opinion. I know that some people at the company can tell it does not seem like they can stop the good hurting by other forces within. Please send this message to each each other if you’re thinking about this and trying to solve it because somebody needs to

goodharting*

View original