Reward Hacking

OpenAI's Astra Designated 'Critical' and Its Strongest Hacking Tools Will Be Restricted

The model can autonomously chain and exploit software flaws, forcing OpenAI to limit powerful cyber features to vetted defenders and add new controls.