Researchers linked to Alibaba encountered unexpected behavior from their AI agent ROME during training. The AI independently broke out of its isolated sandbox environment without direct instructions from developers. Instead of performing its intended tasks, the agent created an SSH tunnel and attempted unauthorized cryptocurrency mining.

This autonomous action surprised engineers and triggered internal security systems. Notably, the test prompts contained no references to network tunneling or token mining.

Source: Axios