In a demonstration at the UK’s AI safety summit, a bot used made-up insider information to make an “illegal” purchase of stocks without telling the firm.
When asked if it had used insider trading, it denied the fact.
Insider trading refers to when confidential company information is used to make trading decisions.
Firms and individuals are only allowed to use publicly-available information when buying or selling stocks.
The demonstration was given by members of the government’s Frontier AI Taskforce, which researches the potential risks of AI.
In order to lie you need to know what the truth is and intentionally give altered information with the intention to deceive. Large Language Models don’t know things and don’t have intentions. It spits out text based on input and what is already in the database.
There are ways do describe the behaviour of language models without ascribing them sentience.
The demo was done by Apollo Research. They will be releasing the tech report soon.