Imran Rahman-Jones
Technological journalist
Getty images
According to research carried out by the BBC, four main stories of artificial intelligence (IA) summarize inaccurate.
The BBC gave OPENAI Chatgpt, Microsoft’s co -pilot, Gemini and Perplexity AI content from Google on the BBC website, then asked them about the news.
He said the resulting responses contained “important inaccuracies” and distortions.
In a blog, Deborah Turness, CEO of BBC News and Current Affairs, said that AI had brought “endless opportunities”, but companies developing the tools “played with fire”.
“We live in troubled times, and how long will we last before a title known as IA causes significant real damage?” She asked.
Technological companies that have chatbots have been approached for comments.
‘Withdraw’
In the study, the BBC asked Chatgpt, Copilot, Gemini and Perplexity to summarize 100 news and evaluated each response.
He obtained journalists who were relevant experts on the subject of the article to assess the quality of the AI assistants’ responses.
He revealed that 51% of all AI answers to the news on news was deemed to have important problems of a certain form.
In addition, 19% of the AI responses which cited the content of the BBC introduced factual errors, such as incorrect factual instructions, numbers and dates.
In her blog, Ms. Turness said that the BBC sought to “open a new conversation with AI technology suppliers” so that we can “work together in partnership to find solutions”.
She called on technological companies to “withdraw” their summaries of information on AI, as Apple did after complaints from the BBC according to which Apple Intelligence had distorted the news.
Some examples of inaccuracies found by the BBC included:
Gemini badly declared that the NHS did not recommend vaping as aid to stop SmokingChatgpt and Copilot said that Rishi Sunak and Nicola Sturgeon were still in power even after leaving the perplexity that had cited the BBC News in a story on the means -Orient, saying that Iran had initially shown “a restriction” and described Israel’s actions as “aggressive”
In general, Microsoft’s co -pilot and Google Gemini have had more important problems than the chatpt and perplexity of Openai, which counts Jeff Bezos as one of his investors.
Normally, the BBC blocks its content from AI chatbots, but it opened its website for the duration of the tests in December 2024.
The report indicates that containing factual inaccuracies, chatbots “had difficulty making the difference between opinion and the fact, editorialized and often did not miss the essential context”.
The BBC program director for Geteatif IA, Pete Archer, said that publishers “should have control if and how their content is used and that AI companies should show how the assistants treat the information as well as the scale and extent of errors and inaccuracies they produce “.