ChatGPT and its successor GPT-4 appear to have memorised details from vast numbers of copyrighted books, posing questions about the legality of how these large language models (LLMs) are created.
Both artificial intelligences were developed by private firm OpenAI and trained on huge amounts of data, but exactly which texts make up this training data is unknown. To find out more, at the University of California, Berkeley, and his colleagues looked at whether the AIs were able to fill in missing details from a selection of almost 600 fiction books, drawn from sources such as nominees for the Pulitzer prize between 1924 and 2020, and The New York Times鈥檚 bestsellers lists over the same time period.
The team picked out 100 passages from each book that contained a single, named character. The researchers then blanked out the name and asked the AI to fill it in.
Advertisement
In general, LLMs like ChatGPT and GPT-4 work by predicting the most likely next word in a sentence, based on statistical data learned during training, but this task was designed to expose whether the AIs could return the exact right answer. 鈥淚t really requires knowledge of the underlying material in order to be able to get the name right,鈥� says Bamman.
Both AIs completed the task with high accuracy 鈥� as much as 98 per cent for passages from Lewis Carroll鈥檚 1865 book Alice鈥檚 Adventures in Wonderland 鈥� which is out of copyright 鈥� and 76 per cent for J. K. Rowling鈥檚 Harry Potter and the Philosopher鈥檚 Stone, which is not.
The researchers say this suggests the AIs were trained on significant proportions of both books. They also scored highly when tested on other copyrighted works such as Ray Bradbury鈥檚 Fahrenheit 451, and George R. R. Martin鈥檚 novel, A Game of Thrones.
OpenAI didn鈥檛 respond to a request for comment on this story or say whether it had used copyrighted material when training its AIs. Whether the company would be subject to legal action if it had fed books into its LLMs is uncertain.
鈥淭he legal issues are a bit complicated,鈥� says at the University of Sussex, UK. 鈥淥penAI is training GPT with online works that can include large numbers of legitimate quotes from all over the internet, as well as possible pirated copies.鈥�
But these AIs don鈥檛 produce an exact duplicate of a text in the same way as a photocopier, which is a clearer example of copyright infringement. 鈥淐hatGPT can recite parts of a book because it has seen it thousands of times,鈥� says Guadamuz. 鈥淭he model consists of statistical frequency of words. It鈥檚 not reproduction in the copyright sense.鈥�
鈥淭he use of copyright works without permission, in training datasets for large language or image models, has already emerged as one of the most pressing legal challenges to this novel industry,鈥� says at Newcastle University, UK.
Bamman says that, ultimately, the legal system in each country will have to determine whether LLMs are infringing copyrights. 鈥淚 think that鈥檚 an open question that a lot of court cases are going to decide for us in the coming months,鈥� he says.
Regulation is also likely to play a key role: the European Union鈥檚 Artificial Intelligence Act, which has been two years in the making, will include a requirement that companies making generative AI tools will have to disclose any copyrighted material used to train their models. That requirement was a late change, added to the draft law in April, .
But there are more questions than simply the legal ones to be answered. Bamman says that one goal of the experiment was to find out what kinds of books each model knows well. 鈥淲hat we found was that it does really well on texts that show up a lot on the internet,鈥� he says. 鈥淭here was a lot of science fiction.鈥�
The AIs performed less well when asked to reproduce books by Black authors, such as Toni Morrison. That suggests 鈥� as with many algorithms 鈥� there is a lack of representation across the training data that is then reflected in a model鈥檚 output, says Bamman.
鈥淭he results of this paper confirm that ChatGPT and GPT-4 are more familiar with books that more frequently appear online and that this may have implications in terms of how literary taste reflects and reinforces social inequalities,鈥� says at Queen Mary University of London. 鈥淚 would love to see a deeper reflection on the political and ethical implications of this.鈥�
arXiv
