EDINBURGH, Scotland — More than 350 academics and staff at the University of Edinburgh are urging university leadership to end its partnership with OpenAI, the company behind ChatGPT, citing concerns ranging from data security and labor practices to the potential for military applications and environmental impact. The call to sever ties comes as the university’s contract with OpenAI nears its expiration, presenting an opportunity to reassess the relationship.
The concerns, detailed in an open letter, reflect a growing debate within higher education about the ethical and practical implications of integrating powerful AI tools into academic environments. While universities are exploring the potential benefits of large language models (LLMs) for research and teaching, questions about responsible implementation are mounting.
At the heart of the dispute are allegations that OpenAI’s practices do not align with the University of Edinburgh’s own artificial intelligence and procurement principles. Signatories point to ongoing legal challenges related to harm allegedly caused by OpenAI models, as well as reports of frequent data breaches. According to a report by the cybersecurity firm Wiz, OpenAI experienced more data breaches in 2023 than any other major LLM provider.
Concerns Over Labor Practices and Military Ties
The letter also raises serious ethical questions about OpenAI’s labor practices. Reports from outlets like Time Magazine have detailed allegations of exploitation of content moderators, who were tasked with filtering harmful content from the models and reportedly subjected to low wages and challenging working conditions. These concerns directly contradict the University of Edinburgh’s commitment to ethical sourcing and fair labor practices.
Adding to the unease is OpenAI’s recently announced partnership with the U.S. Department of Defense. This collaboration, which allows OpenAI’s AI tools to be used within the military’s classified systems, has sparked criticism from those who believe it raises ethical concerns about the weaponization of artificial intelligence. James Galbraith, a postdoctoral research associate in the School of Biological Sciences and a signatory of the letter, expressed his discomfort with this development. “The central issue is that contracting OpenAI to provide LLMs to staff and students does not follow the university’s AI policies, in particular the labour rights issues, the impact their data centres are having on the communities they have been built in, and their contracts with the US military,” he said.
Galbraith also voiced concerns that OpenAI’s stated goals may not be aligned with the interests of academia. He believes the company’s focus on predictive algorithms could ultimately lead to the displacement of educators and students. “No university or education provider should be contracting such a company,” he stated.
Environmental Impact and Bias in AI Responses
Beyond ethical considerations, the letter highlights the significant environmental impact of artificial intelligence. Training and running LLMs requires substantial energy consumption, potentially undermining the University of Edinburgh’s sustainability goals. A report in Times Higher Education warned that heavy AI use could jeopardize universities’ net-zero targets.
The letter also points to documented instances of bias in ChatGPT’s responses, raising concerns about the potential for perpetuating harmful stereotypes and inequalities. Critics argue that OpenAI has not been sufficiently transparent about the data used to train its models, making it difficult to assess and mitigate these biases.
University Response and Wider Trends
Gavin McLachlan, vice-principal, chief information officer and librarian at the University of Edinburgh, acknowledged the concerns raised in the letter. “The university aims to provide all students and staff safer access to AI tools and technology in a way that aligns with our values,” he said in a statement. McLachlan added that the university plans to discuss the concerns directly with the authors of the letter and consider the matter with its governance groups. He emphasized that access to university AI platforms is contingent on users agreeing to the university’s AI guidelines, which aim to promote responsible use.
OpenAI defended its practices, stating that the claims in the letter were “misleading” and reiterating its commitment to building AI that is safe, useful, and beneficial. “We do that by making AI widely accessible, investing heavily in safety, and working with governments around the world to ensure people can get the most out of AI safely and responsibly,” an OpenAI spokesperson said.
The University of Edinburgh is not alone in grappling with these issues. Several other universities, including the University of Oxford and the University of Manchester, have established partnerships with AI companies. The University of Manchester, for example, partnered with Microsoft Copilot in January.
What’s Next for the Partnership?
The University of Edinburgh’s decision on whether to renew its contract with OpenAI will likely set a precedent for other institutions navigating the complex landscape of AI integration. The university’s governance groups are expected to review the concerns raised in the open letter and assess the potential risks and benefits of continuing the partnership. A decision is anticipated in the coming weeks, as the current contract nears its expiration date.
The debate at Edinburgh underscores the need for universities to develop clear ethical guidelines and robust oversight mechanisms for the use of AI tools. As AI technology continues to evolve, institutions will face increasing pressure to balance innovation with responsible implementation, ensuring that these powerful tools are used in a way that aligns with their values and promotes the public good.
This story will be updated as more information becomes available.
Have your own thoughts on the University of Edinburgh’s potential decision? Share your comments below, and consider sharing this article with your network.
