On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?

Author: Emily Bender, Timnit Gebru, Angelina McMillan-Major, Shmargaret Shmitchell

Publisher: Association for Computing Machinery (ACM) Digital Library

Publication Year: 2021

Summary: The following article enumerates the costs and risks associated with contemporary large language model development. The most important of these are environmental costs; financial costs, which in turn erect barriers to entry, limiting which languages can benefit from the most advanced techniques; and the risk of stereotyping, denigration, increases in extremist ideology. Interestingly the article also mentions the possibility of wrongful arrest when “humans encounter seemingly coherent LM output and take it for the words of some person or organization who has accountability for what is said.”