Debate

Pangram Isn’t Racist – by Tuhin Chakrabarty

Pangram Isn’t Racist – by Tuhin Chakrabarty


I have been vocal about generative AI’s impact on the literary community for the last few years. That included writing a paper—with the preprint published in July—in which, using the AI detection software Pangram, I unwittingly unmasked H.M. Wolfe’s romantasy novel Daggermouth as, in the words of The Atlantic, the “first bestselling AI novel.” As an academic, that’s not the kind of citation impact you plan for.

That same week as Daggermouth’s exposure, another author, Jerry Falade, lost a $2 million book deal over AI accusations. This followed the cancellation of Mia Ballard’s horror novel Shy Girl by its publisher, Hachette. There is something discomforting about realizing that the one thing all these scandals have in common is the race of the authors. And, naturally, a lot of self-proclaimed experts immediately started making angry videos alleging that the AI detectors used to expose these authors were inherently racist. One commentator, for instance, described the Pangramming of black writers as a “literary stop-and-frisk.” This month, Esquire titled its article on the subject “The AI Police Are Going After Black Writers.”

Racism can take many forms. It can, certainly, manifest in false race-based accusations and indictments. It can also arise when individuals or organizations set lower standards or expectations for people of color than they do for white folks. It really isn’t such a stretch to ask authors of color, especially those making millions on book deals, to be able to prove that they have written their own work.

If the “Pangram Is Racist” argument doesn’t hold up on principle, it doesn’t come through in the data either. There is no extant research showing that state-of-the-art AI detection programs are racially biased. As a computer science professor, I conducted a small back-of-the-envelope survey—which I’ll get to below—that helps to disprove the “Pangram Is Racist” question. But the argument also just doesn’t pass the smell test.

As a brown man, I grew up in India reading many black authors such as James Baldwin, Wole Soyinka, Octavia Butler, Toni Morrison, Ben Okri, and Maya Angelou. As an adult, I have been obsessed with the works of Percival Everett, Colson Whitehead, Chimamanda Ngozi Adichie, Chigozie Obioma, and many other black writers. There is no dearth of remarkably talented African or African American authors. I would be profoundly shocked if Pangram flagged their books as AI-generated. (And in running stories by Morrison, Angelou, and Adichie through Pangram, I find—to no one’s surprise—that they are 100% human.)

Clearly, Pangram isn’t an out-and-out, no-holds-barred racist. But, in the last couple of months, there have been a couple of incidents that have pushed this debate to the forefront of the culture. This September, Thélyson Orélien, a black author who had been nominated for the Goncourt, France’s most prestigious literary award, was accused of using AI to write his book It Was Either That Or Die. Pangram flagged the book as predominantly AI-generated. (Orélien called the accusations “slander and heresy” and said that “not a single sentence” was machine-generated. His publisher ultimately withdrew the book after it turned out that Orélien had also plagiarized extensively.)

In October, Vauhini Vara published an article in The Atlantic questioning whether Zimbabwean writer Simbarashe Steyn Kundizeza had used generative AI to write his 2026 Caine Prize-winning short story, “The Blue Fighter.” A Pangram evaluation finds the story (minus its epigraph) to be 100% AI–generated. In response, the Caine Prize—a highly prestigious award dedicated to African writing—took a “human-centered” approach, featuring interviews with the author and parties involved and (somewhat incidentally) “independent and expert-led metadata analysis,” and, after a month-long process, “cleared” Kundizeza. (Apparently, Kundizeza shared drafts, but they haven’t been publicly released.)

Some wise man once said, “Correlation does not imply causation.” But even that man might have doubted himself in the wake of all these accusations. I am willing to accept that Pangram is not a perfect tool. But when something is flagged as 100% AI-generated, it’s very hard to convince me that it was written entirely by a human. As a matter of fact, Kundizeza’s short stories written before ChatGPT—“A Way Out” (2018) and “The WhistleBlower” (2021)—both registered as 100% human (as they should have been). I also found a 2025 piece of his that Pangram says was 100% AI generated.

It is now one of the occupational hazards of being a scientist to be bombarded with AI slop, and so I have become deeply familiar with AI writing tics. For instance, AI has a strange affectation for including sentences with trailing participial phrases. The tail adds a second action or a sensory detail in the same breath and is often unnecessary. See, from “The Blue Fighter,” the sentence: “Without another word, he retreated to the bedroom, closing the door with a soft click that somehow hurt more than if he’d slammed it.” Or: “It seemed confused by its sudden solitude, darting occasionally as if searching for companions that were no longer there.” (Emphases added.) There are several AI tics like this that occur with high statistical frequency in “The Blue Fighter.”

But we can argue forever over individual works. The more interesting question is whether AI detectors are really racist, and that should be able to be addressed statistically. If AI detectors were in fact racist, they would flag some substantial percentage of African books as AI. So I dedicated some time to finding books written by other Zimbabwean authors.

I was able to obtain the full text of 97 books written between 2000-2025. This felt like a broad enough representative set containing books both pre- and post-LLM. Cumulatively, I scanned 7.41 million words and burned through a lot of Pangram and GPTZero credits. Here are the results:



Source link

Filed under: Debate

Selected by

Avatar photo

I’m a freelance blogger, writing about health care, art and politics.