Impressive – ChatGPT review review: Literaturkritik.de

A review of ChatGPT’s review

By Jonas Hess

As an AI-based configurable language model, ChatGPT can produce a variety of types of text itself. Whether it’s poems, speeches, cover letters or articles: based on a very large amount of data from a variety of texts, the software is able to mimic a certain genre-specific style in different languages ​​and bring the information from that amount of data into a textual context in a meaningful way.

And the chatbot is no stranger to reviews. However, as with all other information, the program operates at the knowledge level of 2021. So while it is not aware of recent publications, the program can provide information and text about older publications.

For example, asking ChatGPT to write a review of Christian Baron’s novel man in line For writing you get the following answer:

Strong Reflection on Social Classes:
“Man on His Side” by Christian Baron

Christian Baron’s novel Man on His Side takes the reader on a deep journey through the landscape of social classes and the discovery of individual identity. With an exceptional blend of personal narration and social analysis, Barron manages to captivate the reader with his poignant story and honest voice.

The novel is based on Barron’s own experiences and tells the story of his rise from the humble circumstances of his origins to studying at an elite university. In doing so, he addresses the complex social structures that both attract and alienate him. Baron Baron is adept at portraying the division between different classes and the tensions that come with it.

Baron’s writing is frank and engaging. He is not afraid to explore contradictions and conflicts within himself and in society. He succeeds in conveying his thoughts and feelings in a way that touches the reader emotionally and makes him think. His honest portrayal allows us to put ourselves in his shoes and understand the intricacies of social class.

What is particularly impressive is Barron’s ability to transcend his own personal history and spark a broader discussion about social justice and the implications of social class. He reflects on the obstacles faced by people from disadvantaged backgrounds and critically questions the structures that perpetuate this inequality.

A Man in His Class is a novel that leaves a lasting impression. It challenges us to question our role in society and to develop empathy for those who face social disadvantage. The Baron’s candid storytelling and eye for social dynamics make this novel an important work beyond mere entertainment.

In conclusion, A Man in His Class is a powerful novel that prompts us to think about social class and individual identity. Christian Barron presents a frank tale that engages, touches and makes the reader think. This book is an absolute must for anyone interested in social justice and the effects of social class.

Really great result. At first glance, the text shows no possibility of being recognized as software generated. The sentences are complete, there are no grammatical errors and they form a coherent whole. Even the punctuation marks were placed correctly (not according to English standards). There is also no stylistic negligence such as frequent repetition of words, and instead the revision comes up with somewhat more bizarre metaphors (“a spectacle of social classes”) here and there. The text is organized along typical lines for reviews. There is an introductory paragraph that explains what the text is about and what you need to know about the author. The reviewed work was briefly presented and evaluated for content and language. At the end there is a brief conclusion with a final recommendation. Information about content, background, and author is mostly correct.

However, it is interesting that a closer look reveals quite a few flaws and oddities. On the other hand, there are many stylistic and compositional repetitions (“that touches the reader emotionally and makes him think”, “that takes the reader with you, touches and makes him think”; “complexity of social classes”, “complex[] social[] Structures”; “faithful narration”, “faithful narration”). However, this should only appear to indicate limited language skills (the set of basic texts on which the program is trained is simply too large). It is more likely that the redundancy has systemic reasons, Because the program works on the basis of statistical probabilities of word sequences.

On the other hand, many formulas appear particularly superficial and vague. For example, what is meant by “complexity of social classes” is not clear and seems empty and rhetorical. It is analogous to talking about ‘the effects of social classes’. Is the same classes meant here or is it rather not belonging For someone whose effects have been discussed?

In this context, the abundance of used and empty adjectives is also striking: the story is “engaging,” the voice is “sincere,” and the literary excursion is “profound.” The Baron narrates “brilliantly”, “frankly”, and “intoxicating”. The text is “honest”, “strong”, even “important” and, of course, makes a “lasting impression”. Of course, everything “captivates” and stimulates “thought”.

In some cases, complete sentences are also twisted in content. For example, according to the review, when Barron succeeds in “portraying the divide between the different classes and the tensions associated with them.” If you take this sentence literally, the novel is about the gap between classes as well as the gap between tensions (connected to the first). What is meant by the gap between the tensions and between the elements present, however, is questionable. Perhaps what was meant was that Barron succeeded in bridging the gap between the various classes and the accompanying tensions. So tensions between classes are displayed, but not a gap between tensions.

Also, one is surprised by a sentence like this: “What is particularly impressive is Barron’s ability to look beyond his own personal history and begin a broader discussion about social justice and the effects of social background.” Whether Barron stimulates or motivates a “wider discussion” is a question that can only be answered after some time has passed. For a review, which is usually associated with publication chronologically, that’s at least an odd statement. In addition, one can certainly ask whether the broad discussion that has already been triggered can be regarded as the author’s ability.

In addition, there is simply false data, which, however, cannot necessarily be distinguished from other correct information without background research. In the text one reads that the novel follows Barron’s own experiences rising from humble circumstances to study at an “elite university”. True, the text – which, by the way, is often not called a novel because of its highly subjective nature – traces the life of the author. However, he studied at the University of Trier, which (according to current rankings and distinction groups) cannot be described as an elite (German) university in the narrow sense. A similar situation arose when ChatGPT asked in advance if the book was known to the program. Amnesty International responded in the affirmative, with a brief synopsis and information that the volume has been “critically acclaimed” and has received “favorable reviews”. There are certainly critical voices (eg V time and the Taz) simply not mentioned. At least that didn’t tell the whole truth.

It’s also interesting that the AI ​​pretends to be human or a human auditor in many places – which it never does when asked explicitly what it is. The fact that Barron’s photography, for example, creates a “lasting impression” and enables us to “put ourselves in his shoes” indicates not only the commonalities between reviewers (software) and readers (people), but also a mutual ability to empathize with empathy that ChatGPT does not have. She does not explicitly attribute it to herself. The fact that aesthetic ratings are made at different points in the review (“adept”, “strong”, “absolute”, etc.) also runs counter to the argument put forward by the program itself that AI is particularly handling ratings (and portraying emotions) difficult. However, the presence of such statements in the review text may be due to the fact that ChatGPT simply imitates the “review” text type, which usually contains such formulas. Whether the corresponding assessments regarding the particular novel are actually meaningful or even just comprehensible is likely to be purely chance (unless existing revisions are included in the generated text).

A similar picture of the text – rich in repetitions, cliches and inaccuracies – emerges if you allow the program to write a short story (or other literary text). The result is usually an uninspired laboratory narrative that draws remarkably from what is already out there. However, the basic linguistic, interactive and also informational results (the program can explain, for example, quantum computers or black holes – in Mandarin, Hebrew, Portuguese …) are impressive in many respects. And these are still the first steps of new generations of artificial intelligence. Meanwhile, ChatGPT has its first update from basic GPT-3 to the more robust update GPT-4 Google and other big tech companies with expertise are developing artificial intelligence at full speed. It remains to be seen how long the described textual defects will continue to exist.

Until then, however, it can be said, at least given the example discussed here: such a revision is by no means an “absolute necessity for all”.