{"id":20950,"date":"2023-12-01T10:20:54","date_gmt":"2023-12-01T18:20:54","guid":{"rendered":"https:\/\/www.kith.org\/jed\/?p=20950"},"modified":"2023-12-01T10:27:40","modified_gmt":"2023-12-01T18:27:40","slug":"sorry-but-chatgpt-doesnt-love-your-book","status":"publish","type":"post","link":"https:\/\/www.kith.org\/jed\/2023\/12\/01\/sorry-but-chatgpt-doesnt-love-your-book\/","title":{"rendered":"Sorry, but ChatGPT doesn\u2019t love your book"},"content":{"rendered":"\r\n

A month ago, File 770 carried an item in which an author said that he had asked ChatGPT for a blurb for his book<\/a>. He seemed to be delighted that ChatGPT had not only read his book, but loved it; ChatGPT called it a \u201ccaptivating narrative.\u201d The author continued:<\/p>\r\n

\r\n

Could [ChatGPT] have reached into my computer and read my novel and then compared it to the thousands of other novels and their reviews that have been uploaded to its massive database? And now makes a value judgement like that?<\/p>\r\n

It could do so in a nanosecond.<\/p>\r\n<\/blockquote>

\r\n

The author claimed to \u201cknow a bit about AI,\u201d but unfortunately appeared to misunderstand what ChatGPT does.<\/p>\r\n

A few commenters provided corrections\/clarifications, but anyone who didn\u2019t read the comments may have been left with the impression that ChatGPT \u201cknow[s] more than humans do\u201d and that it read this book and thought it was great.<\/p>\r\n

I\u2019m posting all this not to pick on the specific author, nor on File 770\u2019s editor\/owner, but rather because it\u2019s just one instance of what I suspect is a very widespread misunderstanding.<\/p>\r\n

So, just in case anyone who sees this post of mine is uncertain:<\/p>\r\n

ChatGPT is more like a game of Mad Libs than like a person. It\u2019s not sentient. It doesn\u2019t \u201cread\u201d a book, and it doesn\u2019t \u201cmake a value judgement\u201d about a book. The way it works (very roughly) is that, given some input words, it chooses a sequence of words based on which word is the most likely next word in the sequence. (Where it determines what\u2019s \u201cmost likely\u201d by having been trained on an enormous number of examples of text written by humans.)<\/p>\r\n

(What I\u2019m saying about ChatGPT here also applies to other software that\u2019s in the AI subcategory called \u201cLLM,\u201d or Large Language Model. There are also other kinds of AI software that work differently, but none of them so far are capable of making meaningful value judgments about books.)<\/p>\r\n

ChatGPT\u2019s training included a vast number of book blurbs (I would guess millions of them), so when it\u2018s asked to write a book blurb, it creates a sequence of words that looks a lot like all of the other blurbs out there.<\/p>\r\n

So ChatGPT didn\u2019t evaluate this book and find it \u201ccaptivating.\u201d Instead, ChatGPT created a sequence of words that was similar to the sequences of words used in other blurbs, and the phrase \u201ccaptivating narrative\u201d is a very common phrase, so it used that phrase.<\/p>\r\n

\r\n

I just asked ChatGPT to write me a blurb for the Gor series. Here\u2019s part of its response:<\/p>\r\n

\r\n

Explore the captivating world of Gor in John Norman's iconic series. Immerse yourself in a vivid and intricate universe where honor, adventure, and exotic landscapes come alive. With engaging characters and thought-provoking themes, the Gor series weaves a compelling tapestry of fantasy that resonates with fans worldwide.<\/p>\r\n<\/blockquote>\r\n

Again, that doesn\u2019t mean that ChatGPT read and loved the Gor books. It means that ChatGPT was trained on a large volume of human-written text, and humans have written blurbs, and humans have written about Gor, and ChatGPT is generating a sequence of words based on the human writing it was trained on.<\/p>\r\n

I also asked ChatGPT to write a negative<\/em> review of the book that the File 770 author wrote. I won\u2019t quote the result here, because again my goal here is not to pick on that particular author; but it was full of the kinds of negative phrases that appear in negative reviews.<\/p>\r\n

So, once again: ChatGPT isn\u2019t sentient, and it doesn\u2019t evaluate the literary quality of books.<\/p>\r\n\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[132],"tags":[],"class_list":["post-20950","post","type-post","status-publish","format-standard","hentry","category-ai"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/posts\/20950","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/comments?post=20950"}],"version-history":[{"count":3,"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/posts\/20950\/revisions"}],"predecessor-version":[{"id":20953,"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/posts\/20950\/revisions\/20953"}],"wp:attachment":[{"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/media?parent=20950"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/categories?post=20950"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.kith.org\/jed\/wp-json\/wp\/v2\/tags?post=20950"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}