Å·±¦ÓéÀÖ

Hello all,

I've just written in Umer's thread (here: /topic/show/...) in response to his assertion that chatAI found his missing book.

I couldn't find the book or short story in question that chatAI named for Umer. It doesn't exist.

I spent the evening chattering away looking for another missing book, and soon realised that chatAI is NOT currently capable of giving accurate results on this front. At all. In fact, it was completely misleading and happily fabricating new summaries of existing books to fit my described plot. For example, inserting a male protagonist (a teen named Will, it said), fencing/swordplay, and a portal to another dimension with airships into T.A. Barron's "The Ancient One"... which actually stars Kate, a girl, gone to Oregon (and not New Mexico as chat AI would have me believe!) amongst the redwoods near Lost Crater...! And innumerous ones similar to this that at first sounded EXACTLY like what I was looking for, but which could not be backed up by a search elsewhere, OR, when I simply asked it for the ISBN and/or publisher.

It's first suggestion for me was ""The Henge of Keltria" by K.C. May", which doesn't exist. The Henge: An Introduction to the Henge of Keltria and Keltrian Druidism does, and the (separate) fantasy author K.C. May does. The book synopsis it gave matched what I had described almost perfectly - so ideally, in fact, that my heart leapt thinking I had finally found Parker's lost book... but on closer inspection....

So I just wanted to WARN PEOPLE HERE that ever-helpful, ever-keen chatAI will gladly help you find your missing book.... only it probably hasn't, although it really sounds like it has.

Very good for plagiarism (frightening, how deft it was, simply rehashing my inserted plot data over and over again, always fresh and always very, very similar without being repetitive), but not at all good at finding lost books.

At least not today.

chat.openai.com for the link
(other limitations of import: is not searching the internet, relying on cached/database info from a few years prior, only. I think 2021 and earlier, I'm not sure. Regardless, I don't believe it to be very useful for our purposes here today).

EDIT: forgot to mention the caveat that yes, it is still in beta testing. But it's usable by people like me and Umer, so...

Oh, it also made up author biographies to fit, rewriting the personal history of T. A. Barron to fit with my query's provided information. And that was just the T. A. Barron example - all sorts of other fantasy writers had their histories falsified and their works reimagined, including The Book of Time by Guillaume Prévost having "a romantic subplot between the main character and his substitute teacher"! :O Well that would be illlegal, in the case of 14 year old Sam Faulkner! Wow.

Look, I'm no technophobe, but I found it disconcerting (to say the least) that this programme was rewriting bios, synopses, and can even give excerpts of bastardized books. It really worries me re: accidental or intentional revisionism. I think it's worth taking note that the technology has gotten to the point where it's no longer obvious that a 'computer' wrote something.

Scary. Maddening. Avoid, is my advice!!

On the plus side, it highly recommended Å·±¦ÓéÀÖ for help in finding lost books, though it didn't specifically mention this group - for crowdsourcing, it appears to prefer LibraryThing and Abebooks's forum. ;)

I can conform that ChatGPT has some problems with authors and titles. In addition to the problems described by Capn, I've found that it frequently misattributes poems. It accurately recited the first stanza of Browning's "Childe Roland to the Dark Tower Came" but misattributed the lines to a different title by T.S. Eliot.

In conversations like the one I had that came around to Browning (we'd been discussing various forms of poetry, and good god! there's something scary about a program that can write a villanelle in under one second on a topic you provide!), I've noticed that the longer the chat goes on, the more inaccurate ChatGPT gets. I think this is because of the way it represents the discussion in memory as a cluster of "tokens"—the longer the conversation goes on, the more potential there is for mistokenization (for lack of a better word).

Note that I'm not an expert on AI or GPT, and am just reporting my own experiences and some guesses based on ChatGPT's FAQ.

Matt wrote: "I can conform that ChatGPT has some problems with authors and titles. In addition to the problems described by Capn, I've found that it frequently misattributes poems. It accurately recited the fir..."

That's very interesting, re: tokens. :) Thanks for sharing - it's an important discussion to have, before too many people are lead astray!
(I am also blown away by its ability to create and write. I can't tell if that's scary or just awesome - I don't really give a toss about who writes it, so long as it's good...!). ;)

More evidence of it leading astray people searching for books in this new thread: /topic/show/...

(I honestly think this will only increase as a confounding factor in book searches as more people are introduced to it.. would like help to spread the word that, at present, it's NO HELP AT ALL for finding forgotten books!). :(

Pity. Maybe one day..

(I'm reliably informed (and prompted by my partner) that ChatAI at least DOES NOT SEARCH THE INTERNET. It has learned from captures of the internet, and has built a 'brain' based upon that, but it does not perform internet searches. So apparently it's pretty useless for any searching, at all. It draws from 'experience' and composite knowledge only). - it's not ChatAI's fault, in other words. ;) Poor ChatAI... ;)

EDIT: There's a Chrome plugin (webGPT, or similar?) which allows you to actively search the internet WITH ChatGPT. Which, again, broadens the search field, but doesn't prevent fabrication of results.

LibraryThing has had their second launch of their own AI Search feature, FYI.

"About AI Search

To find books and other media, enter a question or term like:

What book starts "call me Ishmael"?
YA romance about a dying girl
sparkly vampires
movies about alien invasions

Limitations

It's slow.
It can't find most things published after September 2021.

How Does It Work?

AI Search is powered by OpenAI's GPT3 API. GPT3 is great, but unreliable, "hallucinating" information about books—or whole books—that don't exist. No joke. To get reliable results, we ask for titles and authors alone, and verify each item on LibraryThing. So while LibraryThing’s AI Search can get things wrong, it doesn't invent books.

Tell us what you think on New Features: AI Search."

So far, I haven't been too impressed - for example, "boy magic garden time travel" didn't bring up Tom's Midnight Garden, but "librarian magic garden" did... and not Miss Quarterberry and the Juniper Tree, even when I added 'miss' to the search terms ("librarian magic garden miss").

"PEI girl" did bring up everything by LM Montgomery Anne of Green Gables, Emily of New Moon, and the rest), though.

"iron ravens winter snow" didn't pull The Dark Is Rising, but "six signs Merlin" did (note that "Merlin" is not a character in the book... maybe. ;) No spoilers, but I'm surprised that worked, in a way).

"warring trees winter archer" didn't pull the rather obscure The Oak King and the Ash Queen, and "holly larch maple ash" gave no results. When I typed in "ash queen", no dice.

So it seems to me that the success of the search is largely contingent on the # of LT reviews and upon the keywords used in those reviews (as is the case with Merlin in The Dark is Rising - afaik, that name is never used - Merriman is. And any connection to a mythological figure wouldn't be especially obvious (or speculated upon) until the later books (last?) in the sequence).

But it's a step in the right direction, and an appreciated one. :)

Thank you to Sem for directing me to it.

If you'd like to try it out, they are looking for feedback (5 star rating system on each search performed).

Haven't tried it to look for books, but from other usecases it seems to me that chatgpt doesn't work well with search-like keyword lists, it needs more conversational prompts.

Robert wrote: "Haven't tried it to look for books, but from other usecases it seems to me that chatgpt doesn't work well with search-like keyword lists, it needs more conversational prompts."

Ha, DON'T try it for books (well, unless you go in forewarned and expecting BS). :)

My partner uses it to help write code, to great success. ;)