3 Comments
User's avatar
Linda Gosslin's avatar

This is a fascinating article. I now understand much more about AI, and what it can and can’t do. Thanks for writing it. I have every book you’ve published,including the first children’s book.

Expand full comment
Robin Mehaffey's avatar

What a great article! Thanks for all your research and experience and taking the time to share it. This is a fascinating subject. I was thinking that AI might be a quicker solution than my learning how to paint with watercolors to illustrate a children's book but probably not. And learning to paint is fun, too! P.S. Love all your books. :)

Expand full comment
Ralph's avatar

Great, understandable summary of a very complex problem.

You might want to look at "How AI Knows Things No One Told It," by By George Musser on May 11, 2023, in Scientific American.

GPT (short for “generative pre-trained transformer”) and other large language models, or LLMs rely on a machine-learning system called a neural network. That GPT and other AI systems perform tasks they were not trained to do, giving them “emergent abilities,” has surprised even researchers who have been generally skeptical about the hype over LLMs. “I don't know how they're doing it or if they could do it more generally the way humans do—but they've challenged my views,” says Melanie Mitchell, an AI researcher at the Santa Fe Institute.

OpenAI's plug-ins have given ChatGPT a modular architecture a little like that of the human brain. “Combining GPT-4 [the latest version of the LLM that powers ChatGPT] with various plug-ins might be a route toward a humanlike specialization of function,” says M.I.T. researcher Anna Ivanova.

OpenAI has not divulged the details of how it designed and trained GPT-4, in part because it is locked in competition with Google and other companies—not to mention other countries. “Probably there's going to be less open research from industry, and things are going to be more siloed and organized around building products,” says Dan Roberts, a theoretical physicist at M.I.T., who applies the techniques of his profession to understanding AI.

Good luck "Don Quixote!"

Ralph Buck

Expand full comment