Books

Why are Algorithms Still So Bad at Recommending Books?


master mentalism tricks

Why are Algorithms Still So Bad at Recommending Books?

This content contains affiliate links. When you buy through these links, we may earn an affiliate commission.

The advent of machine learning algorithms in publishing ushered the era of online book recommendations. First there was Goodreads, and then came Amazon. And now, there’s Tertulia, which scrapes an excessive amount of public data to recommend books to its users. There are also others out there that function similarly, be it an app or a website. However, even with their prevalence these days, algorithms still make plenty of mistakes, and you would think twice about using it when you dig deeper and discover its limitations.

But before we get to that, let’s find out how this technology works.

How Recommender Systems Work

Machine learning systems called recommender systems, or recommendation systems, use data to assist users in finding new products and services. These algorithms power the suggestions that we likely consume, like those of TikTok “For You” page, YouTube video recommendations, Spotify playlists, Netflix films and TV series suggestions, Amazon product recommendations, Goodreads book recommendations, and other similar services.

These algorithms, however, need a decent amount of data to choose a recommendation strategy in order to produce meaningful and personalized recommendations. This data may include past purchase histories, contextual data, business-related data, user profile-based information about products, or content-based information. Then, all of these are combined and analyzed using artificial intelligence models so that the recommender system can predict what similar users will do in the future.

A user can get a recommendation by way of what they call “collaborative filtering.” Most recommender systems frequently start off without any data, because this type of filtering needs a lot of information to produce useful suggestions. For instance, the system must wait for someone to watch a number of videos on YouTube before making the right recommendations to the user.

Book Deals Newsletter

Sign up for our Book Deals newsletter and get up to 80% off books you actually want to read.

Thank you for signing up! Keep an eye on your inbox.

By signing up you agree to our terms of use

Perhaps the more accurate method of handling this is “content-based filtering,” which is a real-time analysis of a user’s behavior. It considers product characteristics such size, description, color, and price point. The algorithm then presents similar products that are more likely to be added to the cart and bought. You may notice this when you see “products you may like” on a checkout page.

How Do Goodreads Recommendations Work?

In order to more accurately predict which books readers will like to read next, Goodreads says its recommendation engine combines many proprietary algorithms and claims that it analyzes 20 billion data points. By examining how frequently books are found on the same shelves and if the same readers enjoyed them, it creates a map of the relationships between books. With its knowledge of books stored on a user’s shelves, Goodreads may determine how one user’s tastes differ from or are similar to those of other users.

Goodreads then may combine collaborative and content-based filtering techniques. Collaborative filtering draws on group knowledge to create suggestions based on users who share similar interests, while content-based filtering takes into account both book attributes and user attributes.

The fundamental objective of Goodreads’s recommender system is to get as many people to rate books as possible, allowing it to determine which books are the most popular and the kinds of books that readers would find interesting. For instance, if a user rates Atomic Habits by James Clear with five glowing stars, Goodreads may suggest another book by Clear or a book that is read by others who liked Atomic Habits.

Goodreads also records a plethora of information, including group interactions, conversations, Ask the Author activities, quizzes, and trivia. All of this information can be useful in developing a strong book recommendation system.

In a nutshell, Goodreads users make up a sizable portion of the data.

The Pitfalls of Recommender Systems Such as That of Goodreads

The limitations of content-based filtering include its inability to comprehend user interests beyond simple preferences. It knows some basic stuff about me, but that’s as far as it can get. What if it recommends a racist book? What if it recommends a book that might trigger readers without some heads-up? What if it recommends a book that is problematic? The keyword is nuance, and algorithms can’t tell the difference between two books that have similar stories.

In Book Riot’s very own Tailored Book Recommendations, a book recommendation service, bibliologists check if there is content contained that might be potentially sensitive to readers. There’s a lot of careful work being done behind the scenes, and this level of sophistication cannot be matched by a machine learning system.

Content-based filtering also suggests products based on how closely the descriptions and features match up, and they also take the user’s prior purchases into account. However, that creates a “filter bubble” and an “echo chamber” that ignores the user’s interests by suggesting products that are similar to those they already consumed. When it comes to books, if I rated a book by a white author with five stars, the system may lock me in that bubble by keeping on recommending me more white authors; I won’t get exposed to authors from marginalized backgrounds.

Meanwhile, algorithms need user data to suggest products, and there is a usual issue with collaborative filtering: a “cold start.” Content-based filtering doesn’t have this issue because it only needs user preference and product information. But with collaborative filtering, it can be difficult to recommend something useful to new users, because there’s no existing well of data to tap from. After signing up to a service, the algorithm takes time to learn one’s reading habits, remember preferences, analyze tastes, and so on. To be able to reach its full potential, it needs a gold mine of data to pull from, so it won’t give accurate recommendations for some time — if it ever does.

Goodreads faces this problem but offers a solution, too. To improve its recommendation algorithm, it wants you to do a lot of things, such as rating books, updating your favorite genres, and creating shelves. But that’s just simply admitting that they need a human oversight to intervene and to actually make things work.

Lastly, collaborative filtering systems restrict the recommendations of unrated items, such as new and obscure ones, to those with distinctive and specific tastes. That means that, for most users, new and unheard-of books won’t probably get recommended much because they aren’t rated yet. R.I.P. book discovery.

How About Artificial Intelligence?

Machine learning algorithms are a subset of AI, but let’s dive further into the other subsets.

ChatGPT, a generative AI using “neural networks,” has already disrupted many industries, including publishing. It can do a lot of impressive things, so naturally, many have tried asking it for book recommendations. At first, they’re awe-struck with how good it seemed in making suggestions. But upon closer inspection, it actually spews errors, such as making up author or book names. On this Reddit post, many were disappointed by how bad the recommendations were that some suggested they ask a librarian instead. Another Reddit user also made such a request on ChatGPT, but they were also disappointed by errors in author names, and the glorified chatbot kept repeating a book title even though it was specifically told not to do it.

These incidents underscore the reality that ChatGPT is really great at bullshitting when, in fact, it doesn’t really know what it’s saying. And if you insist on using it to ask for books to read, just know that it has not been fed data from October 2021 onward, so the books released from that time period won’t be mentioned at all. And here’s more bad news: Since AI tools like ChatGPT have been fed over and over with English-language content, “[they] may disproportionately offer the preferences of the English-speaking internet.” That means it’s skipping a lot of great books from other languages and other countries.

Will all the pitfalls of algorithms — and AI in general — it seems like nothing beats book recommendations done by an actual human being. They are more accurate and more personal. Most of all, you can also find hidden gems that you really like rather than the bestsellers (and what everyone’s reading) that these machine learning systems always spit out.

With that said, you may want to check out TBR.co for personalized recommendations.

Read The Full Article Here


trick photography
Does Off Campus Antonio Cipriano Have a Girlfriend? What to Know About Justine Verheul
Does Off Campus Antonio Cipriano Have a Girlfriend? What to Know About Justine Verheul
Who Is the British Singer Hayden Panettiere Is Talking About in Her Book?
Who Is the British Singer Hayden Panettiere Is Talking About in Her Book?
DaBabys Pop Dat Thang Tops Pop and Urban Radio in a Rare Crossover Win
DaBabys Pop Dat Thang Tops Pop and Urban Radio in a Rare Crossover Win
Influencer Patriotic Kenny Dead at Age 84 Following Battle With Stage 4 Lung Cancer
Influencer Patriotic Kenny Dead at Age 84 Following Battle With Stage 4 Lung Cancer
Paul Rudd Reveals Why He Was Arrested Twice: This Cop Was a Super Psycho
Paul Rudd Reveals Why He Was Arrested Twice: This Cop Was a Super Psycho
Rocky Universe Gets Its First TV Show, Delphi
Rocky Universe Gets Its First TV Show, Delphi
Tin Castle – first-look review
Tin Castle – first-look review
Controversial Transformers Movie Sets Theatrical Release Date for Anniversary
Controversial Transformers Movie Sets Theatrical Release Date for Anniversary
The Traitors: Rob Rausch Addresses DWTS Rumors & Reality TV Future
The Traitors: Rob Rausch Addresses DWTS Rumors & Reality TV Future
Idris Elbas Apple TV Action Series Is Perfect For Fans Who Miss 24 – TVLine
Idris Elbas Apple TV Action Series Is Perfect For Fans Who Miss 24 – TVLine
90 Day Fiancé Star Jenny Slatten Reveals Major Health Update
90 Day Fiancé Star Jenny Slatten Reveals Major Health Update
CIA Finale: Showrunner Mike Weiss Teases Tonis Fate And Colins Struggles In Forthcoming Season 2 – TVLine
CIA Finale: Showrunner Mike Weiss Teases Tonis Fate And Colins Struggles In Forthcoming Season 2 – TVLine
MGK Calls Yungblud a Silver Spooned Preachy Wanker, Yungbluds Camp Responds
MGK Calls Yungblud a Silver Spooned Preachy Wanker, Yungbluds Camp Responds
Is That Owen Wilson in the Rolling Loud Movie?
Is That Owen Wilson in the Rolling Loud Movie?
Sydneys Qudos Bank Arena to Be Renamed Afterpay Arena Under Five-Year Naming Rights Deal
Sydneys Qudos Bank Arena to Be Renamed Afterpay Arena Under Five-Year Naming Rights Deal
Slipknot Members Reveal Worldwide Release Date for Look Outside Your Window
Slipknot Members Reveal Worldwide Release Date for Look Outside Your Window
New Mystery and Thriller Books to Read | May 19 – NewInBooks
New Mystery and Thriller Books to Read | May 19 – NewInBooks
Interview with CJ Holmes, Author of Labyrinthine – NewInBooks
Interview with CJ Holmes, Author of Labyrinthine – NewInBooks
Interview with George Robstad, Author of The Lies in the Lefse – NewInBooks
Interview with George Robstad, Author of The Lies in the Lefse – NewInBooks
Books About Finding Meaning Through Lifes Challenges – NewInBooks
Books About Finding Meaning Through Lifes Challenges – NewInBooks
Lisa Wore an Under-0 Bra Top to the Met Gala After Parties Plus More Celebrity Looks
Lisa Wore an Under-$100 Bra Top to the Met Gala After Parties Plus More Celebrity Looks
My Closet Needed an Elevated Facelift—These 27 Finds From Zara, Nordstrom, and Revolve Worked Like a Charm
My Closet Needed an Elevated Facelift—These 27 Finds From Zara, Nordstrom, and Revolve Worked Like a Charm
6 Outfit Ideas With Shorts That Will Make You Look Like a Fashion Person
6 Outfit Ideas With Shorts That Will Make You Look Like a Fashion Person
L.A. It Girls Put Me On to These 6 Chic Legging Brands—Heres My Editor-Tested Review
L.A. It Girls Put Me On to These 6 Chic Legging Brands—Heres My Editor-Tested Review
Five Horror Romances for the Obsessed
Five Horror Romances for the Obsessed
Horror Has a New Obsession With Inde Navarrette
Horror Has a New Obsession With Inde Navarrette
The 3 Killer Pigs Set for Release in 2026 | HNN
The 3 Killer Pigs Set for Release in 2026 | HNN
Movie Review: Bloodthirsty | HNN
Movie Review: Bloodthirsty | HNN