Simple Science

Cutting edge science explained simply

# Computer Science # Information Retrieval # Artificial Intelligence

Revolutionizing Recommendations: The Controllable Retrieval Model

Discover how the new CRM enhances user suggestions online.

Chi Liu, Jiangxia Cao, Rui Huang, Kuo Cai, Weifeng Ding, Qiang Luo, Kun Gai, Guorui Zhou

― 5 min read


CRM: The Future of CRM: The Future of Recommendations suggestions. CRM boosts user engagement with smarter
Table of Contents

Recommendation systems are tools used by online platforms to suggest content or products to users. Imagine you walk into a gigantic library filled with millions of books, and instead of wandering aimlessly, a friendly librarian shows you exactly what you might like to read based on your interests. That’s what recommendation systems do but in the digital world. They help users discover items by matching their preferences with a vast selection of candidates while also considering the platform's goals.

How Does It Work?

A recommendation system usually works in two main steps: retrieval and ranking.

  1. Retrieval is like the first round of a talent show where hundreds of contestants (items) are selected based on their appeal to what the audience (user) likes. This stage focuses on narrowing down the options to find the best candidates.

  2. Ranking occurs after retrieval, where the selected items are scored based on various criteria to pick the top contenders. It’s like a panel of judges taking a closer look at each contestant, deciding who gets the final spotlight on stage.

The Problem with Standard Models

While the retrieval stage works hard to find potential candidates, it often misses out on detailed information about the items during decision-making. This means it primarily looks at simple targets, like how many times an item was clicked, but doesn't take into account other important factors, like how long people actually watched the videos. This gap can limit how effective the recommendations are, making them less appealing to users.

Introducing a New Model

A new approach has been developed to help fill this gap. This model takes the idea of adding more context to the retrieval process by incorporating extra information into the system. We’ll call this new approach the "Controllable Retrieval Model," or CRM for short.

Think of CRM as a smart assistant that not only knows what you’ve liked in the past but also understands how long you usually watch content. By combining these insights, it can make much better recommendations. This allows the system to find and suggest items that not only match user interests but also consider how engaging those items are expected to be.

How Does CRM Work?

Here’s the basic idea behind CRM:

  • Conditioning: During its learning phase, CRM uses additional information - like how long users typically watch a video - to help shape its recommendations. It incorporates this "watch time" as a guiding feature.

  • Real-time Adjustments: When the system is making suggestions in real-time, it sets conditions based on user behavior and what the platform hopes to achieve. It’s like asking the librarian to suggest books based on your mood today.

Two Simple Versions

CRM doesn’t just stop at being a fancy new model. It comes in two flavors: the "naive" version, which is straightforward and easy to use, and a fancier "Decision Transformer" version that employs more complex techniques.

The naive CRM is like a basic smartphone; it does the job but isn’t packed with all the latest bells and whistles. The decision transformer CRM, on the other hand, is like getting the smartphone with all the gadgets, providing deeper insights and better suggestions.

Why Is This Important?

So, why should we care about CRM? Well, it turns out that having better recommendations can lead to happier users. When people get suggestions that closely match their interests, they are more likely to engage with the content.

In practical terms, this means that platforms using CRM can expect users to watch more videos, spend more time in the app, and even share their excitement through likes, comments, and follows. It’s like hosting a successful party where everyone has a great time and talks about it afterward.

Testing It Out

The real beauty of CRM comes from its testing. By trying it out in real-life scenarios, particularly in short-video apps, its effectiveness has been proven. For example, platforms have seen a noticeable increase in how much time users spend watching videos, along with other positive Engagement metrics.

These improvements show that using CRM can yield significant benefits, making the recommendations not just smarter but also more enjoyable for users. It’s like going from a simple house party to a block party where everyone wants to join in.

Comparing to Other Methods

While CRM has shown to be effective, it’s not the only player in town. There are several other methods that also try to recommend items to users. These include approaches based on specific interests, diffusion models that spread suggestions around like gossip, and models that rank items in a list.

However, in comparisons, CRM has outperformed these other methods, especially when it comes to how long users spend engaging with recommended content. It’s like being the most popular kid in class for giving the best book recommendations!

What About the Future?

Looking ahead, there’s a lot of potential for further enhancements in recommendation systems. The goal is to incorporate even more types of information that can help refine recommendations. Imagine if the system could not only predict how long you'd watch a video but also suggest it based on the time of day or the mood you were in when you logged on.

There’s plenty of room for creativity and innovation, paving the way for new features that keep users coming back for more.

Conclusion

Recommendation systems play a crucial role in how users interact with content online. The introduction of models like CRM highlights the importance of considering various factors for better user engagement. By combining simple and complex strategies, these systems can deliver personalized and meaningful recommendations.

So next time you find yourself engrossed in the endless scroll of videos and feel like they just “get you,” remember there’s a lot of clever technology working in the background to keep you entertained and engaged! It’s like having a personal assistant dedicated to ensuring you never run out of good content to enjoy.

Original Source

Title: CRM: Retrieval Model with Controllable Condition

Abstract: Recommendation systems (RecSys) are designed to connect users with relevant items from a vast pool of candidates while aligning with the business goals of the platform. A typical industrial RecSys is composed of two main stages, retrieval and ranking: (1) the retrieval stage aims at searching hundreds of item candidates satisfied user interests; (2) based on the retrieved items, the ranking stage aims at selecting the best dozen items by multiple targets estimation for each item candidate, including classification and regression targets. Compared with ranking model, the retrieval model absence of item candidate information during inference, therefore retrieval models are often trained by classification target only (e.g., click-through rate), but failed to incorporate regression target (e.g., the expected watch-time), which limit the effectiveness of retrieval. In this paper, we propose the Controllable Retrieval Model (CRM), which integrates regression information as conditional features into the two-tower retrieval paradigm. This modification enables the retrieval stage could fulfill the target gap with ranking model, enhancing the retrieval model ability to search item candidates satisfied the user interests and condition effectively. We validate the effectiveness of CRM through real-world A/B testing and demonstrate its successful deployment in Kuaishou short-video recommendation system, which serves over 400 million users.

Authors: Chi Liu, Jiangxia Cao, Rui Huang, Kuo Cai, Weifeng Ding, Qiang Luo, Kun Gai, Guorui Zhou

Last Update: Dec 18, 2024

Language: English

Source URL: https://arxiv.org/abs/2412.13844

Source PDF: https://arxiv.org/pdf/2412.13844

Licence: https://creativecommons.org/licenses/by/4.0/

Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.

Thank you to arxiv for use of its open access interoperability.

More from authors

Similar Articles