Latent Factor Recommender Systems | Stanford Lecture 55

Added:

Content-Based and Hybrid Recommendation (Addressing Cold-Start and Interpretability)

While Latent Factor models (such as SVD) excel at uncovering hidden patterns from user-item interactions, they suffer from two major flaws: the "cold-start" problem and a lack of interpretability. Because SVD relies purely on historical collaborative data, it cannot recommend new items or serve new users who lack interaction history. Additionally, the mathematical "latent factors" are abstract and unexplainable to users. Content-Based and Hybrid Recommender Systems offer a critical alternative. By analyzing explicit features (e.g., item descriptions, user demographics, and knowledge graphs), these systems can recommend items based on actual content similarity rather than user behavior alone. This approach effectively resolves the cold-start issue, provides transparent and explainable recommendations, and reduces the popularity bias common in matrix factorization models.

Fundamental Linear Algebra: Familiarity with matrix operations, dimensionality reduction, and the basic concept of Singular Value Decomposition (SVD).
Collaborative Filtering Basics: Understanding how user-item interaction matrices work, including the difference between content-based filtering and memory-based collaborative filtering.
Optimization and Loss Functions: Basic knowledge of loss minimization, optimization techniques like Gradient Descent, and evaluation metrics like Root Mean Squared Error (RMSE).
Basic Machine Learning Workflows: Understanding train/test splits, overfitting, and regularization techniques to prevent models from memorizing sparse data.
Advanced Optimization Algorithms: Exploring Alternating Least Squares (ALS) vs. Stochastic Gradient Descent (SGD) specifically optimized for large-scale sparse matrices.
Implicit Feedback Models: Learning how to build recommender systems using binary or implicit data (clicks, dwell time, purchase history) rather than explicit ratings.
Factorization Machines (FMs): Studying how to incorporate metadata and context (user demographics, time of day, item tags) into the latent factor framework.
Deep Learning-Based Recommendation: Investigating Neural Collaborative Filtering (NCF) and using autoencoders or sequence-based models (like GRU4Rec) for recommendation.
Ranking-Based Evaluation Metrics: Moving from predicting absolute ratings (RMSE) to evaluating ranking quality using metrics like Precision@K, Recall@K, and NDCG.
50K views648likes14:16@ArtificialIntelligenceAllinOneOriginal Release: 2016-04-13

Latent factor recommender systems model recommendations as an optimization problem where the rating prediction task is approached through matrix factorization, decomposing the user-item rating matrix into two lower-dimensional matrices (Q for items and P for users) that map both users and items into a shared latent factor space; predictions are generated by computing the dot product between corresponding user and item vectors, with the system optimized to minimize the root mean squared error on known ratings while generalizing to unknown ratings.