Recommendation systems have evolved beyond simple algorithms into comprehensive strategies encompassing overall system design, data quality, real-time processing, and ethics. Alongside the latest technology trends, we thoroughly examine 8 essential points to consider when applying them to real services. The ultimate goal is to maximize each user's individual experience -- and that should never be forgotten.


1. Basic Approaches to Recommendation Systems

If you're new to recommendation systems, you might think of classic categories like content-based, collaborative filtering, and hybrid approaches. As shown in the diagram below, these traditional classifications are indeed the typical starting point.

Traditional recommendation system classification diagram

However, as of 2025, recommendation systems are an endlessly expanding domain that must comprehensively consider types and structures of data, real-time capabilities, large-scale distributed architectures, cutting-edge AI techniques (Large Language Models, GNNs, reinforcement learning, etc.), and ethical concerns.

"We no longer look at algorithms alone. We must consider data, infrastructure, ethics, and the latest AI techniques."


2. Overall Architecture of Recommendation Systems

The core purpose of a recommendation system is to quickly and accurately select the most suitable items for a user from a vast pool of items. To achieve this, two domains -- offline (data and model training) and online (real-time request handling) -- work together organically.

Overall recommendation system architecture

The 4 Stages of a Recommendation System

1. Retrieval (Candidate Generation)

  • Purpose: Quickly extract the top N candidates from the entire item pool
  • Key technique: Fast embedding similarity search using ANN (Approximate Nearest Neighbors), etc.

    "The role of Retrieval is to narrow millions of items down to just hundreds in seconds!"

2. Filtering

  • Purpose: Ensure quality and policy compliance
  • Main tasks: Filter out already-viewed items, out-of-stock/policy-violating items, etc.
  • Techniques: Bloom Filter, Rule-based Filter

3. Scoring

  • Purpose: Assign complex scores to candidates to determine rankings
  • Characteristics: Uses sophisticated models like Wide&Deep and Transformers, multi-objective optimization

    "This is where the real brain kicks in -- sophisticated scoring determines 'who is more relevant to whom.'"

4. Ordering (Final Display Order)

  • In practice: Determines display order reflecting business strategy, diversity, user experience, etc.

In reality, recommendation lists become smarter through an endless cycle of user responses (clicks, purchases, etc.) -> data collection -> offline training -> model redeployment.


3. Latest Trends in Recommendation Systems

Summary of latest recommendation system trends

Trends can be divided into 4 categories!

  1. Data & Representation

    • Leveraging diverse data and structures including multimodal and graph data
    • Data-centric innovation: data matters more than the model
  2. Modeling Approaches

    • Applying cutting-edge AI including LLMs (GPT, etc.), generative recommendations, reinforcement learning, and conversational recommendations
    • Rapid growth in sequential/session-based behavioral pattern analysis

      "The latest technologies permeate every stage, capturing even subtle changes in user behavior."

  3. System Operations

    • Real-time large-scale distributed processing, virtual servers, streaming diverse behavioral data
    • Distributed/online learning, self-feedback loops
  4. Trust & Ethics

    • Growing spotlight on trust-building technologies including fairness, transparency, privacy, and bias prevention
    • Data protection through XAI, Federated Learning, etc.

4. Personalized Recommendation System Strategies

At the center of all this evolution lies 'personalization' -- ultimately for the user.

Personalization means: Showing results tailored to each user's preferences, behavior, and context.

Success is when users feel "This really matches my taste -- it feels like the system knows me!"

Why Is Personalization Key?

  • Users are accustomed to tailored experiences: Most services including OTT, shopping, and music have embraced personalization!
  • Maximizing business impact through response rates (CTR, conversion), dwell time, purchase inducement, etc.
  • Effective in advertising too: "Smartly choosing who receives which message."

Personalization Implementation Methods

  1. Explicit Profile-Based
    • Users directly input preferred categories.
    • Advantages: Quick initial response, cold-start mitigation.
  2. Behavior-Based
    • Leveraging implicit feedback from clicks, viewing, etc. (collaborative/content-based, hybrid)
  3. Context/Situation-Based
    • Utilizing real-time context such as time, location, weather, events
    • "Nearby restaurants at lunch, movie recommendations on weekends!"
  4. Deep Learning Embedding-Based
    • Behavioral sequence embeddings using ANN, GNN, Transformers, etc.

Cautions with Personalization

  • Cold Start: Lack of behavioral data for new users/items. -> Use content-based approaches, onboarding events, surveys, etc.
  • Bias/Over-Personalization: Recommending only what users like reduces novelty and diversity
  • Privacy Concerns: "Does the system know everything I've looked at?"
    • Data processing in compliance with privacy laws such as GDPR, CCPA

      "Federated Learning trains only on individual devices and aggregates only the results on the server. This reduces data leakage concerns!"


5. 8 Essential Considerations When Implementing and Operating Recommendation Systems

Recommendation systems have moved from 'nice to have' to essential infrastructure! Here are the 8 must-check points for implementation and operation, hitting only the key highlights.

  1. Establish Goals and KPIs

    • "What are we building this for?"
    • Commerce: CTR, CVR, LTV / OTT: Watch time, subscription rate, etc.

      "Recommendations that only boost click-through rates may decrease long-term satisfaction."

  2. Data Pipeline & Feature Strategy

    • Essential: event definitions for clicks/scrolls, feature stores, data quality monitoring systems
  3. Cold Start Strategy

    • Mitigate initial data scarcity using diverse approaches: popularity-based, content-based, onboarding surveys, etc.
  4. Model/Architecture Design

    • Two-stage structure (Retrieval + Ranking), applying latest techniques (LLM, GNN, etc.), considering retraining/online learning
  5. A/B Testing and Deployment

    • "Must validate in real-time environments!"
    • Design experiment groups, control groups, and rapid rollback structures together
  6. Business Rules and Policies

    • Priority display of specific items, maintaining diversity, reflecting promotions, etc.

      "Blindly recommending only what users like can be problematic in many cases."

  7. Risk/Ethics Considerations

    • Privacy protection, GDPR/CCPA compliance, XAI (Explainable AI)
    • Essential considerations for data bias, fairness, and privacy
  8. Operations & Real-Time Monitoring

    • Real-time checks on CTR, CVR, etc. and rapid response readiness for issues (model drift, feature gaps, etc.)

Conclusion

The future of recommendation systems is expanding beyond algorithms into the realm of overall 'system strategy'. Precise goal setting, quality data, efficient architecture, real-time improvement, and engineering that encompasses ethics and trust are the keys to success.

"Providing the most valuable experience to users -- this is the ultimate reason behind all these changes."

By combining technology and strategy in a balanced way, recommendation systems can become not just a simple feature but a core engine for business growth.

Related writing

HarvestEngineering Leadership · AIEnglish

Why Agent-Era Skill Standardization Changes Everything

A walkthrough of Skills as org-wide AI infrastructure: four ecosystem shifts, how specialist stacks and orchestrators work, practical authoring rules (description, one-line gotcha, reasoning), agent-first design, three-tier ops, community repos—and why perfection, depth, and stamina still compound.

Mar 31, 2026Read more
HarvestEngineering Leadership · AIEnglish

AX Roadmap That Leads to Results: Connecting Individual Efficiency to Organizational Productivity

This webinar by Flex team's CCPO examines why 'using more AI doesn't automatically improve organizational outcomes' through structural analysis. Drawing from real experiments and failures in measurement, sequencing, and organizational adoption, it presents an AX design strategy focused on solving bottlenecks from the last mile - SSOT, evaluation environments, validation, and access control - concluding that changing bottlenecks, verification, decision-making, and collaboration structures matters more than increasing output volume.

Mar 28, 2026Read more
HarvestAI · Data & Decision-MakingEnglish

The Era When Agents 'Code' and Research Runs in 'Loops': Andrej Karpathy Conversation Summary

Andrej Karpathy says that with the recent leap in coding agents, the core task has shifted from writing code directly to 'conveying intent to agents.' He sees this extending to AutoResearch—autonomous research loops running experiment-learn-optimize cycles with minimal human involvement.

Mar 22, 2026Read more