NExT-Search: Rebuilding User Feedback Ecosystem for Generative AI Search
Abstract
NExT-Search seeks to enhance generative AI search by introducing fine-grained feedback mechanisms at each stage of the pipeline using User Debug Mode and Shadow User Mode, facilitating continuous improvement.
Generative AI search is reshaping information retrieval by offering end-to-end answers to complex queries, reducing users' reliance on manually browsing and summarizing multiple web pages. However, while this paradigm enhances convenience, it disrupts the feedback-driven improvement loop that has historically powered the evolution of traditional Web search. Web search can continuously improve their ranking models by collecting large-scale, fine-grained user feedback (e.g., clicks, dwell time) at the document level. In contrast, generative AI search operates through a much longer search pipeline, spanning query decomposition, document retrieval, and answer generation, yet typically receives only coarse-grained feedback on the final answer. This introduces a feedback loop disconnect, where user feedback for the final output cannot be effectively mapped back to specific system components, making it difficult to improve each intermediate stage and sustain the feedback loop. In this paper, we envision NExT-Search, a next-generation paradigm designed to reintroduce fine-grained, process-level feedback into generative AI search. NExT-Search integrates two complementary modes: User Debug Mode, which allows engaged users to intervene at key stages; and Shadow User Mode, where a personalized user agent simulates user preferences and provides AI-assisted feedback for less interactive users. Furthermore, we envision how these feedback signals can be leveraged through online adaptation, which refines current search outputs in real-time, and offline update, which aggregates interaction logs to periodically fine-tune query decomposition, retrieval, and generation models. By restoring human control over key stages of the generative AI search pipeline, we believe NExT-Search offers a promising direction for building feedback-rich AI search systems that can evolve continuously alongside human feedback.
Community
In summary, the main contributions of this paper are as follows:
We provide a systematic analysis of the transition from traditional Web search to generative AI search, highlighting the core reasons why generative AI search has struggled to achieve large-scale success—chiefly, the loss of rich user feedback loops.
We envision a new paradigm for generative AI search, called NExT-Search, which aims to rebuild the user feedback ecosystem with two modes: a User Debug Mode that enables step-by-step user debugging across the pipeline and a Shadow User Mode that simulates user feedback using personalized user agents to support minimal-interaction users.
We outline how fine-grained feedback can be utilized through both online adaptation and offline model updates, and propose a feedback store to incentivize user participation, laying the foundation for a sustainable and self-improving search ecosystem.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Automating Personalization: Prompt Optimization for Recommendation Reranking (2025)
- SymbioticRAG: Enhancing Document Intelligence Through Human-LLM Symbiotic Collaboration (2025)
- Scent of Knowledge: Optimizing Search-Enhanced Reasoning with Information Foraging (2025)
- From Prompting to Alignment: A Generative Framework for Query Recommendation (2025)
- Toward Holistic Evaluation of Recommender Systems Powered by Generative Models (2025)
- Search and Refine During Think: Autonomous Retrieval-Augmented Reasoning of LLMs (2025)
- ReZero: Enhancing LLM search ability by trying one-more-time (2025)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper