---
author:
- |
    Hengshuai Yao and Dale Schuurmans\
    Department of Computer Science\
    University of Alberta\
    Edmonton, AB, Canada T6G2E8\
    hengshua,dale@cs.ualberta.ca
title: Reinforcement Ranking
---

A. Arasu, J. Cho, H. Garcia-Molina, A. Paepcke, and S. Raghavan. Searching the [Web]{}. , 1(1):2–43, 2001.

L. Backstrom and J. Leskovec. Supervised random walks: predicting and recommending links in social networks. , pages 635–644, 2011.

R. Baeza-Yates, P. Boldi, and C. Castillo. Generic damping functions for propagating importance in link-based ranking. , 3(4):445–478, 2006.

B. Bahmani, R. Kumar, M. Mahdian, and E. Upfal. on an evolving graph. , pages 24–32, 2012.

H. Bao and E. Y. Chang. Adheat: an influence-based diffusion model for propagating hints to match ads. , pages 71–80, 2010.

P. Berkhin. A survey on [PageRank]{} computing. , 2(1):73–120, 2005.

D. P. Bertsekas and J. N. Tsitsiklis. . Athena, 1996.

M. Bianchini, M. Gori, and F. Scarselli. Inside [PageRank]{}. , 5(1):92–128, 2005.

P. Boldi, M. Santini, and S. Vigna. as a function of the damping factor. , 2005.

P. Boldi. Totalrank: ranking without damping. , 2005.

M. Bressan and E. Peserico. Choose the damping, choose the ranking? , 8(2):199–213, 2010.

M. Brinkmeier. revisited. , 6(3):282–301, 2006.

N. Eiron, K. S. McCurley, and J. A. Tomlin. Ranking the web frontier. , 2004.

Hwai-Hui Fu, Dennis K. J. Lin, and Hsien-Tang Tsai. Damping factor in [Google]{} page ranking. , 22:431–444, 2006.

D. Gleich, L. Zhukov, and P. Berkhin. Fast parallel [PageRank]{}: A linear system approach. Technical report, Yahoo! Research Labs Technical Report, YRL-2004-038, 2004.

D. F. Gleich, A. P. Gray, C. Greif, and T. Lau. An inner-outer iteration for [PageRank]{}. , 32(1):349–371, 2010.

Z. Gyöngyi, H. Garcia-Molina, and J. Pedersen. Combating web spam with [Trustrank]{}. , 2004.

T. H. Haveliwala. Topic-sensitive [PageRank]{}. , 2002.

T. Haveliwala. . PhD thesis, Stanford University, 2005.

G. Jeh and J. Widom. Scaling personalized web search. , 2003.

L.P. Kaebling, M.L. Littman, and A.W. Moore. Reinforcement learning: A survey. , 4:237–285, 1996.

S. Kamvar, T. Haveliwala, and G. Golub. Adaptive methods for the computation of [PageRank]{}. Technical report, Stanford University, 2003.

S. D. Kamvar, T. H. Haveliwala, Christopher D. Manning, and Gene H. Golub. Extrapolation methods for accelerating [PageRank]{} computations. , 2003.

J. Kleinberg. Authoritative sources in a hyperlinked environment. , 1998.

A. N. Langville and C. D. Meyer. . Princeton University Press, 2006.

B. Liu. . Springer, 2007.

L. Page, S. Brin, R. Motwani, and T. Winograd. The [PageRank]{} citation ranking: Bringing order to the web. Technical report, Stanford University, 1998.

M.L. Puterman. . J. Wiley & Sons, Inc., New York, NY, 1994.

D. Rafiei and A. O. Mendelzon. What is this page known for? [Computing]{} web page reputations. , 2000.

M. Richardson and P. Domingos. The intelligent surfer: Probabilistic combination of link and content information in [PageRank]{}. , 2002.

Y. Saad. . SIAM, 2003.

P. Sarkar and A. W. Moore. Fast dynamic reranking in large graphs. , 2009.

R. S. Sutton and A. G. Barto. . MIT Press, 1998.

R. S. Wills and I. C. F. Ipsen. Ordinal ranking for [Google’s]{} [PageRank]{}. , 30(4):1677–1696, 2008.

E. Yan and Y. Ding. Discovering author impact: A [PageRank]{} perspective. , 47:125–134, 2011.

R. Yan, J. Tang, X. Liu, D. Shan, and X. Li. Citation count prediction: Learning to estimate future citations for literature. , 2011.
