some ideas and direction of how to measure ranking, AP, MAP, recall for IR evaluation
<p>I have question about how to evaluate the information retrieve result is good or not such as calculate </p>

<p>the relevant document rank, recall, precision ,AP, MAP.....</p>

<p>currently, the system is able to retrieve the document from the database once the users enter the query. The problem is I do not know how to do the evaluation.</p>

<p>I got some public data set such as "Cranfield collection" <a href="http://ir.dcs.gla.ac.uk/resources/test_collections/cran/" rel="nofollow noreferrer">dataset link</a>
it contains </p>

<p>1.document 2.query 3.relevance assesments</p>

<pre><code>             DOCS   QRYS   SIZE*
Cranfield   1,400    225    1.6
</code></pre>

<p>May I know how to use do the evaluation by using "Cranfield collection" to calculate 
the relevant document rank, recall, precision ,AP, MAP.....</p>

<p>I might need some ideas and direction. not asking for how to code the program.</p>