Using d 0 to Optimize Rankings
We introduced0 as an optimization measure for ranking problems, such as information retrieval (IR). d0 is an intuitive, differentiable measure which is somewhat correlated with standard IR measures of performance. A set of experiments is described in which the weight used to combine the results of two IR systems is chosen by optimizing d0. This technique works about as well as optimizing “exact precision,” a traditional IR performance measure. These results suggest the use of d0 f r training more complex, neural net models for solving ranking problems.