Empirical Evaluation Techniques in Computer Vision covers methods that allow comparative assessment of algorithms and the accompanying benefits:
Empirical evaluations are divided into three basic categories providing useful insights into computer vision algorithms. Independently administered evaluations make up the first category. The second is evaluations of a set of classification algorithms by one group. The third category is composed of problems where the ground truth is not self evident. A major component of the evaluation process is to develop a method of obtaining the ground truth.
Empirical evaluations of algorithms are slowly emerging as a serious subfield in computer vision. The text builds a foundation for developing accepted practices for evaluating algorithms that determine the strengths and weaknesses of different approaches while identifying necessary further research. Successful evaluations can help convince potential users that an algorithm has matured to the point that it can be successfully fielded.