Performance Evaluation Journal Articles

"Computer Vision Theory: The Lack Thereof", Computer Vision, Graphics, and Image Processing, Vol. 36, 1986, pp. 372-386.
"Performance Assessment of Near Perfect Machines", Machine Vision and Applications, Vol. 2, 1989, pp. 1-16.
"Performance Characterization in Image Analysis: Thinning, A Case in Point", Pattern Recognition Letters, Vol. 13, January, 1992, pp. 5-12.
"Error Propagation in Machine Vision", (with Seungku Yi and L.G. Shapiro), Machine Vision and Applications, Vol. 7, 1994, pp. 93-114.
"DIALOG: Performance Characterization in Computer Vision", Computer Vision, Graphics, and Image Processing: Image Understanding, Vol. 60, No. 2, September, 1994, pp. 245-249.
"Response To Replies Comments on Performance Charaterization Replies", Computer Vision Graphics and Image Processing: Image Understanding, Vol 60, No 2, September 1994, pp. 264-265.
"A Methodology for Quantitative Performance Evaluation of Detection Algorithms", (with T. Kanungo, M.Y. Jaisimha, and J. Palmer), IEEE Transactions on Image Processing, December, 1995, Vol. 4, No. 12, pp. 1667-1674.
"Propagating Covariance in Computer Vision", International Journal of Pattern Recognition and Artificial Intelligence, Vol. 10, No. 5, 1996, pp. 561-572.
"Breakpoint Detection Using Covariance Propagation", (with Qiang Ji) IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 20, No. 8, 1998.
"Error Propagation for the Hough Transform", with Qiang Ji, Pattern Recognition Letters, Vol 22, 2001, pp. 813-823.
"Performance Evaluation of Document Structure Extraction Algorithms", (with Jisheng Liang and Ihsin Phillips), Computer Vision and Image Understanding, Vol 84, 2001, pp. 144-159.
"Efficient Facet Edge Detection and Quantitative Performance Evaluation", (with Qiang Ji), Pattern Recognition, Vol 35, No 3, 2002, pp. 689-700.
"On the Use of Error Propagation for Statistical Validation of Computer Vision Software", (with Xufei Liu and Tapas Kanungo), IEEE Pattern Analysis and Machine Intelligence, Vol. 27, No. 10, October 2005, pp. 1603-1614.
"A Bayesian Framework for Noise Covariance Estimation Using the Facet Model", (with Desika Nadadur and D.E. Gustafson), IEEE Image Processing, Vol. 14, No. 11, November 2005, pp. 1902-1917.

Performance Evaluation Conference Articles

"Two View Motion Analysis Under a Small Perturbation", (with X. Zhuang), Proceedings, IEEE International Conference on Acoustics, Speech, and Signal Processing}, Tampa, FL, March 26--29, 1985, Vol. 2, pp. 929-932.
"Computer Vision Theory: The Lack Thereof", IEEE Computer Society Third Workshop on Computer Vision: Representation and Control, Bellaire, MI, October 13--16, 1985, pp. 113-121.
"Methodology for Experimental Computer Vision", Proceedings, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, June 4--8, 1989, pp. 437-438.
"Developing Robust Techniques for Computer Vision", (with X. Zhuang), IEEE Computer Society International Workshop on Robust Computer Vision, Seattle, WA, October 1--3, 1990, pp. 19-38.
"Performance Characterization of Vision Algorithms". (with V. Ramesh), SPIE Proceedings: Image Understanding in the '90s: Building Systems that Work, McLean, VA, October 18--19, 1990, pp. 2-16.
"An Experimental Methodology for Performance Characterization of a Line Detection Algorithm", (with T. Kanungo, M.Y. Jaisimha, and J. Palmer), Optics, Illumination, and Image Sensing for Machine Vision V, October, 1990, SPIE Vol.~1385, pp. 104--112.
"An Experimental Methodology for Performance Characterization of a Line Detection Algorithm", (with T. Kanungo, M.Y. Jaisimha, and J. Palmer), reprinted in Proceedings of SPIE Symposium on Advances in Intelligent Systems, Boston, MA, November 4--9, 1990.
"Performance Characterization of Edge Detectors", (with V. Ramesh), Special Session: Performance Evaluation of Edge Detectors---Artificial Intelligence and Applications, SPIE Machine Vision and Robotics Conference, Orlando, FL, April, 1992, SPIE Vol. 1708, pp. 252--266.
"Random Perturbation Models and Performance Characterization in Computer Vision", (with V. Ramesh), Proceedings, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, June 15--18, 1992, pp. 521-527.
"Predicting Expected Grey Level Statistics of Opened Signals", (with W.S. Costa), Proceedings, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, June 15--18, 1992, pp. 554--559.
"Performance Characterization in Computer Vision", CAIP, 1993, pp. 1-9.
"Propagating Covariance in Computer Vision", Progress in Image Analysis Processing III: Proceedings of the 7th International Conference on Image Analysis and Processing, Capitolo, Monopoli, Italy, September 20--22, 1993, pp. 467-477
"Performance Characterization of Edge Operators", (with V. Ramesh), Proceedings: DARPA Image Understanding Workshop, Washington, DC, April 18--21, 1993, pp. 1071-1079.
"A Quantitative Methodology for Analyzing the Performance of Detection Algorithms", (with T. Kanungo, M.Y. Jaisimha, and J. Palmer), Proceedings of IEEE International Conference on Computer Vision, Berlin, Germany, May 11--14, 1993, pp. 247-252.
"Estimation of Curvature from Sampled Noisy Data". (with C.K. Lee and K. Deguchi), Proceedings, 1993 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York City, NY, June 15--18, 1993, pp. 536-541.
"Implementation Methodology and Error Analysis for the CD-ROM English Document Database", (with I.T. Phillips, J. Ha, and S. Chen), Proceedings of the 1993 AIPR Workshop, Washington, DC, October 13--15, 1993.
"A Methodology for the Characterization of the Performance of Thinning Algorithms", (with M.Y. Jaisimha and D. Dori), International Conference on Document Analysis and Recognition, Tsukuba Japan, October 20--22, 1993, pp. 282-286.
"Global and Local Document Degradation Models", (with T. Kanungo and I. Phillips), International Conference on Document Analysis and Recognition, Tsukuba, Japan, October 20--22, 1993, pp. 730-734.
"Performance Evaluation of Two OCR Systems", (with S. Chen, S. Subramaniam, and I.T. Phillips), Proceedings of the Third Annual Symposium on Document Analysis and Information Retrieval, University of Nevada, Las Vegas, NV, April 11--13, 1994, pp. 299-317.
"Estimating Errors in Document Databases", (with J. Ha, S. Chen, and I.T. Phillips), Proceedings of the Third Annual Symposium on Document Analysis and Information Retrieval, University of Nevada, Las Vegas, NV, April 11--13, 1994, pp. 435-459.
"Quantitative Performance Evaluation of Thinning Algorithms in the Presence of Noise", (with M.Y. Jaisimha and D. Dori), Aspects of Visual Form Processing, 2nd International Workshop on Visual Form (IWVF2), Capri, Italy, May 30--June 2, 1994, C. Arcelli, L.P. Cordella, and G.S. di~Baja (eds), Singapore: World Scientific, 1994, pp. 261-286.
"Quantitative Performance Evaluation of Thinning Algorithms under Noisy Conditions", CVPR94: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, June 21--23, 1994, pp. 678--683.
"Automatic Selection of Tuning Parameters for Feature Extraction Sequences", (with V. Ramesh, X. Zhang, D.C. Nadadur, and K. Thornton), CVPR94: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, June 21--23, 1994, pp. 672-677.
"Propagating Covariance in Computer Vision", Proceedings of the 12th IAPR International Conference on Pattern Recognition: Conference A: Computer Vision and Image Processing, Jerusalem, Israel, October 9--13, 1994, Vol. I, pp. 493-498.
"Overview: Computer Vision Performance Characterization", Proceedings, ARPA Image Understanding Workshop, Monterey, CA, November 13--16, 1994, Vol. I, pp. 663-665.
"Performance Characterization Protocol in Computer Vision", Proceedings, ARPA Image Understanding Workshop, Monterey, CA, November 13--16, 1994, Vol. I, pp. 667--673.
"A Methodology for Automatic Selection of IU Algorithm Tuning Parameters", (with V. Ramesh), Proceedings, ARPA Image Understanding Workshop, Monterey, CA, November 13--16, 1994, Vol. I, pp. 675-687.
"Document Degradation Models: Parameter Estimation and Model Validation", (with T. Kanungo, H. S. Baird, W. Stutzle, and D. Madigan), Proc. of IAPR Workshop on Machine Vision and Applications, Kawasaki, Japan, 1994, pp. 552-557
"Estimation of Morphological Degradation Parameters", (with T. Kanungo) Proc. SPIE Conference on Nonlinear Imaging, San Jose, CA, Vol. 2424, February , 1995, pp. 86-95.
"A Benchmark: Performance evaluation of Dashed-Line Detection Algorithms", (with Bin Kong, Ihsin Phillips, Arathi Prasad, Rangachar Kasturi), GREC 1995, pp. 270-285.
"Validation and Estimation of Document Degradation Models", (with T. Kanungo, and H. Baird), Fourth Annual Symposium on Document Analysis and Information Retrieval, University of Nevada, Las Vegas, April 24-26, 1995, pp. 217-228.
"Power Functions and Their Use in Selecting Distance Functions for Document Degradation Model Validation", (with T. Kanungo and H.S. Baird), ICDAR'95: Third International Conference on Document Analysis and Recognition, Montreal, Canada, Vol.~II, August 14--16, 1995, pp. 734-739.
"Constrained Monotone Regression of ROC Curves and Histograms Using Splines and Polynomials", (with T. Kanungo and D.M. Gay), ICIP-95: Proceedings, International Conference on Image Processing, Washington, DC, Vol. II, October 23--26, 1995, 292--295.
"Receiver Operating Characteristic Curves and Optimal Bayesian Operating Points", (with T. Kanungo), ICIP-95: Proceedings, International Conference on Image Processing, Washington, DC, Vol.~III, October 23--26, 1995, pp. 256-259.
"Detection Performance Methodology", Image Understanding Workshop, Vol. 2, Feb. 12-15, Palm Springs, CA, 1996, pp. 981-983.
"Statistical Validation of Computer Vision Software", (with Xufei Liu, Tapas Kanungo), Image Understanding Workshop, Vol. 2, Feb. 12-15, Palm Springs, CA, 1996 pp. 1533-1540.
"Constrained Monotone Regression of Receiver Operating Curves and Histograms Using Splines and Polynomials", (with T. Kanungo, D.M. Gay) Proc. of IEEE Int. Conf. on Image Processing, Vol. 2, Washington, D.C., 1995, pp. 292-295.
"Performance Evaluation of Document Layout Analysis Algorithms on the UW-III Data Set", (with Jisheng Liang and I.T. Phillips), Document Recognition IV, SPIE '97, San Jose CA, 1997, pp. 149-160.
"Corner Detection Using Covariance Propagation", (with Qiang Ji), IEEE Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 1997, pp. 362-367.
"A Performance Evaluation Protocol for Engineering-drawing Recognition Systems", (with Ihsin Phillips and Jisheng Liang), Proceedings of the Second IAPR Workshop on Graphics Recognition, Nancy France, August 22-23, 1997, pp. 333-346.
"Using Centroid Covariance in Target Recognition", (with Gang Liu) 14th International Conference on Pattern Recognition, August 16-20, Brisbane Australia, 1998, pp. 1343-1346.
"A Statistical Framework for Geometric Tolerancing Manufactured Parts", (with Qiang Ji), 14th International Conference on Pattern Recognition, August 16-20, Brisbane Australia, 1998, pp. 1728-1730.
"An Improved Hough Transform Technique Based on Error Propagation", (with Qiang Ji), 1998 IEEE Conference On Systems, Man and Cybernetics, San Diego, CA, Oct 1998.
"Performance Evaluation of Document Image Algorithms", Graphics Recognition Recent Advances (GREC), 1999, pp. 315-323.
"Error Propagation For Computer Vision Performance Characterization", (with Qiang Ji), Proceedings of the International Conference on Imaging Science, Systems, and Technology, Las Vegas, June 28- July 1, 1999, pp. 429-435.
"Quantitative Evaluation of Edge Detectors Using the Minimum Kernel Variance Criterion", (with Qiang Ji), IEEE International Conference on Image Processing, Kobe, Japan, October, 1999.
"Validating Image Processing Algorithms", (invited keynote talk) SPIE Conference on Medical Imaging 2000, Image Processing, San Diego, Feb 14-17, 2000, pp. 2-16.
"Algorithm Performance Contest", (with Selim Aksoy, Ming Ye, Michael Schauf, Mingzhou Song, Yalin Wang, Jim Parker, Juraj Pivovarov, Dominik Royko, Changming Sun and Gunnar Fareback), International Conference on Pattern Recognition, Barcelona Spain, September 3-7,2000, Vol 4, pp. 870-875.
"Zone Content Classification and Its Performance Evaluation", (with Yalin Wang and Ihsin Phillips), Sixth International Conference on Document Analysis and Recognition (ICDAR 2001), Seattle WA, September 10-12, 2001, pp. 540-544.