Abstract
As a commonly used unsupervised learning algorithm in Content-Based Image Retrieval (CBIR), Expectation-Maximization (EM) algorithm has several limitations, including the curse of dimensionality and the convergence at a local maximum. In this article, we propose a novel learning approach, namely Coevolutionary Feature Synthesized Expectation-Maximization (CFS-EM), to address the above problems. The CFS-EM is a hybrid of coevolutionary genetic programming (CGP) and EM algorithm applied on partially labeled data. CFS-EM is especially suitable for image retrieval because the images can be searched in the synthesized low-dimensional feature space, while a kernel-based method has to make classification computation in the original high-dimensional space. Experiments on real image databases show that CFS-EM outperforms Radial Basis Function Support Vector Machine (RBF-SVM), CGP, Discriminant-EM (D-EM) and Transductive-SVM (TSVM) in the sense of classification performance and it is computationally more efficient than RBF-SVM in the query phase.
- Bargeron, D., Viola, P., and Simard, P. Y. 2005. Boosting-based transductive learning for text detection. In Proceedings of the International Conference on Document Analysis and Recognition, 1166--1171. Google ScholarDigital Library
- Bhanu, B. and Lee, S. 1994. Genetic Learning for Adaptive Image Segmentation. Kluwer. Google ScholarDigital Library
- Bhanu, B. and Lin, Y. 2003. Genetic algorithm based feature selection for target detection in SAR images. Image Vision Comput. 21, 7, 591--608.Google ScholarCross Ref
- Bhanu, B., Lin, Y., and Krawiec, K. 2005. Evolutionary Synthesis of Pattern Recognition Systems. Springer-Verlag, Berlin, Germany. Google ScholarDigital Library
- Carson, C., Belongie, S., Greenspan, H., and Malik, J. 2002. Blobworld: Image segmentation using Expectation-Maximization and its application to image querying. IEEE Trans. Pattern Analys. Mach. Intel. 25, 8, 1026--1038. Google ScholarDigital Library
- Chang, C. C. and Lin, C. J. 2001. LIBSVM: A library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm. Google ScholarDigital Library
- Chen, Y., Wang, G., and Dong, S. 2003. A progressive transductive inference algorithm based on support vector machine. J. Softw. 14, 3, 451--460.Google Scholar
- Dempster, A. P., Laird, N. M., and Rubin, D. B. 1977. Maximum likelihood from incomplete data via the EM algorithm with discussion. J. Royal Statist. Soc. (Series B) 39, 1, 1--38.Google ScholarCross Ref
- Dong, A. and Bhanu, B. 2003. A new semi-supervised EM algorithm for image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Madison, WI, 662--667.Google Scholar
- Dong, A. and Bhanu, B. 2005. Active concept learning in image databases. IEEE Trans. Syst. Manag. Cybernatics, Part B 35, 3, 450--466. Google ScholarDigital Library
- Dong, A., Bhanu, B., and Lin, Y. 2005. Evolutionary feature synthesis for image databases. In Proceedings of the IEEE Workshop on Applications of Computer Vision, 330--335. Google ScholarDigital Library
- Fang, Y. and Geman, D. 2005. Experiments in mental face retrieval. In Proceedings of the International Conference on Audio- and Video-Based Biometric Authentication, 637--646. Google ScholarDigital Library
- Figueriedo, M. A. and Jain, A. K. 2002. Unsupervised learning of finite mixture models. IEEE Trans. Pattern Analys. Mach. Intel. 24, 3, 382--396. Google ScholarDigital Library
- Flickner, M., Sawhney, H. S., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., and Yanker, P. 1995. Query by image and video content: The QBIC system. IEEE Trans. Comput. 28, 9, 23--32. Google ScholarDigital Library
- Guyon, I. and Elisseeff, A. 2003. An introduction to variable and feature selection. J. Mach. Learn. Resear. 3, 1157--1182. Google ScholarDigital Library
- He, X., Ma, W. Y., and Zhang, H. 2004. Learning an image manifold for retrieval. In Proceedings of the ACM Multimedia Conference (ACMMM), New York, NY, ACM, 17--23. Google ScholarDigital Library
- He, X., Yan, S., Hu, Y., and Zhang, H. 2003. Learning a locality preserving subspace for visual recognition. In Proceedings of the IEEE Conference on Computer Vision, 385--393. Google ScholarDigital Library
- Joachims, T. 1999. Making large-scale SVM learning practical. In Advances in Kernel Methods--Support Vector Learning. B. Schlkopf, C. Burges, and A. J. Smola, Eds. MIT Press, Cambridge, MA, 169--184. Google ScholarDigital Library
- Joachims, T. 1999. Transductive inference for text classification using support vector machines. In Proceedings of the International Conference on Machine Learning. Google ScholarDigital Library
- Joachims, T. 2003. Transductive learning via spectral graph partitioning. In Proceedings of the International Conference on Machine Learning, Washington, DC, 290--297.Google Scholar
- Koza, J. R. 1994. Genetic Programming II: Automatic Discovery of Reusable Programs. MIT Press, Cambridge MA. Google ScholarDigital Library
- Lee, D. D. and Seung, H. S. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401, 788--791.Google ScholarCross Ref
- Li, R., Bhanu, B., and Dong, A. 2005. Coevolutionary feature synthesized EM algorithm for image retrieval. In Proceedings of the ACM Multimedia Conference (ACMMM), Singapore, ACM, 696--705. Google ScholarDigital Library
- Li, S. Z., Hou, X., Zhang, H., and Cheng, Q. 2001. Learning spatially localized, parts-based representation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 207--212.Google Scholar
- Lin, Y. and Bhanu, B. 2005. Evolutionary feature synthesis for object recognition. IEEE Trans. Syst., Manag., Cybernetics, Part C 35, 2, 156--171. Google ScholarDigital Library
- McLachlan, G. and Peel, D. 2000. Finite Mixture Models. John Wiley.Google Scholar
- Meir, R. and Rtsch, G. 2002. An introduction to boosting and leveraging. Lecture Notes in Computer Science. Springer, 118--183. Google ScholarDigital Library
- Nakazato, M. and Huang, T. S. 2001. 3D Mars: Immersive virtual reality for content-based image retrieval. In Proceedings of the IEEE International Conference on Multimedia and Expo, 12--15.Google Scholar
- Nigam, K., Mccallum, A. K., Thrun, S., and Mitchell, T. 2000. Text classification from labeled and unlabeled documents using EM. Mach. Learn. 39, 2--3, 103--134. Google ScholarDigital Library
- Peng, J., Bhanu, B., and Qing, S. 1999. Probabilistic feature relevance learning for content-based image retrieval. Comput. Vision and Image Underst. 75, 1--2, 150--164. Google ScholarDigital Library
- Rui, Y., Huang, T. S., Ortega, M., and Mehrotra, S. 1998. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. Circ. Syst. Video Techn. 8, 5, 644--655. Google ScholarDigital Library
- Saunders, C., Gammerman, A., and Vovk, V. 1999. Transduction with confidence and credibility. In Proceedings of the International Joint Conference on Artificial Intelligence, Morgan Kaufmann Publishers, 722--726. Google ScholarDigital Library
- Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., and Jain, R. 2000. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Analys. Mach. Intel. 22, 12, 1349--1380. Google ScholarDigital Library
- Su, Z., Li, S., and Zhang, H. 2001. Extraction of feature subspaces for content-based retrieval using relevance feedback. In Proceedings of the ACM Multimedia Conference (ACMMM)), 98--106. Google ScholarDigital Library
- Swets, D. L. and Weng, J. 1999. Hierarchical discriminant analysis for image retrieval. IEEE Trans. Pattern Analys. Mach. Intel. 21, 5, 386--401. Google ScholarDigital Library
- Tang, H. L., Hanka, R., and Ip, H. H. S. 2003. Histological image retrieval based on semantic content analysis. IEEE Trans. Inform. Techn. Biomedicine 7, 1, 26--36. Google ScholarDigital Library
- Vapnik, V. 2000. The Nature of Statistical Learning Theory. Springer-Verlag. Berlin, Germany. Google ScholarDigital Library
- Virginia, R. D. S. 1993. Learning classification with unlabeled data. In Advances in Neural Information Processing Systems. Morgan Kaufmann, 112--119.Google Scholar
- Wang, J., Li, J., and Wiederhold, G. 2001. SIMPLIcity: Semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Analys. Mach. Intel. 23, 9, 947--963. Google ScholarDigital Library
- Wu, P., Manjunath, B. S., and Shin, H. D. 2000. Dimensionality reduction for image retrieval. In Proceedings of the International Conference on Image Processing, 726--729.Google Scholar
- Wu, Y. and Huang, T. S. 2000. Color tracking by transductive learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 133--138.Google Scholar
- Wu, Y., Tian, Q., and Huang, T. S. 2000. Discriminant-EM algorithm with application to image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 222--227.Google Scholar
- Xiang, S., Nie, F., and Zhang, C. 2005. Texture image segmentation: An interactive framework based on adaptive features and transductive learning. In Proceedings of the Asian Conference on Computer Vision, 216--225. Google ScholarDigital Library
- Xu, W., Liu, X., and Gong, Y. 2003. Document clustering based on non-negative matrix factorization. In Proceedings of SIGIR, 267--273. Google ScholarDigital Library
- Yin, P. Y., Bhanu, B., Chang, K. C., and Dong, A. 2002. Improving retrieval performance by long-term relevance information. In Proceedings of the IEEE Conference on Compute Vision and Pattern Recognition, 533--536. Google ScholarDigital Library
- Yin, P. Y., Bhanu, B., Chang, K. C., and Dong, A. 2005. Integrating relevance feedback techniques for image retrieval using reinforcement learning. IEEE Trans. Pattern Analys. Mach. Intel. 27, 10, 1536--1551. Google ScholarDigital Library
- Yu, J. and Tian, Q. 2006. Learning image manifolds by semantic subspace projection. In Proceedings of the ACM Multimedia Conference (ACMMM), Santa Barbara, CA, 297--306. Google ScholarDigital Library
- Zhou, X. S., Rui, Y., and Huang, T. S. 1999. Water-filling: a novel way for image structural feature extraction. In Proceedings International Conference on Image Processing, Kobe, Japan.Google Scholar
- Zhu, L. and Zhang, A. 2000. Supporting multi-example image queries in image databases. In Proceedings of the International Conference on Multimedia and Expo, 397--700.Google Scholar
Index Terms
Feature synthesized EM algorithm for image retrieval
Recommendations
Coevolutionary feature synthesized EM algorithm for image retrieval
MULTIMEDIA '05: Proceedings of the 13th annual ACM international conference on MultimediaAs a commonly used unsupervised learning algorithm in Content-Based Image Retrieval (CBIR), Expectation-Maximization (EM) algorithm has several limitations, especially in high dimensional feature spaces where the data are limited and the computational ...
A new integrated SVM classifiers for relevance feedback content-based image retrieval using EM parameter estimation
In content-based image retrieval (CBIR), the support vector machine (SVM) based relevance feedback is studied extensively to narrow the gap between low-level image feature and high-level semantic concept. Despite the success, for conventional SVM ...
An image retrieval scheme with relevance feedback using feature reconstruction and SVM reclassification
In content-based image retrieval (CBIR), the gap between low-level visual features and high-level semantic meanings usually leads to poor performance, and relevance feedback (RF) is an effective method to bridge this gap and to scale up the performance ...
Comments