Uncorrelated Semi-paired Subspace Learning

Abstract

Multi-view datasets are increasingly collected in many real-world applica tions, and existing multi-view learning methods byleveraging therelation information across multiple views have gained great successes comparing to conventional single view learning methods. However, most of these methods are built on the assumption that each instance having all given views, so they are not able to integrate the unpaired data properly that can often be observed in reality. In this paper, we focus on learning uncorrelated features for semi-paired subspace learning as the usefulness of uncorre lated features have been witnessed by many existing works. Specifically, we propose a generalized uncorrelated multi-view subspace learning framework, which is able to naturally integrate various learning criteria derived from the semi-paired data. To showcase the flexibility of our framework for various learningscenarios, weinstantiate new semi-paired models for both unsupervised learning and semi-supervised learn ing. We further propose a deflation-based optimization scheme to solve the resulting challenging optimization problem. An efficient and scalable Krylov subspace method is used to solve the subproblem with globalsolution, andtheproposedalgorithmguar antees monotonic convergence. Extensive experimental results on multi-view feature extraction and multi-modality classification show that our proposed models perform competitively to or better than baselines.