CPCANet: Deep Unfolding Common Principal Component Analysis for Domain Generalization
Abstract
CPCANet is a domain generalization framework that uses Common Principal Component Analysis to discover structured domain-invariant subspaces through differentiable neural layers, achieving state-of-the-art performance in zero-shot transfer.
Domain Generalization (DG) aims to learn representations that remain robust under out-of-distribution (OOD) shifts and generalize effectively to unseen target domains. While recent invariant learning strategies and architectural advances have achieved strong performance, explicitly discovering a structured domain-invariant subspace through second-order statistics remains underexplored. In this work, we propose CPCANet, a novel framework grounded in Common Principal Component Analysis (CPCA), which unrolls the iterative Flury-Gautschi (FG) algorithm into fully differentiable neural layers. This approach integrates the statistical properties of CPCA into an end-to-end trainable framework, enforcing the discovery of a shared subspace across diverse domains while preserving interpretability. Experiments on four standard DG benchmarks demonstrate that CPCANet achieves state-of-the-art (SOTA) performance in zero-shot transfer. Moreover, CPCANet is architecture-agnostic and requires no dataset-specific tuning, providing a simple and efficient approach to learning robust representations under distribution shift. Code is available at https://github.com/wish44165/CPCANet.
Community
We propose CPCANet, which unrolls CPCA into a differentiable network to learn a structured domain-invariant subspace for domain generalization. It is architecture-agnostic and tuning-free, and achieves SOTA performance on standard benchmarks.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- RecycleLoRA: Rank-Revealing QR-Based Dual-LoRA Subspace Adaptation for Domain Generalized Semantic Segmentation (2026)
- Learning domain-invariant features through channel-level sparsification for Out-Of Distribution Generalization (2026)
- Bi-Level Optimization for Single Domain Generalization (2026)
- Meta-Contrastive Learning for Vision-Language Models via Task-Adaptive CLIP Training (2026)
- IConE: Batch Independent Collapse Prevention for Self-Supervised Representation Learning (2026)
- MER-DG: Modality-Entropy Regularization for Multimodal Domain Generalization (2026)
- CrossFlowDG: Bridging the Modality Gap with Cross-modal Flow Matching for Domain Generalization (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper