{"ID":2836633,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2511.21937","arxiv_id":"2511.21937","title":"Interpretable Multimodal Cancer Prototyping with Whole Slide Images and Incompletely Paired Genomics","abstract":"Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal integration. Furthermore, most existing methods overlook real-world clinical scenarios where genomics may be partially missing or entirely unavailable. We propose a flexible multimodal prototyping framework to integrate whole slide images and incomplete genomics for precision oncology. Our approach has four key components: 1) Biological Prototyping using text prompting and prototype-wise weighting; 2) Multiview Alignment through sample- and distribution-wise alignments; 3) Bipartite Fusion to capture both shared and modality-specific information for multimodal fusion; and 4) Semantic Genomics Imputation to handle missing data. Extensive experiments demonstrate the consistent superiority of the proposed method compared to other state-of-the-art approaches on multiple downstream tasks. The code is available at https://github.com/helenypzhang/Interpretable-Multimodal-Prototyping.","short_abstract":"Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal integration. Furthermore, most existing methods overlook real-world clinical scena...","url_abs":"https://arxiv.org/abs/2511.21937","url_pdf":"https://arxiv.org/pdf/2511.21937v1","authors":"[\"Yupei Zhang\",\"Yating Huang\",\"Wanming Hu\",\"Lequan Yu\",\"Hujun Yin\",\"Chao Li\"]","published":"2025-11-26T21:53:17Z","proceeding":"cs.CV","tasks":"[\"cs.CV\"]","methods":"[]","has_code":false,"code_links":[{"ID":606618,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_id":2836633,"paper_url":"https://arxiv.org/abs/2511.21937","paper_title":"Interpretable Multimodal Cancer Prototyping with Whole Slide Images and Incompletely Paired Genomics","repo_url":"https://github.com/helenypzhang/Interpretable-Multimodal-Prototyping","is_official":false,"mentioned_in_paper":false,"mentioned_in_github":true,"github_stars":0}]}