Published in ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2025
This paper proposes an efficient, stable, and effective residual neural network framework in hyperbolic space.
Recommended citation: Neil He, Menglin Yang, and Rex Ying. 2025. Lorentzian Residual Neural Networks. In KDD .
Paper Link | Code Link
Published in ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2025
This paper presents a comprehensive survey that details the recent techinical advanvents in hyperbolic foundation models.
Recommended citation: Neil He, Hiren Madhu, Ngoc Bui, Menglin Yang, and Rex Ying. "Hyperbolic Deep Learning for Foundation Models: A Survey." in KDD. 2025.
Paper Link | Download Slides
Published in The Forty-Second International Conference on Machine Learning (ICML), 2025
This paper is proposes an efficient diffusion framework for generative modelling on symmetric manifolds, such as the unitary group, with provable convergence guarantees and iteration complexity.
Recommended citation: Oren Mangoubi, Neil He, and Nisheeth K. Vishnoi. "Efficient Diffusion Models for Symmetric Manifolds." in ICML. 2025
Paper Link | Code Link
Published in TheWebConf NEGEL Workshop, 2025
HyperCore is an easy-to-use, open source library for building hyperbolic deep learning networks, especially hyperbolic foundation models. This paper details the library components and builds the several novel hyperbolic foundation models with it, such as hyperbolic CLIP, ViT, and GraphRAG.
Recommended citation: Neil He, Menglin Yang, and Rex Ying. "HyperCore: The Core Framework for Building Hyperbolic Foundation Models with Comprehensive Modules." TheWebConf NEGEL Workshop. 2025.
Paper Link | Code Link
Published in SoftwareX, 2024
PyPOD-GP is a Pytorch-based, GPU-optimized software for accurate and efficient core-level thermal simulation on many-core processor chips.
Recommended citation: Neil He, Ming-Cheng Cheng, Yu Liu. "PyPOD-GP: Using PyTorch for accelerated chip-level thermal simulation of the GPU " in SoftwareX. Vol.30, p.102147.
Paper Link | Code Link
Published in preprint, under review, 2025
This paper propose a framework for a family of hyperbolic LLMs, including a mixture-of-curvature experts module where each expert operates in a distinct curvature space, hyperbolic Multi-Head Latent Attention mechanism, and hyperbolic rotary positional encoding.
Recommended citation: Neil He, Rishabh Anand, Hiren Madhu, Ali Maatouk, Smita Krishnaswamy, Leandros Tassiulas, Menglin Yang, and Rex Ying. "HELM: Hyperbolic Large Language Models via Mixture-of-Curvature Experts." arXiv preprint. 2025.
Paper Link | Code Link
Published in preprint, under review, 2025
This paper argues for the necessity of incoporating non-Euclidean geometry into foundation models design, with arguments grounded in both theoretics and pratical considerations
Recommended citation: Neil He, Jiahong Liu, Buze Zhang, Ngoc Bui, Ali Maatouk, Menglin Yang, Irwin King, Melanie Weber, and Rex Ying. "Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries." arXiv preprint. 2025.
Paper Link