Neil He

Neil He

he/him

PhD Student in Computer Science at UIUC

Publications

You can also find my articles on my Google Scholar profile.

Conference Papers

Position: Beyond Euclidean – Foundation Models Should Embrace Non-Euclidean Geometries

Published in Learning on Graphs Conference 2025 (Oral), 2025

This paper argues for the necessity of incoporating non-Euclidean geometry into foundation models design, with arguments grounded in both theoretics and pratical considerations

Recommended citation: Neil He, Jiahong Liu, Buze Zhang, Ngoc Bui, Ali Maatouk, Menglin Yang, Irwin King, Melanie Weber, and Rex Ying. "Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries." arXiv preprint. 2025.
Paper Link

HELM: Hyperbolic Large Language Models via Mixture-of-Curvature Experts

Published in Conference on Neural Information Processing Systems (NeurIPS) 2025, 2025

This paper propose a framework for a family of hyperbolic LLMs, including a mixture-of-curvature experts module where each expert operates in a distinct curvature space, hyperbolic Multi-Head Latent Attention mechanism, and hyperbolic rotary positional encoding.

Recommended citation: Neil He, Rishabh Anand, Hiren Madhu, Ali Maatouk, Smita Krishnaswamy, Leandros Tassiulas, Menglin Yang, and Rex Ying. "HELM: Hyperbolic Large Language Models via Mixture-of-Curvature Experts." arXiv preprint. 2025.
Paper Link | Code Link

Lorentzian Residual Neural Networks

Published in ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2025

This paper proposes an efficient, stable, and effective residual neural network framework in hyperbolic space.

Recommended citation: Neil He, Menglin Yang, and Rex Ying. 2025. Lorentzian Residual Neural Networks. In KDD .
Paper Link | Code Link

Hyperbolic Deep Learning for Foundation Models: A Survey

Published in ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2025

This paper presents a comprehensive survey that details the recent techinical advanvents in hyperbolic foundation models.

Recommended citation: Neil He, Hiren Madhu, Ngoc Bui, Menglin Yang, and Rex Ying. "Hyperbolic Deep Learning for Foundation Models: A Survey." in KDD. 2025.
Paper Link | Download Slides

Efficient Diffusion Models for Symmetric Manifolds

Published in The Forty-Second International Conference on Machine Learning (ICML), 2025

This paper is proposes an efficient diffusion framework for generative modelling on symmetric manifolds, such as the unitary group, with provable convergence guarantees and iteration complexity.

Recommended citation: Oren Mangoubi, Neil He, and Nisheeth K. Vishnoi. "Efficient Diffusion Models for Symmetric Manifolds." in ICML. 2025
Paper Link | Code Link

HyperCore: The Core Framework for Building Hyperbolic Foundation Models with Comprehensive Modules

Published in TheWebConf NEGEL Workshop, 2025

HyperCore is an easy-to-use, open source library for building hyperbolic deep learning networks, especially hyperbolic foundation models. This paper details the library components and builds the several novel hyperbolic foundation models with it, such as hyperbolic CLIP, ViT, and GraphRAG.

Recommended citation: Neil He, Menglin Yang, and Rex Ying. "HyperCore: The Core Framework for Building Hyperbolic Foundation Models with Comprehensive Modules." TheWebConf NEGEL Workshop. 2025.
Paper Link | Code Link

Journal Articles