Research group · CDS
Probabilistic Inference Lab
Developing rigorous Bayesian and probabilistic methods for reasoning under uncertainty — from scalable approximate inference to principled model selection in high-dimensional scientific problems.
Overview
The Probabilistic Inference Lab treats uncertainty as a first-class object in computation. We develop algorithms that represent, propagate, and reason about uncertainty rigorously — not as a post-hoc annotation, but as a core design constraint. Our methods range from foundational Bayesian computation (variational inference, Markov chain Monte Carlo, normalizing flows) to higher-level concerns: model comparison, experimental design, and the integration of prior scientific knowledge into learned models.
A central interest is scalability. Classical Bayesian methods are often computationally intractable at the scale required by modern scientific datasets. We study how to approximate posterior distributions faithfully while preserving the calibration properties that make probabilistic reasoning useful. Our work on amortized inference and meta-learning-for-inference has enabled Bayesian updating at previously impractical scales in collaborations with the Distributed Learning Systems Group and the Computational Neuroscience Group.
We also build probabilistic programming tools. Our open-source library Veyra Infer provides a composable primitive set for specifying probabilistic models and running inference in a unified framework. It is used by several other research groups on campus and by external collaborators. The group maintains close ties with the Meridian HPC facility for large-scale Monte Carlo computation.
Research themes
- Variational inference and normalizing flows for complex posteriors
- Scalable MCMC methods: HMC variants, parallel tempering, sequential Monte Carlo
- Amortized inference and neural posterior estimation
- Probabilistic programming language design and compilation
- Bayesian experimental design and active learning
- Model selection, Bayes factors, and marginal likelihood estimation
- Calibration of predictive distributions in large-scale models
- Simulation-based inference for scientific simulators
Current projects
Active · 2023–2026
NeuroSBI
Simulation-based inference for mechanistic neural models. Develops neural posterior estimation algorithms that can invert complex biophysical simulators, enabling parameter identification in computational neuroscience models. Joint project with the Computational Neuroscience Group.
Funded by VIAS Cross-Division Initiative · 390,000 cr
Active · 2022–2025
Infer-Scale
Scaling variational inference to billion-parameter probabilistic models. Combines stochastic gradient ELBO optimization with novel control-variate estimators and structured mean-field approximations that preserve posterior correlations in large generative models.
Funded by Veyra Strategic Research Fund · 520,000 cr
Active · 2024–2027
BayesDesign
Bayesian optimal experimental design at scale. Develops tractable bounds on expected information gain that can guide experiment selection in materials characterization and clinical trial settings, reducing required sample sizes by 30–50% in benchmark comparisons.
Funded by VIAS Core Grants Programme · 275,000 cr
Selected publications
-
Eberhardt, T. & Johansson, L. (2024). Amortized variational inference with structured approximate posteriors for scientific simulators. Veyra Technical Reports. VEYRA-DOI:10.veyra/2024-pil-003
-
Eberhardt, T., Okoro, H., & Singh, P. (2023). Neural posterior estimation for biophysical neuron models. Veyra Preprint Series. VEYRA-DOI:10.veyra/2023-pil-005
-
Johansson, L., Reyes, C., & Eberhardt, T. (2023). Control-variate estimators for high-variance ELBO gradients in large generative models. Veyra Technical Reports. VEYRA-DOI:10.veyra/2023-pil-009
-
Ravelo, N., Eberhardt, T., & Kim, J. (2021). Uncertainty-aware model aggregation in federated learning. Joint CDS publication. VEYRA-DOI:10.veyra/2021-cds-011
-
Eberhardt, T. (2020). Calibration properties of deep neural network posteriors under distributional shift. Veyra Preprint Series. VEYRA-DOI:10.veyra/2020-pil-001
-
Singh, P. & Eberhardt, T. (2019). Sequential Monte Carlo for online Bayesian model comparison. Veyra Technical Reports. VEYRA-DOI:10.veyra/2019-pil-002
People
The lab is led by Prof. Tomas Eberhardt. Postdoctoral researchers include Lars Johansson, Priya Singh, and Carmen Reyes. Doctoral students: Oskar Brandt, Wenxin Liu, Fatuma Odhiambo, Rúairí Ó'Muireagáin, Benedikt Halvorsen, Ananya Krishnaswamy, and Demi Voronova. Research staff: two scientific software engineers supporting the Veyra Infer library. New doctoral applicants should visit graduate admissions.