Contact

Overview

The Probabilistic Inference Lab treats uncertainty as a first-class object in computation. We develop algorithms that represent, propagate, and reason about uncertainty rigorously — not as a post-hoc annotation, but as a core design constraint. Our methods range from foundational Bayesian computation (variational inference, Markov chain Monte Carlo, normalizing flows) to higher-level concerns: model comparison, experimental design, and the integration of prior scientific knowledge into learned models.

A central interest is scalability. Classical Bayesian methods are often computationally intractable at the scale required by modern scientific datasets. We study how to approximate posterior distributions faithfully while preserving the calibration properties that make probabilistic reasoning useful. Our work on amortized inference and meta-learning-for-inference has enabled Bayesian updating at previously impractical scales in collaborations with the Distributed Learning Systems Group and the Computational Neuroscience Group.

We also build probabilistic programming tools. Our open-source library Veyra Infer provides a composable primitive set for specifying probabilistic models and running inference in a unified framework. It is used by several other research groups on campus and by external collaborators. The group maintains close ties with the Meridian HPC facility for large-scale Monte Carlo computation.

Research themes

  • Variational inference and normalizing flows for complex posteriors
  • Scalable MCMC methods: HMC variants, parallel tempering, sequential Monte Carlo
  • Amortized inference and neural posterior estimation
  • Probabilistic programming language design and compilation
  • Bayesian experimental design and active learning
  • Model selection, Bayes factors, and marginal likelihood estimation
  • Calibration of predictive distributions in large-scale models
  • Simulation-based inference for scientific simulators

Current projects

Active · 2023–2026

NeuroSBI

Simulation-based inference for mechanistic neural models. Develops neural posterior estimation algorithms that can invert complex biophysical simulators, enabling parameter identification in computational neuroscience models. Joint project with the Computational Neuroscience Group.

Funded by VIAS Cross-Division Initiative · 390,000 cr

Active · 2022–2025

Infer-Scale

Scaling variational inference to billion-parameter probabilistic models. Combines stochastic gradient ELBO optimization with novel control-variate estimators and structured mean-field approximations that preserve posterior correlations in large generative models.

Funded by Veyra Strategic Research Fund · 520,000 cr

Active · 2024–2027

BayesDesign

Bayesian optimal experimental design at scale. Develops tractable bounds on expected information gain that can guide experiment selection in materials characterization and clinical trial settings, reducing required sample sizes by 30–50% in benchmark comparisons.

Funded by VIAS Core Grants Programme · 275,000 cr

Selected publications

  • Eberhardt, T. & Johansson, L. (2024). Amortized variational inference with structured approximate posteriors for scientific simulators. Veyra Technical Reports. VEYRA-DOI:10.veyra/2024-pil-003

  • Eberhardt, T., Okoro, H., & Singh, P. (2023). Neural posterior estimation for biophysical neuron models. Veyra Preprint Series. VEYRA-DOI:10.veyra/2023-pil-005

  • Johansson, L., Reyes, C., & Eberhardt, T. (2023). Control-variate estimators for high-variance ELBO gradients in large generative models. Veyra Technical Reports. VEYRA-DOI:10.veyra/2023-pil-009

  • Ravelo, N., Eberhardt, T., & Kim, J. (2021). Uncertainty-aware model aggregation in federated learning. Joint CDS publication. VEYRA-DOI:10.veyra/2021-cds-011

  • Eberhardt, T. (2020). Calibration properties of deep neural network posteriors under distributional shift. Veyra Preprint Series. VEYRA-DOI:10.veyra/2020-pil-001

  • Singh, P. & Eberhardt, T. (2019). Sequential Monte Carlo for online Bayesian model comparison. Veyra Technical Reports. VEYRA-DOI:10.veyra/2019-pil-002

All VIAS publications

People

The lab is led by Prof. Tomas Eberhardt. Postdoctoral researchers include Lars Johansson, Priya Singh, and Carmen Reyes. Doctoral students: Oskar Brandt, Wenxin Liu, Fatuma Odhiambo, Rúairí Ó'Muireagáin, Benedikt Halvorsen, Ananya Krishnaswamy, and Demi Voronova. Research staff: two scientific software engineers supporting the Veyra Infer library. New doctoral applicants should visit graduate admissions.

Related links