Build software better, together

uncertainty-toolbox / uncertainty-toolbox

Uncertainty Toolbox: a Python toolbox for predictive uncertainty quantification, calibration, metrics, and visualization

visualization metrics scoring-rules toolbox uncertainty calibration visualizations uncertainty-quantification uncertainty-estimation bayesian-neural-networks bayesian-deep-learning sharpness predictive-uncertainty recalibration uncertainty-calibration uncertainty-metrics uncertainty-toolbox

Updated Mar 5, 2025
Python

valeman / awesome-conformal-prediction

Sponsor

Star

A professionally curated list of awesome Conformal Prediction videos, tutorials, books, papers, PhD and MSc theses, articles and open-source libraries.

python machine-learning awesome r statistics ai probability uncertainty datascience probability-distribution awesome-list machinelearning deeplearning probability-distributions uncertainty-quantification uncertainty-estimation conformal-prediction explainable-ai robust-ml

Updated Aug 25, 2026

cvs-health / uqlm

Star

[JMLR 2026] "UQLM: A Python Package for Uncertainty Quantification in Large Language Models"

uncertainty-quantification uncertainty-estimation ai-safety confidence-score hallucination confidence-estimation ai-evaluation llm llm-evaluation llm-safety hallucination-evaluation hallucination-detection hallucination-mitigation llm-hallucination

Updated Oct 7, 2026
Python

aangelopoulos / conformal-prediction

Star

Lightweight, useful implementation of conformal prediction on real data.

natural-language-processing computer-vision time-series uncertainty uncertainty-quantification uncertainty-estimation conformal time-series-prediction conformal-prediction distribution-shift conformal-inference

Updated Nov 14, 2025
Jupyter Notebook

SALib / SALib

Star

Sensitivity Analysis Library in Python. Contains Sobol, Morris, FAST, and other methods.

python numpy uncertainty uncertainty-quantification sensitivity-analysis morris sensitivity-analysis-library sobol global-sensitivity-analysis salib joss

Updated Sep 19, 2026
Python

awslabs / fortuna

Star

A Library for Uncertainty Quantification.

machine-learning ai deep-learning ml uncertainty calibration neural-networks flax bayesian-inference model-calibration uncertainty-quantification uncertainty-estimation conformal-prediction jax uncertainty-calibration

Updated Apr 23, 2025
Python

jxzhangjhu / Awesome-LLM-Uncertainty-Reliability-Robustness

Star

Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models

reliability calibration safety awesome-list uncertainty-quantification uncertainty-estimation robustness hallucination gpt-3 gpt-4 in-context-learning large-language-models prompt-engineering prompting llms chain-of-thought chatgpt

Updated Oct 3, 2026

ENSTA-U2IS-AI / awesome-uncertainty-deeplearning

Star

This repository contains a collection of surveys, datasets, papers, and codes, for predictive uncertainty estimation in deep learning models.

machine-learning awesome deep-neural-networks deep-learning uncertainty-neural-networks uncertainty-quantification uncertainty-estimation uncertainty-analysis awesome-resources deep-learning-tutorials

Updated Aug 19, 2026

A Python-based toolbox of various methods in decision making, uncertainty quantification and statistical emulation: multi-fidelity, experimental design, Bayesian optimisation, Bayesian quadrature, etc.

python machine-learning emulation decision-making uncertainty-quantification sensitivity-analysis bayesian-optimization experimental-design bayesian-quadrature multi-fidelity

Updated Aug 30, 2026
Python

AlaaLab / deep-learning-uncertainty

Star

Literature survey, paper reviews, experimental setups and a collection of implementations for baselines methods for predictive uncertainty estimation in deep learning models.

deep-neural-networks deep-learning uncertainty-quantification uncertainty-estimation prediction-uncertainty