hessian-vector-product

Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditioner and more)

Tensorflow implementation of preconditioned stochastic gradient descent

Using PyTorch autograd to compute Hessian of Perplexity for Large Language Models

FOSI library for improving first order optimizers with second order information

Do Hessian curvature spectra predict when a transformer will grok? 240 modular-arithmetic runs, stochastic Lanczos spectra and forecasts of grokking time from early training.

NeurIPS 2026: When Attribution Patching Lies. HVP and multi-step HVP corrections, model examples, and isolated-edge scoring utilities.

🧐 Calculating exact and approximate confidence and information metrics for deep learning on general purpose and chemistry tasks.