Does Probability Calibration Survive a Change of OCT Scanner? A Leakage-Free Study of Calibration Transfer Across Manufacturers
International Journal of Computer Applications · Vol. 187 · No. 149 · pp. 37–44 · October 2026 · ISSN 0975-8887
Research question
Do the predicted probabilities of retinal OCT classifiers stay calibrated when the scanner manufacturer changes?
Study
Three-class OCT classifiers (AMD, DME, normal) were trained on patient-disjoint Heidelberg Spectralis B-scans from the Kermany dataset and evaluated on an unseen Optovue Avanti RTVue XR cohort (OCTDL), across eleven runs, two backbones and two resizing policies. Before any modelling, the study audited both datasets for leakage and built splits that keep the same patient and near-duplicate images together.
Method
- Leakage audit of both public datasets: shared patient identifiers across Kermany class folders, and pixel-identical OCTDL images filed under different patient IDs.
- Splits built from connected components of “same patient” or “near-duplicate” relations.
- Source-only temperature scaling compared with physics-parameterised OCT acquisition degradation, a matched-severity generic corruption family, and input-conditioned temperature.
Takeaway
Resizing policy mattered more than any calibration method tested, a single source-fitted temperature was the most dependable fix, and the error promised at a source-calibrated referral threshold more than doubled on the new scanner.
Optical coherence tomographyProbability calibrationDomain shiftData leakageTemperature scalingRetinal imagingReproducibility
Findings reported in the published abstract
Target balanced accuracy
Higher is better
Uncalibrated target ECE
Lower is better
10/11 runs
Source-only temperature scaling lowered target ECE
6/11 runs
…with a 95% bootstrap interval excluding zero
5/11 runs
Physics-based OCT degradation beat a generic corruption family
10/11 runs
Input-conditioned temperature lost to one global temperature
A referral threshold promising 0.5% error on the source scanner gave 1.19%–1.59% error on the new scanner.