Browse State-of-the-Art › scoring rule
scoring rule
25 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 90 · with a code link: 25 · where Syntology ran a sample: 6 (5 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (6 of 90 tagged: 5 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 90 of 90, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
8 Oct 2019 4 repositories listed Syntology official (archive's flag): 3 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)NGBoost generalizes gradient boosting to probabilistic regression by treating the parameters of the conditional distribution as targets for a multiparameter boosting algorithm.
-
13 Jan 2021 3 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We show that in the context of object detection, training variance networks with negative log likelihood (NLL) can lead to high entropy predictive distributions regardless of the correctness of the output mean.
-
28 Oct 2022 2 repositories listedYet calibration is not enough: even a perfectly calibrated classifier with the best possible accuracy can have confidence scores that are far from the true posterior probabilities.
-
26 Mar 2021 2 repositories listedWe consider frequently used scoring rules for right-censored survival regression models such as time-dependent concordance, survival-CRPS, integrated Brier score and integrated binomial log-likelihood, and prove that…
-
3 Aug 2020 2 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)Speech synthesis is an important practical generative modeling problem that has seen great progress over the last few years, with likelihood-based autoregressive neural models now outperforming traditional concatenative…
-
22 Jun 2025 1 repository listedIn this study, we summarize and categorize previous works into three general strategies: intuitively designed methods, binning-based methods, and methods based on formulations of ideal calibration.
-
16 Jun 2025 1 repository listedWe demonstrate that state-of-the-art models do not issue calibrated forecasts for extreme wind speeds, and that the calibration of forecasts for extreme events can be improved by suitable adaptations to the loss…
-
25 Nov 2024 1 repository listedIn many large-scale classification problems, classes are organized in a known hierarchy, typically represented as a tree expressing the inclusion of classes in superclasses.
-
Superior Scoring Rules for Probabilistic Evaluation of Single-Label Multi-Class Classification Tasks25 Jul 2024 1 repository listedTraditional scoring rules like Brier Score and Logarithmic Loss sometimes assign better scores to misclassifications in comparison with correct classifications.
-
23 Jul 2024 1 repository listedBuilding upon the Bayesian approach introduced in, we devise a new method for online change point detection in the mean of a univariate time series, which is well suited for real-time applications and is able to handle…
-
22 Jul 2024 1 repository listedIn this work we aim to improve statistical post-processing models for probabilistic predictions of extreme wind speeds.
-
2 Jul 2024 1 repository listedAccurate precipitation forecasts have a high socio-economic value due to their role in decision-making in various fields such as transport networks and farming.
-
6 Jun 2024 1 repository listedEvaluating on 8 survival metrics, we assess discrimination, calibration, and overall predictive performance of the tested models.
-
29 May 2024 1 repository listed Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 2 pointer-only (licence)Leveraging this strategy, we train language generation models using two classic strictly proper scoring rules, the Brier score and the Spherical score, as alternatives to the logarithmic score.
-
19 Apr 2023 1 repository listed Syntology official (archive's flag): 17 ran · 17 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 19 harvested samples)Multivariate probabilistic time series forecasts are commonly evaluated via proper scoring rules, i. e., functions that are minimal in expectation for the ground-truth distribution.
-
10 Nov 2022 1 repository listedIn this paper we propose a new method for adjusting approximate posterior samples to reduce bias and produce more accurate uncertainty quantification.
-
29 Oct 2022 1 repository listedWhile being an effective framework of learning a shared model across multiple edge devices, federated learning (FL) is generally vulnerable to Byzantine attacks from adversarial edge devices.
-
26 Sep 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)Ensemble weather forecasts based on multiple runs of numerical weather prediction models typically show systematic errors and require post-processing to obtain reliable forecasts.
-
31 May 2022 1 repository listedHowever, generative networks only allow sampling from the parametrized distribution; for this reason, Ramesh et al. [2022] follows the common solution of adversarial training, where the generative network plays a…
-
4 May 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)We propose a novel deep dynamics model, Probabilistic Equivariant Continuous COnvolution (PECCO) for probabilistic prediction of multi-agent trajectories.
-
15 Mar 2022 1 repository listedAccurate uncertainty estimates are essential for deploying deep object detectors in safety-critical systems.
-
3 Mar 2022 1 repository listedWe consider the problem of discovering causal relations from independence constraints selection bias in addition to confounding is present.
-
15 Dec 2021 1 repository listedAdversarial-free minimization is possible for some scoring rules; hence, our framework avoids the cumbersome hyperparameter tuning and uncertainty underestimation due to unstable adversarial training, thus unlocking…
-
20 Feb 2020 1 repository listedFirst, we want the learning algorithm to be no-regret with respect to the best fixed expert in hindsight.
-
5 Mar 2019 1 repository listedRobust scatter estimation is a fundamental task in statistics.
-
Aligned Textual Scoring Rules8 Jul 2025 0 repositories listedScoring rules elicit probabilistic predictions from a strategic agent by scoring the prediction against a ground truth state.
-
End-to-End Probabilistic Framework for Learning with Hard Constraints8 Jun 2025 0 repositories listedWe present a general purpose probabilistic forecasting framework, ProbHardE2E, to learn systems that can incorporate operational/physical constraints as hard requirements.
-
The Disparate Effects of Partial Information in Bayesian Strategic Learning31 May 2025 0 repositories listedWe study how partial information about scoring rules affects fairness in strategic learning settings.
-
Likelihood-Free Variational Autoencoders24 Apr 2025 0 repositories listedVariational Autoencoders (VAEs) typically rely on a probabilistic decoder with a predefined likelihood, most commonly an isotropic Gaussian, to model the data conditional on latent variables.
-
Relationship between Hölder Divergence and Functional Density Power Divergence: Intersection and Generalization23 Apr 2025 0 repositories listedIn this study, we discuss the relationship between two families of density-power-based divergences with functional degrees of freedom -- the Hölder divergence and the functional density power divergence (FDPD) -- based…
-
A Stable and Strategy-Proof Controlled School Choice Mechanism with Integrated and Flexible Rules23 Mar 2025 0 repositories listed
-
Distributional Diffusion Models with Scoring Rules4 Feb 2025 0 repositories listed
-
Consistency Checks for Language Model Forecasters24 Dec 2024 0 repositories listed
-
Generalized Bayesian deep reinforcement learning16 Dec 2024 0 repositories listed
-
Efficient pooling of predictions via kernel embeddings25 Nov 2024 0 repositories listed
-
Survival Models: Proper Scoring Rule and Stochastic Optimization with Competing Risks22 Oct 2024 0 repositories listed
-
Concentrated Superelliptical Market Maker17 Oct 2024 0 repositories listed
-
MVG-CRPS: A Robust Loss Function for Multivariate Probabilistic Forecasting11 Oct 2024 0 repositories listed
-
Efficient Training of Neural Stochastic Differential Equations by Matching Finite Dimensional Distributions4 Oct 2024 0 repositories listed
-
Scoring rule nets: beyond mean target prediction in multivariate regression22 Sep 2024 0 repositories listed
-
Combinations of distributional regression algorithms with application in uncertainty estimation of corrected satellite precipitation products29 Jun 2024 0 repositories listed
-
Teaching Models To Survive: Proper Scoring Rule and Stochastic Optimization with Competing Risks20 Jun 2024 0 repositories listed
-
VAEneu: A New Avenue for VAE Application on Probabilistic Forecasting7 May 2024 0 repositories listed
-
On Training Survival Models with Scoring Rules19 Mar 2024 0 repositories listed
-
Ads in Conversations16 Mar 2024 0 repositories listed
-
Consistent and Asymptotically Unbiased Estimation of Proper Calibration Errors14 Dec 2023 0 repositories listed
-
Uncertainty estimation of machine learning spatial precipitation predictions from satellite data13 Nov 2023 0 repositories listed
-
Familiarity-Based Open-Set Recognition Under Adversarial Attacks8 Nov 2023 0 repositories listed
-
Determining Winners in Elections with Absent Votes11 Oct 2023 0 repositories listed
-
Using AI Uncertainty Quantification to Improve Human Decision-Making19 Sep 2023 0 repositories listed
-
Probabilistic Self-supervised Learning via Scoring Rules Minimization5 Sep 2023 0 repositories listed
-
SupEuclid: Extremely Simple, High Quality OoD Detection with Supervised Contrastive Learning and Euclidean Distance21 Aug 2023 0 repositories listed
-
A Novel Multiagent Flexibility Aggregation Framework17 Jul 2023 0 repositories listed
-
U-Calibration: Forecasting for an Unknown Agent30 Jun 2023 0 repositories listed
-
ProPanDL: A Modular Architecture for Uncertainty-Aware Panoptic Segmentation17 Apr 2023 0 repositories listed
-
Learning to Incentivize Information Acquisition: Proper Scoring Rules Meet Principal-Agent Model15 Mar 2023 0 repositories listed
-
Uniform Pessimistic Risk and its Optimal Portfolio2 Mar 2023 0 repositories listed
-
Model selection with Gini indices under auto-calibration28 Jul 2022 0 repositories listed
-
Robust Estimation for Nonparametric Families via Generative Adversarial Networks2 Feb 2022 0 repositories listed
-
A Unified Framework for Multi-distribution Density Ratio Estimation7 Dec 2021 0 repositories listed
-
Shift Happens: Adjusting Classifiers3 Nov 2021 0 repositories listed
-
Online Aggregation of Probability Forecasts with Confidence29 Sep 2021 0 repositories listed
-
Optimal Scoring Rule Design under Partial Knowledge15 Jul 2021 0 repositories listed
-
Predictive Uncertainty in Deep Object Detectors: Estimation and Evaluation1 Jan 2021 0 repositories listed
-
Automated Market Makers for Decentralized Finance (DeFi)3 Sep 2020 0 repositories listed
-
Evaluating probabilistic classifiers: Reliability diagrams and score decompositions revisited7 Aug 2020 0 repositories listed
-
Incentives for Federated Learning: a Hypothesis Elicitation Approach21 Jul 2020 0 repositories listed
-
Competitive Wakeup Scheme for Distributed Devices19 May 2020 0 repositories listed
-
Improved Price Oracles: Constant Function Market Makers22 Mar 2020 0 repositories listed
-
Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules16 Oct 2019 0 repositories listed
-
ORCCA: Optimal Randomized Canonical Correlation Analysis11 Oct 2019 0 repositories listed
-
Distance Restricted Manipulation in Voting7 Sep 2019 0 repositories listed
-
Scoring Strategic Agents4 Sep 2019 0 repositories listed
-
Who is in Your Top Three? Optimizing Learning in Elections with Many Candidates19 Jun 2019 0 repositories listed
-
On the marginal likelihood and cross-validation21 May 2019 0 repositories listed
-
Compound Density Networks1 May 2019 0 repositories listed
-
Online Learning with Continuous Ranked Probability Score26 Feb 2019 0 repositories listed
-
Proper-Composite Loss Functions in Arbitrary Dimensions19 Feb 2019 0 repositories listed
-
RDeepSense: Reliable Deep Mobile Computing Models with Uncertainty Estimations9 Sep 2017 0 repositories listed
-
Strictly Proper Kernel Scoring Rules and Divergences with an Application to Kernel Two-Sample Hypothesis Testing9 Apr 2017 0 repositories listed
-
Statistical Inference for Pairwise Graphical Models Using Score Matching1 Dec 2016 0 repositories listed
-
Optimizing positional scoring rules for rank aggregation18 Sep 2016 0 repositories listed
-
Calibration of Phone Likelihoods in Automatic Speech Recognition14 Jun 2016 0 repositories listed
-
Market Scoring Rules Act As Opinion Pools For Risk-Averse Agents1 Dec 2015 0 repositories listed
-
Budget Constraints in Prediction Markets7 Oct 2015 0 repositories listed
-
Efficient Dodgson-Score Calculation Using Heuristics and Parallel Computing21 Jul 2015 0 repositories listed
-
Likelihood-ratio calibration using prior-weighted proper scoring rules30 Jul 2013 0 repositories listed
-
Assessment, Criticism and Improvement of Imprecise Subjective Probabilities for a Medical Expert System27 Mar 2013 0 repositories listed
-
Overlaying classifiers: a practical approach for optimal ranking1 Dec 2008 0 repositories listed
-
Predictive Indexing for Fast Search1 Dec 2008 0 repositories listed
Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections