REVIEW 10 cited by
Aequitas: A Bias and Fairness Audit Toolkit
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Aequitas: A Bias and Fairness Audit Toolkit
read the original abstract
Recent work has raised concerns on the risk of unintended bias in AI systems being used nowadays that can affect individuals unfairly based on race, gender or religion, among other possible characteristics. While a lot of bias metrics and fairness definitions have been proposed in recent years, there is no consensus on which metric/definition should be used and there are very few available resources to operationalize them. Therefore, despite recent awareness, auditing for bias and fairness when developing and deploying AI systems is not yet a standard practice. We present Aequitas, an open source bias and fairness audit toolkit that is an intuitive and easy to use addition to the machine learning workflow, enabling users to seamlessly test models for several bias and fairness metrics in relation to multiple population sub-groups. Aequitas facilitates informed and equitable decisions around developing and deploying algorithmic decision making systems for both data scientists, machine learning researchers and policymakers.
Forward citations
Cited by 10 Pith papers
-
Beyond Third-Person Audits: Situated Interaction Auditing for User-Centered LLM Bias Research
Introduces Situated Interaction Auditing (SIA) to examine how user sociodemographic signals affect LLM response quality, content, and tone in personal interactions.
-
Do Fair Models Reason Fairly? Counterfactual Explanation Consistency for Procedural Fairness in Credit Decisions
Outcome-fair credit models often exhibit hidden procedural bias through inconsistent reasoning across groups, which the CEC framework mitigates by enforcing consistent feature attributions via counterfactuals.
-
TabChange: Precise Attribute Changes in Tabular Data
TabChange produces more proximal and valid counterfactuals on tabular data by relationship-based flipping or adversarial latent-space attribute removal compared to baselines on seven datasets.
-
RISED: A Pre-Deployment Evaluation Framework for High-Stakes AI Decision-Support Systems, with Application to Healthcare
RISED operationalizes five evaluation dimensions for AI decision-support systems via BCa bootstrap intervals and Holm-Bonferroni verdicts, revealing failures missed by AUROC on seven cohorts including Diabetes 130 and NHANES.
-
RISED: A Pre-Deployment Evaluation Framework for High-Stakes AI Decision-Support Systems, with Application to Healthcare
RISED is a structured pre-deployment safety framework that flags failures in clinical AI systems across reliability, inclusivity, sensitivity, equity, and deployability using pre-specified criteria and statistical cor...
-
Fairness of Explanations in Artificial Intelligence (AI): A Unifying Framework, Axioms, and Future Direction toward Responsible AI
A conditional invariance framework defines explanation fairness as explanations being statistically independent of protected attributes given task-relevant features, unifying existing metrics and enabling procedural b...
-
MIFair: A Mutual-Information Framework for Intersectionality and Multiclass Fairness
MIFair defines fairness via mutual information independence between predictions and sensitive attributes, supplies a flexible metric template plus regularization-based mitigation, proves equivalences to standard notio...
-
FairLogue: A Toolkit for Intersectional Fairness Analysis in Clinical Machine Learning Models
FairLogue provides modular tools to quantify intersectional fairness gaps in clinical ML using extended demographic parity, equalized odds, and counterfactual methods, shown on a glaucoma surgery prediction task from ...
-
Concolic Testing on Individual Fairness of Neural Network Models
PyFair adapts the PyCT concolic testing tool with a dual network to systematically detect discriminatory instances and verify individual fairness in DNNs, providing completeness guarantees for certain network types.
-
Software Fairness: An Analysis and Survey
A literature survey of 164 papers on software fairness reveals gaps in requirements engineering, intersectional measures, unstructured data, and white-box ML methods.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.