Skip to content

MulticlassAUROC: Implement a multi-class version of the AUROC metric #3304

@NumesSanguis

Description

@NumesSanguis

🚀 Feature

Create the metric MulticlassAUROC to allow for the AUROC metric to be used in multi-class problem settings. Or,
Expand the AUROC metric to support multi-class data, which would also directly solve this AUROC bug that instead gives a random value when used in multi-class problems: #3303

Motivation

AUROC is a useful metric for model performance, but the current AUROC metric is not made for multi-class problems.
An out of the box working multi-class AUROC metric would be great.

Pitch

According to this post on the PyTorch Lightning forum, implementation would just require wrapping existing functionality together.

Implementing this metric would lower the barrier of its usage, instead of needing to be aware of the different metrics available that could be combined to effectively get his metric.

Alternatives

Additional context

Metadata

Metadata

Assignees

Labels

featureIs an improvement or enhancementgood first issueGood for newcomershelp wantedOpen to be worked on

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions