MMCls¶
BaseMetric in MMEval
follows the design of the mmengine.evaluator module and introduces distributed communication backend to meet the needs of a diverse distributed communication library.
Therefore, MMEval
naturally supports the evaluation based on OpenMMLab 2.0 algorithm library, and the evaluation metrics using MMEval in OpenMMLab 2.0 algorithm library need not be modified.
For example, use mmeval.Accuracy in MMCls, just configure the Metric to be Accuracy in the config:
val_evaluator = dict(type='Accuracy', topk=(1, ))
test_evaluator = val_evaluator
MMEval’s support for OpenMMLab 2.0 algorithm library is being gradually improved, and the supported metric can be viewed in the support matrix.