支持矩阵¶
支持的分布式通信后端¶
| MPI4Py | torch.distributed | Horovod | paddle.distributed | oneflow.comm |
|---|---|---|---|---|
| MPI4PyDist | TorchCPUDist TorchCUDADist |
TFHorovodDist | PaddleDist | OneFlowDist |
支持的评测指标及机器学习框架¶
注解
下表列出 MMEval 已实现的评测指标与对应的机器学习框架支持情况，打勾表示能够直接接收对应框架的数据类型（如 Tensor）进行计算。
注解
MMEval 在 PyTorch 1.6+，TensorFlow 2.4+, Paddle 2.2+ 和 OneFlow 0.8+ 测试通过。
| 评测指标 | numpy.ndarray | torch.Tensor | tensorflow.Tensor | paddle.Tensor | oneflow.Tensor |
|---|---|---|---|---|---|
| Accuracy | ✔ | ✔ | ✔ | ✔ | ✔ |
| SingleLabelMetric | ✔ | ✔ | ✔ | ||
| MultiLabelMetric | ✔ | ✔ | ✔ | ||
| AveragePrecision | ✔ | ✔ | ✔ | ||
| MeanIoU | ✔ | ✔ | ✔ | ✔ | ✔ |
| VOCMeanAP | ✔ | ||||
| OIDMeanAP | ✔ | ||||
| COCODetection | ✔ | ||||
| ProposalRecall | ✔ | ||||
| F1Score | ✔ | ✔ | ✔ | ||
| HmeanIoU | ✔ | ||||
| PCKAccuracy | ✔ | ||||
| MpiiPCKAccuracy | ✔ | ||||
| JhmdbPCKAccuracy | ✔ | ||||
| EndPointError | ✔ | ✔ | ✔ | ||
| AVAMeanAP | ✔ | ||||
| StructuralSimilarity | ✔ | ||||
| SignalNoiseRatio | ✔ | ||||
| PeakSignalNoiseRatio | ✔ | ||||
| MeanAbsoluteError | ✔ | ||||
| MeanSquaredError | ✔ |