TensorPack

TensorPack is a neural net training interface on TensorFlow, with focus on speed + flexibility

There are many examples of classic models and tasks provided in the TensorPack repository. This section shows how to use mmeval.COCODetection for evaluation in TensorPack-FasterRCNN, and the related code can be found at mmeval/examples/tensorpack.

First you need to install TensorFlow and TensorPack, then follow the preparation steps in the TensorPack-FasterRCNN example to install the dependencies and prepare the COCO dataset, as well as download the pre-trained model weights to be evaluated.

Scripts for model evaluation are provided in predict.py, and the model can be evaluated with the following commands:

./predict.py --evaluate output.json --load /path/to Trained-Model-Checkpoint --config SAME-AS-TRAINING

MMEval provides a evaluation tools for TensorPack-FasterRCNN that use mmeval.COCODetection. This evaluation script needs to be placed in the TensorPack-FasterRCNN example directory, and then the evaluation can be executed with the following command.

# run evaluation
python tensorpack_mmeval.py --load <model_path>

# launch multi-gpus evaluation by mpirun
mpirun -np 8 python tensorpack_mmeval.py --load <model_path>

We tested this evaluation script on COCO-MaskRCNN-R50C41x and got the same evaluation results as the TensorPack report.

Model	mAP (box)	mAP (mask)	Configurations
COCO-MaskRCNN-R50C41x	36.2	31.8	MODE_FPN=False