Skip to content

Latest commit

 

History

History

mnasnet

README.md

MnasNet

[1] Mingxing Tan, Bo Chen, Ruoming Pang, Vijay Vasudevan, Mark Sandler, Andrew Howard, Quoc V. Le. MnasNet: Platform-Aware Neural Architecture Search for Mobile. CVPR 2019. Arxiv link: https://arxiv.org/abs/1807.11626

About the model and training regime

MnasNet is a family of mobile hardware friendly neural networks, found by Mobile Neural Architecture Search (MNAS). It improves the accuracy and inference speed than previous state-of-the-art mobile models such as MobileNetV2. Here we provide a few standard-size and small-size AutoML models in mnasnet_models.py including:

  • mnasnet-a1 (ckpt) has ~75.2% top-1 ImageNet accuracy with 3.9M parameters and 312M Multiply-Adds.
  • mnasnet-small (ckpt) has ~66% top-1 ImageNet accuracy with 2.0M parameters and 68M Multiply-Adds.

The standard size MnasNet-A1 inference has 1.8x faster throughput (55% lower latency) than the corresponding MobileNetV2 model.

MnasNet-A1 and MobileNetV2

Comparing to MobileNetV2, MnasNet-A1 model has clear better performance in accuracy when they are at the same latency level.

MnasNet-A1 and MobileNetV2 Details

Here are the details of Mnasnet-A1 on ImageNet:

ckpt Input Size Depth Multiplier Top-1 Acc Top-5 Acc Parameters(M) Multi-Adds (M) Pixel1 latency (ms)
ckpt 224 1.4 77.2 93.5 6.1 591.5 135
ckpt 224 1 75.2 92.5 3.9 315.2 78
ckpt 224 0.75 73.3 91.3 2.9 226.7 61
ckpt 224 0.5 68.9 88.4 2.1 105.2 32
ckpt 224 0.35 64.1 85.1 1.7 63.2 22
ckpt 192 1.4 76.1 93.0 6.1 435.1 99
ckpt 192 1 74.0 91.6 3.9 232.0 57
ckpt 192 0.75 72.1 90.5 2.9 166.9 45
ckpt 192 0.5 67.2 87.4 2.1 77.6 24
ckpt 192 0.35 62.4 83.8 1.7 46.8 17
ckpt 160 1.4 74.8 92.1 6.1 302.8 72
ckpt 160 1 72.0 90.5 3.9 161.6 41
ckpt 160 0.75 70.1 89.3 2.9 116.4 33
ckpt 160 0.5 64.9 85.8 2.1 54.4 18
ckpt 160 0.35 52.3 81.5 1.7 32.9 13
ckpt 128 1.4 72.5 90.6 6.1 194.5 49
ckpt 128 1 69.3 88.9 3.9 104.1 29
ckpt 128 0.75 67.0 87.3 2.9 75.0 23
ckpt 128 0.5 60.8 83.0 2.1 35.3 12
ckpt 128 0.35 54.8 78.1 1.7 21.6 8.5
ckpt 96 1.4 68.6 88.1 6.1 110.3 32
ckpt 96 1 64.4 85.8 3.9 59.3 18
ckpt 96 0.75 62.1 84.0 2.9 42.9 17
ckpt 96 0.5 54.7 78.1 2.1 20.5 7.4
ckpt 96 0.35 49.3 73.4 1.7 12.7 5.4

Understanding the code

For more detailed information, read the documentation within each file.

  • imagenet_input.py: Constructs the tf.data.Dataset input pipeline which handles parsing, preprocessing, shuffling, and batching the data samples.
  • mnasnet_main.py: Main code which constructs the TPUEstimator and handles training and evaluating the model.
  • mnasnet_model.py: Modeling library which constructs the network via modular MnasBlock.
  • mnasnet_models.py: A script that defines benchmark MnasNet architectures (e.g. MnasNet-A1, MnasNet-small) through decoding string representation of the network.
  • preprocessing.py: Useful utilities for preprocessing and augmenting ImageNet data for MnasNet training.
  • mnasnet_example.ipynb: A colab example to load MnasNet saved model files and use it to classify images.

Serve the exported model in TFLite

The export function of MnasNet trainer will always export TFLite float model when the '--export_dir' is specified. Furthermore, once '--post_quantize=True' is set, the trainer will also export a quantized TFLite model using the latest model checkpoint.

Please see mnasnet_example.ipynb as an example on how to use these exported model.

Using different MnasNet configurations

The default MnasNet models have been carefully tested with the default flags but mnasnet_model.py offers a generic MnasNetBlock implementation. Thus, user is able to define model configuration through the string annotation in mnasnet_models.py to define new models. Meanwhile, '--depth_multiplier', '--depth_divisor', '--min_depth' are flags offered to adjust MnasNet model to different sizes quickly.

Training MnasNet on TPU

please refer to our tutorial: https://cloud.google.com/tpu/docs/tutorials/mnasnet