Home page

Deconstructing Deep Learning + δeviations

Drop me an email | RSS feed link : Click
Format : Date | Title
  TL; DR

Total posts : 78

View My GitHub Profile


Index page

Bag Of Tricks

[24] Bag Of Tricks - He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., & Li, M. (2019). Bag of tricks for image classification with convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 558-567). Paper

Training procedure

Large batch training

Zero gamma

No bias decay

FP16

XResnet

One cycle

Label Smoothing CE

Distillation

Use mixup