[1] Z. Abai, N. Rajmalwar, et al., “DenseNet Models for Tiny ImageNet Classification,” arXiv:1904.10429 [cs.CV].

[2] S. F. L. Shi, “Kaminet - a convolutional neural network for tiny imagenet challenge,” CS, vol. 231, 2015.

[3] A. S. Walia, “The Vanishing Gradient Problem.” [Online]. Available: https://medium.com/

[4] “What   is   the   Exploding   Gradient   Problem?”   [Online].   Avail- able: https://deepai.org/machine-learning-glossary-and-terms/exploding- gradient-problem

[5] L. N. Smith, “Nicholay Topin. Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates,” arXiv:1708.07120 [cs.LG].

[6] S. Hochreiter, “ The vanishing gradient problem during learning recurrent neural nets and problem solutions,” International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 2, no. 107–116, 1998. [Online]. Available: https://www.bioinf.jku.at/publications/older/2304.pdf

[7] Google, “TensorFlow playground .” [Online]. Available: https:// playground.tensorflow.org/

[8] L N. Smith, “Cyclic Learning rates for training neural networks”, arXiv:1506.01186[cs.CV]

[9] Abinav Shrivastava, Abhinav Gupta, Ross Girshick,” Training region-based object detectors with online hard example mining”, arXiv:1604.03540 [sc.CV]

[10] ILSVRC, “https://tiny-imagenet.herokuapp.com/”

[11] Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan Salakhutdinov,” Dropout: a simple way to prevent neural networks from overfitting”, journal of machine learning  research 15 (2014)

[12]Jarek Duda, “SGD momentum optimizer with step estimation by online parabola model”, arXiv:1907.07063 [cs.LG]

Student, Department of Computer Science & Engineering, MVJ College of Engineering, Whitefield, Bangalore, India (email: inboxpraveenkumar17@gmail.com)