The Python Oracle

Ordering of batch normalization and dropout?

Become part of the top 3% of the developers by applying to Toptal https://topt.al/25cXVn

--

Music by Eric Matyas
https://www.soundimage.org
Track title: Puzzle Game 3 Looping

--

Chapters
00:00 Question
02:04 Accepted answer (Score 237)
03:02 Answer 2 (Score 66)
04:43 Answer 3 (Score 28)
05:20 Answer 4 (Score 26)
06:39 Thank you

--

Full question
https://stackoverflow.com/questions/3969...

Accepted answer links:
[Ioffe and Szegedy 2015]: https://arxiv.org/pdf/1502.03167.pdf
[this video]: https://www.youtube.com/watch?
[dropout paper]: https://www.cs.toronto.edu/~hinton/absps...

Answer 2 links:
[here]: https://www.reddit.com/r/MachineLearning.../
[pseudomarvin's]: https://math.stackexchange.com/users/167...

Answer 3 links:
[Understanding the Disharmony between Dropout and Batch Normalization by Variance Shift]: https://arxiv.org/pdf/1801.05134.pdf

--

Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...

--

Tags
#python #neuralnetwork #tensorflow #convneuralnetwork

#avk47