Shall we set experimental_aggregate_gradients to False or True when manually accumulating gradients in Tensorflow?

Become part of the top 3% of the developers by applying to Toptal https://topt.al/25cXVn

--

Music by Eric Matyas
https://www.soundimage.org
Track title: Hypnotic Puzzle2

--

Chapters
00:00 Question
01:19 Accepted answer (Score 1)
03:12 Thank you

--

Full question
https://stackoverflow.com/questions/6431...

Question links:
[here]: https://www.tensorflow.org/api_docs/pyth...

Accepted answer links:
[tf.distribute.Strategy]: https://www.tensorflow.org/api_docs/pyth...

--

Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...

--

Tags
#python #tensorflow #optimization #deeplearning #gradient

#avk47