Is it thread-safe when using tf.Session in inference service?
--------------------------------------------------
Hire the world's top talent on demand or became one of them at Toptal: https://topt.al/25cXVn
and get $2,000 discount on your first invoice
--------------------------------------------------
Music by Eric Matyas
https://www.soundimage.org
Track title: Ancient Construction
--
Chapters
00:00 Is It Thread-Safe When Using Tf.Session In Inference Service?
00:29 Accepted Answer Score 18
00:59 Thank you
--
Full question
https://stackoverflow.com/questions/3869...
--
Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...
--
Tags
#python #multithreading #tensorflow #tensorflowserving
#avk47
Hire the world's top talent on demand or became one of them at Toptal: https://topt.al/25cXVn
and get $2,000 discount on your first invoice
--------------------------------------------------
Music by Eric Matyas
https://www.soundimage.org
Track title: Ancient Construction
--
Chapters
00:00 Is It Thread-Safe When Using Tf.Session In Inference Service?
00:29 Accepted Answer Score 18
00:59 Thank you
--
Full question
https://stackoverflow.com/questions/3869...
--
Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...
--
Tags
#python #multithreading #tensorflow #tensorflowserving
#avk47
ACCEPTED ANSWER
Score 18
The tf.Session object is thread-safe for Session.run() calls from multiple threads.
Before TensorFlow 0.10 graph modification was not thread-safe. This was fixed in the 0.10 release, so you can add nodes to the graph concurrently with Session.run() calls, although this is not advised for performance reasons; instead, it is recommended to call sess.graph.finalize() before using the session from multiple threads, to prevent accidental memory leaks.