The Python Oracle

How to split in chunks (submatrices), or handle a huge matrix giving memory error on numpy?

Become part of the top 3% of the developers by applying to Toptal https://topt.al/25cXVn

--

Music by Eric Matyas
https://www.soundimage.org
Track title: Life in a Drop

--

Chapters
00:00 Question
04:32 Accepted answer (Score 3)
06:22 Answer 2 (Score 0)
07:51 Thank you

--

Full question
https://stackoverflow.com/questions/5494...

Question links:
[pooling]: https://www.quora.com/What-is-max-poolin...
[this]: https://stackoverflow.com/questions/4405...
[this]: https://stackoverflow.com/questions/1908...

Accepted answer links:
[dask]: https://docs.dask.org/en/latest/
[package]: https://anaconda.org/Chroxvi/memory_prof...
[here]: https://ipython-books.github.io/511-perf.../
[here]: https://docs.dask.org/en/latest/array.ht...
[here]: https://ipython-books.github.io/511-perf.../

Answer 2 links:
https://medium.com/analytics-vidhya/matr...

--

Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...

--

Tags
#python #python3x #numpy #matrix #largedata

#avk47