How to reversibly store and load a Pandas dataframe to/from disk

Become part of the top 3% of the developers by applying to Toptal https://topt.al/25cXVn

--

Music by Eric Matyas
https://www.soundimage.org
Track title: Darkness Approaches Looping

--

Chapters
00:00 Question
00:32 Accepted answer (Score 643)
01:37 Answer 2 (Score 131)
04:24 Answer 3 (Score 39)
05:42 Answer 4 (Score 31)
05:57 Thank you

--

Full question
https://stackoverflow.com/questions/1709...

Accepted answer links:
[pickle]: http://docs.python.org/2/library/pickle....
[to_pickle]: http://pandas.pydata.org/pandas-docs/sta...
[HDF5]: http://pandas.pydata.org/pandas-docs/sta...
[pytables]: http://www.pytables.org
[very fast]: https://stackoverflow.com/questions/1662...
[cookbook]: http://pandas-docs.github.io/pandas-docs...
[msgpack]: http://pandas.pydata.org/pandas-docs/sta...
[this question]: https://stackoverflow.com/q/30651724/124...

Answer 2 links:
[Efficiently Store Pandas DataFrames]: http://matthewrocklin.com/blog/work/2015...
[online]: https://gist.github.com/mrocklin/4f6d06a...
[serialize.py]: https://gist.github.com/agoldhoorn/ee3be...
[image]: https://i.stack.imgur.com/T9JEL.png
[categorical]: http://pandas.pydata.org/pandas-docs/ver...
[pickle]: https://docs.python.org/2/library/pickle...
[Fastest Python library to read a CSV file]: https://softwarerecs.stackexchange.com/q...
[answer]: https://softwarerecs.stackexchange.com/a...
[numpy.fromfile]: http://docs.scipy.org/doc/numpy/referenc...
[serialization test]: https://gist.github.com/justinfx/3174062
[msgpack]: https://pypi.org/project/msgpack
[ujson]: https://pypi.python.org/pypi/ujson

Answer 3 links:
[ipython]: http://ipython.org/
[HDF5 table]: http://pandas.pydata.org/pandas-docs/sta...
[feather]: https://github.com/wesm/feather
[this answer]: https://stackoverflow.com/questions/1426...

--

Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...

--

Tags
#python #pandas #dataframe

#avk47