(this page is under construction, feel free to add to it)
Anaconda is an open-source Python distribution that makes is possible to easily install many pre-packaged third party Python modules.
It has some big advantages over using Esri's distributions:
How to do a separate Python installation with ArcGIS? (GIS Stack Exchange)
Using ArcPy with Anaconda (PyMorton)