Michael McKerns

Number of videos:
The Failure of Python Object Serializations: Why HPC in Python is Broken and How to Fix it
SciPy 2014
Michael McKerns
Recorded: July 9, 2014Language: English

Parallel and asynchronous computing in python is crippled by pickle's poor object serialization. Dill, a more robust serialization package, strives to serialize all of python. Dill has been used to enable state persistence and recovery, global caching, and the coordination of distributed parallel calculations across a network of the world's largest computers.