Deploying random AI models: from pip nightmare to dream2nix
Or: how I stopped worrying and learned to love docker images
How can we take existing python software, and turn it into a docker image? Can we use the power of Nix? Can we make it easy?
I'll tell you all about my new half-finished project, where I smash dream2nix and docker-tools together to deploy other people's AI models to the cloud in a reproducible manner.
Along the way, we'll have brief detours through flake-parts, docker internals and nvidia software.
What level of experience in Nix is the talk addressed to?
Intermediate
Yorick van Pelt
Yorick is the co-founder of Datakami, a generative AI consulting company.
He installed NixOS in 2014 and can never go back.