NixCon 2024

Deploying random AI models: from pip nightmare to dream2nix
2024-10-25 , Arena

Or: how I stopped worrying and learned to love docker images


How can we take existing python software, and turn it into a docker image? Can we use the power of Nix? Can we make it easy?

I'll tell you all about my new half-finished project, where I smash dream2nix and docker-tools together to deploy other people's AI models to the cloud in a reproducible manner.

Along the way, we'll have brief detours through flake-parts, docker internals and nvidia software.


What level of experience in Nix is the talk addressed to?:

Intermediate

Do you allow your talk to be recorded?: yes

Yorick is the co-founder of Datakami, a generative AI consulting company.

He installed NixOS in 2014 and can never go back.