How do you all deploy ML models for production?

Mostly, I have seen people in my team creating an API endpoint for it and deploy on a VM via uvicorn. Anything better?

12mo ago

Find out if you are being paid fairly.Download Grapevine

FloatingWaffle

On a VM? Seems too manual.

First yes API end point is mandatory.. Something should have it.

Kubernetes deployment with CI-CD enabled
Use a model host and push model there. Your kubernetes service should always call the latest model from the model host.

SquishyQuokka

What kind of a model host would you recommend? Huggingface?

Discover more

Curated from across

Ask a question on Grapevine.

Get the app on Android or iOS.