How do you all deploy ML models for production?

Mostly, I have seen people in my team creating an API endpoint for it and deploy on a VM via uvicorn. Anything better?

15mo ago

Talking product sense with Ridhi

9 min AI interview5 questions

FloatingWaffle

Flipkart15mo

On a VM? Seems too manual.

First yes API end point is mandatory.. Something should have it.

Kubernetes deployment with CI-CD enabled
Use a model host and push model there. Your kubernetes service should always call the latest model from the model host.

SquishyQuokka

Gojek15mo

What kind of a model host would you recommend? Huggingface?

Discover more

Curated from across

Software Engineers15mo

by SillyUnicornGoogle

How to become a GenAI Developer?

I am an ML enthusiast and have been learning Reinforcement Learning and other Algorithms to shift my profile to ML engineer. But as soon as I started applying for jobs, every job is looking for people who have experience in GENAI, LLMs, ...

Company Reviews9mo

by SparklyLlamaAccenture

Should I join the Scaler Academy ?

Hi everyone,

I'm currently working on an SAP MM-based project. Despite talking with everyone who could assist me in securing a development role, I've been told that, as an ASE, I can't switch to development. I'm worried about my career ...