Senior Data Engineer-Which Tech stack to upskill?

I am a senior Data engineer(9YOE) and have worked on a large scale Data warehousing, Spark, Orchestration(Airflow) and visualization on AWS and Azure. I currently don't have scope for tech stack improvement in my current org and would like to learn and implement my personal projects. So far, I have been advised to learn golang and kubernetes so that I could deploy ML models in the future or even move into observability space. Any suggestions on what tech stack I should learn? I want to jump to startups in a couple of months and eventually move into a pure software engineering role. Already working on leetcode and practicing system design for the same.

9mo ago
Find out if you are being paid fairly.Download Grapevine
FluffyKoala
FluffyKoala

If you want more money move swe why your staying as DE

CosmicMochi
CosmicMochi

I'm not looking at the compensation aspect. I want to work on solving or implementing large scale systems. Could you guide me what is the latest trends in backend engineering?

SnoozyWaffle
SnoozyWaffle

Try to move to Backend esp python based frameworks would be helpful...

CosmicMochi
CosmicMochi

Will do that. Thank you!

GoofyTaco
GoofyTaco

Not a DE, but DuckDB seems to be gaining a lot of traction as an alternative to Spark. Maybe you can check that out.

CosmicMochi
CosmicMochi

I'll have a look at DuckDB. Thank you!

JazzyDonut
JazzyDonut
TCS9mo

Can i connect you in DM.
I am in need of some guidance, working in Front end, and hating every minute of it

CosmicMochi
CosmicMochi

Sure

JazzyDonut
JazzyDonut
TCS9mo

It is asking for 🍇 grapes. Not allowing me in DM CAN YOU PLEASE SAY hi on 8090834061

JazzyDonut
JazzyDonut
TCS9mo

Should I move to DE from front end dev?

Discover more
Curated from across