Senior Data Engineer-Which Tech stack to upskill?
I am a senior Data engineer(9YOE) and have worked on a large scale Data warehousing, Spark, Orchestration(Airflow) and visualization on AWS and Azure. I currently don't have scope for tech stack improvement in my current org and would like to learn and implement my personal projects. So far, I have been advised to learn golang and kubernetes so that I could deploy ML models in the future or even move into observability space. Any suggestions on what tech stack I should learn? I want to jump to startups in a couple of months and eventually move into a pure software engineering role. Already working on leetcode and practicing system design for the same.
If you want more money move swe why your staying as DE
I'm not looking at the compensation aspect. I want to work on solving or implementing large scale systems. Could you guide me what is the latest trends in backend engineering?
Try to move to Backend esp python based frameworks would be helpful...
Will do that. Thank you!
Not a DE, but DuckDB seems to be gaining a lot of traction as an alternative to Spark. Maybe you can check that out.
I'll have a look at DuckDB. Thank you!
Should I move to DE from front end dev?