Data engineer

Hello everyone,  I'm currently working as a data engineer and trying to upskill myself. My current tech stack is python, pyspark,pandas and SQL. Use s3 for storage and Apache airflow for jobs. I ha...

Welcome to Data Scientists's Private Community

Hello everyone,

I'm currently working as a data engineer and trying to upskill myself.
My current tech stack is python, pyspark,pandas and SQL.
Use s3 for storage and Apache airflow for jobs.
I have a few questions regarding the same and would like to know from an experienced person.

Thanks

Any Data engineers here? Need some suggestions.

Any Data engineers here? Need some suggestions.- Grapevine

Welcome to Software Engineers's Private Community

Any Data engineers here? Need some suggestions

Welcome to Indian Startups's Private Community

Hi Everyone,
I have 5 ys experience working in Database support with having knowledge in SQL, Scripting and python.

I want to switch my role to a Data Engineering job as my current role is not having enough job opportunities outside.

I am planning to learn tools on Data Engineering.
Like the Data Frameworks: Airflow,SSIS,Azure Factory 
And Dataworks like Snowflake,Databricks,Postgres

I need some guidance on which tool to start learning and if I plan to learn these tools for the next 6 months. Is it possible to crack the interviews....this is my 1st switch to a new company. 

Can anyone pls suggest which framework, Dataworks tool i need to start and has high possibility for getting switch to new company.

If possible can you pls share the learning path 🙏🙏🙏. Thanks in advance.

Pls advise.... Planning to switch ti Data Engineering job from Database support

Software Engineer

I am a Data Engineer working from 2+ years in a small company. What things should I consider while switching. I work on Azure, Python, Snowflake,SQL ,PL-SQL,T-SQL. Also not sure but getting too many rejection mails from easy apply. What should i do ? Anyone DE ehi recently switched please share your experience Below

Data engineer seeking guidance

Welcome to IT Company Discussion's Private Community

Hi All,
I have been working in Infosys for the last 2.5years in the Data Analysis domain with SQL and Microsoft Power BI skillsets.
Now I am planning to switch job.
 so which extra skills in the Data field can I learn for the future?
Which is the most demanding technology in the Data field?

Skill set request

I am an emerging Data Engineer. I have got one offer in similar role and currently learning data engineering. 
I have 60 days notice left and still learning new concepts in data engineering everyday. 
Can you suggest me few key areas, tools and technology i should focus on.? 
Additionally, I am working on Azure cloud only.

Seeking Advice on Data Engineering

Team Lead

So I am currently working as a data analyst. Main tech stack is SQL, Python , pyspark , snowflake and databricks . I feel like I am not learning enough in the role so wanna switch after 1 year. Does anyone have any job openings . Open to startups as well as big companies .

Anyone hiring for 1year exp

Any experienced azure data engineer who can help me..i want to switch my career to data engineering..learnt basics of azure services bt now stuck confused ....donno how to move forward

Azure data engineer

Hi everyone. Currently i have 3+ years of hands-on experience in python 3,pyspark,sql,spark-sql,pandas,numpy. 
I am trying to switch into a software developer / Data engineering role .What other skills do i need so that my profile gets shortlisted .

Looking forward to your suggestions. Thank you

Exploring Career Options: Seeking Advice

Software Developer

Skillset : SQL, PowerBI, Python, Advance Excel, ML, Very basic Azure (Just started learning)
1.5 yrs of experience in TCS in PLSQL DB Team

I am confused as to which field should I venture into,

Big data or data engineering or cloud architect?

I like coding but not way too much.  (7 on a scale of 1 -10)
I love communicating and organising/managing stuff(9 on a scale of 10)


I love working with data but I dont want to be a generalist/data analyst.

I would like to make good money

Seeking Advice: Data Science

I have experience of 2.8Years .
Currently I'm working on technology like Microsoft Azure , Databricks , Snowflake , Altreyx, Python ,Pyspark, SQL, PowerBi. 
Currently I am open to work do let me know if any reference or any job is available for the same.

Looking for Data Engineer job role.

Hey Viners!

I’m on the lookout for new remote opportunities in Data Engineering. After nearly two years, I’ve had a blast working with data pipelines, ETL processes, and creating visualizations.

Drop a comment for more details :)

Looking for data engineer position

Hey everybody!

I am currently preparing for senior data engineer interviews. I have 2.7 YOE. I have experience working with Data pipelines, AWS S3, Python, Spark, Scala, Hive, Hadoop, Kafka.

Any suggestions on how to prepare and what should be the focus?

Thank you in advance!

Senior Data Engineer Interviews

I am a fresher working as a Data analyst in a growing startup. My current role doesn't include much of coding just python and SQL and sometimes little bit ML work. Currently handling 2 projects, and some of PM work to define some roadmaps.
I like engineering and coding in whole and want to know more. So do I switch to some SDE role or is there are more paths after Data analytics? I know ML, DL and NLP but not sure will it be a great choice to make career primarily in Data science.
So, I am little confused. Please give all good advices.

Thanks
A curious Engineer

What after Data analytics?

I am currently working as a Business Intelligence Consultant. I have 3 years of experience in Tableau, Power-BI and SQL. Could someone in the community please tell me how can I transition into data engineering and which companies should I target ?
 
Thank You !

Data Engineering Transition

Data Analyst

I am a senior Data engineer(9YOE) and have worked on a large scale Data warehousing, Spark, Orchestration(Airflow) and visualization on AWS and Azure. I currently don't have scope for tech stack improvement in my current org and would like to learn and implement my personal projects. So far, I have been advised to learn golang and kubernetes so that I could deploy ML models in the future or even move into observability space. Any suggestions on what tech stack I should learn? I want to jump to startups in a couple of months and eventually move into a pure software engineering role. 
Already working on leetcode and practicing system design for the same.

Senior Data Engineer-Which Tech stack to upskill?

I'm working on a migration project of pyspark. I have an understanding of the script code. I can build code logic. But somewhere feeling like that is not enough while switching. Wondering what more skills I require as a pyspark developer or data engineer .

Please guide.

Need assistance/Career guidance

Senior Software Engineer

I currently work as a Data analyst and want to upskill myself and pursue my career in Data Engineering ,kindly suggest me the best resources to follow and learning path . TIA

Any Data engineers here? Need some suggestions.

Discover More

Software Engineers on

by Isaiah Carmden

TCS

Any Data engineers here? Need some suggestions

Indian Startups on

by Matilda Dean

Accenture

Pls advise.... Planning to switch ti Data Engineering job from Database support

Indian Startups on

by Jordon Carmden

Accenture

Pls advise.... Planning to switch ti Data Engineering job from Database support

Data Scientists on

by Jordon Carmden

vConstruct

Data engineer seeking guidance

IT Company Discussion on

by Aaron Lee

Infosys

Skill set request

IT Company Discussion on

by Jordon Dean

Publicis Sapient

Seeking Advice on Data Engineering

Software Engineers on

by Kendall Carmden

American Express

Anyone hiring for 1year exp

IT Company Discussion on

by Jordon Lee

TCS

Azure data engineer

Misc on

by Karilyn Hyrum

TCS

Exploring Career Options: Seeking Advice

Data Scientists on

by Karilyn Dean

Stealth

Seeking Advice: Data Science

Big 4 on

by Matilda Denver

Amdocs

Looking for Data Engineer job role.

Referrals on

by Jordon Lee

Wells Fargo

Looking for data engineer position

Software Engineers on

by Blair Carmden

TCS

Senior Data Engineer Interviews

Software Engineers on

by Jordon Vernon

Student

What after Data analytics?

Misc on

by Matilda Carmden

Nice software solutions Pvt Ltd

Data Engineering Transition

Misc on

by Kalan Lee

Mercedes-Benz Group

Senior Data Engineer-Which Tech stack to upskill?

Software Engineers on

by Kalan Carmden

Capgemini

Need assistance/Career guidance

Data Scientists on

by Kendall Vernon

Capgemini

I currently work as a Data analyst and want to upskill myself and pursue my career in Data Engineering ,kindly suggest me the best resources to follow and learning path . TIA