Enhancing Skills in Python, PySpark, Unix, SQL, Hive, and Hadoop: Seeking Guidance on Advancement and Project Development for Career Transitions

I am currently working on projects using Python, PySpark, Unix, SQL, Hive, and Hadoop, but my knowledge is at a basic level. I would like to expand my skills further. What additional skills should I focus on learning? Also, what kinds of projects should I work on to enhance my expertise? When transitioning to a new role, which skill sets are usually taken into consideration?