Senior PySpark Developer
Join a multinational company with startup spirit. You can make the difference!
We are on a mission! Keyrus is a key player in consulting and technology specialised in Data & Analytics, AI & Machine Learning and Digital Transformation with clients in more than 20 countries in 4 continents.
Keyrus is seeking a seasoned Senior PySpark Developer to join our dynamic team in a significant migration endeavor for a leading financial institution, aimed at migrating critical data processes from conventional SQL and SAS Data Integration Studio to PySpark and Azure Synapse. As a Senior Consultant, you'll bring your expertise in data migration and ETL processes to drive the execution of migration strategies, optimize workflows, and provide technical guidance to the team.
This position is fully remote.
Your Duties and Responsibilities:
- Collaborate in the migration initiative from SAS to PySpark
- Design and implement PySpark-based solutions aligned with project goals.
- Optimize data pipelines, algorithms, and processes for maximum efficiency and performance.
- Collaborate with cross-functional teams to understand requirements and deliver robust solutions.
- Troubleshoot and resolve technical issues related to PySpark data processing.
- Document code, processes, and solutions for knowledge sharing and future reference.
About You:
- 5+ years of experience with PySpark, preferably in a leadership or senior role.
- Expertise in Python or Scala programming languages for data processing tasks.
- Strong understanding of SQL, data structures, algorithms, and optimization techniques.
- Proven mentoring skills to guide and support junior team members.
- Excellent problem-solving abilities and effective communication skills.
- Fluent in English (French is a Plus)
- Must be a Portuguese or European citizen or having a work permit for Portugal
Nice-to-have:
- Previous experience with MS Azure/Synapse
- Knowledge of SAS Data Integration Studio
- Prior experience in large-scale data migration projects.
- Familiarity with cloud platforms (e.g. AWS, Azure, GCP) for data processing tasks.
- Proficiency in data warehousing concepts and ETL processes.
At Keyrus Portugal, we offer:
- Salary based on your skills and experience and in line with market practices
- Meal allowance of €8.32 per day
- Private Health Insurance
- 22 days of annual leave
- Professional development through the Keyrus Learning Experience (KLX) Program
Why Keyrus?
Joining Keyrus means joining a market leader in the Data Intelligence field and an (inter)national player in Management Consultancy and Digital Experience.
You will be part of a young and ever-learning enterprise with an established international network of thought-leading professionals driven by bridging the gap between innovation and business. You get the opportunity to meet specialised and professional consultants in a multicultural ecosystem. With Keyrus, you have the opportunity to showcase your talents and potential, to build up experience through working with our clients, with the opportunity to grow depending on your capabilities and affinities, in a great working and dynamic atmosphere.
#Li-Remote
- Areas de expertise
- Data & Analytics
- Locations
- Lisbon, Porto
- Remote status
- Fully Remote
About Keyrus Portugal
At Keyrus Portugal, we're more than just a company - we're a constellation of bright minds and innovative souls.
If you're seeking a place where your passion meets purpose, where every project is a canvas and every challenge an opportunity, then look no further.
Join us, and be a part of a community that's shaping the digital frontier. At Keyrus Portugal, your journey to greatness begins.
Senior PySpark Developer
Join a multinational company with startup spirit. You can make the difference!
Loading application form
Already working at Keyrus Portugal?
Let’s recruit together and find your next colleague.