Lead Data Engineer
GFT · Kraków, Poland · On site · 7 days ago
Why a CV for this job?
- They see what they asked for, first. Your experience that matches the ad leads, in the ad's own words, so someone skimming finds it in seconds.
- It gets past the software. Many larger employers use software that ranks CVs by how closely they match the ad, often before anyone reads them.
- In the language of the ad. An ad written in Spanish gets a CV in Spanish, even when yours is in Portuguese.
- Your facts, nothing invented. Your own experience, reordered and reworded. What the ad wants and your CV does not show is listed for you to add, only if it is true. You check it before you send it.
Type of contract: Employment contract
Salary range: 17400-26700 PLN gross
What will you do?
You will lead the technical delivery of data migration and engineering initiatives, working closely with Engineers, Data Analysts and Business Analysts. You will design scalable data solutions in GCP, guide the engineering pod, promote development standards and support the team throughout the Agile development process.
Your tasks
Provide technical leadership for data migration projects, including solution design, approach and estimation
Design and develop scalable data pipelines using GCP, PySpark and Scala
Provide guidance on environment setup, system architecture and cloud design patterns
Implement solutions focused on performance, scalability, availability, accuracy and monitoring
Promote coding standards, conduct code reviews and support knowledge sharing
Mentor engineers and oversee the technical delivery of the engineering pod
Work with Business Analysts to ensure requirements are correctly interpreted and implemented
Support production environments, troubleshoot issues and communicate findings to development teams
Participate in planning sessions, status meetings, sprint reviews and retrospectives
Identify opportunities to use AI enablers to improve traditional engineering workflows
Your skills
At least 10 years of experience in software design, data engineering and development in Agile and DevOps environments
Strong development and solution design experience with PySpark or Scala
Hands-on experience with Google Cloud Platform and building data pipelines in GCP
Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce and ETL frameworks
Experience with Python, SQL, PL/SQL and data integration
Experience with Apache Airflow or similar scheduling tools
Experience with REST APIs and RESTful services
Strong knowledge of Unix and Linux environments
Experience with Git, GitHub, Jenkins, Ansible and Jira
Experience with automated testing, deployment and monitoring
Understanding of cloud architecture and cloud design patterns
Ability to lead an engineering pod and guide the work of other engineers
Ability to work autonomously and act as a technical subject-matter expert
Strong communication and presentation skills for technical, senior and non-technical audiences
Strong written and spoken English
Nice to have
Experience with Elasticsearch
Experience developing Java APIs
Experience with data ingestion solutions
Experience working with Scrum and Kanban
Interest in AI-based tools that can accelerate engineering workflows
We offer
Hybrid work in our client's office (Kraków) 8 days a month
Working in a highly experienced and dedicated team
Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)
Online training and certifications
Access to e-learning platform
Social events
- Employer
- GFT
- Location
- Kraków, Poland · On site