Overview
We are seeking a Senior Data Software Engineer skilled in Databricks to join our team in Portugal.
You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks and an open-minded approach to our collaborative and friendly work environment. This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice.
Responsibilities
- Design, develop and maintain scalable data pipelines and architectures
- Optimize data models and enhance ETL processes utilizing Databricks and related technologies
- Implement rigorous data quality checks and monitoring to guarantee high integrity
- Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools
- Troubleshoot and resolve data-related issues promptly
- Participate in code reviews ensuring adherence to high standards of code quality
Requirements
- Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies
- Solid understanding of data architecture and data modeling skills
- Expertise in Spark, using either Scala or PySpark
- Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks
- Engineering background in AWS, Azure or GCP
- Experience with big data and performance optimization of data-intensive applications
- Proactive approach and prior client-facing experience
- Ability to navigate ambiguity and work independently
- Desire to engage in a transparent, fast-moving startup environment
- Fluent English communication skills at a B2+ level or higher
Portugal
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours