Senior Data Engineer – Data Platform
Responsibilities
- Design, develop, and maintain scalable data pipelines for batch and real-time processing.
- Build distributed data processing solutions using Python, Scala, and Apache Spark.
- Develop low-latency streaming workflows supporting business-critical applications.
- Optimize Spark jobs to improve performance and resource utilization.
- Maintain cloud-based data solutions, ensuring reliability, monitoring, and efficient production support.
- Design and manage data models and processing workflows to ensure data quality and consistency.
- Collaborate with engineering and business teams to translate requirements into effective technical solutions.
- Improve data engineering practices through testing, orchestration, and documentation.
Requirements
- Solid professional experience in Data Engineering and production data pipelines.
- Strong programming skills in Python
- Practical experience with Apache Spark and distributed data processing.
- Knowledge of real-time processing, particularly Spark Streaming.
- Hands-on experience with AWS and Databricks.
- Understanding of data modeling, orchestration, monitoring, and pipeline optimization.
- Strong communication skills and ability to work with cross-functional teams.
- High level of ownership and commitment to ethical standards.
What We Offer
- Stable employment based on an employment contract.
- Opportunities for professional growth and career development.
- Access to technical training and development programmes.
- Sports card.
- Private medical care.