Overview
We are seeking a Senior Azure Data Engineer to join our software, system, and test engineering team.
The role focuses on building and maintaining resilient data pipelines and processing systems for a large user base. Your contributions will ensure our data solutions align with business demands and maintain high industry standards. You will coordinate with architects, tech leads, and team members to deliver on product objectives. If you bring expertise in Azure DevOps, Databricks, and designing scalable data solutions, we encourage you to apply and make an impact through innovative projects.
Responsibilities
- Build and maintain data pipelines alongside large-scale customer-focused processing systems
- Establish data frameworks to provide stable and reliable operations
- Ensure data solutions adhere to business requirements and industry standards
- Recommend strategies to boost data quality, efficiency, and reliability
- Collaborate with system architects, technical leads, and team members to achieve aligned goals
- Deploy Databricks workflows using Databricks Asset Bundles
- Support scalable data platforms designed for a broad user base
- Write Python scripts to automate data processes and improve performance
- Oversee Azure DevOps CI/CD pipelines and associated deployment tools
Requirements
- Background in data DevOps engineering with a minimum of 3 years of practical experience
- Knowledge of Azure DevOps CI/CD pipelines, Terraform, and deployment strategies for large infrastructures
- Expertise in deploying Databricks workflows using Databricks Asset Bundles
- Competency in developing data pipelines on Azure Databricks with Spark
- Capability to design and sustain scalable data platforms for large-scale consumers
- Proficiency in Python programming
- Skills in collaboration to work effectively with architects and other technical professionals
- English competency at an intermediate level or higher
Nice to have
- Experience in creating preliminary prototypes for new product functionalities
- Background in designing data set processes for governance, production, and data modeling
- Familiarity with multiple programming languages and tools for seamless system integration
Hungary
- Dynamic, entrepreneurial corporate environment
- Diverse multicultural, multi-functional, and multilingual work environment
- Opportunities for personal and career growth in a progressive industry
- Global scope, international projects
- Widespread training and development opportunities
- Unlimited access to LinkedIn learning solutions
- Competitive salary and various benefits
- Advanced wellbeing and CSR programs, recreation area
[epamgdo] Hungary (About EPAM)
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
[epamgdo] Hungary (Campus Programs)
Do you know someone interested in starting a career in IT? Share our EPAM Campus programs with them, where they can enhance their knowledge in various fields online, free of charge.