Overview
We are looking for a Senior Data Quality Engineer who will ensure data accuracy throughout the entire lifecycle, from backend ETL pipelines to frontend visualization. This position requires a hybrid approach, combining thorough manual data reconciliation with the implementation of automated testing frameworks for enterprise data platforms. The role involves verifying that BI dashboard numbers match the source data and ensuring accuracy, completeness and consistency of data as it moves through pipelines. The ideal candidate will possess a strong understanding of data architecture, manual exploratory testing and automated validation at scale, along with the business acumen to confirm that data aligns with strategic KPIs and operational needs.
Responsibilities
- Design and execute automated test plans for ETL/ELT pipelines to verify data transformations and schema integrity
- Perform source-to-target mapping and reconciliation checks across data lakes, warehouses and reporting layers
- Implement data-specific automation using the AWS DQDL framework
- Validate performance of large-scale pipelines and identify bottlenecks in data processing runtimes
- Conduct regression testing to ensure new ETL code deployments do not disrupt existing metrics or KPI calculations
- Investigate data quality incidents end-to-end and provide technical feedback to engineers and product owners
Requirements
- Bachelor's degree in Computer Science, Engineering or a related technical field
- 3+ years of experience in data quality assurance
- Advanced proficiency in SQL, including complex queries, joins, window functions and stored procedure validation
- Proficiency in Python for scripting automated validation checks
- Expertise in cloud data warehouses (Iceberg, AWS Redshift) and file formats such as Parquet and JSON
- Hands-on experience validating mappings and data lineage in ETL processes
- Understanding of integrating tests into GitHub Actions workflows
- Knowledge of relational databases for data validation
- Background in RESTful API testing tools like Postman
- Familiarity with BI tools like Tableau for dashboard validation
- High attention to detail, critical thinking and strong written and verbal communication skills
- English proficiency at B2 level or higher
[GTS] Benefits (generic, except India)
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn