Overview

We are seeking an experienced AWS Data Engineering Team Lead to drive the design, development, and optimization of highly secure data pipelines and cloud-based architectures. In this leadership role, you will guide a skilled team of engineers, contributing to innovative projects such as building new scanned image data pipelines and migrating healthcare data into centralized, scalable solutions.

Be part of a dynamic team where innovation and collaboration fuel success as we build secure and scalable AWS solutions!

Responsibilities

  • Lead, mentor, and manage a team of data engineers to deliver high-quality, scalable solutions
  • Design and implement optimized workflows using AWS Glue and Amazon Athena
  • Build and enhance distributed data processing systems leveraging Apache Spark
  • Analyze business requirements to improve and develop efficient BI processes
  • Drive data migration and centralization efforts for large-scale and secure data solutions
  • Integrate new scanned image data pipelines into existing systems with a focus on efficiency
  • Troubleshoot, monitor, and optimize AWS-based systems to ensure high performance and reliability
  • Conduct regular code reviews and enforce best practices in data engineering and cloud computing
  • Collaborate with internal teams and leadership to align project deliverables with organizational goals
  • Stay updated on emerging cloud and data engineering technologies to implement best practices

Requirements

  • 5+ years of professional experience in data engineering or a related field
  • At least 1 year of relevant leadership experience in managing technical teams to build and maintain large-scale solutions
  • Proficiency in AWS Glue, Amazon Athena, and general Amazon Web Services ecosystem
  • Expertise in Apache Spark, data pipeline optimization, and distributed processing systems
  • Knowledge of BI process analysis and ability to design scalable solutions
  • Familiarity with end-to-end data management practices, including governance and security
  • Capability to troubleshoot complex cloud-based architectures and ensure system reliability
  • Flexibility to work in EST time zone and collaborate within a LATAM-based engineering team
  • Excellent command of written and spoken English (B2+ level)

Nice to have

  • Knowledge of Amazon Elastic Kubernetes Service (EKS) for containerized application orchestration
  • Understanding of Amazon Kinesis for real-time data streaming processes
  • Familiarity with Apache Hive for data warehouse purposes and integration with big data ecosystems
  • Knowledge of BI Toolset operational workflows for streamlined business intelligence reporting
  • Understanding of Java and/or Node.js with flexibility to utilize them for development tasks
  • Skills in SQL with a proven track record of crafting and optimizing queries for performance

[GTS] Benefits (generic, except India)

  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn