Overview
We are looking for a skilled Senior AWS Data Engineer to contribute to the design, development, and optimization of secure data pipelines and cloud-based architectures. In this senior role, you will work alongside a team of talented engineers, supporting innovative projects such as building scanned image data pipelines and aiding healthcare data migration into scalable solutions.
Be part of a dynamic team where innovation and collaboration fuel success as we build secure and scalable AWS solutions!
Responsibilities
- Support and collaborate with data engineers to deliver effective, scalable solutions
- Assist in designing workflows optimized for AWS Glue and Amazon Athena
- Enhance distributed data processing systems utilizing Apache Spark
- Contribute to analyzing business requirements and developing BI processes
- Aid in data migration projects for centralized, high-performance solutions
- Integrate scanned image data pipelines into new or existing systems efficiently
- Monitor and troubleshoot AWS systems to ensure reliability and improved performance
- Participate in code reviews and promote quality practices in data engineering and cloud computing
- Work closely with internal teams and leadership to align project goals with organizational objectives
- Research emerging cloud and data engineering technologies to help adopt improved methods
Requirements
- 3+ years of professional experience in data engineering or a related field
- Experience contributing to technical teams focused on developing large-scale solutions
- Practical knowledge of AWS Glue, Amazon Athena, and other relevant AWS tools
- Experience with Apache Spark for distributed processing and data pipeline tasks
- Familiarity with BI processes and ability to support scalable solution development
- Understanding of basic data management practices, including governance and security
- Ability to troubleshoot cloud-based architectures and maintain system performance
- Availability to work in EST time zone and collaborate with a LATAM-based engineering team
- English language proficiency at an Upper-Intermediate level (B2) or higher
Nice to have
- Knowledge of Amazon Elastic Kubernetes Service (EKS) for containerized application orchestration
- Understanding of Amazon Kinesis for real-time data streaming processes
- Familiarity with Apache Hive for data warehouse purposes and integration with big data ecosystems
- Knowledge of BI Toolset operational workflows for streamlined business intelligence reporting
- Understanding of Java and/or Node.js with flexibility to utilize them for development tasks
- Skills in SQL with a proven track record of crafting and optimizing queries for performance
[GTS] Benefits (generic, except India)
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn