Overview

We are seeking a motivated Senior Data Integration Engineer to join our team and play a key role in building, optimizing, and migrating data pipelines across diverse systems. This role focuses on utilizing SQL, Azure, PySpark, HDFS, and Snowflake to improve data workflows, ensure seamless integrations, and deliver solutions to complex data challenges.

Responsibilities

  • Design, develop, and optimize SQL queries and stored procedures for efficient data processing and integration
  • Lead data migration projects from on-premises systems or legacy environments to Azure Synapse Analytics
  • Work with advanced Snowflake concepts such as window functions, common table expressions (CTEs), and JavaScript-based stored procedures
  • Implement data pipelines using PySpark and manage file processing in Hadoop HDFS environments
  • Build and troubleshoot Azure Data Factory (ADF) pipelines to integrate data from ADLS and SFTP into target systems
  • Collaborate with cross-functional teams to implement and automate end-to-end data workflows
  • Monitor and maintain the performance of data pipelines, ensuring scalability and reliability
  • Develop and maintain technical documentation for data architecture, transformations, and pipeline processes
  • Provide technical leadership and mentoring to junior engineers and team members as needed

Requirements

  • 3+ years of experience working with data integration, migration, and pipeline optimization across SQL and cloud platforms
  • Expertise in Snowflake, including Snowflake Analytics
  • Advanced SQL skills with knowledge of window functions, CTEs, and JavaScript-based stored procedures
  • Background in PySpark and Hadoop HDFS, including pipeline migration from Cloudera Data Lake to Azure Synapse Analytics
  • Proficiency in creating ADF pipelines for data transfer involving sources such as ADLS and SFTP
  • Competency in Python, PySpark, and SQL for data engineering tasks and automation
  • Understanding of Azure Cloud services and expertise in tools like Azure Synapse Analytics and Power Automate
  • English level of minimum B2 (Upper-Intermediate) for effective communication

Nice to have

  • Familiarity with legacy systems and experience handling data integration from on-prem environments to cloud platforms
  • Showcase of performance tuning techniques for Snowflake stored procedures and SQL pipelines
  • Qualifications in additional Azure services or certifications

Ukraine

With us you can:

  • Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
  • Receive the necessary equipment to perform your work tasks
  • Change projects and technology stacks within EPAM
  • Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
  • Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
  • Participate in volunteer, charity programs and communities (both technical and interest-based)

We focus on your professional growth:

  • You can plan your individual career path together with your manager
  • Receive regular feedback from colleagues
  • Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
  • Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
  • Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
  • Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
  • Study at EPAM Solution Architecture School with the instructors who are practicing architects
  • Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
  • Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)

What we offer:

  • Vacation and sick leave (including a sick leave without a medical certificate)
  • A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
  • Medical insurance for family members at corporate rates
  • Company support during significant life events (childbirth or adoption, marriage, etc.)
  • Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
  • E-kids program - a free programming language training program for EPAMers' children

[epamgdo] Ukraine (benefits may differ)

Kindly be advised that the set of benefits, including learning, certification, and other opportunities, may vary depending on the role you apply for. Our recruiter will be able to share more details about the specific opportunity during your general interview.

[epamgdo] Ukraine (About EPAM)

EPAM strives to provide its global team of over 62,350 professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.