Overview

We are seeking a Senior Data Engineer with strong expertise in Azure and PySpark, skilled in designing, implementing, and maintaining robust data processing solutions. This role focuses on building scalable, production-grade data systems, ensuring reliability, and optimizing performance in distributed environments.

Responsibilities

  • Design and optimize large-scale data pipelines using PySpark
  • Build and maintain scalable ETL/ELT workflows in Azure
  • Troubleshoot production issues related to performance, latency, and availability
  • Work with distributed NoSQL technologies (e.g., Cosmos DB, Cassandra, DynamoDB, MongoDB, or similar)
  • Optimize Spark jobs (partitioning, execution plans, resource usage)
  • Implement best practices for scalability, security, and reliability
  • Collaborate with cross-functional teams on data-driven solutions
  • Contribute to automation, CI/CD, and operational improvements

Requirements

  • 5+ years of experience as a Data Engineer or similar role
  • Strong hands-on experience with PySpark in production
  • Proven experience in data modeling, partitioning, indexing, and performance tuning in NoSQL systems
  • Strong programming skills in Python
  • Experience building and operating production-grade pipelines in cloud (Azure)
  • Experience with distributed NoSQL databases (e.g., Cosmos DB, Cassandra, DynamoDB, MongoDB)
  • Strong understanding of distributed systems and performance optimization
  • Experience with CI/CD, monitoring, troubleshooting, and production support
  • Strong analytical and communication skills (English B2+)

Nice to have

  • Experience with real-time / streaming data
  • Exposure to Data Science workflows
  • Knowledge of Big Data ecosystems
  • Experience with financial data
  • Familiarity with AI-assisted development or LLM tools

Poland (Prod)

We gather like-minded people:

  • Engineering community of industry professionals
  • Friendly team and enjoyable working environment
  • Flexible schedule and opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Business-driven relocation opportunities

We provide growth opportunities:

  • Outstanding career roadmap
  • Leadership development, career advising, soft skills, and well-being programs
  • Certification (GCP, Azure, AWS)
  • Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
  • English classes

We cover it all:

  • Stable income (Employment Contract or B2B)
  • Participation in the Employee Stock Purchase Plan
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
  • Referral bonuses
  • Corporate, social and well-being events

Please, note:

  • The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.
  • We will reach out to selected candidates exclusively.

[epamgdo] Poland (About EPAM)

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.