Senior Data Engineer role with The Hanover, responsible for designing, developing, and implementing data solutions using Azure and on-premises platforms. The role involves driving larger projects independently and mentoring junior engineers. Strong experience in data engineering and best practices is required.

Requirements

  • Proven experience in data engineering and best practices for data storage, integration, transformation, and access within Azure and on-premises platforms.
  • Proven expertise in designing and implementing data solutions utilizing Azure Resources (Azure Data Factory, Azure Synapse, ADLS, etc).
  • Strong experience with data integration, ETL processes, and data warehousing.
  • Advanced proficiency in SQL, Python, and PowerShell.
  • Proven knowledge of data modeling, governance, and data engineering best practices and patterns.
  • Hands-on experience with optimizing data ingestion pipelines and notebooks for scale, performance, reliability, and cost efficiency.
  • Familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST).
  • Strong problem-solving, communication, and collaboration skills.
  • Ability to create documentation for data processes and solutions.
  • Ensure data security and compliance with industry standards.
  • Experienced in agile development methodologies and DevOps best practices.
  • Git/Github experience for CI/CD.
  • Coaching, mentoring, and technical guidance for junior team members.
  • Analytical skills for profiling and analyzing large data sets.
  • Critical thinking and attention to detail.
  • Debugging skills for data solution issues.
  • Collaborate with data scientists, analysts, and stakeholders.
  • Monitor and maintain data pipelines.
  • Design, develop, and test data mapping with transformation rules.
  • Ensure data quality and reliability.
  • Develop and maintain documentation for data integration and ETL solutions.

Benefits

  • Medical, dental, vision, life, and disability insurance
  • 401K with a company match
  • Tuition reimbursement
  • PTO
  • Company paid holidays
  • Flexible work arrangements
  • Cultural Awareness Day in support of IDE
  • On-site medical/wellness center (Worcester only)