We are seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you will collaborate with our clients to address their most complex needs, working alongside a team of highly skilled engineers and architects. You will also be involved in strategic enterprise data projects and large-scale implementations.

Responsibilities:

  • Support projects leveraging an agile delivery model through requirements gathering and documentation, data ingestion pipeline development, and technical testing.
  • Contribute to project delivery in the following ways:
  • Add configurations for data enrichments such as lookups, type conversions, calculations, and concatenations

· Add data quality rules

· Connect to new data sources

  • Map multiple sources into a single output
  • Interpret error messages to troubleshoot data pipelines
  • Create outputs that facilitate reporting, dashboarding, and semantic modeling for tools such as Tableau and Power BI

· Test data pipelines to ensure accuracy

  • Work closely with our clients as part of the development team to gather technical requirements and develop solutions
  • Coordinate activities with data source application owners to understand the underlying data, ensure integration and data integrity
  • Build relationships with clients through written and verbal communication

Qualifications:

  • 2+ years of hands-on professional development experience, consulting experience preferred.
  • 1+ years of experience working with Databricks
  • Experience writing complex SQL queries related to data manipulation strategies
  • Experience building or working with metadata-driven ETL / ELT patterns and concepts.
  • Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and/or Lambda.
  • Exposure using ETL tools (Azure Data Factory, AWS Glue, Informatica, Talend, IBM DataStage, etc.), database platforms (Snowflake, Redshift, Azure Synapse, or Oracle), and data visualization tools (Tableau, Power BI, Looker).
  • Experience in technical testing, issue identification and resolution
  • Strong verbal and written communication skills