Responsibilities:


  • Architect, design, and implement scalable, secure AWS data lake solutions (Amazon S3, AWS Lake Formation, AWS Glue, Amazon EMR, Amazon Redshift, Amazon Athena, Amazon Kinesis/MSK), including reference architecture, data zoning, partitioning strategy, and schema/catalog management (25%).
  • Lead the design and deployment of AI/ML-ready data pipelines, including feature stores and model training pipelines, and integrate with Amazon SageMaker and Amazon Bedrock to support generative AI and machine learning use cases (20%).
  • Partner with data science and AI engineering teams to operationalize AI solutions in production, including model deployment pipelines, MLOps integration, and inference data flows (15%).
  • Establish and enforce data governance, security, and compliance standards, including IAM, KMS encryption, Lake Formation permissions, and audit logging (15%).
  • Drive cost optimization and performance tuning across storage, compute, and query layers, and evaluate new AWS services and architectural patterns (15%).
  • Provide technical leadership and mentorship to data engineers, own technical documentation and architecture decision records, and support operational handoffs for production issues (10%).

Minimum Qualifications:

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field required; Master’s degree preferred
  • 8+ years’ experience in data engineering or data architecture required; 5+ years specifically architecting solutions on AWS required
  • Hands-on experience designing and operating AWS data lake architectures, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon EMR, Amazon Redshift, Amazon Athena, and Amazon Kinesis/MSK
  • Demonstrated experience deploying or supporting AI/ML solutions in production, including integration with Amazon SageMaker and Amazon Bedrock
  • Proficiency in Python and/or Scala/Spark for large-scale data processing
  • Strong understanding of data governance, security, and compliance best practices in cloud environments

 

Desired Qualifications

  • AWS Certified Data Engineer – Associate (DEA-C01) or equivalent AWS certification (e.g., AWS Certified Solutions Architect – Professional)
  • Experience with modern lakehouse formats such as Apache Iceberg, Delta Lake, or Apache Hudi
  • Experience architecting generative AI solutions on AWS using Amazon Bedrock, including foundation model access, agents, and knowledge bases
  • Exposure to infrastructure-as-code (Terraform, AWS CloudFormation, or AWS CDK) for provisioning data platform resources
  • Experience operating in regulated or large-scale enterprise environments with strict data governance requirements