AI Engineer, Enterprise LLM Platform

Company: Series A, VC backed - Applied AI / Enterprise Software

Location: Hybrid, New York, NY

Salary: $200K–$350K + competitive equity

Sponsorship: open to visa transfers (OPT, H1B)

We're hiring an AI Engineer at a fast-moving, well-funded Series A startup building a custom AI/LLM platform for regulated enterprises, starting with one of the top 5 banks in the US, a seven-figure deal already closed. The founding team are repeat entrepreneurs on their second venture together, with deep technical and applied AI research backgrounds.

This is a high-ownership role, not a narrow slice of a larger stack. You'll own the technical build-out of a custom AI/LLM platform end-to-end, architecture, deployment, and production reliability, for a marquee enterprise customer, working directly with the core engineering team.

The problem you'd help solve: Regulated enterprises need production-grade AI deployed entirely within their own environment, with no data leaving their infrastructure. This company builds a workflow intelligence platform that understands how employees work and augments it with custom, self-hosted AI models, deployed per customer, with full infrastructure control. It's a fundamentally harder deployment problem than typical SaaS AI, since security, compliance, and customization requirements are set by the enterprise, not the vendor.

You'll fork and customize the core platform for the customer's environment, collaborate daily with the core engineering team to merge customer-specific work into the main product, and serve as the go-to technical point of contact for the bank's engineering stakeholders (~20% customer-facing).

You'll likely be a fit if you have:

  • 6-12 years of backend/AI engineering experience, building and deploying LLM systems in production
  • Recent experience (past 2-3 years) at a well-funded, actively-innovating AI startup, not exclusively Big Tech
  • Backend engineering ownership for enterprise customers: architecture, APIs, integrations, deployments
  • Strong software architecture and system design ability, comfortable owning end-to-end technical delivery
  • Experience with enterprise customers in banking, fintech, or other regulated environments
  • BS in Computer Science or related field

Nice to have:

  • Cloud, Kubernetes, CI/CD, and observability tooling experience
  • High ownership, independence, and leadership potential

What you won't find here: This role won't suit you if you want a well-scoped ticket and someone else making the architecture calls, or if your background is purely academic AI research with no production deployment experience. You'll be setting technical precedent that the team and the customer both build on.

Sponsorship: open to visa transfers (e.g. OPT, H1B). Hybrid role based in New York, NY.

Seniority Level: Mid-Senior level

Industry:

  • Artificial Intelligence
  • Financial Services
  • Technology, Information and Internet

Employment Type: Full-time

Skills:

  • Python
  • Machine Learning
  • Natural Language Processing (NLP)
  • Large Language Models (LLM)
  • Kubernetes
  • CI/CD
  • Amazon Web Services (AWS)
  • REST APIs
  • Cloud Computing
  • System Design