Key Responsibilities

• Define target-state architecture for AIRP, LLM platforms, model hubs, AI gateways, RAG services, agent frameworks, orchestration layers, and model-serving infrastructure
• Establish enterprise standards for AI SDLC, LLMOps, MLOps, evaluation, release management, operational resilience, and production support
• Create AWS implementation patterns that align with a cloud-agnostic blueprint and minimize unnecessary vendor lock-in
• Define standards for Terraform modules, reusable IaC templates, environment strategy, pipeline promotion, approvals, observability, secrets, rollback, and operational controls
• Guide architecture for secure, scalable, and cost-efficient inference across cloud, hybrid, private, and containerized environments
• Define guardrail patterns for hallucination mitigation, bias monitoring, harmful-content controls, prompt injection defense, data leakage prevention, and human oversight
• Lead design reviews for critical AI systems and provide technical assurance to architecture, risk, security, and governance forums
• Partner with cybersecurity, risk, compliance, legal, audit, product, business, and citizen-development enablement teams
• Assess emerging AI technologies and recommend adoption based on business value, maturity, risk, cost, portability, and regulatory fit

Requirements

• 10+ years in AI/ML systems, distributed systems, enterprise architecture, or platform engineering
• Deep experience with LLMs, RAG, embeddings, model serving, AI orchestration, evaluation frameworks, and AI infrastructure
• Proven track record defining architecture and technical standards across multiple engineering teams
• Strong AWS cloud architecture experience or comparable hyperscaler depth, with ability to design cloud-agnostic AI platform patterns
• Experience shaping Terraform/IaC standards, DevOps pipelines, secure deployment patterns, observability, resiliency, and platform operating models
• Ability to influence senior stakeholders across business, technology, risk, compliance, security, data, and architecture forums
• Must be local to New Jersey and eligible for H1-B sponsorship/transfer
• Global bank, fintech, financial-services, or regulated-enterprise platform experience preferred
• Familiarity with Responsible AI, model risk management, audit expectations, and technology risk controls preferred

Skills Required