First Citizens Bank logo
Banking, Financial Services

Principal AI Architect

Raleigh, NCOnsiteFull TimePrincipal$160,000–$240,000 /yrPosted 1 month agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

  • AI Architect
  • GenAI
  • MLOps
  • LLM
  • RAG
  • Agentic Systems
  • Multimodal Solutions
  • Model Serving
  • Prompt Management
  • Orchestration

Nice to have

  • AWS certifications
  • Agentic AI design patterns
  • Autonomous workflow agents
  • AI copilots
  • API Design
  • Microservices

Role summary

The Principal AI Architect is a senior technical leadership role focused on defining and governing enterprise-wide AI, GenAI, and MLOps architecture. This role establishes the long-term vision, reference architectures, and reusable patterns for scalable, secure, and responsible AI adoption. Responsibilities include architecting LLM platforms, RAG patterns, agentic systems, and multimodal solutions, as well as operationalizing MLOps capabilities like model lifecycle management and CI/CD for ML. The role requires deep expertise in AWS-native services, cloud security, governance, and responsible AI principles. The Principal AI Architect will act as a key advisor to senior leaders, mentor other architects, and drive alignment across teams.

Overview

The Principal AI Architect is a senior technical leadership role responsible for defining and governing enterprise-wide AI, GenAI, and MLOps architecture. This role sets the long-term vision, reference architectures, and reusable patterns for scalable, secure, and responsible AI adoption across the organization. This role combines strong hands-on engineering with strategic innovation to design, prototype, and deliver intelligent, data-driven solutions that power analytics, machine learning, and next-generation AI applications.


Responsibilities & Qualifications

Enterprise AI & GenAI Architecture

  • Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions.
  • Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks.
  • Lead architecture decisions for buy vs. build, model selection, hosting strategies, and vendor integrations.
  • Ensure AI architectures align with enterprise standards, cloud strategy, security, and governance.

AI Platform Engineering & MLOps

  • Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems.
    Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML, feature stores, model monitoring, and drift detection.
  • Define enterprise patterns for training, fine-tuning, deployment, and observability of ML and GenAI workloads.
  • Guide teams on productionizing PoCs into scalable, resilient, and supportable AI systems.
  • Partner with platform teams to evolve a shared enterprise AI platform.


AWS-Centric AI Architecture

  • Design AI and GenAI solutions using AWS-native services, including (but not limited to):
  • Amazon Bedrock, SageMaker, Lambda, ECS/EKS
  • S3, DynamoDB, Aurora, OpenSearch
  • IAM, KMS, VPC, CloudWatch
  • Define cost, performance, and scalability guardrails for AI workloads on AWS.
  • Ensure architectures follow Well-Architected Framework principles.

Governance, Risk, and Responsible AI

  • Partner with security, legal, and compliance teams to define AI governance, guardrails, and controls.
  • Embed responsible AI principles, data privacy, and explainability into enterprise designs.
  • Establish standards for model access, auditability, and risk management.

Technical Leadership & Influence

  • Act as a principal-level advisor to senior technology and business leaders.
    Champion hands-on experimentation and rapid solution delivery while maintaining technical excellence.
  • Mentor architects and senior engineers on AI architecture and MLOps best practices.
  • Drive alignment across teams by publishing reference architecture, design standards, and decision frameworks.
  • Represent the organization in architecture forums, reviews, and strategic initiatives.


Qualifications:

Bachelor's Degree and 10 years of experience in Application Development, Systems Engineering, or Information Technology management OR High School Diploma or GED and 14 years of experience in Application Development, Systems Engineering, or Information Technology management

Key Responsibilities:

Enterprise AI & GenAI Architecture

  • Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions.
  • Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks.
  • Lead architecture decisions for buy vs. build, model selection, hosting strategies, and vendor integrations.
  • Ensure AI architectures align with enterprise standards, cloud strategy, security, and governance.


AI Platform Engineering & MLOps

  • Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems.
    Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML, feature stores, model monitoring, and drift detection.
  • Define enterprise patterns for training, fine-tuning, deployment, and observability of ML and GenAI workloads.
  • Guide teams on productionizing PoCs into scalable, resilient, and supportable AI systems.
  • Partner with platform teams to evolve a shared enterprise AI platform.

AWS-Centric AI Architecture

  • Design AI and GenAI solutions using AWS-native services, including (but not limited to):
  • Amazon Bedrock, SageMaker, Lambda, ECS/EKS
  • S3, DynamoDB, Aurora, OpenSearch
  • IAM, KMS, VPC, CloudWatch
  • Define cost, performance, and scalability guardrails for AI workloads on AWS.
  • Ensure architectures follow Well-Architected Framework principles.

Governance, Risk, and Responsible AI

  • Partner with security, legal, and compliance teams to define AI governance, guardrails, and controls.
  • Embed responsible AI principles, data privacy, and explainability into enterprise designs.
  • Establish standards for model access, auditability, and risk management.

Technical Leadership & Influence

  • Act as a principal-level advisor to senior technology and business leaders.
  • Champion hands-on experimentation and rapid solution delivery while maintaining technical excellence.
  • Mentor architects and senior engineers on AI architecture and MLOps best practices.
  • Drive alignment across teams by publishing reference architecture, design standards, and decision frameworks
  • Represent the organization in architecture forums, reviews, and strategic initiatives.

Qualifications:
10+ years of experience in enterprise architecture, data platforms, or distributed systems.
Deep expertise in AI/ML architecture, including GenAI and LLM-based systems.
Strong experience designing MLOps platforms and enterprise AI foundations.
Proven experience architecting solutions on AWS.
Experience with Snowflake Cortex AI, Snowflake Native AI capabilities
Strong understanding of cloud security, networking, and governance.
Proficiency in Python, SQL, and modern data frameworks (e.g., Databricks, Airflow, Snowflake, Vertex AI).

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

Preferred:

Relevant AWS certifications in cloud architecture, AI/ML, generative AI, or related domains.
Experience with agentic AI design patterns, including tool-use orchestration, autonomous workflow agents, or AI copilots.
Proficiency in API design, microservices, and containerization (Docker, Kubernetes).
Demonstrated ability to rapidly prototype new AI concepts and transition successful PoCs into production-grade systems.


Additional Information

If hired in NC, the base pay for this position is generally between $160,000 and $240,000. Actual starting base pay will be determined based on skills, experience, location, and other non-discriminatory factors permitted by law. For some roles, total compensation may also include variable incentives, bonuses, benefits, and/or other awards as outlined in the offer of employment.

Benefits are an integral part of total rewards and First Citizens Bank is committed to providing a competitive, thoughtfully designed and quality benefits program to meet the needs of our associates. More information can be found at https://jobs.firstcitizens.com/benefits.

Ready to apply?
You'll be redirected to First Citizens Bank's application page.

Similar roles

See how RiseMe works

Match, tailor, and prep so you send fewer applications and land more interviews.