We're in beta · Starting with US & Canada · Shipping weekly — your feedback shapes RiseMe
BIP logo
BIP Verified
Management Consulting

Senior Platform Engineer, Generative AI Infrastructure

New York, New York, United StatesHybridFull TimeSenior$140,000–$200,000 /yrPosted 1 month agoVisa sponsorship available

Compensation estimateAI

See base, equity, bonus, and total comp estimates for this role — free, no credit card.

Sign up to see compensation estimate

Company Overview:

Business Integration Partners (BIP) is Europe’s fastest growing digital consulting company and is on track to reach the Top 20 globally by 2030. With a growing presence across the United States—including New York, Charlotte, Chicago, and Houston—BIP operates at the intersection of business strategy, technology, and data to deliver impactful solutions for clients.

With more than 6,000 professionals worldwide, BIP partners with organizations across Financial Services, Insurance, Payments, and other industries. Our capabilities span Data & AI, Cybersecurity, Risk & Compliance, Digital Transformation, and Change Management. We combine deep industry expertise with engineering excellence to help clients modernize platforms, unlock data insights, and drive innovation.

As part of our continued expansion in the United States, BIP is strengthening its Capital Markets technology practice. Our teams work closely with trading, risk, and front-office technology organizations to modernize critical platforms, enhance analytics capabilities, and support complex financial product ecosystems.

Position Overview:

We are seeking an experienced Senior Platform Engineer with 7–10+ years of experience to support the design, build, and operational management of infrastructure powering enterprise Generative AI applications. This role will focus on building and maintaining scalable environments that support AI-driven workloads across development, testing, and production.

The ideal candidate will have strong experience in platform engineering, DevOps practices, containerized environments, and distributed systems, with the ability to support high-performance computing workloads and modern AI application stacks.

This individual will work closely with engineering, data science, and platform teams to ensure reliable, scalable, and efficient infrastructure supporting the development and deployment of advanced AI solutions.

Key Responsibilities:

Platform Architecture & Environment Management

  • Design, implement, and maintain scalable platform environments supporting AI and data-driven applications from proof-of-concept through production deployment.
  • Manage environment dependencies across infrastructure, applications, data services, and networking layers.

Infrastructure Automation & DevOps

  • Build and maintain automated processes for provisioning, installation, configuration validation, monitoring, and deployment of platform components.
  • Implement and support CI/CD pipelines to streamline development workflows and accelerate releases.

Platform Standardization & Best Practices

  • Define and enforce standards for platform configuration, environment management, and infrastructure governance.
  • Maintain version-controlled inventories of platform environments, configurations, and deployment artifacts.

Containerization & Distributed Systems

  • Support containerized deployment models using technologies such as Docker and Kubernetes or similar orchestration platforms.
  • Ensure scalability, reliability, and efficient resource utilization across distributed infrastructure environments.

Monitoring, Performance & Optimization

  • Implement infrastructure monitoring solutions to track CPU, GPU, memory utilization, inference latency, and system performance.
  • Identify performance bottlenecks and optimize infrastructure to improve throughput, efficiency, and latency.

Deployment & Operational Support

  • Collaborate with engineering and operational teams to deploy applications and support production environments.
  • Troubleshoot and resolve infrastructure, configuration, and environment-related issues.

Capacity Planning & Environment Allocation

  • Manage environment capacity and allocate resources across teams based on project lifecycle requirements.
  • Work with project teams to optimize infrastructure costs while maintaining performance and scalability.

Required Qualifications:

  • 7–10+ years of experience in platform engineering, DevOps engineering, infrastructure engineering, or similar technical roles.
  • Proven experience designing and maintaining end-to-end platform environments from development through production.
  • Strong understanding of hardware, software, networking, and application configuration dependencies.
  • Experience working with CI/CD pipelines and DevOps tooling.
  • Experience supporting containerized and distributed application architectures using technologies such as Docker and Kubernetes or similar orchestration platforms.
  • Experience working with microservices, serverless architectures, or loosely coupled distributed systems.
  • Familiarity with both cloud-based and on-premises infrastructure environments.
  • Experience working with relational and NoSQL databases, object storage, or large-scale data environments.
  • Strong scripting skills in Unix/Linux environments, including automation and scheduling tools.
  • Experience implementing high availability, load balancing, and disaster recovery strategies.

Preferred Qualifications:

  • Experience supporting AI, machine learning, or Generative AI infrastructure environments.
  • Familiarity with Python-based application stacks and AI frameworks such as TensorFlow or PyTorch.
  • Experience managing GPU-based compute environments, including resource scheduling and scaling.
  • Experience with inference optimization, performance tuning, and infrastructure monitoring for AI workloads.
  • Prior experience supporting high-performance computing or data-intensive environments.
  • Experience working in financial services or other highly regulated enterprise environments.

\*\*The base salary range for this role is $140,000 - $200,000, with flexibility for exceptional candidates\*\*

Benefits:

  • Choice of medical, dental, vision insurance.
  • Voluntary benefits.
  • Short- and long-term disability.
  • HSA and FSAs.
  • Matching 401k.
  • Discretionary performance bonus.
  • Employee referral bonus.
  • Employee assistance program.
  • 11 public holidays.
  • 20 days PTO.
  • 7 Sick Days.
  • PTO buy and sell program.
  • Volunteer days.
  • Paid parental leave.
  • Remote/hybrid work environment support.

For more information about BIP US, visit https://www.bip-group.com/en-us/.

Equal Employment Opportunity:

It is BIP US Consulting policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship, or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.

BIP US provides a reasonable range of compensation for our roles. Actual compensation is influenced by a wide array of factors including but not limited to skill set, education, level of experience, and knowledge.

Ready to apply?
You'll be redirected to BIP's application page.

Similar roles