AI Infrastructure Engineer

Akkodis is seeking a
AI Infrastructure Engineer
for a
Direct Hire
position with a client located in
Lake Mary FL or Pittsburgh PA
. Ideally looking for applicants with a solid background in the financial services industry.

Pay Range:
$125,000 to $130,000

AI Infrastructure Engineer job responsibilities include:

• Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale.
• Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:AI and NVIDIA BCM.
• Own the observability of our AI platforms—monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity.
• Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation.
• Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads.

To fulfill this role the AI Infrastructure Engineer will be required to:

• Bachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred8-10 years of related experience required; experience in the securities or financial services industry is a plus.
• Experience with Linux administration (RHEL/Ubuntu), shell scripting, and system-level debugging.
• Proven experience running distributed systems in Kubernetes and containerized environments using Docker.
• Familiarity with GPU resource management, including NVIDIA GPU Operator and device plugin lifecycle.
• Experience with CI/CD workflows and infrastructure automation tools such as GitLab CI, Jenkins, Terraform, Helm, or Ansible.
• Knowledge of networking fundamentals and persistent storage systems.
• Exposure to cloud platforms (AWS, GCP, Azure) and hybrid GPU environments.
• Ability to read and support Python code focused on ML/AI pipeline integration.
• Strong analytical and troubleshooting skills with a collaborative mindset.
• Effective communication skills and proactive ownership of platform reliability and performance.

If you are interested in this
AI Infrastructure Engineer
job in
New York, NY
, then please click APPLY NOW. For other opportunities available at Akkodis go to www.akkodis.com.If you have questions about the position, please contact
Varun Mahajan
at
610-230-7027 or varun.mahajan@akkodisgroup.com.

Equal Opportunity Employer/Veterans/Disabled

(INCLUDE
YOUR CLIENT’S BENEFITS HERE
)

Benefits include but are not limited to:

• 401(k) with match
• Comprehensive medical insurance (PPO, HSA)
• Dental insurance (PPO)
• Vision assistance
• Three weeks of Paid Time Off to Start; Accumulating Structure Afterwards
• Paid Holidays Off

Available paid leave may include Paid Sick Leave, where required by law; any other paid leave required by Federal, State, or local law; and Holiday pays upon meeting eligibility criteria.

*To read our Candidate Privacy Information Statement, which explains how we will use your information, please visit https://www.modis.com/en-us/candidate-privacy/*

*The Company will consider qualified applicants with arrest and conviction records.*