Senior Software Engineer, AI

Sr. Software Engineer, AI

Location:
Brooklyn, NY (Hybrid)
Experience:
5+ years in ML/AI Engineering

About North

The public cloud is rapidly evolving, with businesses investing over $200B annually in cloud technology. As AI accelerates demand for scalable infrastructure, cloud costs are soaring, and most teams still rely on spreadsheets to manage them.

At North, we're building the next-generation cloud spend management platform. We give companies real-time visibility, control, and automation over their cloud finances, so they can grow efficiently, without wasting time or money.

Backed by top-tier investors and trusted by global customers like Brave, The New York Public Library, and SumUp, we're assembling a world-class team to redefine how businesses manage cloud infrastructure.

About the Role

We're looking for a Sr. Software Engineer, AI to own the machine learning and AI efforts across our platform. You'll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.

This is a hands-on, senior-level role — perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you're a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we'd love to hear from you.

What You'll Do

• Design, build, and deploy ML models for cloud automation and optimization.
• Work with LLMs, fine-tuning, optimizing, and integrating them into our platform.
• Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
• Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
• Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
• Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
• Collaborate with engineering, product, and leadership teams to align AI development with business goals.
• Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
• Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North's AI capabilities.

What We're Looking For

• 5+ years of hands-on experience in ML, AI model development, and infrastructure deployment.
• Experience deploying ML models at scale on AWS (cloud-based, distributed systems, or edge deployments).
• Strong programming skills in Python and SQL, with demonstrated ability to write production-quality code.
• Proficiency with ML frameworks and the judgment to determine when and where to apply them based on data complexity.
• Ability to move fast and iterate, taking ideas from concept to production.
• Comfortable with Git.
• Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
• Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.

Nice to Have

• Experience working in a startup.
• Experience working with financial cloud data across GCP, AWS, or Azure, or complex large financial and logging datasets.
• Experience deploying models in Amazon Bedrock or on AWS.
• Experience deploying infrastructure with Terraform.
• AWS technical certification (or equivalent cloud certification).

Work Setup

Hybrid role based in New York City, with an office in Dumbo, Brooklyn.

Benefits

• Unlimited PTO
• 16-week fully paid parental leave (20 weeks at 50% for mothers)
• Company-wide breaks: last week of August & Dec 23–Jan 3
• The opportunity to participate in company benefits, including a Medical PPO Plan with majority of the premium covered by North.
• 30-day sabbatical every 4 years

Compensation

$230,000 – $270,000 base salary, depending on experience Equity included

If you're a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we'd love to hear from you.