
Software Engineer, Infrastructure
Role summary
Ivo is seeking an Infrastructure Engineer to build and manage the foundation of their AI-native legal tech platform. This role involves designing and scaling cloud infrastructure to support thousands of customer deployments, instrumenting systems for performance monitoring, and developing robust CI/CD pipelines. The engineer will be responsible for incident management and on-call duties. A strong interest in LLMs and experience with LLMOps, such as developing LLM evaluations and autonomous agents for issue detection, is highly desirable. This is an opportunity to significantly impact the company's growth and product development in a fast-paced startup environment.
Engineering at Ivo
Engineers at Ivo are inventors. Ivo was first-to-market with:
- An AI agent that lives in MS word and edits the document for you [2023]
- Ditching imprecise embeddings models in favor of agentic RAG [2023]
- Large-scale LLM-based legal fact extraction [2024]
- A legal assistant that can search large contract databases, without sacrificing accuracy [2024]
- Clustering legal documents descended from the same family [2025]
- Automatic deviation analysis to locate buried risk in huge contract databases [2025]
- Merging contracts with their amendments to make a time series of “composite” contracts (a customer actually cried when we showed her this) [2025]
Role
Infrastructure Engineers build the foundation for Ivo’s entire platform.
We’re looking for an Infrastructure Engineer to:
- Own and shape the future of our environment. We still have a relatively minimal footprint, giving you a lot of freedom to design the system.
- Manage dozens, hundreds, thousands (?) of customer deployments. Customers are cagey about their contracts, so each customer gets their own containers, database, VPC, etc. It’s a lot to orchestrate.
- Instrument our system so we understand performance bottlenecks, errors, etc.
- Aggregate metrics/logs/health checks into slick dashboards and pager alerts
- Be on call and lead infrastructure related incidents
- Get our CI/CD system running super quickly (it currently takes ~12 minutes, boo)
In addition to helping us run a solid, high-performance distributed system, we’d love someone who’s as excited about LLMs as we are. You’d be deeply embedded into the engineering team and encouraged to push the DevOps frontier by, for example:
- Developing on-the-fly LLM evals to monitor the real-time accuracy of our responses
- Building autonomous agents to detect and diagnose production issues before they become major fires
- Any other useful stuff you can think of
Mission
Every major business has an in-house legal team, and all of those lawyers are overworked. 80 hour weeks, tight deadlines and contract-reading death marches are the industry norm. Up until recently, there wasn’t anything technology could do to help this situation.
LLMs have given us the ability to give these lawyers their lives back, and at Ivo, that’s our mission.
We’re building an AI-native platform to automate legal drudgery. People
*love*
our software - despite high competition, we have the highest trial win rate on the market (85%). We’re genuinely improving people’s lives, and we’re only just getting started.
Ivo might be a good fit for you if you:
- You love writing code, but you love having impact more: We’re a team of engineers at heart, but our #1 goal is building the best possible product. That means making pragmatic choices and looking for 80/20 solutions.
- Would describe yourself as being
relentlessly resourceful
.
- You have a strong internal sense of urgency. You have a bias towards doing things \*today\*, rather than tomorrow.
- Experience working in a startup environment is preferred but not required.
- Are excited about the adventure of building a company!
FAQ:
How far along are we?
We launched in early access in 2023. Since then, we’ve had an incredible response from the market and are growing rapidly. We 6x'd in ARR in the last 12 months. Our clients include companies like IBM, Uber, Reddit, Canva, Pinterest, Shopify, WordPress, and more. We're happy to share more details with candidates who go through our interview process.
Can I work remotely?
We have an in-office culture, with some hybrid flexibility.
Compensation:
The USD salary range for this role is $225K-$485K.
Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
Similar roles
- Senior Software Engineer, InfrastructureRemoteHunter · United States · Remote
Software Engineer, InfrastructureSuperhumancy Talent Partners · Vancouver, British Columbia, Canada · Hybrid- Software Engineer, InfrastructureTavus · United States · Remote
Software Engineer, InfrastructureSuperhumancy Talent Partners · San Francisco, California, United States · Hybrid
Software Engineer, InfrastructureSuperhumancy Talent Partners · New York, New York, United States · Hybrid