Experienced Software Test Engineer

### Who you are
- We are looking for a detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services within AVEVA Connect
- This role demands deep technical skill and a passion for delivering robust, secure, and ethical AI services at scale
- Extensive experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies
- Proficient in designing automated testing frameworks
- Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments
- Strong understanding of API testing, performance profiling, and security testing
- Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions
- Experience of testing stochastic systems
- Experience working in Agile teams and collaborating across global R&D locations
- Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation
- Familiarity with LLM evaluation techniques, output scoring, and validation frameworks
- Understanding of key concepts such as prompt engineering, RAG, model orchestration, and hallucination detection
- Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations
- Defining Performance Metrics for AI services and testing for the same
- Awareness of AI safety, bias detection, and explainability techniques
- Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act)
- Strong belief in ethical AI practices, transparency, and end-user trust

### What the job involves
- You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities
- You’ll be a part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools - with a builder mindset - rapid prototyping and continuous improvement with agility of a start-up
- Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure
- Design and implement automated test suites for APIs, service components, and AI pipelines
- Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses
- Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks
- Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes
- Participate in threat modelling and security validation of exposed APIs and AI services
- Provide feedback early in the lifecycle to reduce defects and improve design
- Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation

### The application process
- Get started by submitting your cover letter and CV

### Benefits
- Time off: 28 days of annual leave, plus bank holidays. You can also buy/sell five days a year
- Emergency leave: Five days a year to use when unexpected or urgent events make it impossible to work
- Hybrid working: The default option for employees is a 3:2 split between the office and working from home. Some positions are fully remote and others are fully office-based—refer to the job listing for specific details
- Parental leave: Maternity leave comprises 18 weeks at full pay, followed by 21 weeks statutory pay and 13 weeks unpaid. Paternity leave is two weeks at full pay. Pension contributions and benefits are maintained throughout
- Workplace nursery scheme: Pay for your child’s nursery directly through payroll, saving tax and NI contributions
- Electric care lease: Use your flexible benefits fund to subsidize the pre-tax leasing of a brand-new electric or ultra-low-emission car
- Shopping vouchers: Use your flexible benefits fund on discounts and vouchers for many major retail, tech and restaurant chains
- BUPA private healthcare: BUPA healthcare is a core benefit for employees. Use your flexible benefits fund and/or salary sacrifice to add family members
- Anonymous counselling: Through our Modern Health benefit, employees and their dependents over 13 are eligible to use our mental health app and receive unlimited counselling and coaching each year
- Dental insurance: Use your flexible benefits fund to cover preventative and restorative treatment. You can also add coverage for family members
- Cycle to work: Buy a brand-new bike and save 25–40% on retail price thanks to tax savings
- Gym membership: Use your flexible benefits fund to discount a membership to a major gym chain
- Bonus: Based on a combination of your own performance and AVEVA’s financial results
- Pension: Use your flexible benefits fund to increase the standard employer contribution. You can also route your bonus directly into your pension, saving tax and NI
- Income protection: Secure a reliable income if you’re unable to work due to long-term sickness or injury
- Life assurance: In the event of your death, your loved ones will receive a lump sum
- Charitable giving: The Action for Good program gives you three days of paid volunteering every year, as well as match funding opportunities. You can also use your flexible benefits fund to give to charity pre-tax
- Professional development: Access to LinkedIn Learning gives you the chance to grow your knowledge and skills, while AVEVA’s extensive mentorship network allows you learn from colleagues across the company
- Education support: After one year with AVEVA, you can apply for support towards a relevant course or qualification. AVEVA will reimburse up to 70% of the cost
- Service recognition: Whether you’ve been with us for 12 months or 50 years (it’s happened!), the AVEVAversary program rewards you during milestone years with cash and time off. We also recognize your contributions by planting a tree in the AVEVA Forest, our global forest of recognition