QA Engineer

Purpose of Position

We are looking for an experienced QA Engineer with a deep commitment to quality assurance and a strong interest in AI-driven solutions. You will play a key role in ensuring that our cutting-edge AI systems, powered by large language models (LLMs), deliver exceptional performance, accuracy, and user experience. You will collaborate closely with developers, data scientists, and product managers, operating at the forefront of innovation in a fast-paced environment.

The Team

You will be joining our Team Sagitta in the Growth Domain, a newly formed group that you will help shape from day one. As one of the founding members, you’ll play a pivotal role in defining the team’s direction and crafting innovative AI-driven solutions that directly impact our customers. This is your chance to influence the AI value proposition from the ground up, setting the stage for future advancements.

Key Tasks & Responsibilities

• Develop and execute test plans and cases tailored for AI and LLM-based applications.
• Create and maintain automated test scripts for validating AI functionality, performance, and integrations.
• Perform functional, regression, performance, and security testing.
• Identify, document, and track defects, ensuring timely resolution.
• Address AI-specific quality aspects like bias, fairness, and explainability by implementing dedicated testing strategies.
• Provide input on system design for enhanced testability and usability.
• Collaborate with cross-functional teams to ensure high-quality deliverables.

Skills & Expertise

Required:

• Experience: At least 3 years in software quality assurance, with 1+ years in AI/ML systems testing.
• Programming Skills: Strong proficiency in Python for automation testing.
• AI Testing: Hands-on experience testing AI/ML solutions, particularly those utilising LLMs, with a focus on integrating LLM evaluation systems with traditional QA processes.
• API Testing: Proficient in testing RESTful APIs using tools like Postman.
• Test Automation Tools: Experience with tools like Pytest, Selenium or equivalent frameworks.
• Testing Methodologies: Comprehensive understanding of the software testing pyramid.
• Performance Testing: Ability to analyze and test system performance effectively.
• Data Handling: Understanding of data validation and preprocessing in AI pipelines.
• Problem-Solving: Proactive and analytical approach to identifying and resolving issues.

Nice to have:

• Familiarity with LLM frameworks such as OpenAI GPT or Hugging Face.
• Knowledge of CI/CD pipelines and containerization tools (Docker/Kubernetes).
• Experience with cloud platforms like AWS, Azure, or GCP.
• Exposure to testing AI models for fairness and ethical considerations.
• Proficiency in JavaScript and associated testing tools for broader automation needs.
• Knowledge of Jupyter Notebooks for visualizing and validating AI processes.

Our Offer

• Flexi-Week and Work-Life Balance: We prioritise your mental health and wellbeing, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves.
• Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately.
• Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
• Meal Vouchers: You will be supported with a certain net sum to spend it on a variety of lunches.
• Health & Wellbeing: The insurance covers several types of health, vision and / or dental treatments for you and for up to one additional family member.
• Remote Working Furniture Package: After 3 months of employment, you will be eligible for a furniture package, which should enable you to set up a proper workplace at your remote working location
• Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program.

Established in 2000, Awin is proud of our dynamic, social and inclusive culture.

Like all businesses, we’ve had to adapt and nurture our culture in a virtual environment. Our virtual ‘Life @ Awin’ hub brings our colleagues from across the globe together for various social activities.

Diversity & Inclusion are paramount to us, and we proudly pursue and hire diverse team members. We champion uniqueness and authenticity; this is who we are at our core. Our network of affiliate partnerships are diverse and transparent, as are the employees powering our vision to build the world’s leading open partner ecosystem. We welcome all backgrounds, identities, and experiences. If you need support at any point in the application or interview process, please let us know.

Apply now to begin the next stage of your career at a progressive company that supports both your professional and personal development.

#LI-RS1