QA Tester, AI Development
About This Role
The QA Tester is the quality gatekeeper for Insight's AI Development team, responsible for defining and executing test strategies across AI-powered applications. This role goes beyond traditional functional testing — you will validate the reasoning, accuracy, and safety of AI agents and LLM-powered features, while also maintaining robust automation frameworks for the full application stack. You will lead QA efforts across multiple projects and mentor team members on testing best practices for AI applications.
Key Responsibilities
Define and implement test strategies for AI-powered applications, including functional, integration, regression, and AI-specific testing (prompt evaluation, hallucination detection, guardrail validation).
Build and maintain automated test frameworks using Python (Pytest) and UI automation tools (Playwright, Cypress, or Selenium) for React front-ends and API back-ends.
Validate AI model outputs for accuracy, safety, and adherence to expected behaviors across agentic workflows and conversational interfaces.
Integrate automated test suites into CI/CD pipelines to ensure rapid feedback on code changes.
Lead defect management: identify, document, reproduce, and track bugs; work closely with developers to verify fixes.
Collaborate with AI Developers, Full Stack Developers, and DevOps Engineers to ensure quality is embedded throughout the development lifecycle.
Establish QA metrics and reporting to communicate quality status and risk to stakeholders.
Qualifications
Experience: Minimum 3 years of experience as a QA Engineer or SDET, with experience testing complex web applications and API integrations.
Automation: Proficient in Python for writing automated test scripts (Pytest preferred); experience with UI automation tools (Playwright, Cypress, or Selenium).
API Testing: Strong understanding of REST APIs; experience validating API responses and JSON schemas.
AI/ML Testing: Familiarity with testing LLM-powered applications, including non-deterministic output validation. Experience with evaluation frameworks (RAGAS, LangSmith, or similar) is a plus.
Cloud: Working knowledge of Microsoft Azure; ability to navigate cloud logs and debug deployed services.
CI/CD: Experience integrating test suites into CI/CD pipelines (Azure DevOps, GitHub Actions).
Communication: Strong written and verbal English communication skills; ability to articulate risk and quality metrics to stakeholders.
Nice to Have: Experience with performance testing, security testing, or accessibility testing.
The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here .
About Insight
Today, every business is a technology business. Insight Enterprises, Inc. empowers organizations of all sizes with Insight Intelligent Technology Solutions™ and services to maximize the business value of IT. As a Fortune 500-ranked global provider of digital innovation, cloud/data center transformation, connected workforce, and supply chain optimization solutions and services, we help clients successfully manage their IT today while transforming for tomorrow. From IT strategy and design to implementation and management, our 11,000 teammates help clients innovate and optimize their operations to run smarter. Discover more at insight.com
...We are searching for an Activities Assistant with experience to assist and support the Activities Director in planning, coordinating, conducting and implementing a therapeutic activity program to meet both group and individual patients needs and interests. Assists in...
...School-Based Speech-Language Pathologist (SLP) If you are interested in applying for this job, please make sure you meet the following requirements as listed below. Location: Salem, OR Schedule: 2 School Year, School-Based Daytime Hours Pay: $55-$65/Per Hour...
...responsibilities as required, assigned, or requested Required: Undergraduate degree or equivalent experience 4+ years of progressive QA/testing experience in Information Technology or software development focus on problems / projects of diverse complexity and scope ...
Requisition ID:925427 Store # :00P945 Sunglass Hut Position: Full-Time Total Rewards: Benefits/Incentive Information At Sunglass Hut, we're always in the sun. Youll find a dynamic space with endless possibilities to grow your career. We are a culture...
...Additional Information About the Role J oin the Respiratory Team at BJC Healthcare's Progress West Hospital where we are dedicated to your growth and development. Be a part of an environment where you can thrive! We are seeking a dedicated and compassionate Respiratory...