Job Description
The Senior Quality Engineer – AI Integrations contributes to Arctic Wolf’s engineering organization by building scalable automation frameworks and quality solutions for artificial intelligence, machine learning, and cybersecurity applications. This role focuses on ensuring reliability, performance, and quality across distributed systems, cloud‑native services, and large language model–driven applications by creating and extending software frameworks and tools to execute, monitor, and report on automated tests, and by building and maintaining CI/CD‑integrated automation pipelines. Responsibilities include reviewing test strategies and plans, architecting automation for API validation, performance and load testing, fuzz testing, developing and maintaining testing frameworks for generative AI and ML applications, validating model behavior and prompt‑response consistency (including hallucination detection and regression testing), and implementing evaluation pipelines to measure LLM accuracy, latency, bias, toxicity, and reliability. The engineer collaborates with highly skilled software engineering teams to continuously improve engineering quality, automation practices, and testing methodologies, while learning and adopting emerging technologies in AI, cybersecurity, and cloud engineering.