VAGASLUME
W

Title: AI Quality Manager / QA Lead (German C1+)

W9R LIMITED OÜ · Remote - Estonia, Germany · Remote · Wellfound

QA Engineer$48k – $68kFreelanceEstonia, Germany · Remote

This job is restricted to candidates in: Germany. City: Estonia. Work model: Remote

About the job

We are building an AI-first insurance venture together with the Alteos team, backed by AXA. Our customer-facing flow (quote, advice, purchase) is fully AI-driven and live, and a second track automates internal insurance operations with AI. Small team, startup speed, decisions made in-house.

Must have

  • German at C1 level or higher (the product, data and insurance policies are in German)
  • Daily use of tools like Claude Code or ChatGPT, and an understanding of how LLM products behave and fail
  • Experience organizing people and distributing work (QA lead, test manager or similar)
  • Startup experience
  • Strong self-organization across parallel tracks and constant change
  • You own every conclusion you present, AI-assisted or not, and can explain it in a few sentences

Nice to have

  • Insurance background (claims, underwriting, policy wording, customer service or product at an insurer, broker or insurtech). You will judge whether AI answers about insurance are correct, so domain knowledge counts a lot
  • You built or ran an AI evaluation setup yourself (golden answer sets, LLM-as-judge, regression testing)
  • Technical background (semi-technical is enough)

What you will do

  • Own the AI testing strategy: what gets tested, why, and to what depth
  • Define what "correct" means for our AI answers and turn it into clear evaluation criteria
  • Organize test sets across many parallel variations (often 50 at once)
  • Review and mark AI outputs, and define how manual testers evaluate them
  • Brief, distribute and check the work of the freelance tester pool
  • Report clearly what is broken, how bad it is, and what must be fixed before release

Main requirements

QA Engineer

Application

Posted 4 weeks ago

Tailor my resume

Members feature · See plans

Remember: Vagaslume.Tech never charges fees, courses or payments to take part in hiring processes. If you are asked to pay anything related to being hired, do not make the payment.

W

W9R LIMITED OÜ

Open jobs at this company: 2

See company profile →