AI Test Automation Engineer

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Bucharest, Romania

specialization icon

Automated Testing Java

lob icon

BCM Industry

date icon

11/02/2026

Req. VR-120860

Apply
Project description

Join our Development Center in Bucharest, and become a member of our open-minded, progressive and professional team. In this role you will be working on projects for one our world famous clients.
You will have a chance to grow your technical and soft skills, and build a thorough expertise of the industry of our client.
On top of attractive salary and benefits package, Luxoft will invest into your professional training, and allow you to grow your professional career.

Responsibilities
bullet icon

We're seeking an experienced AI Quality Assurance Engineer to ensure the quality, reliability, and performance of our AI-powered solutions built on Google's Gemini platform and CX Agent Studio automation systems. You'll play a critical role in testing and validating conversational AI experiences and customer experience automation workflows

bullet icon

Key Responsibilities

bullet icon

You'll design and execute comprehensive testing strategies for Gemini-powered applications and CX Agent Studio automation workflows, focusing on conversational AI quality, intent recognition accuracy, and end-to-end customer journey validation. Working alongside AI developers and CX designers, you'll establish quality benchmarks for chatbot responses, voice interactions, and automated customer service flows.

bullet icon

Your work will include creating automated test suites for Gemini API integrations, validating multi-turn conversations and context handling, and testing CX Agent Studio automation scenarios across various customer touchpoints. You'll monitor deployed conversational AI agents for response quality degradation, hallucinations, and edge case failures, while also evaluating prompt engineering effectiveness and model response consistency.

bullet icon

You'll develop testing frameworks to assess natural language understanding accuracy, entity extraction, and sentiment analysis within CX Agent Studio workflows. Additionally, you'll conduct adversarial testing to identify prompt injection vulnerabilities and unintended behaviors, analyze conversational outputs for bias and inappropriate content, and collaborate with product teams to define acceptance criteria for AI-driven customer experiences.

Skills

Must have

bullet icon

3+ years of experience in software quality assurance: API test automation, testing AI/ML systems, preferably conversational AI or customer experience platforms.

bullet icon

Strong understanding of large language models, prompt engineering, and generative AI evaluation is essential; familiarity with dialogue flow validation.

bullet icon

Experience with Google Cloud Platform services.

bullet icon

Experience with API testing tools such as Postman, Newman, or equivalent.

bullet icon

Experience with programming languages such as Python or Java.

bullet icon

Experience with CI/CD tools like GitHub Actions, TeamCity.

bullet icon

Experience with Agile/Scrum software development methodologies.

bullet icon

Excellent communication and collaboration skills.

bullet icon

Good knowledge of software QA methodologies, tools, and processes.

bullet icon

Hands-on experience testing Google Gemini models or similar LLMs (GPT, Claude, etc.) is highly valued.

bullet icon

Direct experience with CX Agent Studio, Dialogflow CX, or comparable conversational AI platforms.

bullet icon

Knowledge of contract automation frameworks, multi agent testing strategies.

bullet icon

Experience with AI safety testing, content moderation, and responsible AI practices will strengthen your application.

bullet icon

Familiarity with customer experience metrics (CSAT, NPS, containment rate) and understanding of voice AI, speech-to-text, and text-to-speech quality assessment is a plus.

Nice to have

bullet icon

/

Other
seniority icon

Languages

English: C2 Proficient

seniority icon

Seniority

Senior

Bucharest, Romania

Req. VR-120860

Automated Testing Java

BCM Industry

11/02/2026

Req. VR-120860

Apply for AI Test Automation Engineer in Bucharest

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.