GenAI Engineer (LLM Applications on Azure)
Successfully
Req. VR-125168
Expert-level engineer designing and building LLM applications and agentic workflows on Azure: RAG pipelines, multi-agent orchestration, MCP tool integration, evaluation, guardrails and cost control. Sets the GenAI engineering standards for the account and is accountable for solution quality against agreed evaluation thresholds.
Build LLM applications and agent workflows with LangGraph / LangChain / Semantic Kernel on Azure OpenAI (AWS Bedrock / GCP Vertex a plus).
Design RAG pipelines: document ingestion, chunking strategies, embeddings, vector search (Azure AI Search, FAISS, Pinecone), hybrid retrieval and re-ranking.
Integrate enterprise tools and context via Model Context Protocol (MCP) servers and function / tool calling; design multi-agent systems.
Engineer, version and test prompts; run offline and online evaluations (accuracy, grounding, hallucination rate) and fine-tuning where justified.
Implement responsible-AI guardrails (content filters, PII redaction, policy checks) and LLM observability (tracing, token accounting, latency).
Optimise token and inference cost (model routing, caching, batching); report against cost budgets.
Document prompts, evaluation results and model choices; mentor engineers adopting GenAI patterns.
Must have
Bachelor's degree in Computer Science, Engineering, Information Systems or a related field, or equivalent practical experience.
10+ years in software or data engineering, of which 3+ in machine learning / NLP and 2+ delivering production LLM applications (RAG, agents) on Azure OpenAI or equivalent.
Expert Python; LangGraph, LangChain and/or Semantic Kernel; asynchronous, event-driven application design.
Azure OpenAI, Azure AI Search, Azure AI Foundry / ML, Functions, Container Apps / AKS, Key Vault, Application Insights.
RAG design: chunking, embeddings, vector databases (Azure AI Search, FAISS, Pinecone), hybrid search, re-ranking.
MCP server / client development, function calling, multi-agent orchestration and state management.
LLM evaluation (RAGAS, promptfoo, Azure AI evaluation or equivalent), fine-tuning (LoRA / PEFT) and model selection.
Guardrails (Azure AI Content Safety, NeMo Guardrails or similar), LLM observability (LangSmith, OpenTelemetry), FinOps for inference.
Nice to have
AWS Bedrock or GCP Vertex AI.
Semantic caching, model distillation, small-language-model deployment.
Azure AI Engineer Associate (AI-102) or equivalent.
Experience in financial services, sovereign wealth / investment holding or other regulated enterprise environments.
Experience working with distributed teams (onsite UAE with nearshore India / offshore Poland squads).
Languages
English: C1 Advanced
Seniority
Senior
*The acquisition of rights to the above benefits depends on the form of cooperation. Benefits apply to those employed under a contract of employment.
**Please note that relocation is not available for all open positions. At Luxoft Poland it is possible to work remotely only from the territory of Poland.
***Options offered by the Polish government.
Remote Poland, Poland
Req. VR-125168
Data Platform Engineering
BCM Industry
23/09/2026
Req. VR-125168
Apply for GenAI Engineer (LLM Applications on Azure) in Remote Poland
*Indicates a required field