AI Engineer

Shimi Sp. z o.o. Show all offers

175 PLN / hour

Warszawa

25 days ago

In short

Mid/Senior AI Engineer needed for live LLM system. Build LLM features end-to-end, own answer quality, and debug production. Python, FastAPI, LangGraph, Azure required. Remote, B2B contract. Rate: 175 PLN/H net + VAT.

Keywords

AI LLM Python FastAPI LangGraph Azure RAG Tracing Cloud

AI-written summary based on the listing content.

For one of our clients, we are looking for a Mid/Senior AI Engineer (m/f/n).

You'd work on a live LLM system with real users — not a proof of concept. We're looking for a Senior AI Engineer who can take an LLM-based feature from idea to production and then keep it accurate, fast, observable and efficient.

Tasks and responsibility

Build LLM-powered features end to end. Design and implement agentic flows, retrieval, and tool calling using LangGraph — then ship them as FastAPI services with streaming, persistence and proper tests.
Own answer quality. Build evaluation datasets, regression suites and LLM-as-judge checks so we know whether a prompt or model change made things better before it reaches users.
Get the right context to the model. Turn user questions into effective queries against our search platform, orchestrate multi-step research loops, and shape the context the model reasons over. When an answer is wrong, work out whether retrieval, the query or the prompt is at fault — and fix the right one.
Debug production. Instrument flows with tracing (Langfuse), investigate bad answers from real traces, and manage latency, token and cost budgets — including routing across model sizes and families behind an AI gateway.

Requirements

Experience in building and operating backend services — APIs, async, testing.
Hands-on experience taking LLM features to production and keeping them running — not only prototypes.
Agent / orchestration frameworks. LangGraph ideally.
Practical RAG experience.
Experience debugging LLM systems in production — tracing, evaluation, cost and latency.
Experience running services in the cloud (we're on Azure).
Strong problem-solving skills, analytical thinking, and technical decision-making.
Fluent in English, proactive communicator, and a collaborative team player.
Open-minded, creative, and motivated to push boundaries in AI and automation.