Principal AI Engineer

Team & Context

Gorgias is an AI‑first company building products powered by large language models and agent‑based systems. As we scale our AI capabilities, we need to improve how we evaluate, iterate, and operate these systems in production. Parts of the process remain manual or fragmented, especially around prompt iteration, validation, and evaluation workflows.

About The Role

You’ll help build and scale the systems that support AI evaluation and iteration, empowering the team to move faster and more reliably.

What You’ll Do

• Architect the Evaluation "Factory"
• Own and lead the development of the internal evaluation platform, moving from manual testing to a fully automated lifecycle (from LLM‑as‑a‑judge creation to production monitoring).
• Accelerate Time‑to‑Market by designing tools and workflows that drastically reduce the time it takes to deliver a calibrated, production‑ready agent.
• Collaborate with the Orchestration team to build the robust, scalable infrastructure required to run complex evals and agentic simulations at scale.
• Scale AI expertise across squads, guiding them through complexities of agent design, failure analysis, and prompting best practices.
• Decentralize quality assurance so product squads become autonomous in measuring and maintaining their own agent quality.
• Define what "good" looks like for AI at Gorgias, translating non‑deterministic AI behavior into predictable engineering metrics.
• Lead engineering initiatives, mentoring engineers on applying rigorous system design to LLMs and agents.
• Own the feedback loop, ensuring production insights directly inform the next iteration of our evaluation datasets.
• Build systems that handle high scale with long‑term maintainability and performance (8+ years of engineering excellence).
• Demonstrate agentic curiosity by experimenting beyond the chatbot phase, focusing on orchestration, state management, and reliability.
• Think systemically about probabilistic AI, building deterministic wrappers and evaluation loops to make models safe for production.
• Apply distributed system and developer tooling expertise to the AI stack.
• Architect multi‑stage AI orchestrations (agents, chained workflows, custom runtime logic).
• Build complex, multi‑step workflows (e.g., temporal systems, state machines, event‑driven architectures) for agentic loops.
• Develop evaluation frameworks that measure model performance against real‑world data, avoiding vibes‑based testing.
• Utilize the AI glue stack: vector databases, semantic caching, and API integration with third‑party tools.
• Strong backend experience (Python preferred).
• Experience with distributed systems and event‑driven architectures.
• Familiarity with tools like Kafka, Pub/Sub, or equivalents.
• Experience working with LLMs (prompting, RAG, agents, evaluation workflows).
• Experience building APIs and scalable services.
• Understanding of monitoring, observability, and system performance.

Perks And Benefits

• Competitive salary & equity (90th percentile worldwide).
• 5‑week vacation plus 2 weeks RTT (following country PTO laws).
• Paid sick leave.
• Paid parental leave (16 weeks).
• MacBook Pro.
• Personal credit card to buy lunches (we use Swile).
• Private health insurance (we use GAN). 
• Up to €700 for a home workstation setup.
• Up to €2000 per year for learning material and wellness support (€1500 for job‑related learning, €500 wellness).
• Quarterly company‑wide summit and yearly retreats.

AI at Gorgias

At Gorgias, AI is a natural extension of how we work and build. Our teams use it every day to research, write, analyze, code, and craft better customer experiences. Everyone has access to premium AI tools (ChatGPT, Claude, Granola & others) and an annual L&D budget to explore new ones. The real magic happens when we share what we learn. Our #powerup Slack channel is a digital petri dish of new tools and workflows, and each team has AI champions who showcase fresh ideas during weekly company‑wide standups, often in the form of AI demo sessions. We see AI as a multiplier that helps us move faster, think deeper, and serve customers better.

AI use in Recruiting at Gorgias

By submitting your application, you agree that Gorgias may collect and process your personal data for recruiting, workforce planning, and related purposes. For more information about how we process your data and your rights, please refer to our Applicant Privacy Policy.

Diversity & Inclusion at Gorgias

We’re committed to creating an inclusive environment where everyone can thrive. We welcome applicants from all backgrounds, experiences, and perspectives because diverse teams drive innovation and better decision‑making. If you need accommodations during the application or interview process, please contact us at