Senior ML Ops / LLM Ops Engineer

Caixa Mágica Software • lisboa, lisboa • Posted June 23, 2026

Position Overview

Overview

This role focuses on building and operating the ML Ops / LLM Ops pipeline that closes it: ingest production signal, redact it, store it, slice it, classify it, surface the failures, mine new eval cases, and alert on regressions. You drive the toolchain decisions, the data‑governance posture, and the day‑to‑day reliability of the pipeline itself. The Head of AI sets vision and priorities and you own the technical execution end‑to‑end.

What will you do?

  • Design and build a source‑agnostic ingestion pipeline for production ML / LLM traffic
  • Design storage tiering based on automotive and company requirements, policy‑driven retention windows, and privacy requirements
  • Build slicing dashboards and the query path engineers use to debug production at 11p.m.
  • Enable autoraters and lightweight LLM classifiers across production traffic
  • Build the rule‑based triage layer for obvious failures
  • Stand up the ...