AI Product Engineer focused on production LLM systems with measured quality, not vibes. Recent work:
- Spanish occupational-safety RAG assistant over the INSHT corpus: hybrid retrieval (BM25 + voyage-3 + rerank-2.5), Hit@8 0.98 and MRR 0.955 against a 50-item human-labeled golden set. Rebuilt the LLM-as-judge layer from TNR 0.00 to TPR/TNR 1.00/1.00 on faithfulness by fixing threshold calibration and adding reference context, with meta-evaluation gating on top. Evals run in CI and fail the build on regressions.
- RepoDoctor: LangGraph agent that clones a repo, auto-detects the stack, runs its test and lint suites in sandboxed subprocesses, and returns a structured diagnosis grounded in real command output. Streaming Next.js frontend.
Previously shipped auth flows in Next.js/TypeScript at a Swedish startup. Looking for a full-time role shipping LLM features end to end: retrieval, agents, evals, and the product surface around them. Live demo and case study: https://www.emanuelecz.dev
Remote: Yes, remote only. EU contract, or US via EOR (Deel / Remote.com). Registered freelancer, can also invoice B2B.
Willing to relocate: No
Technologies: Python, LangGraph/LangChain, RAG (hybrid BM25 + dense retrieval, VoyageAI embeddings + reranking, ChromaDB, pgvector), LLM evals (golden sets, LLM-as-judge, judge meta-evaluation), Claude + OpenAI APIs, FastAPI, PostgreSQL, TypeScript/React/Next.js, Docker, GitHub Actions
Résumé/CV: https://www.emanuelecz.dev/emanuele-czofei-cv.pdf
Email: emanuelecz06@gmail.com
AI Product Engineer focused on production LLM systems with measured quality, not vibes. Recent work:
- Spanish occupational-safety RAG assistant over the INSHT corpus: hybrid retrieval (BM25 + voyage-3 + rerank-2.5), Hit@8 0.98 and MRR 0.955 against a 50-item human-labeled golden set. Rebuilt the LLM-as-judge layer from TNR 0.00 to TPR/TNR 1.00/1.00 on faithfulness by fixing threshold calibration and adding reference context, with meta-evaluation gating on top. Evals run in CI and fail the build on regressions.
- RepoDoctor: LangGraph agent that clones a repo, auto-detects the stack, runs its test and lint suites in sandboxed subprocesses, and returns a structured diagnosis grounded in real command output. Streaming Next.js frontend.
Previously shipped auth flows in Next.js/TypeScript at a Swedish startup. Looking for a full-time role shipping LLM features end to end: retrieval, agents, evals, and the product surface around them. Live demo and case study: https://www.emanuelecz.dev