llm-production-engineering
Field notes from building AI systems in production since 2019. LLM serving ops: cost tracking, eval-driven deployment, capacity planning, observability, incident playbooks.
Field notes from building AI systems in production since 2019. LLM serving ops: cost tracking, eval-driven deployment, capacity planning, observability, incident playbooks.