Events

Building Bulletproof AI Applications: Lessons from Processing Billions of Tokens Daily

Past

CTO of Astra AI Tjaž Silovšek shares engineering realities of production AI systems handling provider outages, rate limits, and failures at scale

When:
Thursday, 9 October 2025
Where:
Sportradar d.o.o., Litostrojska Cesta 52a, 1000 Ljubljana

What to expect

Tjaž Silovšek, CTO at Astra AI, shares real-world lessons from building production LLM applications that process billions of tokens daily. For engineers, developers, CTOs, and technical leads implementing LLMs in production.

Talk

Building reliable LLM applications at scale: provider outages, flaky connections, rate limits, resilient retries, monitoring, and debugging.
Practical strategies for handling service disruptions, managing token quotas, and ensuring reliability at scale.

Agenda

  • 17:00: Doors open, networking
  • 18:00: Talk
  • 19:00: Q&A and networking
Doors open at 17:00. English. Venue parking available.