A space for my stories about AI, dotnet, c#, azure, devops and more

HOME
ALL POSTS
ARCHIVES
CATEGORIES
TAGS
ABOUT

Home Tags hedged-requests

Tag

hedged-requests 1

Hedged Requests and Load Shedding: Finishing the Go LLM Gateway Resilience Stack Oct 25, 2026

Recently Updated

Hedged Requests and Load Shedding: Finishing the Go LLM Gateway Resilience Stack
Rust RwLock on a Read-Heavy Path: parking_lot vs std::sync, Measured
Go LLM Gateway: Circuit Breaker Plus Retry Budget That Cut Token Waste 88%
GOGC=off with runtime.SetMemoryLimit: the GC tuning pair that cut our p99 61%
GOGC=off + a memory limit beat GOGC=400 for p99 (and stopped the OOM kills)

Trending Tags

ai dotnet performance enterprise-ai azure csharp openai enterprise benchmark llm

© 2026 Lamplit Labs. Some rights reserved.

Visit Lamplit Labs

Trending Tags

ai dotnet performance enterprise-ai azure csharp openai enterprise benchmark llm

A new version of content is available!