intermediatePart 1
One endpoint, many models: deploy an LLM gateway on a WEC Instance
· 15 min read
+
+
+0/4
🎯 Skill path0/4 earned
Self-hosting an LLM gateway
- 1One endpoint, scoped keys
- 2Route work to the right model
- 3Mask PII at the gateway
- 🏆Budgets and real cost
Here's how it usually goes. One app needs a model, so you paste the API key into
its .env. Then a second app needs one. Then a script. Six months later the same
key is in five places, nobody remembers which of them is still running, and you
can't rotate it without breaking something you'll only find out about when it
breaks.
A gateway is the boring fix. One endpoint in front of every model, one place that holds the real credential, and a scoped key per app that you can revoke on its own. This post deploys one on a WEC Instance and points it at the WEC Inference API.