A Django app serving as a gateway for locally deployed LLMs, with API key distribution, permission access, usage tracking, etc. Behind a LDAP, using groups or userid to constrain accesses to models (e.g., RPM, keys, tokens). Compatible with Ollama and vLLM.
Tech stack: Python, Django, Pico, htmx, Shiki