Implementation Notes
This approach keeps inference traffic on infrastructure you control. better-cmdk still handles command/search/chat UX while your endpoint enforces policy and model access.
Best For
- - Organizations with private network or compliance boundaries
- - Apps that must keep prompts and context on controlled infrastructure
- - Teams running open-weight models in dedicated environments
Quick Setup Checklist
- 1. Expose a stable internal chat endpoint with streaming support.
- 2. Secure endpoint access with auth, origin checks, and request limits.
- 3. Connect CommandMenu through chatEndpoint or an adapter layer.
- 4. Instrument latency and error metrics before opening to broad traffic.