python-mlx-server
Lightweight OpenAI-compatible API server for running MLX models on Apple Silicon. Minimal overhead, drop-in for any OpenAI SDK client.
Lightweight OpenAI-compatible API server for running MLX models on Apple Silicon. Minimal overhead, drop-in for any OpenAI SDK client.