Sync And Async Inference Sessions Over Websocket

Official Python SDK for LM Studio: connect to a local LM Studio server to run chat, completion, tool-use, and schema-constrained inference with locally hosted LLMs, with sync and async clients plus model load/unload management.

AI Frameworks | Python · python-sdk · llm