Skip to main content
LazyLLM is an open-source low-code LLM application development framework from SenseTime. Its OnlineChatModule supports custom OpenAI-compatible endpoints, so you can connect LazyLLM to ScitiX Model Inference. This guide uses glm-5.2 as an example. For the full model list and pricing, see Models.

Configure

Create an API Key on the API Keys page. After installing lazyllm, create an online model with source="openai" and point it to ScitiX:

Verify

Call the model. A normal response confirms that the connection works. This configuration has been verified with lazyllm 1.3.0.

FAQ

  • source and url: Use source="openai" and set url to the base URL with /v1: https://api.scitix.ai/model-api/v1.
  • Model IDs: The model value is passed through to the upstream service. If the model ID is incorrect, the upstream service returns 404 model_not_found. Use IDs from the Models page.
  • Tool or agent capabilities: Choose a model that supports tool calling. glm-5.2 supports tool calling.