> ## Documentation Index
> Fetch the complete documentation index at: https://docs.scitix.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Manage LLM Engine Config

> Create and manage LLM Engine Config in Siverse, defining Engine Versions, runtime Images, and role rules for different Execute Types.

LLM Engine Config is used to register inference engine versions that can be selected by services and templates, and to define the runtime Image, Execute Type, and role display rules. If an existing engine configuration meets deployment requirements, you can select it directly when creating a service or template. Create or edit an engine configuration only when you need to add an engine version, adjust the runtime Image, or maintain role rules.

Engine configurations maintain reusable engine definitions. When creating a service, you must still select an engine Version for the service and configure Engine Params, Execute Type, and role resources.

## Create Engine Configuration

### 1. Go to the creation page

1. Go to **Inference > LLM Engine Config**.
2. Select a **Region** and **Cluster**.
3. Click **Create**.

### 2. Configure the Engine

Enter the engine configuration JSON in the editor. The fields in the configuration collectively determine the engine versions available when creating a service, as well as the roles and configuration items displayed for different execute types.

| Field | Description |
| - | - |
| `engine` | Engine name. |
| `version` | Engine version. |
| `image` | Image used to run the engine. |
| `routerImage` | Image used by the router role. |
| `executeTypeRoles` | Defines the roles corresponding to different execution types. When creating a service, the page displays the relevant role configurations based on the selected execution type. |
| `showRoleRules` | Controls the configurations to display for each role, including parameters, cmd, images, specifications, and replica counts. |

The execute type and role rules in the engine configuration must be consistent with the startup method of the corresponding image. When creating a service, use the roles actually displayed on the page for the current engine version. Do not infer roles solely based on the execute type name.

### 3. Submit Creation

Click **Submit**. After creation, this engine version can be selected for LLM inference services and inference templates.

## Manage Engine Configurations

Go to **Inference > LLM Engine Config**, locate the target configuration, and perform the appropriate action.

| Actions | Description |
| - | - |
| **Edit** | Modify the image, Execute Type, or role rules of an engine version. |
| **Clone** | Copy an existing configuration to create a new engine version or configuration variant while retaining the original configuration. |
| **Delete** | Delete engine configurations that are no longer in use. |

## Next Steps

* [Manage LLM Inference Templates](/siverse/inference/manage-llm-inference-templates.md)
* [Create LLM Inference Services](/siverse/inference/create-llm-inference-services.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.