Skip to content

[Docs] Add UCM configuration parameters reference page - #1293

Merged
harrisonyhq merged 8 commits into
ModelEngine-Group:feature/docs-nextfrom
ljccsu:docs/config-parameters-page
Sep 1, 2026
Merged

[Docs] Add UCM configuration parameters reference page#1293
harrisonyhq merged 8 commits into
ModelEngine-Group:feature/docs-nextfrom
ljccsu:docs/config-parameters-page

Conversation

@ljccsu

@ljccsu ljccsu commented Aug 27, 2026

Copy link
Copy Markdown

Add comprehensive config parameters documentation with YAML hierarchy indication.

---

## pmr_config (PMR Configuration)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove PMR config


| Parameter | Required | Type | Value Range | Description |
|---|---|---|---|---|
| `use_layerwise` | Optional | bool | Default: `false` | Enable layer-wise (per-layer) load/save mode. Recommended `true`; DeepSeek V4 series recommends `false`. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use_layerwise默认为true

| Parameter | Required | Type | Value Range | Description |
|---|---|---|---|---|
| `store_pipeline` | Optional | string | See valid values below | Pipeline name. Default: `Cache\|Posix`. |
| `storage_backends` | **Required** | string | User-configured, multiple mount points separated by `:` | Storage mount path. See [Create Filesystem Mount](https://support.huawei.com/enterprise/zh/doc/EDOC1100582752/47f029f5#ZH-CN_TOPIC_0000002501883936). |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

链接不要了,只体现这里需要填本地目录或者挂载点,如果有多挂载点的话需要用冒号隔开

| `storage_backends` | **Required** | string | User-configured, multiple mount points separated by `:` | Storage mount path. See [Create Filesystem Mount](https://support.huawei.com/enterprise/zh/doc/EDOC1100582752/47f029f5#ZH-CN_TOPIC_0000002501883936). |
| `io_direct` | Optional | bool | Default: `true` | Enable Direct I/O (bypass OS page cache). `false`: uses PageCache; `true`: skips PageCache. |
| `posix_io_engine` | Optional | string | Default: `psync` | File I/O mode. `psync`: synchronous; `aio`: asynchronous, requires `io_direct=true`. |
| `posix_data_trans_concurrency` | Optional | int | Default: `128` | Read/write threads per card in `psync` mode. NFS over RDMA: 128/card; DPC: max 256/node. Not used in `aio` mode. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

DPC也不需要体现

ljccsu added 2 commits August 28, 2026 10:47
…config, use_layerwise default true, remove Huawei links, remove DPC
…emove recommendation table, constraints block, fix cache_sdma_direct default, add GC conditional notes
| `enable_record_traces` | 选填 | bool | `false` | 用来记录请求信息(时间戳,输入长度,输出长度等信息)。 |
| `enable_metrics` | 选填 | bool | 默认 `true` | 是否开启 metrics 收集。 |
| `use_lite` | 选填 | bool | `false` | 是否启用 UCM Lite 功能。不对 KV Cache 数据进行保存和加载,仅对元数据进行保存和查询。仅可用于评估 KV Cache 命中率情况,无加速效果。 |
| `metrics_config_path` | 选填 | string | 自行配置 | 指定监控指标配置文件路径,启用后可通过 toolkit 进行 UCM 在线监控。 |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

metrics的配置在代码仓中的路径可以注明一下

| `cache_load_backend_only` | 选填 | bool | 默认 `false` | 即使在 cache 层命中还是会强制从 SSD 上加载,仅供测试使用。 |
| `cache_io_aggregation` | 选填 | bool | 默认 `false`,仅在 `PLATFORM=ascend` 且模型为 V4 时自动开启 | 启用 IO 聚合 h2d 传输,仅在 A2 设备生效。 |
| `share_buffer_enable` | 选填 | bool | MLA 默认启用,GQA 默认不启用 | 是否启用共享内存。MLA 如果不用 shm 或 GQA 用 shm 都会导致性能下降。 |
| `posix_capacity_gb` | 选填 | int | 默认 `0`,表示不启用 GC;不可超过挂载文件系统可用容量 | 设置磁盘存储的最大容量(GB),当已用容量 >= `posix_capacity_gb * posix_gc_trigger_threshold_ratio` 时触发 GC。 |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

加一条注明,多实例部署,共享同一文件系统的时候,要求只能有一个实例开启GC,其他实例不要开启

@harrisonyhq
harrisonyhq merged commit 77ed059 into ModelEngine-Group:feature/docs-next Sep 1, 2026
harrisonyhq pushed a commit that referenced this pull request Sep 4, 2026
## Modifications 
Add three reference pages to the docs-next MkDocs site based on the
existing project documentation:
- English project README
- Chinese project README
- Feature and model support matrix
The PR targets the feature/docs-next branch and follows the page
structure and table styling used in PR #1293.The previous PR is #1184
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants