除了作为完整平台要求一部分的核心服务要求之外,AI Center 还需要其他资源,具体取决于您要运行或训练的模型。
The following table describes the additional resources AI Center needs.
在此表格中,所有服务器节点都需要数据磁盘。代理节点不需要此操作。
Use | CPU | RAM (GiB) | GPU | Disk (GiB) |
---|---|---|---|---|
Minimum for serving (ML Skill, one replica) | 0.6 | 2 | 0 | 20 OS Disk |
Minimum for Training (Pipeline) | 1 | 4 | 0 | 20 OS Disk 105 Data Disk |
DU model Serving (ML Skill, one replica) | 1 | 4 | 0 | 20 OS Disk |
DU model Training | 2 | 24 | Strongly recommended | 20 OS Disk 105 Data Disk |
The following table describes the required resources for small and average AI Center implementations. Note that these numbers are general guidance.
在此表格中,所有服务器节点都需要数据磁盘。代理节点不需要此操作。
Use | CPU | RAM (GiB) | GPU | Disk (GiB) |
---|---|---|---|---|
Small implementation: 3 models served 1 concurrent pipelines | 4 | 32 | 0 | 80 OS Disk 200 Data Disk |
Average implementation: 5 models served 2 concurrent pipelines DU model training | 8 | 52 | Strongly recommended | 150 OS Disk 300 Data Disk |
大约一年前更新