-
Notifications
You must be signed in to change notification settings - Fork 197
Open
Labels
questionFurther information is requestedFurther information is requested
Description
Basic Information - Models Used
MiniMax-M2
Description
已经下载好的模型如何本地启动呢?
我使用
SAFETENSORS_FAST_GPU=1 vllm serve /home/user/workspace/MiniMax-M2.5 --trust-remote-code --enable_expert_parallel --tensor-parallel-size 8 --enable-auto-tool-choice --tool-call-parser minimax_m2 --reasoning-parser minimax_m2_append_think --served-model-name MiniMax-M2.5 --port 43383 启动的时候报错
Error retrieving safetensors: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/home/user/workspace/MiniMax-M2.5". Use 'repo_type' argument if needed., retrying 1 of 2
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
questionFurther information is requestedFurther information is requested