Skip to content

feat: service支持多模型#36

Merged
YdrMaster merged 3 commits intoInfiniTensor:llama.cufrom
Ceng23333:dev/multi_model_0
Jun 12, 2025
Merged

feat: service支持多模型#36
YdrMaster merged 3 commits intoInfiniTensor:llama.cufrom
Ceng23333:dev/multi_model_0

Conversation

@Ceng23333
Copy link
Copy Markdown
Collaborator

No description provided.

pub struct ServiceArgs {
#[clap(flatten)]
base: BaseArgs,
#[clap(long)]
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

倒是也能命令行强行传,但是我觉得不如弄个配置文件吧,有格式的字符串会好看很多,而且未来应该会有大量配置可以传

@YdrMaster
Copy link
Copy Markdown
Contributor

YdrMaster commented Jun 11, 2025

另外 cargo fmt 没过


这几个 commit 合起来吧,代码量也不大

Signed-off-by: Ceng <441651826@qq.com>
@Ceng23333 Ceng23333 force-pushed the dev/multi_model_0 branch from acf1369 to 849d550 Compare June 11, 2025 11:39
@YdrMaster YdrMaster changed the base branch from llama.cu-dev to llama.cu June 11, 2025 23:15
@YdrMaster YdrMaster merged commit a154730 into InfiniTensor:llama.cu Jun 12, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants