Skip to content

update auto router to eval#90

Open
cxf2015 wants to merge 1 commit intoRouteWorks:mainfrom
cxf2015:main
Open

update auto router to eval#90
cxf2015 wants to merge 1 commit intoRouteWorks:mainfrom
cxf2015:main

Conversation

@cxf2015
Copy link
Copy Markdown

@cxf2015 cxf2015 commented Mar 26, 2026

/evaluate

@cxf2015
Copy link
Copy Markdown
Author

cxf2015 commented Mar 26, 2026

/evaluate

@cxf2015
Copy link
Copy Markdown
Author

cxf2015 commented Mar 26, 2026

image hi @jiarong0907 @yl231 @jqxue1999 When evaluating,there is no space left, could you handle that?

@jiarong0907
Copy link
Copy Markdown
Contributor

image hi @jiarong0907 @yl231 @jqxue1999 When evaluating,there is no space left, could you handle that?

This is more likely a github issue. Could you retry?

@cxf2015
Copy link
Copy Markdown
Author

cxf2015 commented Mar 27, 2026

/evaluate

@github-actions
Copy link
Copy Markdown

Router Evaluation Results

Router: auto_router
Dataset Split: full

RouterArena Metrics

Metric Value
RouterArena Score 0.7005
Accuracy 70.17%
Total Cost $1.045217
Avg Cost per Query $0.000124
Avg Cost per 1K Queries $0.1244
Number of Queries 8400
Robustness Score 0.4952

Optimality Metrics

Metric Value
Opt.Sel (Optimal Selection) 0.4377
Opt.Cost (Cost Efficiency) 0.4229
Opt.Acc (Accuracy vs Optimal) 1.0000

Evaluation completed by RouterArena automated workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants