Repository navigation

feat(evaluation): Add CJK tokenizer support for ROUGE-1 evaluation - #4143

Closed

maru0804 wants to merge 3 commits into

google:mainfrom

maru0804:fix/4122-cjk-rouge-tokenizer

Closed

feat(evaluation): Add CJK tokenizer support for ROUGE-1 evaluation#4143
maru0804 wants to merge 3 commits into
google:mainfrom
maru0804:fix/4122-cjk-rouge-tokenizer

Commits on Jan 13, 2026
- feat(evaluation): Add CJK tokenizer support for ROUGE-1 evaluation
  maru0804
  committed
  c00ef48
- refactor(evaluation): Simplify CJKTokenizer and optimize RougeScorer instantiation
  maru0804
  committed
  a5bae8d
Commits on Jan 25, 2026
- Merge branch 'main' into fix/4122-cjk-rouge-tokenizer
  maru0804
  authored
  73e2fad