The First ChineseBabyLM Challenge: training data-efficient and cognitively plausible language models for Chinese

arXiv:2607.10745 · cs.CL · Submitted 2026-08-17 · Read on arXiv

Siyuan Song, Zhiheng Qian, Yunhao Zhang, Linyang He, Xiaozhe Ji, Yingxin Lin, Hongao Zhu, Chongtian Shao, Chuhan Lang, Luan Li, Rui Wang, Renfen Hu, Shaonan Wang, Hai Hu

cs.CL

Submitted: 2026-08-17

Updated: 2026-08-18

Comments: 8 pages, 4 tables; work in progress

Code: https://github.com/fxsjy/jieba

Project page: https://chinese-babylm.github.io

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Benchmark — 12× in this paper · explained in 2 episodes
Alignment — 4× in this paper · explained in 1 episode
Fine-Tuning — 4× in this paper · explained in 5 episodes
Natural Language Understanding — 4× in this paper
Transformer — 4× in this paper · explained in 2 episodes
Generalization — 2× in this paper · explained in 13 episodes
Accuracy — 1× in this paper · explained in 1 episode
Adam — 1× in this paper · explained in 2 episodes
Cross-lingual Transfer — 1× in this paper · explained in 2 episodes
Downstream Tasks — 1× in this paper · explained in 2 episodes
Grounding — 1× in this paper · explained in 3 episodes
Perplexity — 1× in this paper · explained in 3 episodes
Semantic Similarity — 1× in this paper · explained in 2 episodes
Semantic Understanding — 1× in this paper · explained in 2 episodes
Tokenization — 1× in this paper · explained in 2 episodes
Transfer Learning — 1× in this paper · explained in 10 episodes
Visual Grounding — 1× in this paper · explained in 2 episodes

Sources

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Terminology

Sources

Related papers