Jiayuan Mao (茅佳源)

I am an undergraduate student of the YaoClass, Tsinghua University, majoring in computer science.

Currently, I am a visiting student of the COCOSCI group at MIT, adviced by Prof. Josh Tenenbaum. Previously, I was a visiting student at USC, adviced by Prof. Joseph Lim. I spent most of my undergraduate years being an research intern at Megvii Inc. (Face++), where my research career began. I have also spent time at Google AI China Center and Bytedance AI Lab.

I aim at building machines that can learn efficiently and generalize reliably as humans do. Towards this goal, my research focuses on structured knowledge representations that can be transferred among tasks and inductive biases that improve the learning efficiency and generalization.

Research Highlights
  • Concept learning: visual concept learning, neuro-symbolic reasoning, neural inductive logic, structure inference.
  • Skill learning: transfer learning in DRL.
  • Language development: grounded language acquisition and emergence.
Publications ( show selected / show all by date / show all by topic )

Topics: Concept Learning / Skill Learning / Language Development / Vision / NLP (* indicates equal contribution)

Visually Grounded Neural Syntax Acquisition
Haoyue Shi*, Jiayuan Mao*, Kevin Gimpel, Karen Livescu

ACL 2019 (To Appear)

Neurally-Guided Structure Inference
Sidi Lu*, Jiayuan Mao*, Joshua B. Tenenbaum, Jiajun Wu

ICML 2019 (To Appear)

Unified Visual-Semantic Embeddings:
Bridging Vision and Language with Structured Meaning Representations
Hao Wu*, Jiayuan Mao*, Yufeng Zhang, Weiwei Sun, Yuning Jiang, Lei Li, Wei-Ying Ma

CVPR 2019 (Oral) Paper

The Neuro-Symbolic Concept Learner:
Interpreting Scenes, Words, and Sentences From Natural Supervision
Jiayuan Mao, Chuang Gan, Pushmeet Kohli, Joshua B. Tenenbaum, Jiajun Wu

ICLR 2019 (Oral) Paper / Project Page / Code / MIT News / MIT Technology Review

Neural Logic Machines
Honghua Dong*, Jiayuan Mao*, Tian Lin, Chong Wang, Lihong Li, Dengyong Zhou

ICLR 2019 Paper / Project Page / Code

Neural Phrase-to-Phrase Machine Translation
Jiangtao Feng, Lingpeng Kong, Po-Sen Huang, Chong Wang, Da Huang, Jiayuan Mao, Kan Qiao, Dengyong Zhou

ArXiv Preprint Paper

Acquisition of Localization Confidence for Accurate Object Detection
Borui Jiang*, Ruixuan Luo*, Jiayuan Mao*, Tete Xiao, Yuning Jiang

ECCV 2018 (Oral) Paper / Code

Learning Visually-Grounded Sementics from Contrastive Adversarial Samples
Haoyue Shi*, Jiayuan Mao*, Tete Xiao*, Yuning Jiang, Jian Sun

COLING 2018 Paper / Code

Universal Agent for Disentangling Environments and Tasks
Jiayuan Mao, Honghua Dong, Joseph J. Lim

ICLR 2018 Paper / Project Page

What Can Help Pedestrian Detection?
Jiayuan Mao*, Tete Xiao*, Yuning Jiang, Zhimin Cao

CVPR 2017 Paper