Jiayuan Mao (茅佳源)

I am an undergraduate student at IIIS (YaoClass), Tsinghua University, majoring in computer science.

Currently, I am a visiting student of COCOSCI group at MIT, adviced by Prof. Josh Tenenbaum. I was a visiting student of CLVR group at USC during the spring and summer of 2017, adviced by Prof. Joseph Lim. I spent most of my undergraduate years being an intern researcher at Megvii Inc. (Face++), where my research career began. I also had a great time at Google AI China Center and Bytedance Inc. (Toutiao AI Lab).

I aim at building machines that can learn efficiently and generalize reliably as humans do. Towards this goal, my research focuses on structured knowledge representations that can be transferred among tasks and inductive biases that improve the learning efficiency and generalization. Specifically, my work centered around the task of learning concepts, skills, and rules from limited, noisy, and even biased data.

Research topics
  • Concept learning: visual-semantic representation [COLING18] [CVPR19], visually-grounded language acquisition [ICLR19a].
  • Skill learning: transfer learning in DRL [ICLR18].
  • Rule learning: neural inductive logic [ICLR19b].
  • Visual perception: [CVPR17] [ECCV18].

Publications (by date)

(* indicates equal contribution)

Unified Visual-Semantic Embeddings:
Bridging Vision and Language with Structured Meaning Representations
Hao Wu*, Jiayuan Mao*, Yufeng Zhang, Weiwei Sun, Yuning Jiang, Lei Li, Wei-Ying Ma

CVPR 2019 (Oral) [ArXiv]

The Neuro-Symbolic Concept Learner:
Interpreting Scenes, Words, and Sentences From Natural Supervision
Jiayuan Mao, Chuang Gan, Pushmeet Kohli, Joshua B. Tenenbaum, Jiajun Wu

ICLR 2019 (Oral) [OpenReview] [Project Page] [MIT News] [Technology Review]

Neural Logic Machines
Honghua Dong*, Jiayuan Mao*, Tian Lin, Chong Wang, Lihong Li, Denny Zhou

ICLR 2019 [OpenReview] [Project Page]

Acquisition of Localization Confidence for Accurate Object Detection
Borui Jiang*, Ruixuan Luo*, Jiayuan Mao*, Tete Xiao, Yuning Jiang

ECCV 2018 (Oral) [Arxiv] [Code]

Learning Visually-Grounded Sementics from Contrastive Adversarial Samples
Haoyue Shi*, Jiayuan Mao*, Tete Xiao*, Yuning Jiang, Jian Sun

COLING 2018 [Arxiv] [Code]

Universal Agent for Disentangling Environments and Tasks
Jiayuan Mao, Honghua Dong, Joseph J. Lim

ICLR 2018 [OpenReview] [Project Page]

What Can Help Pedestrian Detection?
Jiayuan Mao*, Tete Xiao*, Yuning Jiang, Zhimin Cao

CVPR 2017 [ArXiv]