Recent highlights

• 🎉🎉[December, 2023] We present Merlin, the first end-to-end multimodal large language model that supports video-level visual localization (including tracking, video recognition, video registration, etc.) and future reasoning.
• 🎉🎉[July, 2023] Our paper Grounded Image Text Matching with Mismatched Relation Reasoning has been accepted to ICCV 2023.

Selected publications

• 

  Merlin: Empowering Multimodal LLMs with Foresight Minds

  En Yu*, Liang Zhao*, Yana Wei, Jinrong Yang, Dongming Wu, Lingyu Kong, Haoran Wei, Tiancai Wang, Zheng Ge, Xiangyu Zhang, Wenbing Tao

  [Project Page] [Paper]

• 

  Grounded Image Text Matching with Mismatched Relation Reasoning

  Yu Wu*, Yana Wei*, Haozhe Wang, Yongfei Liu, Sibei Yang, Xuming He

  ICCV 2023

  [Project Page] [Paper] [Suppl] [Code] [Video]

Awards

• Third Prize, 11th National College Student Mathematics Competition, 2019
• First Prize, 17th Shandong Province College Student Software Design Competition, 2019
• First Prize, 2019 National College Student Mathematical Modeling Competition, 2019
• Second Prize, 7th "Teddy Cup" National Data Mining Challenge, 2019

Singing Videos