Xueyan Zou

xueyanz@ucsd.edu

About

I am currently a postdoctoral fellow at Contextual Robotics Institute in UC San Diego lead by Prof. Xiaolong Wang. Previously, I obtained Ph.D. degree at Computer Science Department in University of Wisconsin, Madison in 2024 Spring, fortunate to be supervised by Prof. Yong Jae Lee. During my PhD, I was grateful to closely working with Dr. Jianwei Yang in Microsoft Research. Prior to this, I started the doctoral jounrney at UC Davis, advised by the same supervisor and worked closely with Dr. Fanyi Xiao. Previously, I received my B.S. degree from Hong Kong Baptist University in 2018, during which I was fortunate to intern at CMU with Dr. Zhiding Yu.

My current research focuses are: (1) EmbodiedAI/Robotics: Navigation, Manipulation, and Perception. (2) Building Generalist Multimodal Foundation Models. (3) General Representation Learning (2D/3D).

Feel free to email me at xueyanzoucs AT gmail.com if you're interested in collaboration (open to undergraduates, graduates, institutions/companies globally).

Last Updated: Nov, 2024

News

Experience


Selected Publications

Project Image

New! Interfacing Foundation Models' Embeddings

Neural Information Processing Systems (NeurIPS), 2024
Xueyan Zou, Linjie Li, Jianfeng Wang, Jianwei Yang, Mingyu Ding, Junyi Wei, Zhengyuan Yang, Feng Li, Hao Zhang, Shilong Liu, Arul Aravinthan, Yong Jae Lee†, Lijuan Wang†
Project Image

New! Graspsplats: Efficient manipulation with 3d feature splatting

Conference on Robot Learning (CoRL), 2024
Mazeyu Ji*, Ri-Zhao Qiu*, Xueyan Zou, Xiaolong Wang
Project Image

🎈!! Set-of-mark prompting unleashes extraordinary visual grounding in gpt-4v

arXiv, 2023
Jianwei Yang*, Hao Zhang*, Feng Li*, Xueyan Zou*, Chunyuan Li, Jianfeng Gao
Project Image

Llava-plus: Learning to use tools for creating multimodal agents

European Conference on Computer Vision (ECCV), 2024
Shilong Liu, Hao Cheng, Haotian Liu, Hao Zhang, Feng Li, Tianhe Ren, Xueyan Zou, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang, Jianfeng Gao, Chunyuan Li
Project Image

LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Models

European Conference on Computer Vision (ECCV), 2024
Hao Zhang*, Hongyang Li*, Feng Li, Shilong Liu, Tianhe Ren, Xueyan Zou, Shilong Liu, Shijia Huang, Jianfeng Gao, Lei Zhang, Chunyuan Li, Jianwei Yang
Project Image

Semantic-SAM: Segment and Recognize Anything at Any Granularity

European Conference on Computer Vision (ECCV), 2024
Feng Li*, Hao Zhang*, Peize Sun, Xueyan Zou, Shilong Liu, Jianwei Yang⚑, Chunyuan Li, Lei Zhang†, Jianfeng Gao†
Project Image

Visual In-Context Prompting

Computer Vision and Pattern Recognition (CVPR), 2024
Feng Li*, Qing Jiang*, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Huaizhe Xu, Hongyang Li, Jianwei Yang, Chunyuan Li, Lei Zhang, Jianfeng Gao
Project Image

🎈!! Segment Everything Everywhere All-at-Once

Neural Information Processing Systems (NeurIPS), 2023
Xueyan Zou*, Jianwei Yang*⚑, Hao Zhang*, Feng Li*, Linjie Li, Jianfeng Wang, Lijuan Wang, Jianfeng Gao†, Yong Jae Lee†
Project Image

A Simple Framework for Open-Vocabulary Segmentation and Detection

International Conference on Computer Vision (ICCV), 2023
Hao Zhang*, Feng Li*, Xueyan Zou, Shilong Liu, Chunyuan Li, Jianfeng Gao, Jianwei Yang†, Lei Zhang†
X-Decoder Project

🎈!! Generalized Decoding for Pixel, Image, and Language

Computer Vision and Pattern Recognition (CVPR), 2023
Xueyan Zou*, Zi-Yi Dou*, Jianwei Yang*⚑, Zhe Gan, Linjie Li, Chunyuan Li, Xiyang Dai, Jianfeng Wang, Lu Yuan, Nanyun Peng, Lijuan Wang, Harkirat Behl, Yong Jae Lee†, Jianfeng Gao†
Edge Detection Project

End-to-End Instance Edge Detection

arXiv Preprint, 2022
Xueyan Zou, Haotian Liu, Yong Jae Lee
Video Inpainting Project

Progressive Temporal Feature Alignment Network for Video Inpainting

Computer Vision and Pattern Recognition (CVPR), 2021
Xueyan Zou, Linjie Yang, Ding Liu, Yong Jae Lee
Anti-Aliasing Project

🎈!! Delving Deeper into Anti-Aliasing in ConvNets

Proceedings of the British Machine Vision Conference (BMVC), 2020
International Journal of Computer Vision (IJCV), 2022
Xueyan Zou, Fanyi Xiao, Zhiding Yu, Yuheng Li♮, Yong Jae Lee
♮Only in IJCV
Best Paper Award of BMVC2020, Oral Presentation
IJCV invited special issue paper

Misc

  • Reviewer: ICLR23/24, ICCV22/23, CVPR23/24, AAAI22, ECCV22/24, NeurIPS2019/2020, BMVC2021, RA-L, IJCV, BioInfomatics
  • I also hold a PhD minor on Quantitative Biology at UW-Madison for interests.