Cognitive Learning for Vision and Robotics Lab

The Cognitive Learning for Vision and Robotics lab (CLVR) at the University of Southern California is led by Professor Joseph J. Lim. Our goal is to develop intelligent systems that are capable of not only perceiving the world but also reasoning and interacting with it. We are especially interested in building a cognitive model that can learn to make plausible decisions given multi-modal data from the surroundings. Our research spans topics like robotics, computer vision, reinforcement learning, and deep learning.


We are seeking several Ph.D. students to join the lab in 2022 to work on related topics. Ph.D. positions will begin in August 2021 and the application deadline is December 15, 2021. If interested, please apply to the Computer Science Department at the University of Southern California via the application website and specifically mention Professor Joseph Lim in your application. Current USC students can apply at: UG & MS.


News

  • Three papers are accepted to CoRL 2021!
  • Our paper on policy transfer across visual and dynamics gaps is accepted to RSS 2021!
  • One paper is accepted to ICML 2021!
  • Our IKEA Furniture Assembly Environment is accepted to ICRA 2021!
  • SPiRL is selected as a plenary talk and won the best paper presentation award at CoRL 2020!
  • Two papers are accepted to CoRL 2020!
  • Paper on generalization to new actions is accepted to ICML 2020!
  • Two papers are accepted to ICLR 2020!
  • We released IKEA Furniture Assembly Environment for a complex robot manipulation benchmark.
  • Our paper on imitation learning from observation is accepted to CoRL 2019!
  • Our paper on multimodal meta-learning is accepted to NeurIPS 2019!
  • Deepak Pathak from UC Berkeley gave a talk as part of the CLVR Speaker Series.
  • Paper on complex skill composition accepted to ICLR 2019!
  • Kuan Fang from the Stanford Vision Lab gave a talk as part of the CLVR Speaker Series.
  • Tianmin Shu from UCLA gave a talk as part of the CLVR Speaker Series.
  • Yuke Zhu from the Stanford Vision Lab gave a talk as part of the CLVR Speaker Series.
  • Andrew Owens from UC Berkeley gave a talk as part of the CLVR Speaker Series.
  • Paper on novel-view synthesis accepted to ECCV 2018!
  • Paper on neural program synthesis accepted to ICML 2018!
  • Jiajun Wu from MIT gave a talk as part of the CLVR Speaker Series.
  • Paper on object affordance reasoning accepted to CVPR 2018!
  • Carl Vondrick from Google gave a talk as part of the CLVR Speaker Series.
  • Paper on agents that disentangle environment and task accepted to ICLR 2018!
  • Jimmy Ba from UToronto gave a talk as part of the CLVR Speaker Series.
  • Phillip Isola from OpenAI gave a talk as part of the CLVR Speaker Series.
  • Paper on multi-modal imitation learning accepted to NIPS 2017!