I am a startup founder in artificial intelligence, with a variety of research and product experiences on autonomous driving, videos, cameras, maps, advertisements, etc. My research aims at building lifelong autonomous agents.
Previously, I worked at Google DeepMind, Baidu Apollo, Facebook AI Research, CMU Robotics, Apple, Google Streetview, and Comcast Labs DC. I received my Ph.D. in computer science from the University of Maryland College Park. My PhD thesis is spatial perception from visual and linguisitc information.
Publication
- Forget but Recall: Incremental Latent Rectification in Continual Learning. 2024. bib
- Building an open-vocabulary video CLIP model with better architectures, optimization and data. PAMI 2024. bib
- PolicyCleanse: Backdoor Detection and Mitigation for Competitive Reinforcement Learning. ICCV 2023. bib
- Transforming CLIP to an Open-vocabulary Video Model via Interpolated Weight Optimization. ICML 2023. bib
- Hyperspherical Federated Learning. ECCV 2022. bib
- Semi-Supervised Vision Transformers. ECCV 2022. bib
- Neural Mean Discrepancy for Efficient Out-of-Distribution Detection. CVPR 2022. bibtex
- Information-theoretic Online Memory Selection for Continual Learning. ICLR 2022. bibtex
- AEVA: Black-box Backdoor Detection Using Adversarial Extreme Value Analysis. ICLR 2022. code bibtex
- One Pass ImageNet. NeurIPS 2021 Workshop on ImageNet. bibtex
- Task-agnostic Continual Learning with Hybrid Probabilistic Models. ICML 2021 workshop. bibtex
- The Effectiveness of Memory Replay in Large Scale Continual Learning. CVPR 2021 Workshop on Continual Learning. bibtex
- PredCoin: Defense against Query-based Hard-label Attack. 2021.
- Learning to Incentivize Other Learning Agents. NeurIPS 2020. bibtex code
- SOLA: Continual Learning with Second-Order Loss Approximation. ICML 2020 Workshop on Continual Learning. bibtex
- The AVA-Kinetics Localized Human Actions Video Dataset. 2020. data bibtex
- Hybrid Models for Open Set Recognition. ECCV 2020 Oral. bibtex
- PhysGAN: Generating Physical-World-Resilient Adversarial Examples for Autonomous Driving. CVPR 2020. bibtex
- Orthogonal Gradient Descent for Continual Learning. AISTATS 2020. bibtex
- Prediction, Consistency, Curvature: Representation Learning for Locally-Linear Control. ICLR 2020. bibtex
- Improved Knowledge Distillation via Teacher Assistant. AAAI 2020. Bibtex
- Data Efficient Training for Reinforcement Learning with Adaptive Behavior Policy Sharing. NeurIPS 2019 workshop. bibtex
- Cross-View Policy Learning for Street Navigation. ICCV 2019. bibtex
- Improving Open Set Domain Adaptation Using Image-to-Image Translation. ICME 2019.
- Layout-induced Video Representation for Recognizing Agent-in-Place Actions. ICCV 2019. bibtex
- C-WSL: Count-guided Weakly Supervised Localization. ECCV 2018. bibtex
- NISP: Pruning Networks using Neuron Importance Score Propagation. CVPR 2018. bibtex
- Dynamic Zoom-in Network for Fast Object Detection in Large Images. CVPR 2018. bibtex
- Learning Visual N-Grams from Web Data. ICCV 2017. bibtex
- Visual Relationship Detection with Internal and External Linguistic Knowledge Distillation. ICCV 2017. bibtex
- Generating Holistic 3D Scene Abstractions for Text-based Image Retrieval. CVPR 2017. poster data code bibtex
- Towards Unified Data and Lifecycle Management for Deep Learning. ICDE 2017. bibtex
- On Model Discovery For Hosted Data Science Projects. SIGMOD 2017 workshop. bibtex
- Selective Encoding for Recognizing Unreliably Localized Faces. ICCV 2015 spotlight. youtube code bibtex
- Efficient Discriminative Nonorthogonal Binary Subspace with its Application to Visual Tracking. 2015. bibtex
- Planar Structure Matching Under Projective Uncertainty for Geolocation. ECCV 2014. youtube bibtex
- Object Tracking Using Learned Feature Manifolds. CVIU 2013. bibtex
- Bag of Textons for Image Segmentation via Soft Clustering and Convex Shift. CVPR 2012. bibtex
- Discriminative Nonorthogonal Binary Subspace Tracking. ECCV 2010. bibtex
Press Coverage
- Baidu Apollo Day: Expanded robotaxi operations and new autonomous driving software and hardware. Autonomous Driving International.
- Baidu Announces Plan to Build the World's Largest Fully Driverless Ride-Hailing Service Area in 2023. PR Newswire.
- DeepMind’s One Pass ImageNet: A New Benchmark for Resource Efficiency in Deep Learning. Synced Review
- ETA Prediction with Graph Neural Networks in Google Maps (Paper Explained). The AI Epiphany.
- An algorithm that evolved Starcraft bots is also training self-driving cars. MIT Technology Review
- Waymo and DeepMind mimic evolution to develop a new, better way to train self-driving AI. TechCrunch
- How evolutionary selection can train more capable self-driving cars. DeepMind Blog.
- Using automated data augmentation to advance our Waymo Driver. Waymo Blog
- How Google Maps uses DeepMind’s AI tools to predict your arrival time. The Verge.
- DeepMind claims its AI improved Google Maps travel time estimates by up to 50%. VentureBeat
- Traffic prediction with advanced Graph Neural Networks. DeepMind Blog
- DeepMind’s AI uses aerial and ground-view data to navigate unseen areas. VentureBeat
Academic Service
- Journal Reviewer:
- IEEE Transaction on Pattern Analysis and Machine Intelligence (TPAMI)
- IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
- IEEE Transaction on Image Processing (TIP)
- The Visual Computer Journal (TVCJ)
- SPIE Journal of Electronic Imaging (JEI)
- IEEE Transaction on Cybernetics
- Robotics and Autonomous Systems
- Machine Learning
- Session Chair:
- International Joint Conference on Artificial Intelligence (IJCAI) 2021
- Area Chair:
- NeurIPS Workshop on Meta Learning 2021
- NeurIPS Workshop on Meta Learning 2022
- Senior Program Committee:
- AAAI Conference on Artificial Intelligence (AAAI) 2021
- International Joint Conference on Artificial Intelligence (IJCAI) 2020, 2021
- International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) 2020
- Program Committee:
- International Conference on Learning Representations (ICLR)
- Annual Conference on Neural Information Processing Systems (NeurIPS)
- IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- International Conference on Machine Learning (ICML)
- IEEE International Conference on Computer Vision (ICCV)
- European Conference on Computer Vision (ECCV)
- International Joint Conference on Artificial Intelligence (IJCAI)
- International Conference on Artificial Intelligence and Statistics (AISTATS)
- ACM International Conference on Multimedia (MM)