
Jyoti Kini
Graduate Research Assistant
Center for Research in Computer Vision
University of Central Florida
4328 Scorpius St., HEC Suite 249
Orlando, FL 32816-2365
Email: jyoti.kini@ucf.edu
CV | Google Scholar | LinkedIn | GitHub
I am a graduating Ph.D. candidate working with the Center for Research in Computer Vision (CRCV) lab under the mentorship of Prof. Mubarak Shah. My research primarily focuses on 2D/3D scene understanding, including detection, segmentation, and tracking across both camera-based data and point clouds. My recent work also explores equivariant representation learning in diffusion models. Additionally, I have worked on vision-language modeling for 3D object detection, driven by human intent, using large language models (LLMs). During my recent internship at Waymo, I contributed to multimodal self-supervised temporal representation learning through future frame prediction in Bird’s-Eye View (BEV), advancing key downstream tasks such as occupancy prediction, semantic segmentation, and object detection.
As a part of my research experience with the CRCV lab, I had the opportunity to mentor incoming students in the NSF-Funded Research Experience for Undergraduate (REU) program. Additionally, as a Graduate Teaching Assistant (GTA), I have conducted programming labs for undergraduate students. Also, I have provided periodic assistance with maintaining the CRCV website.

Research Intern
Waymo LLC, Mountain View, California, USA | May 2024 – Aug 2024
Hosts: Daniel Cai, Safa Cicek (Perception Sensor Fusion Team)
Temporal Representation Learning via Bird’s-Eye View (BEV) Future Frame Prediction
Research Intern
SRI International, Princeton, New Jersey, USA (Remote) | May 2022 – Aug 2022
Host: Bogdan Matei
Weak Supervision-based Point Cloud Semantic Segmentation, 3D Point Cloud Compression

Intent3D: 3D Object Detection in RGB-D Scans Based on Human Intention
ICLR 2025
Weitai Kang, Mengxue Qu, Jyoti Kini, Yunchao Wei, Mubarak Shah, Yan Yan
[Paper]

ER-DDPMs: Towards Equivariant Representations in Diffusion Models
Arxiv 2024
Jyoti Kini, Navid Kardan, Mubarak Shah
[Paper]

CT-VOS: Cutout Prediction and Tagging for Self-Supervised Video Object Segmentation
CVIU 2023
Jyoti Kini, Fahad Shahbaz Khan, Salman Khan, Mubarak Shah
[Paper]
- Teaching Assistant: COP3502 – Data Structures and Algorithms (Spring 2021)
- Teaching Assistant: COP3223 – Introduction to Programming with C (Fall 2020)
- IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
- Conference on Neural Information Processing Systems (NeurIPS)
- Selected as the recipient of UCF Graduate Dean’s Dissertation Completion Fellowship (2024)
- Secured first place in the ICIAP Competition on Multimodal Action Recognition on the MECCANO Dataset (2023)
- Received ICRA RAS Travel Grant from ICRA Travel Grant Committee (2023)
- Granted Graduate Presentation Fellowship by UCF College of Graduate Studies (2023)
- Received Conference Registration & Travel funding from UCF Student Government (2022)
- Won Stanford’s JackRabbot Dataset 3D Tracking Competition (2021)
- Awarded the ORC Fellowship during my first year as a Ph.D. student with UCF (2018)