Skip to main content

Jyoti Kini

Graduate Research Assistant
Center for Research in Computer Vision
University of Central Florida
4328 Scorpius St., HEC Suite 249
Orlando, FL 32816-2365

Email: jyoti.kini@ucf.edu
CV | Google Scholar | LinkedIn | GitHub

Research

I am a graduating Ph.D. candidate working with the Center for Research in Computer Vision (CRCV) lab under the mentorship of Prof. Mubarak Shah. My research primarily focuses on 2D/3D scene understanding, including detection, segmentation, and tracking across both camera-based data and point clouds. My recent work also explores equivariant representation learning in diffusion models. Additionally, I have worked on vision-language modeling for 3D object detection, driven by human intent, using large language models (LLMs). During my recent internship at Waymo, I contributed to multimodal self-supervised temporal representation learning through future frame prediction in Bird’s-Eye View (BEV), advancing key downstream tasks such as occupancy prediction, semantic segmentation, and object detection.

As a part of my research experience with the CRCV lab, I had the opportunity to mentor incoming students in the NSF-Funded Research Experience for Undergraduate (REU) program. Additionally, as a Graduate Teaching Assistant (GTA), I have conducted programming labs for undergraduate students. Also, I have provided periodic assistance with maintaining the CRCV website.

Work Experience

Research Intern
Waymo LLC, Mountain View, California, USA | May 2024 – Aug 2024
Hosts: Daniel Cai, Safa Cicek (Perception Sensor Fusion Team)
Temporal Representation Learning via Bird’s-Eye View (BEV) Future Frame Prediction

Research Intern
SRI International, Princeton, New Jersey, USA (Remote) | May 2022 – Aug 2022
Host: Bogdan Matei
Weak Supervision-based Point Cloud Semantic Segmentation, 3D Point Cloud Compression

Recent Publications

Intent3D: 3D Object Detection in RGB-D Scans Based on Human Intention
ICLR 2025
Weitai Kang, Mengxue Qu, Jyoti Kini, Yunchao Wei, Mubarak Shah, Yan Yan
[Paper]

ER-DDPMs: Towards Equivariant Representations in Diffusion Models
Arxiv 2024
Jyoti Kini, Navid Kardan, Mubarak Shah
[Paper]

CT-VOS: Cutout Prediction and Tagging for Self-Supervised Video Object Segmentation
CVIU 2023
Jyoti Kini, Fahad Shahbaz Khan, Salman Khan, Mubarak Shah
[Paper]

Ensemble Modeling for Multimodal Visual Action Recognition
ICIAP-W 2023
Jyoti Kini, Sarah Fleischer, Ishan Dave, Mubarak Shah
[Paper] [Project] [Code]

3DMODT: Attention-Guided Affinities for Joint Detection & Tracking in 3D Point Clouds
ICRA 2023
Jyoti Kini, Ajmal Mian, Mubarak Shah
[Paper] [Project]

Self Supervised Learning for Multiple Object Tracking in 3D Point Clouds
IROS 2022
Aakash Kumar, Jyoti Kini, Ajmal Mian, Mubarak Shah
[Paper] [Project]

Tag-Based Attention Guided Bottom-Up Approach for Video Instance Segmentation
ICPR 2022
Jyoti Kini, Mubarak Shah
[Paper] [Poster]

PC-DAN: Point Cloud-based Deep Affinity Network for 3D Multi-Object Tracking
CVPR-W 2021
Aakash Kumar, Jyoti Kini, Mubarak Shah, Ajmal Mian
[Paper] [Slides]

Florida Wildlife Camera Trap Dataset
CVPR-W 2021
Crystal Gagne, Jyoti Kini, Daniel Smith, Mubarak Shah
[Paper] [Project]

Mentoring

REU 2023

Sarah Fleischer
University of Central Florida       

REU 2021

Robert Lake
        University of Virginia               

REU 2020

Matthew Alighchi
University of Nevada, Reno       

REU 2019

Alex Ruiz Irene
University of Puerto Rico at Bayamon
Teaching
  • Teaching Assistant: COP3502 – Data Structures and Algorithms (Spring 2021)
  • Teaching Assistant: COP3223 – Introduction to Programming with C (Fall 2020)
Reviewer
  • IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  • IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
  • Conference on Neural Information Processing Systems (NeurIPS)
Recognitions
  • Selected as the recipient of UCF Graduate Dean’s Dissertation Completion Fellowship (2024)
  • Secured first place in the ICIAP Competition on Multimodal Action Recognition on the MECCANO Dataset (2023)
  • Received ICRA RAS Travel Grant from ICRA Travel Grant Committee (2023)
  • Granted Graduate Presentation Fellowship by UCF College of Graduate Studies (2023)
  • Received Conference Registration & Travel funding from UCF Student Government (2022)
  • Won Stanford’s JackRabbot Dataset 3D Tracking Competition (2021)
  • Awarded the ORC Fellowship during my first year as a Ph.D. student with UCF (2018)