Skip to main content

Jyoti Kini

Applied Research Scientist
Mila – Quebec Artificial Intelligence Institute
6666 Saint-Urbain Street, Suite 200,
Montreal, QC, H2S 3H1

Email: jyotikini03@gmail.com
CV | Google Scholar | LinkedIn | GitHub

Research

I am an Applied Research Scientist at Mila – Quebec Artificial Intelligence Institute. I received my Ph.D. in 2025 from the Center for Research in Computer Vision at the University of Central Florida (UCF), advised by Prof. Mubarak Shah. My research focuses on 2D/3D scene understanding, including detection, segmentation, and tracking across camera and LiDAR data. My recent work also explores autonomy in firefighting using drones, vision-language modeling for 3D visual grounding, equivariant representation learning for diffusion models, LLM evaluation, and self-improving agents. Prior to Mila, I worked as a Senior Research Engineer in Prediction/Planning at PlusAI. Earlier, during my internship at Waymo, I worked on multimodal self-supervised temporal representation learning in Bird’s-Eye View (BEV), contributing to key downstream tasks such as occupancy prediction, semantic segmentation, and object detection, with this work filed for patent review. I have served as a reviewer for NeurIPS, ICCV, WACV, and IROS, and I am a recipient of the UCF Graduate Dean’s Dissertation Completion Fellowship and the ORC Fellowship. I have also mentored students through the NSF-funded Research Experiences for Undergraduates (REU) program.

Work Experience

Applied Research Scientist
Mila – Quebec Artificial Intelligence Institute, Montreal, Quebec, Canada | Jan 2026 – Present
Manager: Gaétan Marceau Caron (Applied Machine Learning Research Team)
LLM Evaluation and RAG Systems for Healthcare and Banking Applications

Senior Research Engineer
PlusAI, Santa Clara, California, USA | May 2025 – Jan 2026
Manager: Amit Kumar (Prediction/Planning)
Multi-Agent Trajectory Prediction and Planning-Oriented End-to-End Autonomy

Research Intern
PlusAI, Santa Clara, California, USA | Mar 2025 – May 2025
Host: Amit Kumar (Prediction/Planning)
BEV Feature Fusion with Agent and Lane Encodings for Map-Aware Trajectory Forecasting

Research Intern
Waymo LLC, Mountain View, California, USA | May 2024 – Aug 2024
Hosts: Daniel Cai, Safa Cicek (Perception Sensor Fusion Team)
Temporal Representation Learning via Bird’s-Eye View (BEV) Future Frame Prediction

Research Intern
SRI International, Princeton, New Jersey, USA (Remote) | May 2022 – Aug 2022
Host: Bogdan Matei
Weak Supervision-based Point Cloud Semantic Segmentation, 3D Point Cloud Compression

Recent Publications

Cross-View Open-Vocabulary Object Detection in Aerial Imagery
Arxiv 2025
Jyoti Kini, Rohit Gupta, Mubarak Shah
[Paper]

Intent3D: 3D Object Detection in RGB-D Scans Based on Human Intention
ICLR 2025
Weitai Kang, Mengxue Qu, Jyoti Kini, Yunchao Wei, Mubarak Shah, Yan Yan
[Paper]

ER-DDPMs: Towards Equivariant Representations in Diffusion Models
Arxiv 2024
Jyoti Kini, Navid Kardan, Mubarak Shah
[Paper]

CT-VOS: Cutout Prediction and Tagging for Self-Supervised Video Object Segmentation
CVIU 2023
Jyoti Kini, Fahad Shahbaz Khan, Salman Khan, Mubarak Shah
[Paper]

Ensemble Modeling for Multimodal Visual Action Recognition
ICIAP-W 2023
Jyoti Kini, Sarah Fleischer, Ishan Dave, Mubarak Shah
[Paper] [Project] [Code]

3DMODT: Attention-Guided Affinities for Joint Detection & Tracking in 3D Point Clouds
ICRA 2023
Jyoti Kini, Ajmal Mian, Mubarak Shah
[Paper] [Project]

Self Supervised Learning for Multiple Object Tracking in 3D Point Clouds
IROS 2022
Aakash Kumar, Jyoti Kini, Ajmal Mian, Mubarak Shah
[Paper] [Project]

Tag-Based Attention Guided Bottom-Up Approach for Video Instance Segmentation
ICPR 2022
Jyoti Kini, Mubarak Shah
[Paper] [Poster]

PC-DAN: Point Cloud-based Deep Affinity Network for 3D Multi-Object Tracking
CVPR-W 2021
Aakash Kumar, Jyoti Kini, Mubarak Shah, Ajmal Mian
[Paper] [Slides]

Florida Wildlife Camera Trap Dataset
CVPR-W 2021
Crystal Gagne, Jyoti Kini, Daniel Smith, Mubarak Shah
[Paper] [Project]

Mentoring

REU 2023

Sarah Fleischer
University of Central Florida       

REU 2021

Robert Lake
        University of Virginia               

REU 2020

Matthew Alighchi
University of Nevada, Reno       

REU 2019

Alex Ruiz Irene
University of Puerto Rico at Bayamon
Teaching
  • Teaching Assistant: COP3502 – Data Structures and Algorithms (Spring 2021)
  • Teaching Assistant: COP3223 – Introduction to Programming with C (Fall 2020)
Reviewer
  • IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  • IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
  • Conference on Neural Information Processing Systems (NeurIPS)
  • International Conference on Computer Vision (ICCV)
Recognitions
  • Selected as the recipient of UCF Graduate Dean’s Dissertation Completion Fellowship (2024)
  • Secured first place in the ICIAP Competition on Multimodal Action Recognition on the MECCANO Dataset (2023)
  • Received ICRA RAS Travel Grant from ICRA Travel Grant Committee (2023)
  • Granted Graduate Presentation Fellowship by UCF College of Graduate Studies (2023)
  • Received Conference Registration & Travel funding from UCF Student Government (2022)
  • Won Stanford’s JackRabbot Dataset 3D Tracking Competition (2021)
  • Awarded the ORC Fellowship during my first year as a Ph.D. student with UCF (2018)