N. SinhaResearcher

Personal Site / Research Profile

Nilotpal
Sinha

Senior AI Researcher at Dolby Laboratories (ATG)

Building an adaptive multimodal data platform that continuously learns from incoming data and employs agentic AI to deliver personalized content and recommendations.

Previously, I worked as a post-doctoral researcher at the CVI2 Lab, University of Luxembourg. Here, I focused on designing Hardware Aware Neural Architecture Search (HW-NAS) algorithms for automatically creating AI models, optimized for edge devices with low power consumption, in space applications.

PhD in Computer Science (2022), National Yang Ming Chiao Tung University, under Prof. Kuan-Wen Chen (COVIS Lab). Doctoral work: efficient Neural Architecture Search that cuts search cost and time.

Research Interests

Artificial Intelligence, Multi-Modal AI, Agentic AI, AutoML, Evolutionary Computation

Programming Languages

Python, Matlab, C++, C, Assembly language · ML frameworks: pytorch, tensorflow · HTML, Javascript

Portrait of Nilotpal Sinha

01 — Vita

Education

  • PhD. in Computer Science (2017 – 2022)

    National Yang Ming Chiao Tung University, Taiwan

    ↪ Doctoral thesis on Neural Architecture Search (NAS) — algorithms that automatically design neural network architectures for a given task. For published papers, see the NAS page.

  • Masters in Electrical Engineering (2015 – 2017)

    National Cheng Kung University, Taiwan

    ↪ Master’s thesis: signal processing algorithm for processing the 3D heart pulse.

  • Bachelor in Electrical Engineering (2009 – 2013)

    National Institute of Technology, Silchar, India

Awards

  • Recipient of 2017 Mediatek Inc. ASEAN South Asia “Taiwan Advanced Study Fellowship”. (link)
  • Recipient of Scholarship for Outstanding New Student Award, National Yang Ming Chiao Tung University, Hsinchu City, Taiwan
  • Recipient of NCKU Distinguished International Student Scholarship, National Cheng Kung University, Tainan, Taiwan

Activities

02 — Career

Work Experience

  • Senior Researcher (October 2024 – Present)

    Advanced Research Group (ATG), Dolby Laboratories, Bengaluru, India

    ↪ Leading the development of core component in Dolby’s data platform for continual adaptation of multimodal foundation models from newly arriving datasets, resulting in novel research contributions published at ICML 2026.
    ↪ Leading the development of an agentic AI personalization system for an immersive user experience, resulting in the filing of 2 patents.
    ↪ Led the development of a scalable platform backbone that connects independently developed AI services through automated discovery and communication.
    ↪ Led intern recruitment and mentorship, leading to multiple research publications at CVPR 2026, ICML 2026. I am also part of the technical recruitment team for the Senior AI Researcher roles.

  • Senior Edge Applications Research Engineer (July 2024 – September 2024)

    Advanced Research Group (ATG), Dolby Laboratories, Bengaluru, India

    ↪ Led a team to create a hybrid on-prem/cloud compute platform, driving 95%+ experiment reproducibility through pinned dependencies and containerized workflows.
    ↪ Collaborated with researchers to design a system for deploying AI models across diverse edge devices, reducing deployment time from 3 weeks to 1 week.

  • Postdoctoral Researcher (November 2022 – July 2024)

    CVI2 Lab, University of Luxembourg

    ↪ HW-NAS algorithms for edge devices (Raspberry Pi, etc.) for space applications.
    ↪ Published in WACV 2024 and CVPR Workshop 2024.
    ↪ Mentoring PhD student — full-length paper in WACV 2025.
    ↪ Teaching Computer Vision and AI on edge devices.

  • Software Engineer Intern (January 2022 – June 2022)

    Microsoft, Taiwan

    ↪ Algorithms that automatically design DNN architectures for multiple tasks.
    ↪ Objective: architectures that perform well across more than one task.

  • Research Assistant in Luo Lab (February 2017 – May 2017)

    National Cheng Kung University, Taiwan

    ↪ Mathematical model for analysing the 3D heart pulse — paper.

03 — Research Output

Selected Publications

Checkout my Google Scholar for full list of papers.

Multi-Modal AI papers

1. Avi Gupta, Nilotpal Sinha, Vishnu Raj, Sambuddha Saha, Pratik Joshi, Koteswar Rao Jerripothula, “Generalizing Multimodal Foundational Models in Context-Driven Class Incremental Learning”, WACV 2027 (Under Review).
2. Avi Gupta, Nilotpal Sinha, Vishnu Raj, Sambuddha Saha, Pratik Joshi, Koteswar Rao Jerripothula, “Listen, Look, and Learn: Learning Without Forgetting in SAM-Audio”, ICML Workshop 2026. Workshop: Continual Adaptation at Scale: Towards Sustainable AI. [paper]
3. Xiyang Wu, Zongxia Li, Jihui Jin, Guangyao Shi, Gouthaman KV, Vishnu Raj, Nilotpal Sinha, Jingxi Chen, Fan Du, Dinesh Manocha, “MASS: Motion-Aware Spatial-Temporal Grounding for Physics Reasoning and Comprehension in Vision-Language Models”, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026. [paper]

EdgeAI related papers

1. Peyman Rostami, Nilotpal Sinha, Nidhaleddine Chenni, Anis Kacem, Abd El Rahman Shabayek, Carl Shneider, Djamila Aouada, “Information Theoretic Pruning of Coupled Channels in Deep Neural Networks”, IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2025. [paper]
2. Nilotpal Sinha, Peyman Rostami, Abd El Rahman Shabayek, Anis Kacem, Djamila Aouada, “Multi-Objective Hardware Aware Neural Architecture Search using Hardware Cost Diversity”, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshop 2024. Workshop: Efficient Deep Learning for Computer Vision. [paper]
3. Nilotpal Sinha, Abd El Rahman Shabayek, Anis Kacem, Peyman Rostami, Carl Shneider, Djamila Aouada, “Hardware Aware Evolutionary Neural Architecture Search using Representation Similarity Metric”, IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024. [paper] [Video]

Neural Architecture Search related papers

1. Nilotpal Sinha, Kuan-Wen Chen, “Neural Architecture Search using Covariance Matrix Adaptation Evolution Strategy”. Evolutionary Computation (MIT Press) 2023 (Impact Factor: 6.8). [paper] [arXiv] [code]
2. Nilotpal Sinha, Kuan-Wen Chen, “Novelty Driven Evolutionary Neural Architecture Search", ACM SIGEVO Genetic and Evolutionary Computation Conference (GECCO) 2022. [paper] [arXiv] [code] [Video]
3. Nilotpal Sinha, Kuan-Wen Chen, “Neural Architecture Search using Progressive Evolution", ACM SIGEVO Genetic and Evolutionary Computation Conference (GECCO) 2022. [paper] [arXiv] [code] [Video]
4. Nilotpal Sinha, Kuan-Wen Chen, “Evolving Neural Architecture Using One Shot Model", ACM SIGEVO Genetic and Evolutionary Computation Conference (GECCO) 2021. [paper] [code] [Video]

Bio-Medical Signal Processing related paper

1. Bo Peng, Ching-Hsing Luo, Nilotpal Sinha, Cheng-Chi Tai, Xiaohua Xie and Haiqing Xie, “Fourier Series Analysis for Novel Spatiotemporal Pulse Waves: Normal, Taut, and Slippery Pulse Images”, Evidence-based Complementary and Alternative Medicine, Volume 2019 (Impact Factor: 2.06). [paper]

Signal Processing related papers

1. S K Singh, D Kumari, Nilotpal Sinha, A K Goswami, N Sinha “Gravity Search Algorithm hybridized Recursive Least Square method for power system harmonic estimation”, Engineering Science and Technology, an International Journal (Elsevier), DOI- 10.1016/j.jestch.2017.01.006, 2017. (Impact Factor: 5.7). [paper]
2. S. K. Singh, Nilotpal Sinha, A. K. Goswami, N. Sinha, “Robust Estimation of Power System Harmonics Using a Hybrid Firefly Based Recursive Least Square Algorithm”, International Journal of Electrical Power and Energy Systems (IJEPES) (Elsevier) Journal, Elsevier, vol. 80, Issue C, Pages 287 – 296, 2016. (Impact Factor: 5.2) [paper]
3. S. K. Singh, Nilotpal Sinha, A. K. Goswami, N. Sinha, “Several Variants of Kalman Filter Algorithm for Power System Harmonic Estimation”, International Journal of Electrical Power and Energy Systems (IJEPES) (Elsevier), Vol. 78, issue C, Pages 793 - 800, 2016. (Impact Factor: 5.2) [paper]

04 — Side Work

Personal Projects

Neural network visualization

Neural Architecture Search

  • Algorithms for automatically searching deep neural network architectures for image classification, implemented in Python and PyTorch.
  • Evolving Neural Architecture Using One Shot Model, ACM SIGEVO GECCO 2021.
  • Progressive Evolutionary Neural Architecture Search, ACM SIGEVO GECCO 2022.
  • Novelty Driven Evolutionary Neural Architecture Search, ACM SIGEVO GECCO 2022.
  • Neural Architecture Search using Covariance Matrix Adaptation Evolution Strategy, Evolutionary Computation (MIT Press) 2023.
Drone in flight

Drone Go

  • Control a Parrot AR Drone 2.0 to follow an object of particular color using the Median Flow tracker from OpenCV.
  • PID controller for drone movement.
  • Communication architecture for Facebook status/stop and local-network speaker alarms during pursuit.
  • Majority in C++; Facebook and speaker communication in Python.
Stack of books

Journey of Reading 100 Books

A quest that started on March 2019 reached its first milestone: “reading 100 books”. It started with a simple goal: “Do I know a little bit more than what I knew yesterday?” This journey introduced topics missing from traditional school education…

05 — Reach Out

Get in touch

  • Email: nightstorm1990[at]protonmail.com

  • Social

  • If you are interested in my reading list, check my Goodreads profile.

06 — Goals

Goals

Reading 100 books ✓ Done

Started March 2019; finished in 3 years. Key insight: “It is just as difficult to unlearn something as it is to learn something.” Read More

Learn something new every day Lifelong

  • Long-term aim: finish reading 1000 books in the next 20 years.
  • See what I’m reading on Goodreads.

Healthy lifestyle Lifelong

  • Exercise, healthy eating, intermittent fasting with positive results.
  • Gym at least 3 times a week.

Quantum Computing ✓ Done

  • Summer 2020 pet project on quantum mechanics for computation.
  • Bronze and Silver diplomas from QWorld — experience with Qiskit.

Blockchain ✓ Done

Explored blockchain after reading about investment; now appreciate the technology beyond fiat replacement.

Habit of not making a habit Lifelong

Humans habit-form for speed, not optimality. Since we are designed to create habits, the aim is to create a habit of not making a habit.