HIVE - IITK | Research

Research

Home
Research

Research Domains

We work across eight interconnected areas of human-machine interaction — published at CHI, NIME, UIST, ISMAR, MobileHCI, C&C, and IndiaHCI.

Human Computer / Machine Interaction

Novel multimodal interaction techniques bridging humans and machines — natural, intuitive, and embodied interactions across diverse applications.

Music Technology & Sound Design

Expressive musical instruments, new interfaces for musical expression, wearable controllers, multisensory performance, and music therapy for rehabilitation.

XR / Spatial Computing

Augmented, Virtual, and Mixed Reality experiences — immersive storytelling, spatial interaction, digital twins, and XR for disaster preparedness and rescue.

Robotics & HRI

Human-robot interaction for social, office, and autonomous robots. Soft continuum manipulators and snake robots for disaster and healthcare contexts.

Assistive & Accessible Technology

Eye-tracking AAC systems, accessible XR interfaces, wearable aids, and inclusive design for people with disabilities — grounded in participatory and crip-led research.

AI & Generative Media

AI-driven generative visuals, diffusion models, multimodal AI systems, and human-AI co-creation tools for art, design, and performance.

New Media & Interactive Arts

Immersive installations, interactive art, speculative design, and generative systems probing technology's impact on human perception, culture, and society.

Automotive UI

Multimodal interaction and haptic alert systems for drivers — gaze, haptic, and auditory modalities to mitigate distraction and assess cognitive load.

Publications & Patents

Journals Conferences Patents Books

Rajashekhar, V. S., & Prabhakar, G. (2026). From preparedness to action: Synthesising insights on robot usage in post-earthquake search operations. Resilient Cities and Structures (Elsevier). In Press.

Journal DOI ↗

Sukanth, K., Sudhiksha, KR., Rajashekhar, VS., Prabhakar, G. (2024). Heads Up eXperience (HUX): Always-On AI Companion for Human Computer Environment Interaction. arXiv preprint.

arXiv Link ↗

Rajashekhar, V. S., Rajesh, A., Athaaillah, M. I. A., & Prabhakar, G. (2024). Serpentine Synergy: Design and Fabrication of a Dual Soft Continuum Manipulator and Soft Snake Robot. arXiv preprint.

arXiv Link ↗

Moora, R. V., & Prabhakar, G. (2024). Tactile Melodies: A Desk-Mounted Haptics for Perceiving Musical Experiences. arXiv preprint.

arXiv Link ↗

Srinath, L., Bhagat, A. K., Sharma, A., & Prabhakar, G. (2026, July). Designing a Scaffolding for the Audience to Create Participatory Sense-making in Indian Classical Dance. In Proceedings of the ACM Creativity & Cognition Conference (C&C '26) — Posters & Demos. London, UK.

C&C 2026 Link ↗

Mukherjee, P., Bhagat, A. K., Jain, K., Rawat, V., Srinath, L., Dev, S. K., Kumar, S., & Prabhakar, G. (2026). Layika: A Wearable Device Mapping Traditional Hand Gestures to Tabla Sound. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME '26).

NIME 2026 PDF ↗

Kalivarathan, S., Rajan, S. K., Rajashekhar, V. S., & Prabhakar, G. (2026). Heads Up eXperience (HUX): Gaze-Driven Multimodal AI for Environment Interaction. In Proceedings of the 2AI Conference (AAI 2026).

AAI 2026 Link ↗

Jain, P., Sharma, A., Chaudhary, S., Rawat, V., Bhagat, A. K., Jain, K., Bayerlein, C., Salter, C. L., & Prabhakar, G. (Accepted). When Assistive Technologies Become Provocations: Unpacking Access in HCI Practices Using Crip Technoscience, Mouth Interfaces, and XR. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. Accepted Full Paper.

CHI 2026 DOI ↗

Kumar, S., Dev, S. K., Srinath, L., Kumar, A., Jain, K., Bhagat, A. K., Mukherjee, P., & Prabhakar, G. (2025, Sep 28–Oct 1). Swarings: Exploring expressive freedom through ring-based musical interaction. In Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST '25). Busan, Republic of Korea.

UIST 2025 DOI ↗

Rajashekhar, V. S., & Prabhakar, G. (2025, October). Exploring the trapped-in-debris experience: Behavioural and verbal analysis of human behaviour in extended reality earthquake simulations. In 2025 IEEE ISMAR-Adjunct — NeuroXR Workshop. IEEE.

ISMAR 2025 Link ↗

Rajashekhar, V. S., & Prabhakar, G. (2025, September). From Awareness to Action: Extended Reality Systems for Earthquake Preparedness, Evacuation, and Rescue. In Proceedings of the 27th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '25) — Doctoral Consortium. ACM.

MobileHCI 2025 DOI ↗

Botev, J., Biswas, P., Rao, A. K., Ray, R. K., Prabhakar, G., & Niknam, S. (2025, October). NeuroXR: Neurophysiological Signals, Affective Computing and Cognition in Extended Reality. In 2025 IEEE ISMAR-Adjunct (Workshop Paper). IEEE.

ISMAR 2025 Link ↗

Jain, K., Williams, A., Bhagat, A. K., Sukanth, K., Rajesh, A., Pal, P., Chandran, K., Rajashekhar, V. S., Ramesh, A., Prabhakar, G. GraviTone: A Tangible Musical Interface using Gravity Well for Sound and Music Creation. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME '25), June 24–27, 2025, Canberra, Australia.

NIME 2025 PDF ↗

Rajashekhar, VS. (2025, February). Key Dimensions for Human-Robot Interaction in XR for Rescue Robots. In Proceedings of the 15th International Conference of HCI Design & Research (IndiaHCI 2024) (pp. 172–186).

IndiaHCI 2024 Link ↗

Rajashekhar, VS., Aravind, S., Aniruthvishwak, R., Narendhran, V., Prabhakar, G. (2024, May). To Show or Hide — Investigating the Effect of Cursor Visibility in Gaze-controlled Interfaces. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems.

CHI 2024 DOI ↗

Rajashekhar, VS., Prabhakar, G. (2024, March). Multi-Modal Interaction for Soft Continuum Robots during Post-Earthquake Search Operations. In Joint Proceedings of the ACM IUI Workshops 2024, Greenville, South Carolina, USA.

IUI 2024 PDF ↗

Gao, L., Irani, P., Subramanian, S., Prabhakar, G., Martinez Plasencia, D., & Hirayama, R. (2023, April). DataLev: Mid-air Data Physicalisation Using Acoustic Levitation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1–14).

CHI 2023 DOI ↗

Ramesh, A., Prabhakar, G., Ramkumar, J., and Gujjar, M. A Gaze-Controlled Augmentative and Alternative Communication (AAC) Device.

Patent Application No.: 202611024766 · Filed: 02 March 2026 · Indian Patent Office

Prabhakar, G., Bhagat, A. K., Tony, L., and Balasubramani, P. P. Real-time visual feedback system and method for minimizing the risk of jaywalking or distracted walking.

Patent Application No.: 202511070920

Dev, S. K., Kumar, S., Srinath, L., Mukherjee, P., Kumar, A., Bhagat, A. K., Jain, K., and Prabhakar, G. A musical instrument (SWARINGS).

Patent Patent Grant No.: 587794

Mukherjee, P., Dev, S. K., Kumar, S., Srinath, L., Kumar, A., Bhagat, A. K., Jain, K., and Prabhakar, G. Wearable musical device for simulating Indian classical percussion audio (Music Glove).

Patent Patent Grant No.: 588076

Jain, K., Bhagat, A. K., Williams, A., Rajesh, A., and Prabhakar, G. GraviTone.

Patent Application: Under Process

Pandey, M., Samnekar, D., Kumar, R., Agrawal, H., Kar, S. K., Singh, A., & Prabhakar, G. (2025). Non-Invasive Vagus Nerve Stimulation Device with Physiological Feedback.

Patent Indian Patent Application (filed)

Pandey, M., Samnekar, D., Kumar, R., Agrawal, H., Kar, S. K., Singh, A., & Prabhakar, G. (2025). An Ear Device for Nerve Stimulation.

Patent Application No.: 202511002159

Outputs

Demos & Artworks

Rajesh, A., and Prabhakar, G. Echo-Vision: AI-based visualisation tool for conceptualisation through speech and sketching. IndiaHCI'25, IIIT Delhi, 2025.

Rajesh, A., Srinath, L., Dharshna, D., and Prabhakar, G. Nitya-atma: AI-based translation of Rudra and Navarasa to real-time immersive visuals. IndiaHCI'25, IIIT Delhi, 2025.

Mukherjee, P., et al. The Tabla Glove: An accompanist for musical training and exploration. IndiaHCI'25, IIIT Delhi, 2025.

Anutosh, A., and Prabhakar, G. The Crow's Song: Replicating multi-sensory site-specific acoustics in XR. IndiaHCI'25, IIIT Delhi, 2025.

Kumar, S., et al. Swarings: Exploring expressive freedom through ring-based musical interaction. IndiaHCI'25, IIIT Delhi, 2025.

Jain, K., et al. GraviTone: A tangible musical interface using gravity well for sound and music creation. IndiaHCI'25, IIIT Delhi, 2025.

Gupta, I., Anutosh, A., and Prabhakar, G. WashPlay: Projection mapping of germs on hands during hand-wash. IndiaHCI'25, IIIT Delhi, 2025.

Rajesh, A., and Prabhakar, G. Digital Theremin, Techkriti'25, IIT Kanpur, 2025.

Rajesh, A., and Prabhakar, G. Dreamweaver 2.0, Techkriti'25, IIT Kanpur, 2025.

Rajesh, A., and Prabhakar, G. Eye of the Storm, Techkriti'25, IIT Kanpur, 2025.

Moss, K., Ashok, S., Jain, K., et al. NIME Performance, Techkriti'25, IIT Kanpur, 2025.

Rajesh, A., and Prabhakar, G. Dreamweaver, AI4AI, IISc Bangalore, 2025.

Rajesh, A., and Prabhakar, G. Prana, AI4AI, IISc Bangalore / GE Healthcare / Brunel Univ, 2025.

Rajesh, A., Pal, P., and Prabhakar, G. Dreamweaver & Prana, 1Pixel Conference, IIIT Delhi, 2024.

Rajesh, A., Pal, P., and Prabhakar, G. Dreamweaver & Prana, KHOJ Studios, Delhi, 2024.

Rajesh, A., Pal, P., and Prabhakar, G. Focused Clarity & Phantom Visions, India HCI'24, IIT Bombay, 2024.

Rajesh, A., Pal, P., and Prabhakar, G. Phantom Visions, FLAME University, 2024.

Rajesh, A., Pal, P., and Prabhakar, G. Prana, Focused Clarity & Phantom Visions, HMI Horizon 24, IIT Kanpur, 2024.

Rajesh, A., and Prabhakar, G. Prana & Dreamweaver, Kanpur Literature Festival, 2024.

Verma, A., and Prabhakar, G. StarDust, Kanpur Literature Festival / HMI Horizon 23 / WiSSAP, 2023.

Rajesh, A., and Prabhakar, G. Big Brother is Watching, HMI Horizon 23, IIT Kanpur, 2023.

Prabhakar, G. AudioVis, HMI Horizon / WiSSAP / Kanpur Literature Festival, 2023.

Recognition

Awards & Honours

🏆

Best Immersive Artwork Award, IndiaHCI 2025 — Echo-Vision: An AI-based sketching tool for conceptualisation. Rajesh, A., and Prabhakar, G.

🎖️

Outstanding Display, 1Pixel Design Conference, IIIT Delhi, 2025 — Prana and Dreamweaver. Rajesh, A., Pal, P., and Prabhakar, G.

Live Performances

HIVE Lab Collective (Kratika Jain, Benison Bage, Arunav Rajesh, Shreyash Srivastava, Gowdham Prabhakar). Accepted performance — Asia-Pacific Improvisers Symposium 2026, Yong Siew Toh Conservatory of Music, National University of Singapore, 20–21 Oct 2026. 30-minute improvisational session.

Activities

Workshops, Seminars & Exhibitions

HMI Horizon 2025, Exhibition, New Approach Cell, IIT Kanpur, 2025.

Chair of Posters, Demos and Artworks Track, IndiaHCI'25 Conference, IIIT Delhi, 2025.

Live Music Coding Workshop, Iti Gupta, Department of Design, IIT Kanpur, 2025.

Manaswi Mishra, MIT Media Lab — AI Lutherie: Designing AI Musical Instruments for Humans, IIT Kanpur, 2025.

The BluePrint, Exhibition, Techkriti 25, IIT Kanpur, 2025.

Talk on how to write winning grant proposals by J Ramkumar, IIT Kanpur, 2025.

HMI Horizon 2024, Exhibition, Approach Cell, IIT Kanpur, 2024.

Review Workshop for Proposed PG Diploma in HCI, IIIT Delhi, 2024.

Workshop on Data Storytelling by Allwin Williams, IIT Kanpur, 2025.

Electronics Workshop by Vishwaraj and Gowdham, IIT Kanpur, 2024.

CAD and Rapid Prototyping Workshop by Vishwaraj, IIT Kanpur, 2024.

Vinay Sharma, Siemens — 1-month workshop on Design for XR in Unity3D, IIT Kanpur, 2024.

Ninaad — TouchDesigner Workshop, IIT Kanpur, 2024.

8hr Hackathon on Electronic Product Design, IIT Kanpur, 2024.

Workshop on HCI and Interactive Arts Installation at KHOJ Studios, Delhi, 2024.

Talk on Introduction to Cognitive Psychology by Narayanan Srinivasan, IIT Kanpur, 2024.

Puneet and Yesica — Workshop on Accessibility in XR, IIT Kanpur, 2024.

Kaldi Moss — Workshop on Spatial Sound Design, IIT Kanpur, 2024.

Ninad — 1-month workshop on Generative Graphic Design, IIT Kanpur, 2024.

L R D Murthy, MBRD — Talk on Human-AI Collaboration, IIT Kanpur, 2023.

Chair of the Applications Track at UK-India Future Networks (UKI-FNI), IIT Delhi, 2023.

Vinay Sharma, Siemens — Talk on HRI, IIT Kanpur, 2023.

Madan Kumar, UCL — Talk on Mindfulness in HCI Research, IIT Kanpur, 2023.

Priyam Rajkhova — Talk on UX Research, IIT Kanpur, 2023.

HMI Horizon 2023, Exhibition, Department of Design, IIT Kanpur, 2023.

Dissemination

Invited Talks

Guest Talk on New Media Design with Interactive Arts at HCAI and Sensing Workshop, Design Summer School 2025, IIIT Delhi, July 2025.

Guest talk on HCI and New Media Design on Healthcare systems, GE Healthcare, Bangalore, 2025.

Lecture series at ACM India Summer School on Immersive Realities: Demystifying AR, VR, and HCI (for Women Only), FLAME University, Pune, 2025.

Guest talk on Human Computer Interaction at HIVE, Dyson School of Design Engineering, Imperial College London, UK, 2025.

Guest talk on Human Computer Interaction at HIVE, Creative Computing Institute, University of the Arts London (UAL), UK, 2025.

Guest Talk on Music Technology and HCI at JINX Club, IIT Madras, 2025.

Guest talk on Human Computer Interaction at HIVE, Brunel Design School, Brunel University, UK, 2025.

Guest talk on New Media Design for Collaborative AI, Department of Design and Manufacturing, IISc Bangalore, 2025.

Guest talk on Human Computer Interaction at HIVE, MIT Media Lab, US, 2024.

Guest talk on Human Computer Interaction at HIVE, HCI Group, Stanford University, US, 2024.

Guest talk on Human Computer Interaction at HIVE, Mind Machine Music Lab, Virginia Tech, US, 2024.

Guest talk on Human Computer Interaction, FLAME University, Pune, 2024.

Lecture series at TalentSprint course on Intelligent Interaction Design, 2024.

Guest talk on Projects at HIVE, Technische Hochschule Ingolstadt, Germany, 2023.

Guest talk on Projects at HIVE, Zurich University of Arts (ZHDK), Switzerland, 2023.

Our Collaborators

We collaborate with research institutions, design schools, and industry partners across India and internationally.

KHOJ Studios, Delhi Cognitive Science, IIT Kanpur I3D Lab, IISc Bangalore Immersive Arts Space, ZHdK, Zurich IIITDM Kancheepuram UCL, UK MIT Media Lab, US Stanford HCI Group, US Virginia Tech, US Imperial College London, UK University of the Arts London, UK Brunel University, UK Technische Hochschule Ingolstadt, Germany GE Healthcare, Bangalore IIIT Delhi FLAME University, Pune Yong Siew Toh Conservatory of Music, NUS