• Home
  • Publications
  • TEACHING
  • CV
  • Design Portfolio
  • More
    • Home
    • Publications
    • TEACHING
    • CV
    • Design Portfolio
  • Sign In

  • My Account
  • Signed in as:

  • filler@godaddy.com


  • My Account
  • Sign out

Signed in as:

filler@godaddy.com

  • Home
  • Publications
  • TEACHING
  • CV
  • Design Portfolio

Account


  • My Account
  • Sign out


  • Sign In
  • My Account

DISHITA TURAKHIA, Ph.D.

I am a faculty at NYU's Tandon School of Engineering in the Computer Science and Engineering (CSE) department, with an affiliation to the VIDA group.  


I work at the intersection of Human-Computer Interaction and Learning Sciences, specifically focused on designing systems for learning physical skills, such as motor skills,  maker skills, and manufacturing skills, using enabling technologies like ubiquitous sensing, AR/VR/MR/XR tools, and generative AI. 


I was a summer postdoc in MIT Mechanical Engineering Department's Learning Engineering And Practice (LEAP) Group where I worked on designing XR systems for training workforce in manufacturing. I have also been a research scientist intern in Meta Reality Labs' HCI group, where I worked on designing AR systems for adaptive motorskill learning. 


I received my Ph.D. in Electrical Engineering and Computer Science from MIT with a research focus in Human-Computer Interaction and Design and a minor in Brain and Cognitive Science. Prior to starting my Ph.D., I received a dual master's degree in EECS (MS) and Architecture (SMArchS computation) from MIT, in addition to masters (MSc) in Emergent Technology and Design (EmTech) from AA School of Architecture. 


My research has raised over $2.2 million in funding through grants, including two National Science Foundation (NSF Career, NSF Small) grants, three MIT Integrated Learning Initiative (1, 2, 3) grants, and a J-WEL Education Innovation grant. I have been part of the EECS Rising Stars and a recipient of the Meta Ph.D. Research Fellowship ('22-24) and the MIT Edwin S. Webster Graduate Fellowship. At MIT, I have also been a SERC scholar and a Grace Hopper scholar. 


Besides academic research, I have worked in the industry as a computational designer on several award-winning projects in London (PLP Architects), Singapore (SUTD), and Bern (BSR Architekten), and as a licensed architect in Mumbai, where I also co-led my design firm, ArchitextureBuro. 


Google Scholar | LinkedIn | Twitter | TEDx Talk  

CV |  Portfolio

Research Statement | Teaching Statement | Diversity Statement


email: dishita[at]mit[dot]edu     |     d[dot]turakhia[at]nyu[dot]edu

RESEARCH - DESIGNING LEARNER-CENTRIC TOOLS

Given the multifaceted nature of human learning, my research vision is to leverage technology to design learner-centric tools for comprehensive skill learning.


I fulfill this vision through my research at the intersection of Human-Computer Interaction (HCI) and Learning Science (LS).  I combine HCI principles of tool design with LS frameworks to personalize the learning of physical skills by enhancing motivation, creativity, and self-reflection. 


I design, build, and study interventions grounded in learners’ and educators’ experiences thereby challenging prevailing techno-centric approaches that focus solely on skill enhancement. In particular, I have focused on three frameworks for skill learning: i) adaptive, ii) reflection-based, and iii) game-based for learning three different sets of skills: motor skills, maker skills, and fabrication skills. 

OPEN-ENDED LEARNING OF MANUFACTURING SKILLS IN VR

OPEN-ENDED VIRTUAL REALITY SIMULATION FOR TRAINING OF MACHINING TASKS

This VR training simulation prototype presents an open-ended approach to practice drilling using a 3-axis milling machine. The simulation employs near “end-to-end” instruction through a safety module, a setup and drilling tutorial, and open-ended practice complete with warnings of mistakes and failures.


(published at IEEE ISMAR’23 and Demo at ACM CHI'24)

 DOI | PDF 

Benchmarking Open-endedness of VR Training Systems FOR Manufacturing TASKS



Our findings from a benchmarking study of 19 industry applications reveal that current systems are moderately open-ended for goal selection and system adaptability, but have significant limitations in open-endedness for product creation, feedback mechanisms, and learning paths.  



(published at IEEE ISMAR EA'24)

 DOI | PDF

Using ACT-R IN Design OF Intelligent Tutoring Systems for VR Training of Manufacturing TASKS

Using ACT-R IN Design OF Intelligent Tutoring Systems for VR Training of Manufacturing TASKS


We explore the design of an ACT-R based ITS framework for VR training of manufacturing skills like machining, drilling, or lathing. We detail the framework components which include designing instructions, constraint-based system model, warning and error states, action-based and time-based feedback, and the ITS architecture.


(published at IEEE ISMAR EA'24)

 DOI | PDF

TASK GUIDANCE FOR EVERYDAY PHYSICAL TASKS IN AR

Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User Modeling

InsightAR: Multi-modal Summarization and Interactive Analysis of AR-based Egocentric Task Videos

InsightAR: Multi-modal Summarization and Interactive Analysis of AR-based Egocentric Task Videos

The Satori system combines the users’ self knowledge and task goal of the immediate user action with a large-language model (LLM) model to provide visual assistance relevant to the user’s immediate needs.


(accepted at ACM CHI'25)

 DOI | PDF

InsightAR: Multi-modal Summarization and Interactive Analysis of AR-based Egocentric Task Videos

InsightAR: Multi-modal Summarization and Interactive Analysis of AR-based Egocentric Task Videos

InsightAR: Multi-modal Summarization and Interactive Analysis of AR-based Egocentric Task Videos

InsightAR is an LLM-based visual analytics tool to integrate event detection in egocentric AR task videos and extract meaningful task insights, and to refine summaries, compare  performances, and generate actionable feedback.


(under review)


Spatial Memory in XR: The Future of Memory Capture and Replay Through XR and AI

InsightAR: Multi-modal Summarization and Interactive Analysis of AR-based Egocentric Task Videos

Spatial Memory in XR: The Future of Memory Capture and Replay Through XR and AI

This workshop  was a collaborative exploration of cutting-edge technologies and methodologies for capturing, replaying, and sharing memory-rich experiences by bringing together experts and innovators across diverse disciplines.


(published at IEEE VR EA'25)

 DOI | PDF

ADAPTIVE LEARNING OF MOTOR SKILLS

Physical Tools that Adapt their Shape based on Learner's Performance Help in Motor-Skills Training

Adapt2Learn: A Toolkit TO ConfigurE the Learning Algorithm for Adaptive Physical Tools for Motor SKI

A key innovation of this work was leveraging the shape-changing abilities of interactive tools to adapt the training task difficulty. User studies validating the impact of this approach demonstrated that adaptive learning not only outperformed non-adaptive training but also surpassed manually-adaptive training


(published at  ACM TEI'21)

DOI | PDF | Video | Project | Talk | MIT News

Adapt2Learn: A Toolkit TO ConfigurE the Learning Algorithm for Adaptive Physical Tools for Motor SKI

Adapt2Learn: A Toolkit TO ConfigurE the Learning Algorithm for Adaptive Physical Tools for Motor SKI

The Adapt2Learn toolkit expanded the design space for adaptivity, by empowering designers to build adaptive tools for varied skills. Adapt2Learn generates customized learning algorithms for their tools and provides a visualization feature for evaluating if the tool adapted correctly to the learner's performance.


(published at ACM DIS'21)

 DOI | PDF | Project | Video | Talk 

Designing Adaptive Tools for Motor Skill Training in Augmented Reality

Designing Adaptive Tools for Motor Skill Training in Augmented Reality





This project, in collaboration with the Meta Reality Labs, studies the design space of AR for adaptive skill learning. Our studies on using adaptive AR tools for training shed light on which visual & environmental cues the learners rely on for learning. The findings unveiled new design opportunities to adapt virtual cues for optimal personalized training in AR.


[under review]

PDF

REFLECTIVE LEARNING OF MAKERSKILLS

The Reflective Maker: Using Reflection to Support Skill-learning in Makerspaces

reflectables: Using Generative AI to Integrate Reflection Prompts for Makerskills within Instructabl

reflectables: Using Generative AI to Integrate Reflection Prompts for Makerskills within Instructabl

Reflection allows learners to analyze their actions and gain a deeper understanding of the skill and improve learning outcomes. The Reflective Maker - a toolkit for educators to design reflection exercises for novice makers, leverages Donald Schon's framework of reflection in making for teaching makerskills.   


(published at ACM UIST'22)

 DOI | PDF

reflectables: Using Generative AI to Integrate Reflection Prompts for Makerskills within Instructabl

reflectables: Using Generative AI to Integrate Reflection Prompts for Makerskills within Instructabl

reflectables: Using Generative AI to Integrate Reflection Prompts for Makerskills within Instructabl

To support the self-learning of makerskills among individuals who rely on online tutorials like Instructables, Reflectables explores the use of Large Language Models (LLMs) for generating personalized tutorials. Preliminary studies show increased self-efficacy and knowledge of tools among learners.


(under review)

PDF

The Reflective Make-AR In-Action: Using Augmented Reality for Reflective Learning of Makerskills

reflectables: Using Generative AI to Integrate Reflection Prompts for Makerskills within Instructabl

The Reflective Make-AR In-Action: Using Augmented Reality for Reflective Learning of Makerskills

Reflective Make-AR is an augmented reality system for monitoring, prompting, and recording the learners' “in-action reflections.” Our studies on the impact of immersive multimodal reflection on the learning experiences of makers indicated the need to adopt a “less is more” approach when designing interventions


(published at ACM CHI ’23)

DOI | PDF

GAME-BASED LEARNING OF FABRICATION SKILLS

WHAT CAN WE LEARN FROM EDUCATORS ABOUT TEACHING IN MAKERSPACES?

Identifying Game Mechanics for Integrating Fabrication Activities within Existing Digital Games

FabO: Integrating Fabrication with a Player's Gameplay in Existing Digital Games

This work studies how educators scaffold the learning of makerskills, through in-depth interviews with educators in makerspaces across Greater Boston and global fab labs. This study validated how educators prioritize a myriad of learning goals beyond mere tool expertise, such as enhancing self-efficacy and creativity.  


(published in ETRD Journal'23)

 DOI | PDF 

FabO: Integrating Fabrication with a Player's Gameplay in Existing Digital Games

Identifying Game Mechanics for Integrating Fabrication Activities within Existing Digital Games

FabO: Integrating Fabrication with a Player's Gameplay in Existing Digital Games

FabO allowed learners to laser-cut and 3D print objects from their favorite games, such as collectibles or custom controllers crafted from game-related elements. A key novelty of this work is using computer vision to allow seamless integration of fabrication moments within existing games without needing access to the game’s source files.


(published in ACM Creativity and Cognition'22)

 DOI | PDF | Project | Talk  | MIT News

Identifying Game Mechanics for Integrating Fabrication Activities within Existing Digital Games

Identifying Game Mechanics for Integrating Fabrication Activities within Existing Digital Games

Identifying Game Mechanics for Integrating Fabrication Activities within Existing Digital Games

This work employs Papert’s theory of constructionism to develop a game-based framework for learning fabrication and implements it in a toolkit to integrate fabrication activities within existing video games to teach digital fabrication. 



(published at ACM CHI ’22)

 DOI | PDF | Project | Talk 

XR SIMULATIONS FOR LEARNING PROTOTYPING AND MAKERSKILLS

reimagining SYSTEMS FOR HANDS-ON learning of creative and maker skills

SENSORVIZ:: Visualizing Sensor Data in AR Across Different Stages of Prototyping Interactive Objects

While much of the design and engineering of current learning systems is driven by the advances in technology, we can reimagine these systems by reorienting the design goals around constructivist and sociocultural theories of learning to support learning progression, engagement across artistic disciplines, and designing for inclusivity and accessibility.  


(led the workshop at ACM CHI'22)

 DOI | PDF | Workshop Website

SENSORVIZ:: Visualizing Sensor Data in AR Across Different Stages of Prototyping Interactive Objects

SENSORVIZ:: Visualizing Sensor Data in AR Across Different Stages of Prototyping Interactive Objects

SensorViz is a visualization tool that supports novice makers during different prototyping stages with sensors. SensorViz provides 3 visualization modes: datasheet specifications, sensor interaction with the environment via AR before building the physical prototype, and live/recorded sensor data to test the assembled prototype. 


(published in ACM DIS'22)

 DOI | PDF | Project

 

TEACHING

HCI COURSEs

Entrepreneurship CAMPS

AI an DESIGN COURSES

Lead Instructor, CS GY-6543/UY-4543 Human-Computer Interaction, 

NYU Tandon School of Engineering

AI an DESIGN COURSES

Entrepreneurship CAMPS

AI an DESIGN COURSES

TA, 6.034 Artificial Intelligence, MIT

TA, 6.928 Leading Creative Teams, MIT 

TA, 6.810 Embedded Interactive Technology, MIT 

Instructor, Digital Design, KRVIA, Mumbai University

Design WORKSHOPS

Entrepreneurship CAMPS

Entrepreneurship CAMPS

Workshop Lead, Reimagining Learning (ACM CHI'22) 

Workshop Lead, Spatial Cognition in Design, Aalto University

Workshop Lead, Para-centric design,  Bhartiya Vidyapeeth Uni., Mumbai

Entrepreneurship CAMPS

Entrepreneurship CAMPS

Entrepreneurship CAMPS

Instructor, MIT-Global Startup Lab Mentor, Mauritius 

Volunteer mentor, CanopyCity accelerator, Somerville(2017)

Design lead, SketchCAD, DesignX Accelerator, MIT(2016)

AWARDS, GRANTS, AND PRESS

fellowship/ scholarship AWARDS

fellowship/ scholarship AWARDS

fellowship/ scholarship AWARDS

  • 2022, EECS Rising Stars
  • 2022, Meta Fellowship (~$200k )
  • 2022, MIT SERC Fellow
  • 2018, MIT Edwin Webster Fellowship
  • 2018, Grace Hopper Graduate Scholarship
  • 2017,  Bill Mitchell Graduate Fellowship



GRANTS AWARDED TO MY PROJECTS

fellowship/ scholarship AWARDS

fellowship/ scholarship AWARDS

  • MIT Generative AI Impact Grant ($50k) 
  • J-WEL Education Innovation grant ($100k)
  • MIT MISTI-Germany ($30k)
  • MIT Integrated Learning Initiative ($150k)
  • Microsoft Faculty Fellowship ($200k)
  • MIT Integrated Learning Initiative ($250k)
  • NSF Career Small ($300k)
  • MIT.Nano ($200k)
  • MIT Integrated Learning Initiative ($250k)
  • NSF Career ($500k)

PRESS RELATED TO MY RESEARCH

fellowship/ scholarship AWARDS

PRESS RELATED TO MY RESEARCH

  • MIT CSAIL Spotlight
  • MIT News
  • MIT Open Learning
  • Digital Trends
  • ACM News
  • ScienceWiki
  • TechXplore
  • Innovation Toronto
  • News8Plus 

TEDX TALKS, PODCASTS

fellowship/ scholarship AWARDS

PRESS RELATED TO MY RESEARCH

  • TEDx Speaker, Boston,(2017) 
  • Guest, Podcasts on Artificial Intelligence (2017)
  • Speaker, Talk on Spatial Cognition in Architecture at ANFA Conference (2016) 

MENTORING, LEADERSHIP, AND VOLUNTEERING

student mentoring

WOMEN GROUPS AND LEADERSHIP COMMITTEES

WOMEN GROUPS AND LEADERSHIP COMMITTEES

  • Graduate students (Peiling Jiang, David Ludgin, Kelly Qi) 
  • Undergraduate students (Lucas De Bonet, Zane Mroue, Yizhen Chen, Zixuan Wu, Cassandra He, Brent Liu, Thomas Adebiyi, Ivy Wang, Carlos Castillo Lozada, Harrison Allen, Suparnamaaya Prasad, Joshua Verdejo, Bobby Rauch, Andrew Wong, Lotta Blumberg)
  • Highschool students (Christian de Weck)

WOMEN GROUPS AND LEADERSHIP COMMITTEES

WOMEN GROUPS AND LEADERSHIP COMMITTEES

WOMEN GROUPS AND LEADERSHIP COMMITTEES

  • EECS Committee for Diversity Equity and Inclusion (CDEI '22) 
  • MIT EECS Graduate Admission Assistance Program for URM (MIT GAAP'21)
  • MIT Fellow, Science Diversity Equity and Inclusion (Science DEI'20)
  • MIT Graduate Women in Course 6 (GW6'19) 
  • Graduate Women at MIT (GWAMIT'19)
  • New England Grad Women in STEM and Engineering (NEGWISE'19)


CONFERENCE COMMITTEES

WOMEN GROUPS AND LEADERSHIP COMMITTEES

CONFERENCE COMMITTEES

  • Program Committee, Associate chair (C&C'24, TEI'24, DIS’23-'24), 
  • Organizing Committee, Posters and Demo Chair (C&C‘23)
  • Organizing Committee, Experience Social Chair (C&C‘22)
  • Session chair (CHI'23, C&C‘21-'23), 
  • Workshop Organizer (CHI’22), 
  • Student Volunteer (UIST'19, CHI'18)
  • Reviewer (CHI’21-’24, UIST’20-‘23, DIS’21- ‘23, TEI’21-‘23, ERTD’23, C&C’23, TOCHI’19-‘23, CSCW’22, IUI’18) 

PRIOR RESEARCH (COMPUTATIONAL DESIGN)

Thirteen Ways of Looking

Thirteen Ways of Looking

Thirteen Ways of Looking

This work studies the impact of cognitive diversity and social interaction on creative thinking using shape grammar. 

PDF | Project | TEDx Talk

sketchCAD

Thirteen Ways of Looking

Thirteen Ways of Looking

This project uses machine learning to automate the mundane parts of architecture drafting for increased efficiency.

PDF 

neuroscience in design

Thirteen Ways of Looking

neuroscience in design

This research studies the neuroscience frameworks of spatial cognition for applications in architectural design.

PDF | Project | Talk

Minimalision

Thirteen Ways of Looking

neuroscience in design

This project explores the use of sensor technology to detect distractions and block them while focusing on work. 

Project 

Silent Game

Computational Creativity

Sketching with Machines

Building computational models of social cognition and visual communication 

PDF | Project 

Sketching with Machines

Computational Creativity

Sketching with Machines

Fabricating a 2-axis sketching tool and exploring sketching techniques

PDF | Project 

Dynamic Tensegrity str.

Computational Creativity

Computational Creativity

Designing irregular Tensegrity habitable structures for Mumbai slums

PDF | Project 

Computational Creativity

Computational Creativity

Computational Creativity

Using generative design for irregular tensegrity systems

Project 

MIT BLOGS

 On the value of pursuing your dreams 

TO MIT, WITH LOVE

How the MIT's architecture represents its philosophy 

THE INFINITE CORRIDOR

Why being at MIT is like being Alice in Wonderland 

curiouser and curiouser

My experience with MISTI Global Startup Labs 

away from mit, with a slice of mit

Connect

I am actively looking for Academic and Industry Research Positions related to design, emerging technologies (AR/VR, genAI), skill learning, and HCI. 



Copyright © 2017 Dishita Turakhia - All Rights Reserved.


Powered by