• Login
  • Register

Work for a Member organization and need a Member Portal account? Register here with your official email address.

Research
City Science

Looking beyond smart cities
Research
Space Enabled

Advancing justice in Earth's complex systems using designs enabled by space
Research
Camera Culture

Making the invisible visible–inside our bodies, around us, and beyond–for health, work, and connection
Research
Tangible Media

Invent new tangible and embodied interactions that inspire and engage people
Article Research

Generative AI improves a wireless vision system that sees through obstructions

With this new technique, a robot could more accurately detect hidden objects or understand an indoor scene using reflected Wi-Fi signals.
Project Research

Theme | Consensus

City Science researchers are developing a slew of tangible and digital platforms dedicated to solving spatial design and urban planning cha…
Research
Responsive Environments

Augmenting and mediating human experience, interaction, and perception with sensor networks
Research
Conformable Decoders

Converting the patterns of nature and the human body into beneficial signals and energy
Project Research

AI Agents Are Sensitive to Nudges

LLMs are being set loose in complex, real-world environments involving sequential decision-making and tool use. Often, this involves making…
Project Research

A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments

Environments built for people are increasingly operated by a new class of economic actors: LLM-powered software agents making decisions on …
Project Research

Discovering and Steering Interpretable Concepts in Large Generative Music Models

The fidelity with which neural networks can now generate content such as music presents a scientific opportunity: these systems appear to h…
Project Research

Visual Persuasion: What Influences Decisions of Vision-Language Models?

The web is littered with images, once created for human consumption and now increasingly interpreted by agents using vision-language models…
Project Research

Augmented Eternity and Swappable Identities

Have you ever wondered what a friend would do if she was in your decision-making situation? Or thought about where a family membe…
Project Research

ORGANOLOGY: Real-Time Biometrics x Sound Synthesis

Organology: Real-Time Biometrics x Sound Synthesis October 19th @ 8:00 PMMIT Media Lab 3rd Floor AtriumWhat role does the body pl…
Project Research

Creative Text-to-Audio Generation via Synthesizer Programming

Neural audio synthesis methods now allow specifying ideas in natural language. However, these methods produce results that cannot be easily…
Project Research

Contrastive Learning from Synthetic Audio Doppelgängers

​Learning robust audio representations currently demands extensive datasets of real-world sound recordings. By applying artificial transfor…
Research
Fluid Interfaces

Designing Systems for Cognitive Augmentation
Archived
Research
Media Lab Research Theme: Life with AI

Life with AI | Designing the future of smart systems to improve the human experience
Archived
Research
Media Lab Research Theme: Future Worlds

Future Worlds | Design and action for the future we want to live in
Archived
Research
Media Lab Research Theme: Decentralized Society

Decentralized Society | Architecting the new internet for the good of the people
Archived
Research
Media Lab Research Theme: Cultivating Creativity

Cultivating Creativity | Catalyzing a global movement enabling everyone to unlock and unleash their individual and collective creativity
Archived
Research
Media Lab Research Theme: Connected Mind + Body

Connected Mind + Body | Revolutionizing the future of mental and physical wellbeing
Research
Viral Communications

People and intelligent machines in a creative loop
Research
Opera of the Future

Extending expression, learning, and health through innovations in musical composition, performance, and participation
Research
Sculpting Evolution

Cultivating wisdom through evolutionary and ecological engineering
Project Research

Large Population Models

Think about how a delayed shipment, a cancelled flight, or a glitchy app can disrupt your week. Now scale that up: a virus like COVID-19 co…
Research
MIT Center for Constructive Communication

Designing tools, methods and systems that connect rather than divide us to create a healthier society
Project Research

City Science Lab @ Andorra

Andorra and the City Science research group at the MIT Media Lab are taking on the challenge of turning Andorra into an “Internationally Re…
Research
Future Sketches

Exploring the essence of code as a creative medium
Post Research

Dong Won Lee named Amazon AI Fellow

Lee works on multimodal social agents with a focus on developing machine learning methods and evaluation for social intelligence
Research
Affective Computing

Advancing human wellbeing by developing new ways to communicate, understand, and respond to emotion
Research
Multisensory Intelligence

Creating human-AI symbiosis across scales and sensory mediums to enhance productivity, creativity, and wellbeing
Research
RAISE

Responsible AI for Social Empowerment and Education: promoting equity in learning, education, + computational action to prepare diverse K-12
Publication Research

Prompting Large Language Models with Audio for General-Purpose Speech Summarization

Wonjune Kang and Deb Roy. "Prompting Large Language Models with Audio for General-Purpose Speech Summarization." In Proc. Interspeech, pp. 1955-1959. 2024.
Publication Research

Expressive Speech Retrieval using Natural Language Descriptions of Speaking Style

Wonjune Kang and Deb Roy. "Expressive Speech Retrieval using Natural Language Descriptions of Speaking Style." In IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), IEEE, 2025.
Project Research

Future You: An Interactive Digital Twin System for Self-Reflection and Personal Growth

​Say hello to FutureYou!Imagine stepping into a time machine and having a conversation with your future self. What would you ask? What unex…
Research
Personal Robots

Building intelligent personified technologies that collaborate with people to help them learn, thrive, and flourish.
Research
Molecular Machines

Engineering at the limits of complexity with molecular-scale parts
Research
Human Dynamics

Exploring how social networks can influence our lives in business, health, governance, and technology adoption and diffusion
Project Research

Jordan and the jam_bot: A Human-AI Co-Created Live Music Performance

On September 21st, 2024, we concluded a year-long collaboration with GRAMMY-winning keyboardist Jordan Rudess, culminating in a sold-out pe…
Project Research

Generic Pan Tilt: Open Source Motion Control Platform for Entertainment and Research

We introduce the Generic Pan Tilt, an open-source, two-axis motion control platform designed for use in entertainment, art, and research. …
Project Research

Developing Symbiotic Virtuosity: AI-augmented Musical Instruments and Their Use in Live Music Performances

This project seeks to explore and further develop the concept of "Symbiotic Virtuosity," where artificial intelligence (AI) and human music…
Article Research

A model of virtuosity

Acclaimed keyboardist Jordan Rudess’s collaboration with the Media Lab culminates in live improvisation between an AI “jam_bot” + the artist
Publication Research

Developing Symbiotic Virtuosity: AI-Augmented Musical Instruments and Their Use in Live Music Performances

Blanchard, Lancelot*, Perry Naseck*, Eran Egozy, and Joseph A. Paradiso. 2024. “Developing Symbiotic Virtuosity: AI-Augmented Musical Instruments and Their Use in Live Music Performances.” An MIT Exploration of Generative AI, September. https://doi.org/10.21428/e4baedd9.69c11de7.
Project Research

Sleep and Wellbeing

By establishing correlations between sleep parameters and wellbeing indicators, our project hopes to further understanding of fluctuations …
Project Research

conformable Multimodal Sensory Facemask (cMaSK)

Facemasks are used to reduce exposure to viruses and other environmental hazards such as air pollution, and integrating wearable electronic…
Publication Research

Creative Text-to-Audio Generation via Synthesizer Programming

Cherep*, M., Singh*, N., & Shand, J. (2024, July). Creative Text-to-Audio Generation via Synthesizer Programming. International Conference on Machine Learning (ICML)
Project Research

BuzzCam

Protecting biodiversity with acoustic and visual sensing.The South American Bombus dahlbomii is one of the largest bee species in the world…
Project Research

The Deep Image of the City

How do you image a city that doesn't exist? DeepScope is a novel platform for interactive, real-time, and setup-less urban design visu…
Post Research

Manuel Cherep and Pattie Maes from Fluid Interfaces granted 2024 Amazon Research Award

Researchers from Fluid Interfaces receive 2024 Amazon Research Award for work in AWS AI research area.
Archived
Project Research

HyperCubes: Learning computational concepts in Augmented Reality

HyperCubes is an augmented reality platform to help children understand computational concepts drawn from their physical surroundings, from…
Archived
Architecture Machine Group
Archived
Project Research

Silverspot: exploring parameter space with sketches

With computation, it's easy to create systems that have a vast number of variations, but it's sometimes difficult to explore those systems.…
Project Research

Guadalajara Mobility Choices

Mobility Choices is used to predict transportation mode choices of students at the University of Guadalajara (UdeG) within the Guadalajara …
Project Research

Decentralized AI

As AI evolves beyond screen assistants and into dimensional applications, decentralization emerges as the critical factor for unlocking i…
Publication Research

Federated Conformal Predictors for Distributed Uncertainty Quantification

Lu, Charles, et al. "Federated conformal predictors for distributed uncertainty quantification." International Conference on Machine Learning (ICML). PMLR, 2023.
Publication Research

Data Acquisition via Experimental Design for Data Markets

Lu, Charles, et al. "Data Acquisition via Experimental Design for Data Markets." Advances in Neural Information Processing Systems (NeurIPS) 37 (2024): 118086-118118.
Project Research

AttentivU

​There are currently  UROP openings for this project. AttentivU is a neural AI platform for wireless non-invasive sensing of pers…
Research
Signal Kinetics

Inventing, building, and deploying wireless sensor technologies to address complex problems in society, industry, and ecology
Archived
Project Research

RFIQ: Food quality and safety detection using wireless stickers

​We have developed a wireless system that leverages the inexpensive RFID tags already on hundreds of billions of products to sense potentia…
Archived
Project Research

Lensing: Cardiolinguistics for Atypical Angina

Conversations between two individuals—whether between doctor and patient, mental health therapist and client, or between two people romanti…
Archived
Project Research

The Indoor-Training Effect: Unexpected gains from distribution shifts in the transition function

Would you train for a tennis match in chaotic outdoor conditions from day one, or would you first perfect your fundamentals in a controlled…
Archived
Project Research

Nightmare Machine

For centuries, across geographies, religions, and cultures, people try to innovate ways of scaring each other. Creating a visceral emotion …
Archived
Publication Research

Articulatory Synthesis of Speech and Diverse Vocal Sounds via Optimization

Luke Mo*, Manuel Cherep*, Nikhil Singh*, Quinn Langford, and Pattie Maes. Articulatory Synthesis of Speech and Diverse Vocal Sounds via Optimization. In Audio Imagination: NeurIPS 2024 Workshop AI-Driven Speech, Music, and Sound Generation.
Project Research

Scaling Science: Using Data to Find “Hidden Gem” Research

The current system of scientific recognition and funding has significant bias towards work published in the top few percent of journal…
Archived
Archived
Project Research

parkinsAI

Appropriate and adaptive treatment plans are challenging in Parkinson’s disease for several reasons.  parkinsAI models drug response a…
Archived