← HOME

BACK TO TOP ↑

LUMEN

Overview

Discovery

Opportunity

Ideation

Refinement

Final Design

Reflection

Lumen

BRIEF

An interactive AR memory orb of your life, where memories take shape as glowing artifacts, ready to be revisited, reflected on, and reimagined in your space.

SCOPE

AR Experience

AI Integration

Spatial UX

Motion Design

DURATION

10 weeks

TEAM

Elisha Jeon

WingHi Li

Mike Ma

Steve Wu

ADVISED BY

Axel Roesler

OVERVIEW

Walk into your memories

AR and mixed reality completely transforms the 2D UX landscape as we can go beyond static images and relive experiences in an immersive way. That’s how we created Lumen, an AR memory orb that lets you step back into your past and re-experience it firsthand. Powered by AI, Lumen also helps you find memories with a simple question, making time travel possible right in your living space.

This project has been an exciting and unpredictable journey, as my teammates and I were all exploring the possibilities of AR + AI for the first time. How far can we push spatial UX? Does this make sense or is it all in our heads? Take a look at what we’ve built.

Spring quarter of my junior year, I had the privilege of joining MDes students in a graduate design studio to explore the rapidly evolving field of Generative AI. In this small 6-person studio, each of us conceived an original project from the ground up, using Generative AI tools as our collaborative co-designer(s).


My project, PIXELATED, is a three-part exhibition that captures the complexity and ambiguity of GenAI within the design landscape, including:

AR and mixed reality completely transforms the 2D UX landscape as we can go beyond static images and relive experiences in an immersive way. That’s how we created Lumen, an AR memory orb that lets you step back into your past and re-experience it firsthand. Powered by AI, Lumen also helps you find memories with a simple question, making time travel possible right in your living space.

This project has been an exciting and unpredictable journey, as my teammates and I were all exploring the possibilities of AR + AI for the first time. How far can we push spatial UX? Does this make sense or is it all in our heads? Take a look at what we’ve built.

Jump To Final Design ↓

Jump To Final Design ↓

Jump To Final Design ↓

DISCOVERY

The human desire to
revisit past experiences

We document our lives with photographs, digital albums, and journals, but these artifacts only provide brief snapshots of our memories without truly bringing back the the immersive context of the original moment.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

Photographs

Digital Albums

Journals

AR, but still 2D

While some products like the Apple Vision Pro have already started incorporating AR for memory archives, the experience is still confined to 2D screens within virtual reality.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

Apple Vision Pro

Apple Vision Pro

Apple Vision Pro

OPPORTUNITY

How might we design an immersive, interactive way for users to relive and retrieve memories while preserving the natural process of recalling them?

IDEATION

It shouldn't feel forced

Memory recall is a very personal and delicate process. Our goal was to create a gentle experience, allowing users to rediscover their memories organically, whenever the moment felt right. With that, we started ideating concepts that felt less like a structured task and more like a natural and intuitive exploration.


We were initially drawn to the idea of a physical memory shelf, storing memories as virtual artifacts for easy access. But as we explored more, we realized the modularity of artifacts contradicted with how static and restricted the bookshelf was.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

Initial Idea: Memory Shelf with AR Artifacts

Modular and organic

Building on the concept of modularity, we thought, instead of using different artifacts, why not a single, dynamic container for all memories?


Inspired by the Harry Potter crystal ball and the Inside Out memory orb, we went for a spherical form that is both modular and organic, giving off a subtle glow as a gentle reminder of the past.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

Harry Potter

Harry Potter

Harry Potter

Inside Out

Inside Out

Inside Out

After finalizing the concept, we created a storyboard to define the context and functionality of our memory orb, Lumen.

From there, I wanted to get an overall sense of their strengths and weaknesses. I selected 3 GenAI tools from companies of varied sizes, conducted multiple rounds of testing, and documented my findings.

After finalizing the concept, we created a storyboard to define the context and functionality of our memory orb, Lumen.

Storyboard

REFINEMENT

Interfaces + Interactions

We created low-fidelity prototypes of the interfaces and took static action shots to identify the camera perspectives that would best communicate Lumen's functionality and user flows.

Collaborating with GenAI

With this outline, we focused on fleshing out the key user interactions and signature moments that define the Lumen experience.

Co-working with GenAI was a new experience for me, but very rewarding and fascinating. Through many trial and errors, I found a good balance in dividing up the work, combining our strengths and weaknesses to achieve the best result.

I broke the process down into 2 main stages:

01 Immersive Experience

For exploring distant memories, we designed spatial interfaces that provide contextual information (AI-powered metadata) on each scene, including links to locations and people. Users can also edit the AI-generated captions in their own words.

AI-Generated Caption

Edited Caption

02 Constellation

Reflecting the interconnected nature of memories, we created a spatial memory constellation that allows users to see and select memories from a holistic view.

Thematic (a little random)

Thematic (a little random)

Thematic (a little random)

My initial sketch of the constellation (Mike: binary trees?) organized memories by themes, emphasizing interconnectedness but less structured.

Chronological (more structured)

Chronological (more structured)

Chronological (more structured)

Organizing memories chronologically offers a more traceable and clear categorization system than thematic groups.

03 AI Integration

Voice AI allows for fast and direct memory retrieval. We explored UI forms that align with our visual language, while also prioritizing instant feedback and responsiveness.

Black Hole (too literal)

Black Hole (too literal)

Black Hole (too literal)

Going along with our space/star theme, we drew inspiration from the black hole as a potential UI but in a less literal and more refined form.

Abstract Motion (modern + dynamic)

Abstract Motion (modern + dynamic)

Abstract Motion (modern + dynamic)

We added motion and chose a more abstract form to align with the modern and dynamic look that's often associated with AI.

Logo Development

The Lumen logo captures the round, dynamic, and modern visual language, while also serving as a visual representation of the crystal orb.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

To work with GenAI as my co-designer, I needed to know more about its capabilities. I conducted research on large language models (LLMs), neural networks, and the algorithms driving the generative process.

FINAL DESIGN

Introducing, Lumen

Lumen is a spatial memory orb that uses AR and AI to capture, categorize, and help you relive your memories. With Lumen, you can connect with your past beyond static photos or videos, experiencing a dynamic and personal journey through your life's most significant moments.

Lumen is a spatial memory orb that uses AR and AI to capture, categorize, and help you relive your memories. With Lumen, you can connect with your past beyond static photos or videos, experiencing a dynamic and personal journey through your life's most significant moments.

01

Memory Constellations

Lumen organizes your memories as spatial orbs, allowing you to explore them freely while tracing back through time. Moments from a specific period appear in a dynamic constellation, revealing connections between experiences, making the rediscovery more engaging and nostalgic.

Touch to select memory

02

Spatial Experience

Relive the memory by walking into it and experiencing it. As you move through the space, Lumen overlays AI-generated captions, recalling details like where you were, who you were with, and what happened, bringing the past to life with depth and context.

Hold out palm for the menu

03

Recalling Memories

As you gather memory orbs and navigate different chapters of your life, it's easy to lose track of cherished moments. Lumen helps you rediscover lost or distant memories with prompts like “Show me memories with my friends,” bringing them back for you to relive.

Speak to Lumen AI

REFLECTION

AR, AI, and the future of UX

AR and AI have unlocked new dimensions in today's UX landscape, but as designers, I think it's important to carefully consider their practical and ethical implications.


That's why during the ideation phase, we didn't move forward with a lot of ideas due to feasibility and ethical concerns. Now, coming back to those concepts and giving them a second chance could help us explore more potential for Lumen.

01

Memory Sharing

+ Co-Experiencing

Share memory orbs to friends who were also part of them. Like a Valorant game, users can explore the memory together, or even switch POVs.

02

Customizable

Constellation Clusters

Aside from a chronological timeline, users can curate their own constellations by theme, making it easy to save and revisit in the future.

03

Memory

Slideshow Stories

Lumen can combine photos and videos of the same memory into a cohesive story, with AI-generated captions that provide narration and context.

BEHIND THE SCENES

Last IxD group project!

I made so many good memories throughout this project and couldn't have asked for a better ending to my four years of design school :)

'25 Interaction Design

'25 Interaction Design

Next Project →

Pixelated

Research, Publication Design, GenAI

Research and opinions on Generative AI and their influences in the field of design.

Pixelated

Research, Publication Design, GenAI

Research and opinions on Generative AI and their influences in the field of design.

Pixelated

Research, Publication Design, GenAI

Research and opinions on Generative AI and their influences in the field of design.

©2025 Haipei Chen

Last Update: 2025.05.04

Last Update: 2025.05.04

Last Update: 2025.05.04