How should interaction and interface evolve
when AI becomes a creative partner in thinking?
We designed FIELD, a unified hardware–software system designed to transform human–AI dialogue from linear exchange into a multimodal thinking medium.
2026 PRODUCT DESIGN
AI Concept
UI design
IOS
Overview
CLIENT
MDES student
Time
2026
Team
2 Designers, 1 Researcher, 1 Developer
Role
Product Designer
My Role
My biggest contributions:
Designed the UI system across 7 core interaction modes.
Led gesture motion asset development through vibecoding
Worked closely with the developer to ship the final app.
Solution
We created FIELD device and its unique design system, exploring how device and gesture based interaction can enhance the human-AI co-creation process.
FIELD is a unified hardware–software system designed to transform human–AI dialogue from linear exchange into an embodied, multimodal thinking medium.
On FIELD, Software becomes a canvas that externalizes human–AI dialogue as handleable digital artifacts.
FIELD is innately multi-modal. Voice becomes the primary semantic input and gesture is an embodied input.
Context
AI is becoming a creative partner, but the interface still treats dialogue as a scrolling text log.
Information piles up faster than you can track and connect it
AI's early responses set the frame, so people drift from directing their thinking to just editing within the AI's frame.
Human thinking, by contrast, is gestural and spatial. It doesn't work as a sequence of typed commands.
Gesture Research
We grounded the work in embodied cognition research and ran it as research-through-design.
Impact
The final iPad app was exhibited at a gallery. The booth drew industry interest beyond the academic audience: four PMs from Microsoft's Copilot, Xbox, and AI teams, and five Surface team designers, including the design lead, came to see it.
Exhibited publicly at the Henry Art Gallery for a month
