Room of Thoughts: Exploring the Role of AI Assistants in 3D Space

Abstract

We present Room of Thoughts, a novel way to interact with Large Language Models (LLMs) in a visual, graphical interface within augmented reality on Apple Vision Pro. Room of Thoughts combines visualized organization with spatial anchoring by using virtual windows embedded within the user’s physical room that are separated by topic and logically connected by visual links. Room of Thoughts aims to make interaction with LLMs more visual and more engaging, and enable higher levels of exploration and learning.