Virtual Community

An Open World for Humans, Robots, and Society

Get Started Read Paper Run Code

Key Features

Virtual Community integrates geospatial data with generative models to create interactive, scalable open-world scenes with socially grounded agent communities.

Scalable Simulation-Ready Scenes

A fully automatic online pipeline that creates 3D scenes with real-world geospatial data and generative models.

Real World Grounded Geospatial Scenes
Geospatial data ensures the diversity and scale of outdoor 3D scenes.
Automatic Semantic Annotations
Locations and objects automatically labeled within scenes
Semantic Annotations Example
Interactive Indoor Scenes and Objects
Indoor scenes and objects created according to place annotations.

Agent Community

Leverage foundation models and real-world annotations to generate communities and simulate with Genesis physics engine.

Agent Community Generation
LLM-powered profiles with personalities and social connections
Automatic traffic system
pedestrian flow, vehicle flow, transit system
Human and robot interaction
Genesis powers physically realistic robot interactions in the community
Robot simulation with contact visualized

Robotic Agents

Bitcraze Crazyflie 2

UniTree H1

UniTree Go2

Husky Robot

Boston Dynamics Spot

Google Robot

Social and Physical Interaction

Group Discussion

Assault

Human Interacting with Robot

Political Campaign

Public Proposal

Dancing Together

Robot Moving to Human

Robot Following Human

Scene-Grounded Agent Communities

Florence

Madrid

Denver

London

New York

Amsterdam

Real World Grounded Geospatial Scenes

Amsterdam, Netherlands

New York, United States

Bratislava, Slovakia

Brussels, Belgium

Calgary, Canada

Hamburg, Germany

Columbus, United States

Florence, Italy

London, United Kingdom

Detroit, United States

Denver, United States

Charlotte, United States

Research Team

Qinhong Zhou

Qinhong Zhou

Hongxin Zhang

Hongxin Zhang

Xiangye Lin

Xiangye Lin

Zheyuan Zhang

Zheyuan Zhang

Yutian Chen

Yutian Chen

Wenjun Liu

Wenjun Liu

Zunzhe Zhang

Zunzhe Zhang

Sunli Chen

Sunli Chen

Lixing Fang

Lixing Fang

Qiushi Lyu

Qiushi Lyu

Xinyu Sun

Xinyu Sun

Jincheng Yang

Jincheng Yang

Zeyuan Wang

Zeyuan Wang

Bao Chi Dang

Bao Chi Dang

Zhehuan Chen

Zhehuan Chen

Daksha Ladia

Daksha Ladia

Jiageng Liu

Jiageng Liu

Chuang Gan

Chuang Gan

1
UMass
2 JHU
3 CMU