Virtual Community - An Open World for Humans, Robots, and Society

Key Features

Virtual Community integrates geospatial data with generative models to create interactive, scalable open-world scenes with socially grounded agent communities.

Scalable Simulation-Ready Scenes

A fully automatic online pipeline that creates 3D scenes with real-world geospatial data and generative models.

Real World Grounded Geospatial Scenes

Geospatial data ensures the diversity and scale of outdoor 3D scenes.

Automatic Semantic Annotations

Locations and objects automatically labeled within scenes

Semantic Annotations Example

Interactive Indoor Scenes and Objects

Indoor scenes and objects created according to place annotations.

Agent Community

Leverage foundation models and real-world annotations to generate communities and simulate with Genesis physics engine.

Agent Community Generation

LLM-powered profiles with personalities and social connections

Automatic traffic system

pedestrian flow, vehicle flow, transit system

Human and robot interaction

Genesis powers physically realistic robot interactions in the community

Robot simulation with contact visualized

Robotic Agents

Social and Physical Interaction

Scene-Grounded Agent Communities

Real World Grounded Geospatial Scenes

Research Team

Xiangye Lin

Xiangye Lin

Yutian Chen

Yutian Chen

Wenjun Liu

Wenjun Liu

Zunzhe Zhang

Zunzhe Zhang

Qiushi Lyu

Qiushi Lyu

Xinyu Sun

Xinyu Sun

Jincheng Yang

Jincheng Yang

Zeyuan Wang

Zeyuan Wang

Bao Chi Dang

Bao Chi Dang

Daksha Ladia

Daksha Ladia

Jiageng Liu

Jiageng Liu

Chuang Gan

Chuang Gan