Translating Words to Worlds: Zero-Shot Synthesis of 3D Terrain from Textual Descriptions Using Large Language Models
文献类型：期刊论文
| 作者 | Zhang, Guangzi2; Chen, Lizhe2; Zhang, Yu2; Liu, Yan2; Ge, Yuyao1,2,3; Cai, Xingquan2 |
| 刊名 | APPLIED SCIENCES-BASEL
 |
| 出版日期 | 2024-04-01 |
| 卷号 | 14期号:8页码:19 |
| 关键词 | text-to-3D multiagent chain-of-thought large language model LLM's spatial awareness terrain synthesis |
| DOI | 10.3390/app14083257 |
| 英文摘要 | The current research on text-guided 3D synthesis predominantly utilizes complex diffusion models, posing significant challenges in tasks like terrain generation. This study ventures into the direct synthesis of text-to-3D terrain in a zero-shot fashion, circumventing the need for diffusion models. By exploiting the large language model's inherent spatial awareness, we innovatively formulate a method to update existing 3D models through text, thereby enhancing their accuracy. Specifically, we introduce a Gaussian-Voronoi map data structure that converts simplistic map summaries into detailed terrain heightmaps. Employing a chain-of-thought behavior tree approach, which combines action chains and thought trees, the model is guided to analyze a variety of textual inputs and extract relevant terrain data, effectively bridging the gap between textual descriptions and 3D models. Furthermore, we develop a text-terrain re-editing technique utilizing multiagent reasoning, allowing for the dynamic update of the terrain's representational structure. Our experimental results indicate that this method proficiently interprets the spatial information embedded in the text and generates controllable 3D terrains with superior visual quality. |
| 资助项目 | Project of Humanities and Social Sciences of the Ministry of Education in China |
| WOS研究方向 | Chemistry ; Engineering ; Materials Science ; Physics |
| 语种 | 英语 |
| WOS记录号 | WOS:001210735000001 |
| 出版者 | MDPI |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/38998]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Zhang, Guangzi; Chen, Lizhe |
| 作者单位 | 1.Chinese Acad Sci, Inst Comp Technol, CAS Key Lab AI Secur, Beijing 100190, Peoples R China 2.North China Univ Technol, Coll Informat, Beijing 100144, Peoples R China 3.Univ Chinese Acad Sci, Beijing 101408, Peoples R China |
| 推荐引用方式 GB/T 7714 | Zhang, Guangzi,Chen, Lizhe,Zhang, Yu,et al. Translating Words to Worlds: Zero-Shot Synthesis of 3D Terrain from Textual Descriptions Using Large Language Models[J]. APPLIED SCIENCES-BASEL,2024,14(8):19. |
| APA | Zhang, Guangzi,Chen, Lizhe,Zhang, Yu,Liu, Yan,Ge, Yuyao,&Cai, Xingquan.(2024).Translating Words to Worlds: Zero-Shot Synthesis of 3D Terrain from Textual Descriptions Using Large Language Models.APPLIED SCIENCES-BASEL,14(8),19. |
| MLA | Zhang, Guangzi,et al."Translating Words to Worlds: Zero-Shot Synthesis of 3D Terrain from Textual Descriptions Using Large Language Models".APPLIED SCIENCES-BASEL 14.8(2024):19. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。