Infinite Photorealistic Worlds Using Procedural Generation

Alexander Raistrick; Lahav Lipson; Zeyu Ma; Lingjie Mei; Mingzhe Wang; Yiming Zuo; Karhan Kayan; Hongyu Wen; Beining Han; Yihan Wang; Alejandro Newell; Hei Law; Ankit Goyal; Kaiyu Yang; Jia Deng

doi:10.1109/CVPR52729.2023.01215

Infinite Photorealistic Worlds Using Procedural Generation

Alexander Raistrick
, Lahav Lipson
, Zeyu Ma
, Lingjie Mei
, Mingzhe Wang
, Yiming Zuo
, Karhan Kayan
, Hongyu Wen
, Beining Han
, Yihan Wang
, Alejandro Newell
, Hei Law
, Ankit Goyal
, Kaiyu Yang
, Jia Deng

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

75 Scopus citations

Abstract

We introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from scratch via randomized mathematical rules, using no external source and allowing infinite variation and composition. Infinigen offers broad coverage of objects and scenes in the natural world including plants, animals, terrains, and natural phenomena such as fire, cloud, rain, and snow. Infinigen can be used to generate unlimited, diverse training data for a wide range of computer vision tasks including object detection, semantic segmentation, optical flow, and 3D reconstruction. We expect Infinigen to be a useful resource for computer vision research and beyond. Please visit infinigen.org for videos, code and pre-generated data.

Original language	English (US)
Title of host publication	Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023
Publisher	IEEE Computer Society
Pages	12630-12641
Number of pages	12
ISBN (Electronic)	9798350301298
DOIs	https://doi.org/10.1109/CVPR52729.2023.01215
State	Published - 2023
Event	2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023 - Vancouver, Canada Duration: Jun 18 2023 → Jun 22 2023

Publication series

Name	Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume	2023-June
ISSN (Print)	1063-6919

Conference

Conference	2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023
Country/Territory	Canada
City	Vancouver
Period	6/18/23 → 6/22/23

All Science Journal Classification (ASJC) codes

Software
Computer Vision and Pattern Recognition

Keywords

Datasets and evaluation

Access to Document

10.1109/CVPR52729.2023.01215

Cite this

Raistrick, A., Lipson, L., Ma, Z., Mei, L., Wang, M., Zuo, Y., Kayan, K., Wen, H., Han, B., Wang, Y., Newell, A., Law, H., Goyal, A., Yang, K., & Deng, J. (2023). Infinite Photorealistic Worlds Using Procedural Generation. In Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023 (pp. 12630-12641). (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2023-June). IEEE Computer Society. https://doi.org/10.1109/CVPR52729.2023.01215

@inproceedings{dc99787b431b4467b22f84b93c4a70f0,

title = "Infinite Photorealistic Worlds Using Procedural Generation",

abstract = "We introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from scratch via randomized mathematical rules, using no external source and allowing infinite variation and composition. Infinigen offers broad coverage of objects and scenes in the natural world including plants, animals, terrains, and natural phenomena such as fire, cloud, rain, and snow. Infinigen can be used to generate unlimited, diverse training data for a wide range of computer vision tasks including object detection, semantic segmentation, optical flow, and 3D reconstruction. We expect Infinigen to be a useful resource for computer vision research and beyond. Please visit infinigen.org for videos, code and pre-generated data.",

keywords = "Datasets and evaluation",

author = "Alexander Raistrick and Lahav Lipson and Zeyu Ma and Lingjie Mei and Mingzhe Wang and Yiming Zuo and Karhan Kayan and Hongyu Wen and Beining Han and Yihan Wang and Alejandro Newell and Hei Law and Ankit Goyal and Kaiyu Yang and Jia Deng",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023 ; Conference date: 18-06-2023 Through 22-06-2023",

year = "2023",

doi = "10.1109/CVPR52729.2023.01215",

language = "English (US)",

series = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",

publisher = "IEEE Computer Society",

pages = "12630--12641",

booktitle = "Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023",

address = "United States",

}

Raistrick, A, Lipson, L, Ma, Z, Mei, L, Wang, M, Zuo, Y, Kayan, K, Wen, H, Han, B, Wang, Y, Newell, A, Law, H, Goyal, A, Yang, K & Deng, J 2023, Infinite Photorealistic Worlds Using Procedural Generation. in Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2023-June, IEEE Computer Society, pp. 12630-12641, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, Canada, 6/18/23. https://doi.org/10.1109/CVPR52729.2023.01215

Infinite Photorealistic Worlds Using Procedural Generation. / Raistrick, Alexander; Lipson, Lahav; Ma, Zeyu et al.
Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023. IEEE Computer Society, 2023. p. 12630-12641 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2023-June).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Infinite Photorealistic Worlds Using Procedural Generation

AU - Raistrick, Alexander

AU - Lipson, Lahav

AU - Ma, Zeyu

AU - Mei, Lingjie

AU - Wang, Mingzhe

AU - Zuo, Yiming

AU - Kayan, Karhan

AU - Wen, Hongyu

AU - Han, Beining

AU - Wang, Yihan

AU - Newell, Alejandro

AU - Law, Hei

AU - Goyal, Ankit

AU - Yang, Kaiyu

AU - Deng, Jia

PY - 2023

Y1 - 2023

N2 - We introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from scratch via randomized mathematical rules, using no external source and allowing infinite variation and composition. Infinigen offers broad coverage of objects and scenes in the natural world including plants, animals, terrains, and natural phenomena such as fire, cloud, rain, and snow. Infinigen can be used to generate unlimited, diverse training data for a wide range of computer vision tasks including object detection, semantic segmentation, optical flow, and 3D reconstruction. We expect Infinigen to be a useful resource for computer vision research and beyond. Please visit infinigen.org for videos, code and pre-generated data.

AB - We introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from scratch via randomized mathematical rules, using no external source and allowing infinite variation and composition. Infinigen offers broad coverage of objects and scenes in the natural world including plants, animals, terrains, and natural phenomena such as fire, cloud, rain, and snow. Infinigen can be used to generate unlimited, diverse training data for a wide range of computer vision tasks including object detection, semantic segmentation, optical flow, and 3D reconstruction. We expect Infinigen to be a useful resource for computer vision research and beyond. Please visit infinigen.org for videos, code and pre-generated data.

KW - Datasets and evaluation

UR - https://www.scopus.com/pages/publications/85218187263

UR - https://www.scopus.com/pages/publications/85218187263#tab=citedBy

U2 - 10.1109/CVPR52729.2023.01215

DO - 10.1109/CVPR52729.2023.01215

M3 - Conference contribution

AN - SCOPUS:85218187263

T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

SP - 12630

EP - 12641

BT - Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023

PB - IEEE Computer Society

T2 - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023

Y2 - 18 June 2023 through 22 June 2023

ER -

Raistrick A, Lipson L, Ma Z, Mei L, Wang M, Zuo Y et al. Infinite Photorealistic Worlds Using Procedural Generation. In Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023. IEEE Computer Society. 2023. p. 12630-12641. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition). doi: 10.1109/CVPR52729.2023.01215

Infinite Photorealistic Worlds Using Procedural Generation

Abstract

Publication series

Conference

All Science Journal Classification (ASJC) codes

Keywords

Access to Document

Other files and links

Fingerprint

Cite this