{"id":20945,"date":"2022-11-12T09:03:34","date_gmt":"2022-11-12T09:03:34","guid":{"rendered":"https:\/\/vr-room.ch\/?p=20945"},"modified":"2022-11-07T09:14:29","modified_gmt":"2022-11-07T09:14:29","slug":"nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr","status":"publish","type":"post","link":"https:\/\/vr-room.ch\/fr\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/","title":{"rendered":"Le lecteur NeRF diffuse des sc\u00e8nes volum\u00e9triques dynamiques - \u00e9galement pour la VR"},"content":{"rendered":"<h3 id=\"nerfs-repraesentieren-3d-szenen-in-einem-neuronalen-netz-eine-neue-arbeit-eines-internationalen-teams-zu-dem-auch-die-eth-zuerich-gehoert-oeffnet-die-ki-technologie-fuer-dynamische-szenen\">Les NeRF repr\u00e9sentent des sc\u00e8nes en 3D dans un r\u00e9seau neuronal. Un nouveau travail d'une \u00e9quipe internationale, dont fait partie l'EPF de Zurich, ouvre la technologie de l'IA \u00e0 des sc\u00e8nes dynamiques.<\/h3>\n<p>En \u00e9t\u00e9 2020, des chercheurs de Google ont pr\u00e9sent\u00e9 <a href=\"https:\/\/the-decoder.de\/die-welt-digital-in-3d-googles-neue-ki-versteht-das-licht\">Champs de rayonnement neuronal <\/a>(NERF) propose de cr\u00e9er un <a href=\"https:\/\/the-decoder.de\/kuenstliche-intelligenz-begriffe-erklaerung\">IA<\/a>-qui permet d'extraire des donn\u00e9es 3D en profondeur \u00e0 partir d'images 2D telles que des photos. NERF peut ainsi cr\u00e9er un mod\u00e8le 3D textur\u00e9 \u00e0 partir de plusieurs photos prises sous des angles diff\u00e9rents. Les Neural Radiance Fields (NeRF) peuvent ainsi rendre des sc\u00e8nes 3D sous des angles invisibles auparavant. Cela permet par exemple de faire un tour de cam\u00e9ra \u00e0 360 degr\u00e9s autour d'un objet, une visite par enregistrement de drone ou un vol \u00e0 l'int\u00e9rieur d'un restaurant. La technologie peut ainsi \u00eatre utilis\u00e9e pour g\u00e9n\u00e9rer des objets 3D photor\u00e9alistes.<\/p>\n<p>Dans presque tous les cas, il s'agit toutefois de sc\u00e8nes ou d'objets statiques, car les mouvements introduisent une dimension temporelle dans le processus d'entra\u00eenement, ce qui \u00e9tait jusqu'\u00e0 pr\u00e9sent difficile \u00e0 r\u00e9soudre.<\/p>\n<h3 id=\"nerfs-fuer-dynamische-szenen\">NeRFs pour les sc\u00e8nes dynamiques<\/h3>\n<p>Dans un nouveau travail de recherche, une \u00e9quipe de l'Universit\u00e9 de Buffalo, de l'EPF Zurich, d'InnoPeak Technology et de l'Universit\u00e9 de T\u00fcbingen montre maintenant comment les NeRF peuvent repr\u00e9senter des sc\u00e8nes dynamiques et apprendre ainsi une repr\u00e9sentation 4D.<\/p>\n<p>Les images RVB de diff\u00e9rentes cam\u00e9ras ou d'une seule cam\u00e9ra en mouvement servent d'entr\u00e9e. Les images montrent par exemple des personnes en mouvement ou quelqu'un qui verse du caf\u00e9 dans un verre.<\/p>\n<div id=\"attachment_9655\" class=\"wp-caption alignnone\"><a href=\"https:\/\/the-decoder.de\/wp-content\/uploads\/2022\/11\/NeRFPlayer-decomposition.jpg\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-9655 size-medium entered litespeed-loaded\" src=\"https:\/\/the-decoder.de\/wp-content\/uploads\/2022\/11\/NeRFPlayer-decomposition-770x582.jpg\" alt=\"\" width=\"770\" height=\"582\" data-lazyloaded=\"1\" aria-describedby=\"caption-attachment-9655\" data-src=\"https:\/\/the-decoder.de\/wp-content\/uploads\/2022\/11\/NeRFPlayer-decomposition-770x582.jpg\" data-ll-status=\"loaded\" \/><\/a>Pour que les NeRF apprennent des sc\u00e8nes dynamiques, un champ dit de d\u00e9composition divise la sc\u00e8ne en diff\u00e9rentes zones, puis l'\u00e9quipe divise les sc\u00e8nes dynamiques en trois mod\u00e8les temporels : statique, d\u00e9formant et nouvelles zones.<\/p>\n<\/div>\n<p>Dans le cas du caf\u00e9, la planche de bois sur laquelle repose le verre reste statique. Le contenu du verre appara\u00eet sous une nouvelle forme et la main visible se d\u00e9forme. Un champ de d\u00e9composition se charge de diviser la sc\u00e8ne en trois cat\u00e9gories. Chaque zone est repr\u00e9sent\u00e9e par un champ neuronal distinct. Dans leur approche, les chercheurs dissocient en outre les dimensions temporelles et spatiales afin d'am\u00e9liorer la repr\u00e9sentation.<\/p>\n<h3 id=\"virtual-reality-als-vision\">\u00a0La r\u00e9alit\u00e9 virtuelle comme vision<\/h3>\n<p>La repr\u00e9sentation d\u00e9compositionnelle de la sc\u00e8ne dynamique r\u00e9duit consid\u00e9rablement les artefacts visuels par rapport \u00e0 d'autres approches. L'\u00e9quipe pr\u00e9sente \u00e9galement NeRFPlayer, un moyen de diffuser en temps r\u00e9el les repr\u00e9sentations apprises avec des d\u00e9bits binaires limit\u00e9s.<\/p>\n<p>Gr\u00e2ce au framework de Nvidia <a href=\"https:\/\/the-decoder.de\/nvidia-instant-ngp-ki-grafik-ist-weiter-auf-dem-vormarsch\/\" target=\"_blank\" rel=\"noopener\">InstantNGP<\/a>La m\u00e9thode pr\u00e9sent\u00e9e est \u00e9galement rapide, gr\u00e2ce \u00e0 l'utilisation d'un r\u00e9seau neuronal capable d'apprendre en quelques secondes des repr\u00e9sentations d'images gigapixels, d'objets 3D et de NeRF.<\/p>\n<p>Dans son travail, l'\u00e9quipe d\u00e9crit l'exploration visuelle d'un environnement spatio-temporel 4D r\u00e9el pour la r\u00e9alit\u00e9 virtuelle comme une vision et consid\u00e8re son propre travail comme une contribution \u00e0 cet objectif.<\/p>\n<p>\"Explorer visuellement un espace 4D r\u00e9el librement en VR est une t\u00e2che de longue haleine. La t\u00e2che est particuli\u00e8rement stimulante lorsque peu de cam\u00e9ras RVB, voire une seule, sont utilis\u00e9es pour capturer la sc\u00e8ne dynamique\", peut-on lire dans le document.<\/p>\n<div class=\"video-block responsive-container\"><\/div>\n<p>Les d\u00e9monstrations NeRF trouvent leur origine dans un travail de recherche de Google datant de 2020 sur les vid\u00e9os de champs lumineux film\u00e9es dans l'espace.<\/p>\n<div id=\"content-end\"><\/div>\n<div class=\"article-source\">Source : Mixed \/ the decoder<\/div>","protected":false},"excerpt":{"rendered":"Les NeRF repr\u00e9sentent des sc\u00e8nes en 3D dans un r\u00e9seau neuronal. Un nouveau travail d'une \u00e9quipe internationale, dont fait partie l'ETH...","protected":false},"author":12,"featured_media":20946,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[68],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR - Schweizer Virtual Reality News<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vr-room.ch\/fr\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR - Schweizer Virtual Reality News\" \/>\n<meta property=\"og:description\" content=\"NeRFs repr\u00e4sentieren 3D-Szenen in einem neuronalen Netz. Eine neue Arbeit eines internationalen Teams, zu dem auch die ETH&hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vr-room.ch\/fr\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/\" \/>\n<meta property=\"og:site_name\" content=\"Schweizer Virtual Reality News\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-12T09:03:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-11-07T09:14:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"754\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Nathalie\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nathalie\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/\",\"url\":\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/\",\"name\":\"NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR - Schweizer Virtual Reality News\",\"isPartOf\":{\"@id\":\"http:\/\/vr-room.ch\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png\",\"datePublished\":\"2022-11-12T09:03:34+00:00\",\"dateModified\":\"2022-11-07T09:14:29+00:00\",\"author\":{\"@id\":\"http:\/\/vr-room.ch\/en\/#\/schema\/person\/1a03b3a6ced429fb4831f60fa2b37599\"},\"breadcrumb\":{\"@id\":\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#primaryimage\",\"url\":\"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png\",\"contentUrl\":\"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png\",\"width\":1200,\"height\":754,\"caption\":\"Nerf\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Startseite\",\"item\":\"http:\/\/vr-room.ch\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/vr-room.ch\/en\/#website\",\"url\":\"http:\/\/vr-room.ch\/en\/\",\"name\":\"Schweizer Virtual Reality News\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\/\/vr-room.ch\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Person\",\"@id\":\"http:\/\/vr-room.ch\/en\/#\/schema\/person\/1a03b3a6ced429fb4831f60fa2b37599\",\"name\":\"Nathalie\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"http:\/\/vr-room.ch\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/vr-room.ch\/wp-content\/uploads\/2017\/01\/avatar_user_12_1484159890-96x96.jpg\",\"contentUrl\":\"https:\/\/vr-room.ch\/wp-content\/uploads\/2017\/01\/avatar_user_12_1484159890-96x96.jpg\",\"caption\":\"Nathalie\"},\"url\":\"https:\/\/vr-room.ch\/fr\/author\/nathalie\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR - Schweizer Virtual Reality News","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vr-room.ch\/fr\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/","og_locale":"fr_FR","og_type":"article","og_title":"NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR - Schweizer Virtual Reality News","og_description":"NeRFs repr\u00e4sentieren 3D-Szenen in einem neuronalen Netz. Eine neue Arbeit eines internationalen Teams, zu dem auch die ETH&hellip;","og_url":"https:\/\/vr-room.ch\/fr\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/","og_site_name":"Schweizer Virtual Reality News","article_published_time":"2022-11-12T09:03:34+00:00","article_modified_time":"2022-11-07T09:14:29+00:00","og_image":[{"width":1200,"height":754,"url":"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png","type":"image\/png"}],"author":"Nathalie","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"Nathalie","Dur\u00e9e de lecture estim\u00e9e":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/","url":"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/","name":"NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR - Schweizer Virtual Reality News","isPartOf":{"@id":"http:\/\/vr-room.ch\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#primaryimage"},"image":{"@id":"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#primaryimage"},"thumbnailUrl":"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png","datePublished":"2022-11-12T09:03:34+00:00","dateModified":"2022-11-07T09:14:29+00:00","author":{"@id":"http:\/\/vr-room.ch\/en\/#\/schema\/person\/1a03b3a6ced429fb4831f60fa2b37599"},"breadcrumb":{"@id":"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#primaryimage","url":"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png","contentUrl":"https:\/\/vr-room.ch\/wp-content\/uploads\/2022\/11\/NeRFPlayer_-A-Streamable-Dynamic-Scene-Representation-with-Decomposed-Neural-Radiance-Fields-3-52-screenshot-e1667664753387-1200x754-1.png","width":1200,"height":754,"caption":"Nerf"},{"@type":"BreadcrumbList","@id":"https:\/\/vr-room.ch\/en\/2022\/11\/12\/nerf-player-streamt-dynamische-volumetrische-szenen-auch-fuer-vr\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Startseite","item":"http:\/\/vr-room.ch\/en\/"},{"@type":"ListItem","position":2,"name":"NeRF-Player streamt dynamische volumetrische Szenen \u2013 auch f\u00fcr VR"}]},{"@type":"WebSite","@id":"http:\/\/vr-room.ch\/en\/#website","url":"http:\/\/vr-room.ch\/en\/","name":"Schweizer Virtual Reality News","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/vr-room.ch\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"fr-FR"},{"@type":"Person","@id":"http:\/\/vr-room.ch\/en\/#\/schema\/person\/1a03b3a6ced429fb4831f60fa2b37599","name":"Nathalie","image":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"http:\/\/vr-room.ch\/en\/#\/schema\/person\/image\/","url":"https:\/\/vr-room.ch\/wp-content\/uploads\/2017\/01\/avatar_user_12_1484159890-96x96.jpg","contentUrl":"https:\/\/vr-room.ch\/wp-content\/uploads\/2017\/01\/avatar_user_12_1484159890-96x96.jpg","caption":"Nathalie"},"url":"https:\/\/vr-room.ch\/fr\/author\/nathalie\/"}]}},"_links":{"self":[{"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/posts\/20945"}],"collection":[{"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/comments?post=20945"}],"version-history":[{"count":2,"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/posts\/20945\/revisions"}],"predecessor-version":[{"id":20948,"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/posts\/20945\/revisions\/20948"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/media\/20946"}],"wp:attachment":[{"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/media?parent=20945"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/categories?post=20945"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vr-room.ch\/fr\/wp-json\/wp\/v2\/tags?post=20945"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}