LoGeR – 3D rikostrɔkshɔn frɔm rili lɔng vidio dɛn (DeepMind, UC Berkeley)

Kwɛshɔn dɛn we dɛn kin aks bɔku tɛm

Tɔn di Awa dɛn fɔ Vidio to wan Kɔhɛrɛnt 3D Wɔl

Imajin se yu de tek wan vidio fɔ wan ol ivent—wan mared sɛrimɔni, wan kɔnstrɔkshɔn wok, ɔ wan nature waka na wan fɔrɛst. Yu kin dɔn wit bɔku awa fɔ fut, bɔt na flat, linya sikyud. Wetin yu go du if yu ebul fɔ chenj da lɔng fim de we nɔ izi fɔ ol to wan 3D mɔdel we pɔsin kin ebul fɔ waka na di wan ol say we dɛn de sho di fim? Dis na di big gol fɔ LoGeR, we na wan grɔnbrɛkin risach kɔlabɔreshɔn bitwin DeepMind ɛn UC Berkeley. Dis teknɔlɔji nɔ jɔs de stich foto dɛn togɛda; i de rikostrɔk wit sɛns wan 3D wɔl we de kɔntinyu frɔm vidio strim dɛn we de lɔng insay ɔl tu di tɛm ɛn di fizik pat, we de takɛl wan pan di mɔs impɔtant chalenj dɛn na kɔmpyuta vishɔn.

Di Kɔr Chalenj: Kɔnsistɛns Ɔva Vast Skel

Tradishɔnal 3D rikostrɔkshɔn we dɛn kin yuz kin fayn wit shɔt vidio klip dɛn ɔ wan kɔlekɛshɔn fɔ foto dɛn we dɛn tek frɔm difrɛn angul dɛn di sem tɛm. Bɔt, dɛn kin strɛs bad bad wan wit "lɔng" vidio dɛn. Di prɔblɛm dɛn we kin apin kin gɛt tu tin dɛn. Fɔs, tɛmporal lɔng: as di fim de strɛch fɔ minit ɔ awa, layt de chenj, tin dɛn de muf, ɛn pipul dɛn de kam ɛn go. Sɛkɔn, spatial skel: di kamɛra kin travul na big eria, lɛk fɔ waka na pak ɛn go insay wan bildin, we kin mek wan big ɛn kɔmpleks ples fɔ map. Bɔku tɛm, di sistɛm dɛn we de naw nɔ kin ebul fɔ kip wan kɔnsistɛns glob ɔl map, we kin mek dɛn gɛt disjɔyn rikostrɔkshɔn ɔ "floaters"—ghostly artifacts we nɔ de pan ɛni surface. LoGeR de adrɛs dis bay we i de pe atɛnshɔn fɔ bil wan yunifayd ripɔt we de kɔntinyu fɔ kɔrɛkt akɔdin to dɛn big big skel ya fɔ tɛm ɛn spɛs.

Aw LoGeR De Achiv Kɔhɛrɛnt Rikɔnstrɔkshɔn

LoGeR, we tinap fɔ Lɔng Jɛnɛretiv Rikɔnstrɔkshɔn, de introduks wan nyu we we de sɛntrɛd pan wan "sid initialization" strateji. Insted fɔ tray fɔ bil di ɔl 3D scene wan tɛm frɔm wan chaotic vidio strim, di sistem fɔs de no wan smɔl, manejable segment na di vidio we izi fɔ rikostrɔk wit ay kɔnfidɛns. Dis ay kwaliti 3D pat de wok lɛk stebul ankɔ ɔ "sid." Dɔn di mɔdel de gro dis 3D ripreshɔn inkrimɛntal wan, freym bay freym, tek tɛm inkɔrpɔret nyu vijual infɔmeshɔn we i de rɛfrɛns bak to di sid we dɛn dɔn establish fɔ mek shɔ se di glob ɔl kɔnsistɛns. Dis mεtכd de alaw di mכdel fכ avכyd di kכmכn trap dεm fכ skel, we de mek wan mכr akכrd εn rilibul 3D mכdel frכm di ekstrim lכng input. Na shift frɔm we yu de tray fɔ si di wan ol pikchɔ wan tɛm to bil am frɔm wan kɔr we yu kin trɔst.

Praktikal Aplikeshɔn fɔ Biznɛs ɛn Krieta dɛn

Di pɔtnɛshɛl aplikeshɔn fɔ wan teknɔlɔji lɛk LoGeR na bɔku bɔku wan. Fɔ akitɔk ɛn rial ɛstate divɛlɔpa dɛn, i kin transfɔm sayt sɔv, alaw wan simpul vidio wok-thru fɔ jenarayz wan ditayl 3D mɔdel fɔ wan prɔpati. Insay ɛnjɔymɛnt, di wan dɛn we de mek fim kin mek dijital sɛt dɛn frɔm bɔku bɔku fim dɛn we dɛn kin yuz fɔ skaut usay dɛn de. Fɔ lɔjistik ɛn westɛm manejmɛnt, i kin mek dɛn ebul fɔ mek di dinamik 3D map fɔ big big fasiliti dɛn. Dis abiliti fɔ mek wan kɔhiv dijital twin frɔm vidio we nɔ strɔkchɔ na pawaful tul. Na Mewayz, wi si wan natura sinajɛs wit dis teknɔlɔji. Wi modular biznɛs OS na fɔ intagret ɛn strɔkchɔ kɔmpleks data strim dɛn. Imajin wan prɔjek manejmɛnt mɔdyul usay wan sayt inspekshɔn vidio de ɔtomɛtik prosɛs bay wan tul lɛk LoGeR, ɛn di 3D mɔdel we kɔmɔt de kin link wantɛm wantɛm to task list, invɛntari, ɛn tɛmlayn insay di Mewayz pletfɔm, we de gi wan tru tru imɛrsiv ɛn data-rich we fɔ si di prɔjek prɔgrɛs.

Luk bifo: Di Fiuja fɔ Spatiotemporal Ɔndastandin

LoGeR riprizent wan signifyant lip to AI sistem we kin ɔndastand wi wɔl nɔto jɔs lɛk wan siriɔs snɛpsho, bɔt as kɔntinyu, evolv 4D spɛs (3D + tɛm). Fyuchɔ itɛreshɔn kin trak ɔbjɛkt ɛn pipul dɛn seamles wan akɔdin to awa, ɔndastand nɔto jɔs usay tin dɛn de, bɔt aw dɛn kin chenj ɛn intarakt fɔ lɔng tɛm. Dis spatiotemporal ɔndastandin na di nɛks frɔnt. Fɔ pletfɔm dɛn lɛk Mewayz, we aim fɔ bi di sɛntral ɔpreshɔn sistɛm fɔ wan biznɛs, fɔ intagret dɛn kayn advans spatial data kapabiliti dɛn de kin rivɔlɔshɔn aw kɔmni dɛn kin plan, monitar, ɛn analayz fizik ɔpreshɔn. I de muv wi klos to wan fiuja usay di dijital ɛn fizik wɔl dɛn de miks we nɔ gɛt wan prɔblɛm fɔ mek wi ebul fɔ disayd fɔ du sɔntin we smat.