This generative AI startup is strapping cameras to folks’s backs

Date:

Share post:

A startup is coaching an AI system that it claims will allow creators to generate cinematic worlds, with full management over the surroundings, characters, lighting, and movement. How? By having people strap cameras to their backs and hike world wide.

Odyssey, based by self-driving pioneers Oliver Cameron and Jeff Hawke (Cameron was beforehand the VP of product at Cruise), says it’s created an “advanced camera capture system” that may gather information nearly wherever an individual can attain. Weighing about 25 kilos, the system packs six cameras, two lidar sensors, and an inertial measurement unit.

Bearing a resemblance to Google’s Road View Trekker, the system can seize its environment in “3.5K resolution” and 360 levels, with “physics-accurate” depth info metadata hooked up.

So what’s the purpose? Properly, Odyssey says it’s taking information from the system and feeding it by algorithms to “capture the fine details that make up our world.” Basically, the corporate’s producing digital reconstructions of real-world scenes a la Meta’s Hyperscape mission — scenes with forests, caves, trails, seashores, glaciers, parks, buildings, and so forth.

One among Odyssey’s recreated scenes. Picture Credit:Odyssey

Now, it’s not completely clear how these reconstructions will translate to raised generative instruments for creatives. Cameron and Hawke have beforehand stated that Odyssey has developed a number of generative AI fashions that create layers of visible element, together with object geometry, lighting, and movement, after which mix these right into a single digital “world” to create desired scenes.

Even one of the best “world models” right now have limitations, nonetheless — and Odyssey doesn’t declare to have solved all these. Nonetheless, it’s securing money to forge forward.

Odyssey right now introduced that it raised $18 million in a Sequence A funding spherical led by EQT Ventures with participation from GV and Air Road Capital. The brand new cash, which brings the corporate’s whole raised to $27 million, will likely be put towards scaling up Odyssey’s information assortment operations in California.

Odyssey plans to broaden its information assortment to different states and nations sooner or later — with privateness protections in place, one would hope. (Google’s Road View workforce, for one, has discovered itself within the crosshairs of regulators for capturing photographs of public locations that violated bystanders’ privateness.)

“We think it will be impossible for generative models to generate Hollywood-grade worlds that feel alive without training on a vast volume of rich, multimodal real-world 3D data,” the corporate wrote in a publish on its weblog. “We believe an advanced generative world-building model will unlock a better way to create film, games, and more.”

Related articles

Will Sam Altman all the time win the OpenAI board battle in an AI agent simulation?

Be a part of our every day and weekly newsletters for the newest updates and unique content material...

Courageous Search provides AI chat for follow-up questions after your preliminary question

Courageous introduced on Thursday that it’s introducing an AI chat mode for follow-up questions based mostly on preliminary...

Sonos audio system and soundbars are as much as $200 off forward of Black Friday

Excellent news: Black Friday has come early for Sonos followers. Now by December 2nd, you may doubtlessly save...

Black Friday TV offers embody Samsung Body TVs for 40 % off

There are Black Friday offers on sorts of tech goodies already obtainable. However how about snapping up a...