This generative AI startup is strapping cameras to folks’s backs

Date:

Share post:

A startup is coaching an AI system that it claims will allow creators to generate cinematic worlds, with full management over the surroundings, characters, lighting, and movement. How? By having people strap cameras to their backs and hike world wide.

Odyssey, based by self-driving pioneers Oliver Cameron and Jeff Hawke (Cameron was beforehand the VP of product at Cruise), says it’s created an “advanced camera capture system” that may gather information nearly wherever an individual can attain. Weighing about 25 kilos, the system packs six cameras, two lidar sensors, and an inertial measurement unit.

Bearing a resemblance to Google’s Road View Trekker, the system can seize its environment in “3.5K resolution” and 360 levels, with “physics-accurate” depth info metadata hooked up.

So what’s the purpose? Properly, Odyssey says it’s taking information from the system and feeding it by algorithms to “capture the fine details that make up our world.” Basically, the corporate’s producing digital reconstructions of real-world scenes a la Meta’s Hyperscape mission — scenes with forests, caves, trails, seashores, glaciers, parks, buildings, and so forth.

One among Odyssey’s recreated scenes. Picture Credit:Odyssey

Now, it’s not completely clear how these reconstructions will translate to raised generative instruments for creatives. Cameron and Hawke have beforehand stated that Odyssey has developed a number of generative AI fashions that create layers of visible element, together with object geometry, lighting, and movement, after which mix these right into a single digital “world” to create desired scenes.

Even one of the best “world models” right now have limitations, nonetheless — and Odyssey doesn’t declare to have solved all these. Nonetheless, it’s securing money to forge forward.

Odyssey right now introduced that it raised $18 million in a Sequence A funding spherical led by EQT Ventures with participation from GV and Air Road Capital. The brand new cash, which brings the corporate’s whole raised to $27 million, will likely be put towards scaling up Odyssey’s information assortment operations in California.

Odyssey plans to broaden its information assortment to different states and nations sooner or later — with privateness protections in place, one would hope. (Google’s Road View workforce, for one, has discovered itself within the crosshairs of regulators for capturing photographs of public locations that violated bystanders’ privateness.)

“We think it will be impossible for generative models to generate Hollywood-grade worlds that feel alive without training on a vast volume of rich, multimodal real-world 3D data,” the corporate wrote in a publish on its weblog. “We believe an advanced generative world-building model will unlock a better way to create film, games, and more.”

Related articles

The 29 finest software reward concepts for the handyperson in your life

MakerHawk Sort-C USB Tester VoltmeterIf you happen to’ve ever questioned whether or not the USB-C cables or units...

Apple’s AI-infused Remaining Lower Professional 11 is now out there

With its greatest replace to Remaining Lower Professional (FCP) in years, Apple could also be re-embracing the skilled...

Snapchat will quickly be capable to alert dad and mom when their teen leaves or arrives at sure places

Snapchat is bringing enhanced location sharing to Household Heart, its parental controls hub, the corporate introduced Thursday. Customers have...

The very best gaming mouse in 2024

No gaming mouse will magically cease you from getting wrecked in Counter-Strike or Name of Obligation, however ...