This AI transforms your regular images into interactive 3D scenes
World Labs, the start-up led by artificial intelligence pioneer Fei-Fei Li, has unveiled its first project. The innovative tech is an AI system that can turn a single image into an interactive 3D scene. This is what makes it unique from other AI systems that can only turn photos into static 3D models or environments.
AI system offers immersive 3D exploration
The AI system created by World Labs lets users dive into any image and explore it in 3D. As the company said, "Beyond the input image, all is generated." The scenes generated are not just visually stunning but also interactive. They can be easily navigated with a keyboard and mouse on World Labs's website, providing a unique experience to the users.
World Labs's AI system ensures consistency in 3D scenes
World Labs's AI system falls into a new category of AI called "world models." Unlike other models that tend to suffer from artifacting and consistency issues, this one ensures that once scenes are generated, they don't change and follow basic physics laws. This means they retain a sense of solidity and depth, offering a more realistic 3D experience for users.
AI system enhances scenes with interactive effects
Along with keeping things consistent, World Labs's AI can also spice up scenes with interactive effects and animations. These effects range from changing the color of objects to dynamically lighting backdrops. The company says "generating in 3D instead improves control and consistency," which could transform the way we create movies, games, simulators, and other digital representations of our physical world.
World Labs acknowledges room for improvement in AI system
Despite its innovative features, World Labs admits there's still room for improvement in their AI system. As of now, the scenes aren't fully explorable and occasional rendering errors are seen. However, the company promises this is just an "early preview" and they are actively working on improving the size and fidelity of their generated worlds and looking at new ways for users to interact with them.
World Labs aims to revolutionize professional fields with AI
Having raised $230 million in venture capital and valued at over $1 billion, World Labs plans to build tools that could help professionals such as artists, designers, developers, filmmakers, and engineers. "[World models] will let you not just get an image or a clip out but a fully simulated vibrant and interactive 3D world," the company's co-founder Justin Johnson said on a recent a16z podcast.
