Era3D creates high-resolution 360-degree images from just one photo – GIGAZINE

“Simply by recognizing a single image, a 360-degree 3D view can be created.”Era3DIt solves the traditional multiple view problems such as “inaccuracy”, “inefficiency” and “low resolution”. The creator explains the details of Era3D on the web page, and you can also try creating multiple views quickly and easily on your browser.

Era3D: High-resolution multi-view propagation using efficient attention to each row
https://penghtyx.github.io/Era3D/

Era3D MV Demo – Embracing Face Space by pengHTYX
https://huggingface.co/spaces/pengHTYX/Era3D_MV_demo

Although the technology for generating multiple views from different angles from a small amount of material has advanced greatly, the creators of Era3DpengHTYXAccording to him, using traditional methods, images that deviate even slightly from the assumed camera type will be distorted. In addition, the multi-view calculation method used in traditional methods has a greatly increasing computational complexity as the image resolution increases, resulting in huge training costs to generate high-resolution images.

Era3D first generates shape-free images by applying a camera prediction module that estimates the focal length and elevation angle of the input image. In addition, it uses a simple and highly efficient layer called “row attention” to better integrate information from multiple perspectives. As a result, Era3D reduces the computational complexity by a factor of 12 compared to previous state-of-the-art methods. The image below illustrates Era3D’s process, and shows that by estimating the viewpoint and camera position before computation, it is possible to generate high-quality, high-speed data. The image on the right is the final image generated from another perspective, and you can see that although the car’s expression is slightly distorted, the inverted shape is successfully rendered.

In addition, several 360-degree images created with Era3D are posted as samples. In the images below, the image on the far left is the input image, the middle image is the 360-degree view, and the image on the right is the image converted to a rainbow-colored 3D original.

It is also possible to create 3D assets by entering text, such as “bulldog wearing a black pirate hat”, “pig carrying a backpack”, and “beautiful cyborg with brown hair”.

Era3D isDemo pageYou can actually try creating it from here. There are several sample images available for demonstration purposes, so let's choose a camera image.

After confirming that the image is uploaded, click “Generate Standards and Colors” to begin creation.

“Processing in 22.5 seconds” is displayed, and the generation process is completed quickly in about 20 seconds. At this time, the sample image originally has no background, but even if the image has a background, the background will be removed and uploaded automatically.

The result of creating multiple views is below. In the case of “multi-view images”, the protruding part of the lens looks strange, and the back side is painted white, but you can see that a fairly high-quality look was created quickly.

You can also try it with free image by clicking “Click to download”, so you can experience the manga “Part-time life for a brave man and a company slaveI tried to upload a profile picture.

Select the image and click “Open”. A wide range of image formats are supported, including JPEG and PNG, as well as XBM, TIFF, GIF, and SVG.

Make sure the image is uploaded and click on “Create Standards and Colors”.

The result of creating multiple views is below. The character's facial expressions are unclear, and for some reason the character has a tail that is the same color as her hair, but we were able to generate a multi-dimensional 3D view even from a 2D illustration.

Era3D details are available on GitHub.

GitHub – pengHTYX/Era3D
https://github.com/pengHTYX/Era3D