A feed-forward model capable of reconstructing 3D scenes parameterized by 3D Gaussians from unposed sparse multi-view images.
a blog of links related to computer animation and production technology Sponsored by ReelMatters.com
Category: photogrammetry
-
Niantic SPZ – open source, compressed gaussian splats file format
https://scaniverse.com/news/spz-gaussian-splat-open-source-file-format
https://github.com/nianticlabs/spz
• Slashes file sizes by 90% (250MB → 25MB) with virtually zero quality loss
• Lightning-fast uploads/downloads, especially on mobile
• Dramatically reduced memory footprint
• Enables real-time processing right on your phoneTech breakthrough:
• Smart compression of position, rotation, color & scale data
• Column-based organization for maximum efficiency
• Innovative fixed-point quantization & log encodinghttps://www.8thwall.com/products/niantic-studio
-
Apple releases Depth Pro – An open source AI model that rewrites the rules of 3D vision
The model is fast, producing a 2.25-megapixel depth map in 0.3 seconds on a standard GPU.
https://github.com/apple/ml-depth-pro
https://arxiv.org/pdf/2410.02073
-
EVER (Exact Volumetric Ellipsoid Rendering) – Gaussian splatting alternative
https://radiancefields.com/how-ever-(exact-volumetric-ellipsoid-rendering)-does-this-work
https://half-potato.gitlab.io/posts/ever/
Unlike previous methods like Gaussian Splatting, EVER leverages ellipsoids instead of Gaussians and uses Ray Tracing instead of Rasterization. This shift eliminates artifacts like popping and blending inconsistencies, offering sharper and more accurate renderings.
-
Meta Horizon Hyperscape
𝐌𝐞𝐭𝐚 𝐇𝐲𝐩𝐞𝐫𝐬𝐜𝐚𝐩𝐞 𝐢𝐧 𝐚 𝐧𝐮𝐭𝐬𝐡𝐞𝐥𝐥
Hyperscape technology allows us to scan spaces with just a phone and create photorealistic replicas of the physical world with high fidelity. You can experience these digital replicas on the Quest 3 or on the just announced Quest 3S.https://www.youtube.com/clip/UgkxGlXM3v93kLg1D9qjJIKmvIYW-vHvdbd0
𝐇𝐢𝐠𝐡 𝐅𝐢𝐝𝐞𝐥𝐢𝐭𝐲 𝐄𝐧𝐚𝐛𝐥𝐞𝐬 𝐚 𝐍𝐞𝐰 𝐒𝐞𝐧𝐬𝐞 𝐨𝐟 𝐏𝐫𝐞𝐬𝐞𝐧𝐜𝐞
This level of photorealism will enable a new way to be together, where spaces look, sound, and feel like you are physically there.
𝐒𝐢𝐦𝐩𝐥𝐞 𝐂𝐚𝐩𝐭𝐮𝐫𝐞 𝐩𝐫𝐨𝐜𝐞𝐬𝐬 𝐰𝐢𝐭𝐡 𝐲𝐨𝐮𝐫 𝐦𝐨𝐛𝐢𝐥𝐞 𝐩𝐡𝐨𝐧𝐞
Currently not available, but in the future, it will offer a new way to create worlds in Horizon and will be the easiest way to bring physical spaces to the digital world. Creators can capture physical environments on their mobile device and invite friends, fans, or customers to visit and engage in the digital replicas.𝐂𝐥𝐨𝐮𝐝-𝐛𝐚𝐬𝐞𝐝 𝐏𝐫𝐨𝐜𝐞𝐬𝐬𝐢𝐧𝐠 𝐚𝐧𝐝 𝐑𝐞𝐧𝐝𝐞𝐫𝐢𝐧𝐠
Using Gaussian Splatting, a 3D modeling technique that renders fine details with high accuracy and efficiency, we process the model input data in the cloud and render the created model through cloud rendering and streaming on Quest 3 and the just announced Quest 3S.𝐓𝐫𝐲 𝐢𝐭 𝐨𝐮𝐭 𝐲𝐨𝐮𝐫𝐬𝐞𝐥𝐟
If you are in the US and you have a Meta Quest 3 or 3S you can try it out here:https://www.meta.com/experiences/meta-horizon-hyperscape-demo/7972066712871980/
-
2DGS – 2D Gaussian Splatting for Geometrically Accurate Radiance Fields
A 2D Gaussian Splats technique for extracting cleaner 3D geometry from 3DGS
https://github.com/hbb1/2d-gaussian-splatting
https://surfsplatting.github.io/
https://colab.research.google.com/drive/1qoclD7HJ3-o0O1R8cvV3PxLhoDCMsH8W
3D Gaussian Splatting (3DGS) has recently revolutionized radiance field reconstruction, achieving high quality novel view synthesis and fast rendering speed without baking. However, 3DGS fails to accurately represent surfaces due to the multi-view inconsistent nature of 3D Gaussians. We present 2D Gaussian Splatting (2DGS), a novel approach to model and reconstruct geometrically accurate radiance fields from multi-view images. Our key idea is to collapse the 3D volume into a set of 2D oriented planar Gaussian disks. Unlike 3D Gaussians, 2D Gaussians provide view-consistent geometry while modeling surfaces intrinsically. To accurately recover thin surfaces and achieve stable optimization, we introduce a perspective-accurate 2D splatting process utilizing ray-splat intersection and rasterization. Additionally, we incorporate depth distortion and normal consistency terms to further enhance the quality of the reconstructions. We demonstrate that our differentiable renderer allows for noise-free and detailed geometry reconstruction while maintaining competitive appearance quality, fast training speed, and real-time rendering.
-
Generate 3D from ANY Video! │Gaussian Splatting Tutorial w/ Postshot and Blender
After Effects Gaussian Splatting Plugin:
https://aescripts.com/gaussian-splatting/?aff=60Blender Gaussian Splatting Plugin: (kinda buggy)
https://github.com/ReshotAI/gaussian-splatting-blender-addonPostShot
https://www.pixelsham.com/2024/04/03/jawset-postshot-run-gaussian-splatting-with-a-ui-on-your-pc/
-
STL2PNG Converter
Convert STL files to PNG heightmap images for use with 3D printing.
https://fenrus75.github.io/FenrusCNCtools/javascript/stl2png.html
-
Convert 2D Images to 3D Models
- HyperHuman Rodin – free and pay per use
- LumaLabs Genie – free, web based
- Vectary – free and monthly fees, web based
- Selva3D – pay per use
- 3D-Tool – one off payment
- Insight3d – free and open-source
- ItsLitho – free, web based
- Blender – free
- SculptGL – free, web based
- Embossify – pay per use, web based
- Smoothie-3D – free, web based
- ZW3D – one off payment
- ImageToSTL – free, web based
- Alpha3D – First 50 AI-generated 3D assets free
- Reliefmod – free, web based
- 3D Builder – free
- Cube by CSM.ai – web based
- Kaedim3D – monthly and pay per use fees
- 3DForPrint – free, web based
- ZoeDepth – free, web based
- ZoeDepth Colab notebook – easy to use interface for the depth estimation model “ZoeDepth”
- TilingZoeDepth – higher resolution free web based
- DreamGaussian – free, web based
- Photoshop Neural Filters – monthly fees
- DepthR – pay per use
- Materialize – open source
- VistaSculpt – monthly fees
- STL2PNG Converter – free
- Hi3D – free
- Meshy.ai – Text to 3D – free and pay per use
https://www.rankred.com/convert-2d-images-to-3d/
-
Open3d.org – An open source library that supports rapid development of software that deals with 3D data
Core features
- 3D data structures
- 3D data processing algorithms
- Scene reconstruction
- Surface alignment
- 3D visualization with Physically based rendering (PBR)
- 3D machine learning support with PyTorch and TensorFlow
- GPU acceleration for core 3D operations
- Available in C++ and Python with a 3D viewer app.
Categories
- 3Dprinting (167)
- A.I. (521)
- animation (328)
- blender (178)
- colour (220)
- commercials (45)
- composition (144)
- cool (357)
- design (606)
- Featured (46)
- hardware (289)
- IOS (106)
- jokes (133)
- lighting (268)
- modeling (102)
- music (182)
- photogrammetry (150)
- photography (736)
- production (1,217)
- python (77)
- quotes (475)
- reference (295)
- software (1,270)
- trailers (287)
- ves (504)
- VR (218)