a blog of links related to computer animation and production technology Sponsored by ReelMatters.com
-
Artificial Analysis Mochi 1 – an open source text 2 video model
Mochi 1 AI operates on a pay-as-you-go model, meaning you only pay for the services you utilize without any hidden fees.
-
Niantic SPZ – open source, compressed gaussian splats file format
https://scaniverse.com/news/spz-gaussian-splat-open-source-file-format
https://github.com/nianticlabs/spz
• Slashes file sizes by 90% (250MB → 25MB) with virtually zero quality loss
• Lightning-fast uploads/downloads, especially on mobile
• Dramatically reduced memory footprint
• Enables real-time processing right on your phoneTech breakthrough:
• Smart compression of position, rotation, color & scale data
• Column-based organization for maximum efficiency
• Innovative fixed-point quantization & log encodinghttps://www.8thwall.com/products/niantic-studio
-
Motionity – The free, open source web-based motion graphics editor for everyone
https://www.producthunt.com/products/motionity
Motionity is an free and open source animation editor in the web. It’s a mix of After Effects and Canva, with powerful features like keyframing, masking, filters, and more, and integrations to browse for assets to easily drag and drop into your video.
-
Apple releases Depth Pro – An open source AI model that rewrites the rules of 3D vision
The model is fast, producing a 2.25-megapixel depth map in 0.3 seconds on a standard GPU.
https://github.com/apple/ml-depth-pro
https://arxiv.org/pdf/2410.02073
-
Open3d.org – An open source library that supports rapid development of software that deals with 3D data
Core features
- 3D data structures
- 3D data processing algorithms
- Scene reconstruction
- Surface alignment
- 3D visualization with Physically based rendering (PBR)
- 3D machine learning support with PyTorch and TensorFlow
- GPU acceleration for core 3D operations
- Available in C++ and Python with a 3D viewer app.
-
FLUX – The First Ever Open Source text-2-image Model and ComfyUI implementation
FLUX is a creation of Black Forest Labs, with its team primarily consisting of the original StableDiffusion developers.
https://fal.ai/models/fal-ai/flux
https://github.com/black-forest-labs/flux
It comes in three models:
- FLUX.1 [dev]: The base model, open-sourced with a non-commercial license for community to build on top of
- FLUX.1 [schnell]: A distilled version of the base model that operates up to 10 times faster. Apache 2 Licensed.
- FLUX.1 [pro]: A closed-source version only available through API. https://docs.bfl.ml/
ComfyUI implementation :
-
Pallaidium – a free and open source genAI movie studio integrated into the free Blender video editor
https://github.com/tin2tin/Pallaidium/
Features
Text to video Text to audio Text to speech Text to image Image to image Image to video Video to video Image to text ControlNet OpenPose ADetailer IP Adapter Face/Style Canny Illusion Multiple LoRAs Segmind distilled SDXL Seed Quality steps Frames Word power Style selector Strip power Batch conversion Batch refinement of images. Batch upscale & refinement of movies. Model card selector. Render-to-path selector. Render finished notification. Model Cards One-click install and uninstall dependencies. User-defined file path for generated files. Seed and prompt added to strip name. 
-
LocalSend.org – Share files to nearby devices. Free, open source, cross-platform.
https://localsend.org/
-
OpenGlass – Open Source Smart Glasses
https://github.com/BasedHardware/OpenGlass
Turn any glasses into hackable smart glasses with less than $25 of off-the-shelf components. Record your life, remember people you meet, identify objects, translate text, and more.
-
Chinese’s DeepSeek-Coder-V2 – Breaking the Barrier of Closed-Source Models in open source Code Intelligence
An open-source Mixture-of-Experts (MoE) code language model that achieves performance comparable to GPT4-Turbo in code-specific tasks. Specifically, DeepSeek-Coder-V2 is further pre-trained from an intermediate checkpoint of DeepSeek-V2 with additional 6 trillion tokens. Through this continued pre-training, DeepSeek-Coder-V2 substantially enhances the coding and mathematical reasoning capabilities of DeepSeek-V2, while maintaining comparable performance in general language tasks. Compared to DeepSeek-Coder-33B, DeepSeek-Coder-V2 demonstrates significant advancements in various aspects of code-related tasks, as well as reasoning and general capabilities. Additionally, DeepSeek-Coder-V2 expands its support for programming languages from 86 to 338, while extending the context length from 16K to 128K.
https://github.com/deepseek-ai/DeepSeek-Coder-V2
-
DreamWorks Animation to Release MoonRay as Open Source
https://www.awn.com/news/dreamworks-animation-release-moonray-open-source
MoonRay is DreamWorks’ open-source, award-winning, state-of-the-art production MCRT renderer, which has been used on feature films such as How to Train Your Dragon: The Hidden World, Trolls World Tour, The Bad Guys, the upcoming Puss In Boots: The Last Wish, as well as future titles. MoonRay was developed at DreamWorks and is in continuous active development and includes an extensive library of production-tested, physically based materials, a USD Hydra render delegate, multi-machine and cloud rendering via the Arras distributed computation framework.
Note: it does not support osl and usd handling is limited. Cycles may still be a fair alternative.
EDIT
MoonRay review: DreamWorks Animations’ superb rendering software is free for all
A high-performance Monte Carlo ray tracer that’s capable of both DreamWorks’ trademark stylised look and photorealism.
It has all the required features for that setup, including Arbitrary Output Variables (AOVs), which allow data from a shader or renderer to be output during rendering to aid compositing. Additionally, Deep Output and Cryptomatte are supported.
With support for OptiX 7.6 and GPU render denoising with Open Image Denoise 2, MoonRay is able to deliver particularly impressive results, especially when working interactively.
MoonRay has moved to a hybrid CPU and GPU rendering mode for its default state. It’s called XPU, and in many ways combines the best of both types of rendering workflow.
VFX Reference Platform 2023 is probably the biggest addition because it enables the use of MoonRay directly in Nuke 15.
MoonRay has already achieved great success with an array of feature films. Now the renderer is open source, the CG world can expect to see a whole new swathe of MoonRay-powered animations.
For
- Features for VFX workflows
- Open source
- XPU rendering
Against
- Designed for big studios
- Steep learning curve
Categories
- 3Dprinting (167)
- A.I. (521)
- animation (328)
- blender (178)
- colour (220)
- commercials (45)
- composition (144)
- cool (357)
- design (606)
- Featured (46)
- hardware (289)
- IOS (106)
- jokes (133)
- lighting (268)
- modeling (102)
- music (182)
- photogrammetry (150)
- photography (736)
- production (1,217)
- python (77)
- quotes (475)
- reference (295)
- software (1,270)
- trailers (287)
- ves (504)
- VR (218)