ViZARTS: "Reality Jump" - A Quest for AI-Generated 3D Set Extensions for Virtual Production (BTS) скачать в хорошем качестве

ViZARTS: "Reality Jump" - A Quest for AI-Generated 3D Set Extensions for Virtual Production (BTS)

What happens when a crew of Filmmakers and Techies joins forces and utilize AI for generating 3D Set Extensions in a Virtual Production workflow? This is a look behind the scenes of "Reality Jump" where the sequences are the results of the efforts of a crew of filmmakers and techies, who joined forces and collaborated intensively during three days at our ViZARTS AI & Virtual Production for Filmmakers Workshop at Aalborg University's VP Training Facility Studio at the Medialogy education (Copenhagen. Denmark, December. 2024). The theme was "Show me a World, I haven't seen!", and the challenge was for each of the four crews to explore how generative AI could assist them in producing exterior and interior shots (Approx. 1.5 hours shooting time for each location). The participants then experimented with how any location - real or imaginary - now can be re-created or generated using an AI prompt (or a real photo). All crews first used text prompts to create 2D location images generated with the help from Midjourney. These 2D images were then adjusted a bit (using ComfyAI) and transformed into a 3D Depth map (using Stable Diffusion), which could then be used as a 3D Set Extension behind the actors, while achieving a parallax/depth effect when the camera was moving. The crews also worked to achieve Final Pixels In-Camera by creating physical- and in-camera effects ( ICVFX ) with no greenscreen, using a simple rear-projection screen, Unreal Engine and Vive camera tracking. At our next ViZARTS hands-on workshop, we will continue the exploration - and this time we will exploit, how we can use AI not only to generate 3D and 2.5D backgrounds on the fly, so we can shoot in locations from any time and anywhere (including imaginative worlds and real locations) - but the goal is also to work with AI generated 3D props and maybe even creatures, which can be inserted in front of the camera in real-time (AR like) attempting to achieve "Final Pixels on Harddisk". This free workshop (20. March + 1-4. April 2025) in Copenhagen, is for Directors, Cinematographers, Visual AI experts, Actors, Sound artists, Composers, Production designers, Visual artists, Producers and Techies. If you are in Denmark, you are very welcome to apply here until February 28th 2025: https://tinyurl.com/Vizarts-AI-VP-Lab3 The final scenes from "Reality Jump" can be watched here:    • ViZARTS Encounters IV: "Reality Jump" - Vi...   -------- If you are interested in receiving invitations for future AI & VP workshops, then please sign up for the ViZARTS Newsletters here (Approx 4 per year): https://vizarts.aau.dk Or stay tuned here:   / vizarts   -------- ViZARTS is supported by: Nordisk Film Fonden Aalborg University - The Medialogy Education Amunet Storyline Studios CPH Upright Music SAMSUNG / Samsung Media Innovation Lab for Education (SMILE Lab) -------- ViZARTS presents: Reality Jump Credits: Team 1 - “Somewhere Never” Victor Harder Hesel - Director Dirk Brüel - Director of Cinematography Ola Persson - Editor Eigil Hedegaard - Acting Team 2 - “Toy Store Story” Christian Grønvald - Director Morten Øbro - Director of Cinematography Eigil Hedegaard - Acting Team 3 - “Himmelstigen” (Stairway to Heaven) Tara Salas - Director Sine Vadstrup Brooker - Director of Cinematography Susanne Wejp-Olsen - Production Design Morten Holst - Acting Mette Løjberg- Acting Team 4 - “The B-Day Showdown” Jacob Østergaad Johansson – Director of Cinematography David Wittrock Rathje - Production Design Felix Drott - Edit Morten Holst - Acting Pre-production Team: Peter de Neergaard Salle Salée Jesper Duelund Hansen Michael G. Rose Jacob Stig Olsson Jonas Abrahamsen Medialogy Volunteers: Felix Jordan Hasal Alejandro Lenin Rosado Garcia Nicolai Villas Gajda Østergaard The ViZARTS Crew: Ida Marie Bredegaard - Concept Artist / Sketch to AI pipeline Andreas Jin Sum - Supporting AI Crew / Runner / Intern / Boom Nicolai Lind Bouquin - Supporting AI Crew Abderrahman Mhadden - Technical Support / Reality Jump machine operator Mathias Ramsø Thomsen - Technical Lead (Unreal Brainbar / Space Command) Aishah Hussain - Unreal Artist / ViZARTS manager Ani Kreyer - BTS cinematographer and editor Henrik Schønau-Fog - ViZARTS Founder / Executive producer AI tools used: Midjourney - For generating 2D locations based on prompts ComfyUI - For adjusting 2D location images Stable Diffusion - For generating 3D and 2.5D depth maps from 2D images Sound Effects and Music: Upright Music Pixabay Special Thanks to: Storyline Studios Rentals CPH: Arri Alexa 35 Gear Upright Music: Music and Sound Effects Samsung: Monitors, Tablets and Smartphones Aalborg University, Copenhagen Campus: Erik Petersen Stig Møllenberg Frank Petersen Lene Hastrup Jensen Susan Biensø Colleagues, Students and Staff at Medialogy / CREATE