Adobe's New AI Video Tools
🌐 Sony BURANO, UE World Creation, Meta's CoTracker
Powered by
Welcome back to VP Land.
Sony’s got a new cinema camera (and it borrows some AI tools we saw introduced in the Alpha lineup), Adobe has updates across the board (and Firefly is out of beta), and Reverie lets you snap a photo in the real world and turn it into a 3D model in Unreal.
Also, request is still open: if you know of any companies or projects doing interesting things and using tech from Nvidia and a cloud service provider (AWS or Google), reply and let me know.
Alright, let’s jump into it all
MAIN STAGE
Adobe rolls out AI tool upgrades
Adobe announced a bunch of updates coming across all the Creative Cloud apps. Some use AI, some are just nice improvements (looking at you, Frame.io).
Here’s what’s new and interesting for video:
Premiere Pro
New Enhance Speech effect. This is basically the AI voice enhancer in Adobe Podcast now built into Premiere.
Text-based editing (rolled out at NAB) gets some upgrades, like filler word detection and support for multi-channel audio files.
Improved Automatic Tone Mapping and LUT management
After Effects
True 3D workspace. Import, animate, light, shade, and render 3D models.
AI-powered rotoscoping with the Roto Brush
Frame.io
More devices join the Camera to Cloud ecosystem, including the $179 Accsoon Seemo, which turns your phone or tablet into an HDMI monitor and is now the least expensive way to tap into C2C (besides using Filmic Pro on your phone).
You can finally comment when doing side-by-side review comparisons.
Enterprise users can bring their own AWS S3 storage
No Firefly updates for Premiere, but Firefly for Photoshop is officially out of beta.
There’s also a standalone Firefly web app.
Generative AI Credit Model Rolls Out
They also announced a pricing model for AI using generative credits - you get a certain amount each month.
However, the credits are just for priority processing. If you run out you can purchase more or keep generating, just with a longer wait to process your requests.
This blog post goes into more detail, but this reddit post from Terry White explains things a lot better.
And last note - there’s a slight pricing increase, ranging from $2 to $7.5 a month, depending on what plan you’re on.
SPONSOR MESSAGE
Safeguard your video content with Vestigit.
Vestigit’s innovative solutions, including Vestigit AI, Vestigit Sentinel AI, and Vestigit Watermark, provide robust protection against video content piracy and track illegal streams.
Don't let your valuable content fall into the wrong hands. With Vestigit, you can ensure your content remains secure and in control.
Experience the power of Vestigit’s platform firsthand - contact Vestigit now for a free demo.
SECOND UNIT
BURANO: Sony’s New Cinema Camera
Burano is a small island in the Venetian Lagoon, 4 miles from Venice. So it’s an apt name for Sony’s new smaller cinema camera.
The Specs:
Full-Frame 8.6K Sensor
Frame Rates/Video offerings: 8.6K 30, 6K 60p (FF crop), 5.8K 60p (Super 35), and 4K 120p (Super 35 crop).
16 Stops of Latitude
Dual Base ISO (800/3200)
Internal 16-bit X-OCN LT and XAVC H recording.
In-Body Stabilization with PL Mount Lenses
Electronic Variable ND Filter
Hybrid AF (developed through the Sony Alpha camera line and engineers)
AI Subject Recognition AF
Dual CFexpress Type B Slots
Weighs 2.9kg (reportedly “33% lighter” than the VENICE 2)
Check out more from ProVideo Coalition
We’re starting to see the AI features rolled out in Sony’s mirrorless lineup (like the A7R V) make its way to cinema cameras.
With my background in run-and-gun documentary shooting, this is great to see, along with the quick access to settings and IBIS.
It ticks a lot of boxes for a lot of DPs.
If you asked me to write down everything i wanted in my "perfect camera" it would honestly be pretty damn close to the new Burano.
- internal variable ND
- FF, S35, and anarmoprhic modes up to 8K
- PL, or E-mount with autofocus
- internal RAW
- IBIS
- small box under 5lbs
-… twitter.com/i/web/status/1…— patrick. (@imPatrickT)
Sep 12, 2023
Speaking of Blackmagic - they’ve got new product announcements happening later today (‘new in cameras’ is part of the tease), so we’ll see if they announce a full frame option.
As for the BURANO - pre-orders are happening now for $25K, shipping in 2024.
VIDEO VILLAGE
My super power is Reverie, a tool I developed to accelerate world creation. All you need is one photo and then copy+paste into Unreal 🤷
— Alex Leiva (@aviel08)
Sep 5, 2023
AKS
🌐 Around the Web
Meta published a paper on CoTracker, a model for tracking multiple points in a video
TSMC partners with Broadcom and Nvidia to develop advanced silicon photonics
Upload large files and folders fast with MASV*
AI is transforming the landscape of advertising on YouTube
OpenAI's first developer conference coming this November in SF
Pixotope's new Live Controller brings virtual production to broadcasters of any scale
* Sponsored Link
CALL SHEET
📆 Upcoming Events
September
Studio Arts - Technology for Entertainment Creatives
Unreal Engine and virtual production online courses
October 3
XR, Virtual Production & Beyond
St Martins Courtyard, Coney St, York
Engage with experts and industry leaders on the latest trends in film and TV production, games, and software.
October 10 to 11 (other dates and cities available)
Sony’s Professional Display Solutions Roadshow
Sony Corporation, New York City
Meet Sony’s sales and engineering teams to experience hands-on demonstrations of unrivaled display and AV technologies and solutions
October 23 to 27 (other dates available)
Planar Studios Virtual Production Workshop
Planar Headquarters, Hillsboro, OR
Learn about VPXR technologies from industry experts.
October 24 to 26
10th Edition Augmented Enterprise Summit
Houston, TX
World's biggest companies leveraging XR/Metaverse today and preparing for the future of work
—
Istituto Marangoni Visual Design Courses
Visual Design
Multimedia design for integrated communication
Milano - Sept 2023 to Jul 2024
London - Oct 2023 to Jun 2024
Digital Design for Immersive Experiences
Bridging physical and digital worlds and leveraging the power of immersive installations
Milano - Sep 2023 to Dec 2024
Have a film-related event to share? Just reply back to this email and let us know the details.
ABBY SINGER
Thanks for reading VP Land!
Have a link to share or a story idea? Send it here.
Interested in reaching media industry professionals? Advertise with us.