Nilsletter #09 | Cutting-Edge AI Workflow, AI Voice Cloning, and Freebies from Epic! 🎬

Issue #09 | Date: July 3, 2024

Hi!

Hey there, welcome to the ninth edition of the Nilsletter! Personal life has taken up much of my time recently, but I’m excited to be back with you all. I’ve been able to gather some exciting updates and insights from the world of 3D, AI, and other innovative digital technologies. Whether you’re into motion graphics, artificial intelligence, or just looking for some fresh inspiration, there’s always something interesting to discover. Let’s dive in and see what’s new!

And now to this weeks of new stuff

UEFN: Talisman

Epic Games dropped the Metahuman template project for UEFN for everyone to grab. This demo utalises new and improved ways of implementing Metahumans and was shown on the GDC 3 months ago. With this crazy new tech the sizes of these incredible detailed metahumans drop insanely. From 950mb to 60mb. And not only this demo is free for grabs, when you login to your UEFN Creator Portal you can claim a 1 year free Marvelous Designer license. Which should work great in conjunction with the Metahumans.

AI: Text to Speech

Camb.ai has released MARS5-TTS, an advanced, open-source text-to-speech model that generates realistic voice clips from just a 5-second audio sample. It supports two cloning modes: shallow for speed and deep for higher quality. The model can be downloaded and run locally. While the examples shown on the GitHub page are not perfect, they are promising, especially for a local open-source project. For more details, visit the MARS5-TTS GitHub.

EPIC: Free huge motion data set

Epic Games is known for providing a wealth of assets, templates, and tools to help developers and artists quickly get started. Recently, they unveiled a new animation system called motion matching at the GDC and have now released the project files for free. This project is perfect for anyone using Unreal Engine and in need of character animations. It leverages all the latest animation tools in Unreal Engine, making it easy to retarget animations to other skeletons or Epic’s Metahumans. Grab the files here.

AI: Audio to Audio

In the world of AI music generation, two major players are Suno.AI and Udio, both capable of creating music from text input. Suno.AI has introduced an exciting new feature: audio-to-audio input. Similar to image-to-image tools like MidJourney and Stable Diffusion, this feature allows users to input audio instead of text. With audio-to-audio, you can hum a tune or drum a beat, and Suno.AI will transform it into a full song that perfectly matches your input. This innovative tool opens up new creative possibilities for musicians and hobbyists alike. There are some great examples on their blog post showcasing the potential of this feature.

Animation: The AI workflow

Arvid Tappert has created a super creative short film titled “The Odd Birds Kingdom.” What’s even more creative is his innovative workflow, which he kindly shared on his website. This project beautifully showcases how AI tools can be used as creative aids to explore new artistic possibilities. I highly recommend visiting his page to delve into his workflow and see how he seamlessly integrates AI into his creative process. Explore more about the project and his workflow here.

I hope you enjoyed this week’s roundup, and I’m excited to bring you more thrilling updates and innovations from the world of 3D, AI, and digital technologies in the upcoming editions of the Nilsletter. Stay tuned for next week’s edition!

That’s all for now!

Regards,
Nils Bakker

If you enjoyed this newsletter, forward it to a friend and invite them to subscribe!

^{Get in touch:
For inquiries, suggestions, submissions or just to say hi reach out to me at
[email protected]
instagram.com/nils_bakker
nilsbakker.nl}