Nilsletter #2 | Start generating 3D models from a single image 📸

Issue #02 | Date: August 9, 2023

Hello 3D enthusiast,

Welcome to the second round of the 3D Nilsletter! Like before, I've rounded up the coolest happenings from the 3D universe in the last 7 days. Whether it's useful insights or a nudge for your own projects, I hope you find something exciting here.

In the previous newsletter, I offered a sneak peek of the Paperplane prototype I created, complete with a packaged .exe release. While the Unreal Engine project files are already accessible for download on my Gumroad, I recognized that not everyone possesses the expertise to set up the project within Unreal Engine. To address this, I sought a new approach to provide the same immersive experience without the complexities of Unreal Engine. My aim was simplicity, offering a straightforward .exe file for Windows and an .app file for MacOS. I'm thrilled to share that this application is now ready for download on my Gumroad platform.

As a token of my gratitude for your subscription to this newsletter, I'd like to offer you a complimentary download code for this application! Simply apply the code during the checkout process.

For the very first time, I'm introducing what could be termed a 'game', although it's more accurately an immersive experience. I sincerely hope that you derive as much pleasure from engaging with this creation as I have in bringing it to life. Your insights matter greatly to me, so if you have any feedback, suggestions, tips, tricks, or fresh concepts, I encourage you to share them. I pledge to carefully review every comment and endeavor to enhance this encounter, ensuring its accessibility to all.

And now to this weeks of new stuff in the 3D space.

AI: CSM 3D model generator

As all of you are aware, modelling 3D objects takes lots of time. And is a tedious process. Even for the best 3D modeling artists out there. With AI taking over lots of processes, one of them is going to be 3D modeling. We’ve seen photogrammetry developing so quickly to a point where it’s quicker to just take photos of an object and let the computer model it for you. But now AI is taking this a step further. Just one image and AI will guess the 3D shape, and fill in the textures for angles it can’t see. It’s far from perfect, but already in a shape it could be used to generate 3D models that are used in the background, and don’t require lots of detail. CSM.ai is something you should keep an eye on. With their video, and now, image to 3D. Try it yourself at 3d.csm.ai for free. Processing takes a while, so be patient.

3D: Nvidia Omniverse

Nvidia Omniverse is still a new tool in town. And sometimes a bit unclear of what it is trying to be. But it feels like one bit toy box with lots of interesting new tools inside, each focussing on one aspect of 3D. This week Nvidia did a 2 hour presentation at Siggraph. Talking about new hardware and software. And showing a lot of cool things you can do with Nvidia Omniverse. This montage shows a lot of high quality simulations done in Omniverse. Their accelerating industrial planning tool looks impressive to say the least. It’s great to see all these awesome tools come and work together inside one application.

UNITY: Unity Weta Tools

We’ve already seen Unreal Engine being used in film and tv before. Actually - Unreal Engine is currently being used more in non-gaming industries than in gaming industries. That really shows how powerful these game engines are getting. But it’s not only Unreal Engine - now Unity is stepping up their game too. Recently vfx company Weta Digital joined Unity. And now they are working on a toolset for artists working in game and film called Unity Weta Tools.

AI: Inworld AI

InWorld.ai shines as a leading tool at the intersection of AI and virtual reality, with a strong focus on revolutionizing gaming experiences through advanced NPC interactions. This tool demonstrates its prowess in crafting immersive virtual worlds where lifelike NPCs play a pivotal role. By pushing the boundaries of interactivity, InWorld.ai sets the stage for a new era of captivating and dynamic gameplay. Can’t wait to see AI powered NPCs in GTA.

I hope you enjoyed this week's news roundup, and I'm looking forward to sharing more exciting developments in the 3D space in the upcoming editions of this 3D Nilsletter.

That’s all for now!

Regards,
Nils Bakker

If you enjoyed this newsletter, forward it to a friend and invite them to subscribe!

^{Get in touch:
For inquiries, suggestions, submissions or just to say hi reach out to me at
[email protected]
instagram.com/nils_bakker
nilsbakker.nl}