Hey, wanted to share this library I made: GitHub - tzachshabtay/ai-assets: A library for replacing ai assets during runtime to aid development · GitHub
The idea is that you can use openai and elevenlabs to generate 2d animations and sound effects from within your game, see if you like it and promote it to the source code with a single click.
I made a video showing this here (apologies for lags in the video, my machine was not strong enough for a smooth recording): https://www.youtube.com/watch?v=LaXCj2oczyI
Will appreciate feedback, thanks.
1 Like
That’s an interesting idea. In its current iteration, I’ve personally found game art generated from AI to be a pretty big bummer in terms of aesthetics and continuity (especially when kenney exists), but your idea is very interesting. I also work with pixel art a lot and they can’t do pixel art at all.
What might be even cooler is if you used a local AI to perform a plain language search of a library of curated assets. I’ve tried to use an LLM to search for assets before that matched a certain aesthetic and it’s not that helpful.
Thanks! I’m not convinced on how helpful such a feature would be honestly, because while kenney is cool, I don’t think it has enough variety in its database (and I don’t know of another repo that does) to be well integrated into a “make whatever game you want” kind of workflow, like if I want “the devil but with elephant ears” for my game it’s not gonna have it. I am betting on image generation getting better rapidly to the point where what it gives you is equally good as a curated collection.
So do you see the primary use case for this now as something to stub games out so you can reskin them with a designer or would you use this to make a production game in its current form?
Here’s an image I generated for a project I’m currently working on. I was impressed with this since it matched the game well, but upon further inspection, it turned out to be unusable since it contains a ton of errors and it’s smudgy. Do you see AI being able to generate a quality image like this soon? One thing that was kind of frustrating is that everything I generated for this project, it would include some weird artwork with two suns hah. Like I guess it thinks the game is set on Tatooine. I just found that amusing.
I think in its current form, not for a AAA game for sure, but you should be able to use this to make a solo indie game and take it to production, assuming you do some end polish on the images manually.
and yeah I’m betting it will get a lot better soon, will make less mistakes and generate more quality images, maybe even a single sun 
.
