These scripts use AI to turn Minecraft worlds into adorable picturesque scenes
This is what happens when you combine Minecraft with Stable Diffusion AI image generator.
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
It was only a matter of time before someone combined Stable Diffusion AI image generator and Minecraft command-line. This is probably one of the best uses of AI image generators I’ve seen so far, essentially using a combination of Minecraft screenshots and text prompts to create highly detailed images each time the user makes changes to their design within the Minecraft game world.
Sean Simon, more commonly known as ThoseSixFaces (or Lozmosis onReddit), posted the above video yesterday showing off a sped-up version of their scripts running live as they messed around in-game.
It works by taking screenshots from a specific angle as the game is played, resizing or cropping them to 512x512 pixels and saving them to a folder. Each frame is generated on “a fixed interval, or whenever the player places/removes a block.” Using a version ofInvokeAIthat Sean modified, the model then goes about “targeting the latest image in the folder and outputting the Stable Diffusion image.” Another script then displays the output image usingtkinter.
Stable Diffusionis the main thing translating each frame into gorgeous AI generated images, however, which Sean explains “denoises on a random value between 0.47-0.5.” So although Sean is able to use prompts to push the AI in the preferred direction usingimage2image, there’s still a little leeway in how random the generated results can be.
As it stands right now, the process involves running several scripts, though Sean is “keen to compress this all into a single script.”
Best CPU for gaming: The top chips from Intel and AMDBest gaming motherboard: The right boardsBest graphics card: Your perfect pixel-pusher awaitsBest SSD for gaming: Get into the game ahead of the rest
It’s a fascinating project, and one my art teachers from college would be very excited to see working; they seemed to have an obsession with translating work into different mediums, then translating it back. On that note, one Reddit commenter jokingly suggests a reverse process to Sean, in which the AI would “turn arts into minecrafts.”
Sean responds with, “I’ve started cooking something up,” so it may not be too long before we see Minecraft worlds being generated using AI image prompts. Or indeed Minecraft worlds being translated into images, then back into Minecraft worlds.
The biggest gaming news, reviews and hardware deals
Keep up to date with the most important stories and the best deals, as picked by the PC Gamer team.
Whew, what a world we live in.
Sadly, Sean’s scripts are not yet available to download from Github, but do keep an eye on theirTwitterfor updates.
Now, we’ve seenStable Diffusion being used in VR, and the CEO of Discord image bot Midjourney speculates that future consoles will have a “giant AI chip and all the games will be dreams.” This Minecraft project is yet another addition to the exciting, AI-focussed narrative springing up in the gaming sphere right now.
Minecraft potions: Recipes and brewing guideMinecraft enchantments: Magical reference listMinecraft villagers: All the jobs and tradesMinecraft realms: How to start your own server
Screw sports, Katie would rather watch Intel, AMD and Nvidia go at it. Having been obsessed with computers and graphics for three long decades, she took Game Art and Design up to Masters level at uni, and has been rambling about games, tech and science—rather sarcastically—for four years since. She can be found admiring technological advancements, scrambling for scintillating Raspberry Pi projects, preaching cybersecurity awareness, sighing over semiconductors, and gawping at the latest GPU upgrades. Right now she’s waiting patiently for her chance to upload her consciousness into the cloud.
Palworld developer reports Nintendo’s suing over 3 Pokémon patents for only $66,000 in damages, but a videogame IP lawyer says fighting the lawsuit could mean ‘burning millions of dollars’
No Man’s Sky gets cross-save on a dozen platforms and brings back Mass Effect’s Normandy as a limited-time rewar
Warren Spector found working on his cancelled Half-Life episode ‘a little frustrating’, but he’ll be ‘forever grateful’ to Valve for keeping his studio alive
