Building My First AI Story Prototype
Three weeks ago I decided to stop circling ideas and just build. I gave myself one month to turn a vague concept into a working AI storytelling prototype.
The goal wasn't to build the perfect product. It was to ship something real, test my assumptions, and learn what actually matters when you're building with AI.
What I was building
You describe a story, AI writes it with you, and every scene gets a picture so it feels like a real book. Then the scenes come together into a short story video.
The pictures broke first
Writing the story was the easy part. Good images were not.
The best-looking images I could get came from Midjourney, but Midjourney had no API. You prompted it through Discord.
So I built a Discord app that sent my prompts to Midjourney, and a script that ran locally to pull the images back into the prototype. It worked. The pictures showed up, and I used them to make the story video.
Then they started disappearing. The images lived on Discord's servers, and Discord had switched to links that expire. A story that looked finished one day had broken pictures the next.
Midjourney was never built to be used that way. I was bending a tool into something it wasn't made for. That's fine for a demo, but not for a product people need to come back to.
Switching to Stable Diffusion
I moved to Stable Diffusion so the images were mine to keep. The catch was quality. On default settings the pictures weren't good enough for a storybook, so the next job was learning how to get better results out of it.
The technical choices
I chose Next.js, Supabase, and React Query because I wanted control over how data flows and how the interface responds. I didn't want abstraction layers hiding the complexity. I wanted to understand how everything connects, especially once slow AI calls and images that might fail were in the mix.
What I learnt
Own anything your product can't live without. If a picture can vanish, the story isn't really saved. It's the same lesson my hosting business taught me years ago. Building on someone else's ground only works if it stays there.
The prototype works. And now I have a foundation I can iterate on instead of a pile of ideas that never shipped.
Update, early 2025
The image problem didn't end there. Later I tried a video model and ran into the same problem. Then I tried ComfyUI, the node-based tool people use to build Stable Diffusion workflows. It gave me more control, but it was slow and frustrating to use, so I ditched it. Powerful tools aren't much use if they wear you out.
So I parked the idea. I'll come back to it with a different approach.