But if you're "starting from scratch", then what would be the problem? If none of the results match what you want, you reiterate on your prompt and start from scratch. If one of them is suitable you take it. If there's no iterating on the code with the agents, then this really wouldn't add much mental overhead? You just have to glance over more results.
I'm (slowly and haphazardly) working on https://pianobooth.com. Give it a midi file and it should visualise the playing on a piano (though I make no promises and at least currently it doesn't parse all files correctly, but it's mostly there).
I think I've finally gotten it to a point where it's usable and it seems to work on my phone as well. Hopefully baking in the lighting for the 3d models will give a small performance boost and I don't think it will be noticeable at all with the color changes and small movements.
I've also been going through the fastai course so hopefully I'll be able to put that to use on this project by generating midi files from audio! I might be underestimating the difficulties there but it should be fun.
For what it's worth I'm all for both. As someone who dabbles in both domains but does neither professionally, there's a very distinctive difference in how AI fits into the process of producing art and producing code.
For code, it augments my ability to produce code. It's very easy to tinker and modify that code if I so choose, and it's much easier to steer it into the right direction (at least when it comes to the output of the code). For art, it just replaces things. If I create an image with AI for example, it's not that simple to drop it into Procreate and start tinkering with it. There are no layers, no brushes, no masks that come with it - it is the output. I'll just re-prompt, or try to find style guides or reference pictures, but there's no place for an artist in the loop. Others might be using these differently of course, but at least my impression is that it's much more of a replacement when it comes to art.
I've been re-energized to work on some programming things I'd mostly left on the shelf or only picked up once in a blue moon on some quiet weekends. Mostly this is all thanks to LLMs and how enjoyable tools like Claude Code can be to use (when they actually give you what you want!), and how much more social they make the experience for me.
Not a professional developer so I suspect these projects look a lot more like slugging through mud and trying to navigate through a maze in a pitch black environment, and I've found these tools to be helpful especially in small refactorings that would normally result in me just slowly losing interest in the project.
Anyways, https://pianobooth.com is the latest one! Gave me an excuse to learn some Blender as well. It'll play your midi files (well, it might play your midi file) and show the notes being played on a keyboard. :)
Lots of room for improvement. It now works on most of the midi files I've tried, but it's still glitchy and buggy. But at least it works sometimes!
