The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI

Back in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.

Comments

I'm Confused About Why People Prefer to Say Discombobulated?

D iscombobulated. Is a word that I think someone rediscovered about three or four years ago (maybe more because the pandemic years have thrown out my sense of time) and now I hear it a lot. It's not a new word by any means, but when I started hearing multiple celebrities using it in everyday sentences, I actively had to look up what it meant. Define it with as many synonyms as you like but essentially it's just another word meaning 'confused'. Seinfeld Quotes: Quotes.net The words are pretty much interchangeable. He was discombobulated by too many choices. He was confused by too many choices. My confusion is the length of the word. It's unnecessarily long with too many syllables. There are many other words that mean confused, and therefore also mean discombobulated. Most of them are shorter and easier to say. So why not just say 'confused'? Perhaps discombobulated sounds more intelligent, maybe? Hawaii Five-0 Quotes: Quotes.net I've noticed it gets us...

Second Sunday Skateboard Session Ep 2 - Some Improvements

TET heelflip - looking better but still not a land. A s of writing this I've stuck to my plan of filming myself skate every second Sunday. By the time this post goes up I will have three episodes done. As part of that goal I am also skating more between episodes, about every second to third day for an hour, practicing Braille's Skateboarding Made Simple, Volume 1. That said, I'm not posting these videos here immediately after they're posted to my @TETLife YouTube Channel because I only post an article once a week, and that would make every second article a Sunday Session post. These posts are really so I can add some additional thoughts after the fact, and, of course, because this blog is about all things that interest me, of which skateboarding is one of them. In episode two I had intended to speak to camera more than I do but my driveway is right next door to my neighbor's shed/workshop, and I get a little self-conscious if I'm not too sure whether he's th...

Boom Crash Opera Born Classic But Not Again

Boom Crash Opera are an Australian Band that reached the peak of their popularity in the mid to late nineteen eighties. They are a band that I knew about at that time but was never really excited by until they released their ill fated double album Born and Born Again in 1995 (Album cover pictured). At the time of its release I was very much into emerging Australian musical acts and was also looking out for new sounds that were different and had kind of a futuristic/electronic sound. Artists that I was buying at the time included; Swoop , Nine Inch Nails and Pop Will Eat Its Self . As well as a really interesting release by David Bowie, the concept album, Outside . Born was a fairly radical departure for Boom Crash Opera (BCO). The first single, Gimme , was often compared to the sounds of Gary Glitter, particularly his single, Rock n Roll part 2 , because of the pounding drum loops. Watch the video below. My favorite single from the album is dissemble which probably went now...

Australian Federal Election 2025 - The Australian Democrats (Please Like Us Again) and The Greens

Image: Reve AI T here's not much to be said about the current Australian Democrats other than in 2025 Australian election, in May, they'll be out there hoping they win a seat... any seat... 'please like us again!' The Australian Democrats For just over two decades, from the late seventies onward, the Australian Democrats were the third most important party in the Federal government (if you don't count the National party since they've been on that coalition ticket with the Liberals for as long as I can remember). In fact, once I moved away from the Labor party, they were my top pick until the party slowly imploded in the early 2000's from a series of unfortunate events like leaders defecting to other parties, and a highly publicised incident of drunkenness, bullying, and abuse from a male party leader to a female colleague. It's been two decades since then (and that guy's with the Greens now)... please like us again! That aside, the party is still t...

The Australian Federal Election 2025 Could Be a Win For Independents

Australian Democrats founder, Senator Don Chipp, embodied the role of minor parties holding the balance of power with his quote of "keep the bastards honest." Photo Manipulated Caricature by TET. A s of writing this, the actual Australian Federal Election date has yet to be announced, as our Prime Minister, Anthony Albanese, attempts to keep the focus on the fallout of severe weather events in Queensland, however it's looking likely that some time in May is the safest bet. Despite this, all parties have been hard at campaigning, with smaller parties, and in particular, conservative independent candidates, seemingly rallying together to make sure people know how much influence they can have just by preventing the two major parties (Labor and the Liberal/National coalition) from having a majority in either (or both) houses of parliament. They're also doing their part to make sure voters finally understand that preferential voting works in everybody's favor over one ...

Movie Review: Furiosa: A Mad Max Saga (2024) No Spoilers

T his is another film that I would have liked to have seen in a theatre but, for whatever reason, didn't get to. Having now seen Furiosa: A Mad Max Saga (2024) almost a year later I'm glad I didn't. Which is not to say it's bad. Like its predecessor Mad Max: Fury Road (2015), which I enjoyed in a cinema immensely, this film would definitely benefit from being on a big screen for the spectacle and epic visuals of it all. However unlike its predecessor there is so much going on, with back and forth between the waring parties, and Furiosa's story as well, you can't just sit back and kind of enjoy the ride. It's like writer/director, George Miller, wanted to cram in as many of his ideas as possible for the post apocalyptic world of Mad Max, because it's not likely he'll make another one, but whoever does, has a rich, detailed world of on screen source material to draw upon. The story begins with young Furiosa (Alyla Browne) and her journey from the ...

TET.Life (The Extraordinary Tourist Life)

Search This Blog