The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI

Back in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.

Comments

I'm Confused About Why People Prefer to Say Discombobulated?

D iscombobulated. Is a word that I think someone rediscovered about three or four years ago (maybe more because the pandemic years have thrown out my sense of time) and now I hear it a lot. It's not a new word by any means, but when I started hearing multiple celebrities using it in everyday sentences, I actively had to look up what it meant. Define it with as many synonyms as you like but essentially it's just another word meaning 'confused'. Seinfeld Quotes: Quotes.net The words are pretty much interchangeable. He was discombobulated by too many choices. He was confused by too many choices. My confusion is the length of the word. It's unnecessarily long with too many syllables. There are many other words that mean confused, and therefore also mean discombobulated. Most of them are shorter and easier to say. So why not just say 'confused'? Perhaps discombobulated sounds more intelligent, maybe? Hawaii Five-0 Quotes: Quotes.net I've noticed it gets us...

Introducing the Second Sunday Skateboard Sessions - Doing Less to Skateboard More

This was my second heelflip attempt of the day. I was pleased I at least got the full rotation even if I didn't land it. I am determined to keep skating for as long as possible, though, since my last post in May 2024, about reigniting my kickflip battle at age 54 , I've probably been skateboarding less than I had hoped. Still haven't landed that elusive kickflip either. Strangely I've been wanting to film myself skateboarding again but have been reluctant to do so because it can be a bit of a hassle trying to create interesting content, not to mention a lot of editing, if you want to capture the full journey of learning a trick. I really hate editing. Looking at my camera equipment the other day I was thinking what is the most minimal setup that I can put together that would make it easy to film skate videos anywhere? I landed on using my Samsung A13, Android phone, mounted on a GoPro selfie stick that has a tripod base in the handle, and a wireless mic I bought some t...

Second Sunday Skateboard Session Ep 2 - Some Improvements

TET heelflip - looking better but still not a land. A s of writing this I've stuck to my plan of filming myself skate every second Sunday. By the time this post goes up I will have three episodes done. As part of that goal I am also skating more between episodes, about every second to third day for an hour, practicing Braille's Skateboarding Made Simple, Volume 1. That said, I'm not posting these videos here immediately after they're posted to my @TETLife YouTube Channel because I only post an article once a week, and that would make every second article a Sunday Session post. These posts are really so I can add some additional thoughts after the fact, and, of course, because this blog is about all things that interest me, of which skateboarding is one of them. In episode two I had intended to speak to camera more than I do but my driveway is right next door to my neighbor's shed/workshop, and I get a little self-conscious if I'm not too sure whether he's th...

Boom Crash Opera Born Classic But Not Again

Boom Crash Opera are an Australian Band that reached the peak of their popularity in the mid to late nineteen eighties. They are a band that I knew about at that time but was never really excited by until they released their ill fated double album Born and Born Again in 1995 (Album cover pictured). At the time of its release I was very much into emerging Australian musical acts and was also looking out for new sounds that were different and had kind of a futuristic/electronic sound. Artists that I was buying at the time included; Swoop , Nine Inch Nails and Pop Will Eat Its Self . As well as a really interesting release by David Bowie, the concept album, Outside . Born was a fairly radical departure for Boom Crash Opera (BCO). The first single, Gimme , was often compared to the sounds of Gary Glitter, particularly his single, Rock n Roll part 2 , because of the pounding drum loops. Watch the video below. My favorite single from the album is dissemble which probably went now...

Making an Effort to Be a President Trump Free Zone - Final Rant (I Hope)

I hope the American people, who voted for President Trump, get the full experience of what they thought they voted for along with what they're actually getting. Now may be a good time for them to learn to speak Russian because if World War Three does break out, it's not beyond possibility that it'll be the USA and Russia against the rest of the world, as Trump appears to be emboldening Russia to dig in on their attack on the Ukraine. China, may opt to stay neutral, or even join forces with the rest of the world because they've been quietly winning an economic war with so many countries, they may not care so much about the USA. Especially since President Trump wants to bring manufacturing back to America and impose tariffs on every country exporting anything to the USA. After that fiasco meeting President Zelenskyy had in the Oval Office with President Trump I've pretty much had enough. I'm not writing about what new dumb ass thing Trump's doing this week. ...

Two Former Right Wing Australian PM's Call Out President Trump and His America First Approach

Q uite often, leaders on all sides of politics, once they've retired from office, become the kind of person, with a political view that I would've supported, if they had been that person with that viewpoint, when they were leaders. Case in point, two former right wing, Australian Prime Ministers were individually interviewed about President Trump's negative impact on Australia and global politics in general. Both said things that even a left leaning 'woke' voter like myself could get behind and nod in agreement with. Keep in mind both these former PM's are right wing politicians that should be aligned with the US Republican party, and President Trump's views on many issues. Malcolm Turnbull Mr Turnbull, like President Trump is a businessman turned politician. He's a person I was all set to vote for until he aligned himself with the Australian Liberal Party. Which was a little unexpected for me because up to that point his politics sounded more left than ...

TET.Life (The Extraordinary Tourist Life)

Search This Blog