The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI

Back in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.

Comments

TV Series Review: Skeleton Crew (2024) (Disney+) No Spoilers

I f you saw the trailer for Skeleton Crew and decided the show looked too much like Star Wars for little kids, and didn't watch, you missed out on a real treat. While I will say this show was definitely targeted at bringing in younger fans to the Star Wars universe, it is very much more like family viewing than kids only TV. Not to mention, characters are literally gunned down or murdered on this show, but without the really graphic violence you might see on a more adult orientated show. It's actually no more kid only orientated than the first series of Stranger Things (2016), or even the original Star Wars (1977) movie. In fact the whole show is a not so subtle homage to original Star Wars (1977), Treasure Island (1950), and eighties movies like The Goonies (1985), ET (1982), Explorers (1985) and others. The plot is very straight forward. A group of children, living in the Star Wars equivalent of the suburbs, find an aband...

I'm Confused About Why People Prefer to Say Discombobulated?

D iscombobulated. Is a word that I think someone rediscovered about three or four years ago (maybe more because the pandemic years have thrown out my sense of time) and now I hear it a lot. It's not a new word by any means, but when I started hearing multiple celebrities using it in everyday sentences, I actively had to look up what it meant. Define it with as many synonyms as you like but essentially it's just another word meaning 'confused'. Seinfeld Quotes: Quotes.net The words are pretty much interchangeable. He was discombobulated by too many choices. He was confused by too many choices. My confusion is the length of the word. It's unnecessarily long with too many syllables. There are many other words that mean confused, and therefore also mean discombobulated. Most of them are shorter and easier to say. So why not just say 'confused'? Perhaps discombobulated sounds more intelligent, maybe? Hawaii Five-0 Quotes: Quotes.net I've noticed it gets us...

TV Series Review: Creature Commandos (2024) No Spoilers

O fficially, Creature Commandos is the first show of James Gunn's kind of reboot of the DCU. Technically though, it starts with James Gunn's, The Suicide Squad , and includes his series, Peacemaker , as the events of both are either referenced or felt within the show. Potentially that means Margot Robbie is Harley Quinn in the DCU, but I'd be surprised if she would even want another crack at it, let alone that James didn't recast the role. However that's a whole other rabbit hole for a character that may not appear again for at least a few more years. Creature Commandos is Suicide Squad but with monsters, and no real threat of Suicide - well, having your head blown off if you stray from the mission at least. Though I don't recall that being a thing in Gunn's Suicide Squad movie since the team was renamed 'Task Force X'? Amanda Waller (Viola Davis) somehow still has a job, but is no longer allowed to use humans on her team, so she assembles a team of...

The Path to Becoming a Successful Visual Artist Selling Work for Thousands, or Even Millions of Dollars

I'm calling this, 'Stand Up Comedian'. Image by Leonardo.ai and TET. I consider myself to be a successful working artist. I use the term 'working' quite loosely but basically what I mean is I work for myself, I earn money from my art or knowledge, and most of my time I can create art that interests me. I've never been motivated to be a 'career' artist. By that I mean, an artist whose work is displayed in all the top galleries, and that the super rich buy as more of an investment for wealth, than a love of art. Which is not to say these investors don't love art but when you're buying a single artwork for thousands, or even millions, of dollars, you're generally looking for a return on that investment too. That said, I'm not opposed to artists who want that kind of recognition. Certainly, if you're prepared to do the work, in countries like Australia, you can earn a nice passive income off the secondary market. Which means each time yo...

Real Flying Car Prototypes That Look Like What the Movies Promised - Ace VTOL GT Slipstream, Alef Model A, and the Bellwether Flying Cars

Ace eVTOL GT Slipstream Flying Car. I've been a little obsessed with flying cars of late and I thought I was done with the subject for now but then Google News put flying car company, Ace Vtol , based out of Perth, Western Australia in front of me. How could I not take a look? The GT Slipstream's next-generation Arc Reaction Engines. Images: Ace Vtol website. Especially when their flying car, the Ace eVTOL GT Slipstream , kind of looks like a regular car (in terms of size and shape) and has engines that look like they're straight out of a sci-fi movie. Even more surprising is you can actually pre-order one of these vehicles . Ace Vtol has done a USD$250 million deal with Palm Beach, FL based Aeroauto , the leading retailer of eVTOL vehicles in the United States to sell the craft to future owners. The GT Slipstream is described on Ace Vtol's website as follows: The aircraft, named the GT Slipstream, is a two-seater flying “muscle” car that will reach spee...

Meanwhile, In Australia... The World's Most Boring Government Is Fine... We're All Fine.

That's um... What's his name? T o be honest, I stopped following politics in Australia years ago. The only time I check in is usually around election time just to see which set of woke lefty independents, I'm going to vote for, ahead of my fallbacks of the Greens, and then Labor. Despite my sister trying to categorise me as more of a 'left brained' person I definitely lean 'right brained' more at home with my cry baby, woke, alphabet, lefty people. (For the record, if this is the first musing of mine you've ever read, I'm a straight white male who identifies as an artist... Male artist - just in case you were thinking artist is some new kind of gender you hadn't heard of). This year is an election year for our Federal Government, potentially the world's most boring government, for no other reason than during its entire term, if you asked me who was our Prime Minister I'd actually have to stop and think for a moment. Maybe our 31st PM shou...

Squeezing the Toothpaste: A Metaphor

I remember when toothpaste was sold in a metal tube. Back then, as a child, you'd cop it from Mum or Dad if you squeezed the tube anywhere but from the bottom. You could even buy special keys that would wind the toothpaste tube up from the bottom so you could get every last bit of paste - no wastage. Then along came the plastic tubes. Finally you could squeeze anywhere and the tube would retain its shape - or so they said in the sales pitch. For the most part this was true. It wasn't as much of a problem squeezing the new plastic tube from the top. Squeezing toothpaste from the tube was now easy - or so you thought. The thing about squeezing the tube from the top (or even the middle) is that it leaves some of the paste at the bottom. Eventually you do have to spend extra time pushing the paste from the bottom up into the top of the tube. Not like the old days when squeezing from the bottom meant you got just the right amount of paste and the tube was always ready for the next p...

TET.Life (The Extraordinary Tourist Life)

Search This Blog