The GPT ones are strange. The $25 fable one to me is subjectively better than the others. The $100 fable one is too literal and robotic.
The jevons paradox is you need auteurs to curate vignettes or effects and cut or mask them in etc. That's not really different philosophically when software entered art in other ways. I could see errors/glitches lowering in time but I doubt there will be much acceleration.
Unsure if it's just the way they prompted it / coded it, but the output is far too much a literal direct copy of the lyrics. The best music videos have a story arc on the theme of but often not litearlly the lyrics, and start with obscurity and reveal something (following all the literary/story mechanisms)
Consider Amber Run - Found lyrics versus the video, and the story arc of the video
Curious how much time in addition to tokens this costs. If you have to spend $25 and wait 45 minutes to get a basically unwatchable video, I'm not worried about indie film makers being replaced just yet...
It is jarring to me that most of the dancing seems slightly out of sync with the music. It is like a music video uncanny valley - images look good, but the lack of sync to the sound shatters the illusion entirely.
But why spend the same amount of money on AI instead of humans? My guess is that shooting a music video is probably fun for a lot of artists. And with AI the result is not predictable and might be inconsistent in the dumbest ways.
My guess is that an AI music video would have to be a lot cheaper for artists to consider it outside of making one just because you want to make an AI music video.
Though we're finding the studios contracted to do this can bill $50k. I know several studios that previously billed clients six figures for ad campaigns (P&G, HBO, pharma, etc.) are now charging five figures and winning a lion share of the bids now.
Not sure why Wan is the focus of this article and Seedance is a footnote. Wan/LTX/open models are significantly behind Chinese closed source models. (And the Chinese have left the Western models in the dust.)
Seems like if you build some more scaffolding around it, it wouldn't be bad. I think AI video isn't quite there yet so you probably would want to lean into that. For example you could ask for an animated or cartoon music video so the real shots don't look weird. Also if you gave it some guidance on what a good music video is like it would probably help as well. But yeah idk may be that's not the goal here.
Video can be good if you stick to a garden path of simple scenes with tons of examples in the training material and not a ton of motion between overlapping objects in a scene, and don't really care too much about specifics.
As soon as you want something very specific, or something novel, or anything with a lot of moving objects/people, it falls apart.
The GPT ones are strange. The $25 fable one to me is subjectively better than the others. The $100 fable one is too literal and robotic.
The jevons paradox is you need auteurs to curate vignettes or effects and cut or mask them in etc. That's not really different philosophically when software entered art in other ways. I could see errors/glitches lowering in time but I doubt there will be much acceleration.
Unsure if it's just the way they prompted it / coded it, but the output is far too much a literal direct copy of the lyrics. The best music videos have a story arc on the theme of but often not litearlly the lyrics, and start with obscurity and reveal something (following all the literary/story mechanisms)
Consider Amber Run - Found lyrics versus the video, and the story arc of the video
https://www.youtube.com/watch?v=Yj6V_a1-EUA
Literal music videos are still fun and a valid creative direction, e.g., Vance Joy's "Riptide": https://www.youtube.com/watch?v=uJ_1HMAGb4k
The thing about art is that literally everything is a "valid creative direction." But that doesnt make everything immune from derision.
Coincidence that both songs reference Michelle Pfeiffer or was that free connotation at work?
That’s not really the same thing.
In an interview, an adult actress was asked about the things she says during scenes. She said she describes what is happening literally at any moment.
This is what LLM models do.
The fable $25 version was the best.
AI videos as in remotion based videos look much better imo since it can code much better than it can prompt for videos with a coherent narrative
https://youtu.be/uDAeAuYyl0E (parody of Claude announcements) https://youtu.be/cSsVNtGPOIg (recreating a fireship video)
This is incredible! Did you make these yourself? I am familiar with remotion but this is a lot more than just splicing images, etc.
Did you use a skill library to make this?
> None of the music videos were great
Glad they acknowledge this.
Curious how much time in addition to tokens this costs. If you have to spend $25 and wait 45 minutes to get a basically unwatchable video, I'm not worried about indie film makers being replaced just yet...
Directors and editors using Seedance can fire the film studio.
This is a fundamental shift in how storytelling is funded and made, not in who does the driving.
Same as is happening with code.
I'm classically trained and I honestly can't really tell how these are worse than the human produced ones. They all look kinda the same to me.
It is jarring to me that most of the dancing seems slightly out of sync with the music. It is like a music video uncanny valley - images look good, but the lack of sync to the sound shatters the illusion entirely.
When the line was "don't believe me just watch"
And then the clip was literally just an arm wearing a watch!
That's freaking hilarious!
It's like someone playing charades
Regular music videos (including the writing/recording) can easily go into 6 figures. I wonder what the $200,000 AI music videos looks like.
But why spend the same amount of money on AI instead of humans? My guess is that shooting a music video is probably fun for a lot of artists. And with AI the result is not predictable and might be inconsistent in the dumbest ways.
My guess is that an AI music video would have to be a lot cheaper for artists to consider it outside of making one just because you want to make an AI music video.
You don't need to spend $200k, because results can be bad for cheap.
https://youtu.be/HDdsKJl92H4
Though we're finding the studios contracted to do this can bill $50k. I know several studios that previously billed clients six figures for ad campaigns (P&G, HBO, pharma, etc.) are now charging five figures and winning a lion share of the bids now.
Not sure why Wan is the focus of this article and Seedance is a footnote. Wan/LTX/open models are significantly behind Chinese closed source models. (And the Chinese have left the Western models in the dust.)
I wouldn't do anything production grade in Wan.
Seems like if you build some more scaffolding around it, it wouldn't be bad. I think AI video isn't quite there yet so you probably would want to lean into that. For example you could ask for an animated or cartoon music video so the real shots don't look weird. Also if you gave it some guidance on what a good music video is like it would probably help as well. But yeah idk may be that's not the goal here.
Skip the Claude Fable 5 $25 video to 1:42. The disembodied Adams' Family hand is on the job.
It's Wan video, which is a shitty video model.
The OP would exclusively be using Seedance 4k if they were serious about this.
These are getting really good. Much more interesting than the average music video already.
can't tell if sarcasm or just zero taste...
I only glanced at the video thumbnails and was repulsed. But then again, I'm not the target audience for this garbage.
Wow. These are horrible. Sort of refreshing. I thought video was better than this now, but I guess not.
Video can be good if you stick to a garden path of simple scenes with tons of examples in the training material and not a ton of motion between overlapping objects in a scene, and don't really care too much about specifics.
As soon as you want something very specific, or something novel, or anything with a lot of moving objects/people, it falls apart.
Exact same impression
It's an interesting experiment, and I am heartened by how terrible the result is. Also, I fucking hate Bruno Mars.