Midjourney AI turns David Bowie’s music into music films
But this is the to start with time I have at any time viewed a single of them utilised to convert comprehensive songs into illustrations or photos, and the final results are so great that I’m certain that the authentic killer software for this technology is sleeping within David Bowie’s audio archive.
Really do not think me? Here’s Bowie’s “House Oddity,” designed by YouTube person aidontknow. Their procedure involved typing the tune lyrics into the AI prompt, verse by verse, to crank out every single picture for the movie.
See what I suggest?
Certain, the likes of Midjourney, Dall-E, and Steady Fusion will 1 day go away the uncanny valley driving and present a never ever-ending supply of best stock images that will glance as convincing as the real matter. But there’s also a huge draw back to all this enjoyable: These applications are primarily mining the current work of designers and photographers who get no AI licensing charges in a fast evolving discipline that will have unfavorable downstream consequences for the marketplace.
Ideal now, this video clip demonstrates that AI’s usually otherworldly results are nevertheless restricted: properly-suited for poetry and excellent literature, but not everything as well literal. That would seem to be the concept that moved aidontknow to turn some of Ziggy Stardust’s music into songs slideshows.
Aidontknow used the exact same methodology inside Midjourney to make this rendition of “Starman.” The movie description suggests that there are minimum variations and influence from the creator, which I uncovered to be required when I tried using to do the similar using Midjourney in Discord.
From time to time a verse will use the term it to reference an item or person named before in the music, for instance, so I required to swap it back again to the subject’s more distinct title so that the AI could recognize what “it” was.
I only tried out a handful of verses for each song to get an strategy of how nicely it labored with distinct tracks. But making use of Midjourney for the job felt exhilarating: All I did was paste the lyrics, and the images slowly materialized in entrance of my eyes without any other effort, like a genie pluming out of a lamp.
And in truth, I located out that there would seem to be a obvious correlation in between natural beauty and surrealism. The visuals for Tom Waits’s “Alice” (success pictured more than this paragraph) ended up as magical as the music alone:
It is dreamy temperature
We’re on [first image]
You waved your crooked wand
Alongside an icy pond
With a frozen moon [second image]
A murder of silhouette
Crows I observed [third image]
And the tears on my confront
And the skates on the pond
They spell Alice [fourth image]
I bought likewise fantastical outcomes for the Beatles’ “Across the Universe” and the Rolling Stones’ “Gimme Shelter,” which also have very visually evocative lyrics. The magic also labored for the poppy R&B riffs in Snoop Dogg’s “Fall It Like It is Hot.”
At times, the AI created some glitches in the literal interpretation of the words and phrases. Like in Waits’s “Tom Traubert’s Blues,” the line “See ya tomorrow, hey Frank can I borrow/ A couple of bucks from you?” turned cash into literal male deer. (A “buck” I guess.) Which, mind you, in fact adds to the lyricism of it all. Like Bob Ross would say: “There’s no mistakes. Just happy incidents.”
