Midjourney AI turns David Bowie’s music into music films

But this is the to start with time I have at any time viewed a single of them utilised to convert comprehensive songs into illustrations or photos, and the final results are so great that I’m certain that the authentic killer software for this technology is sleeping within David Bowie’s audio archive.

Really do not think me? Here’s Bowie’s “House Oddity,” designed by YouTube person aidontknow. Their procedure involved typing the tune lyrics into the AI prompt, verse by verse, to crank out every single picture for the movie.

https://www.youtube.com/check out?v=tgBHgmMI4kU

See what I suggest?

Certain, the likes of Midjourney, Dall-E, and Steady Fusion will 1 day go away the uncanny valley driving and present a never ever-ending supply of best stock images that will glance as convincing as the real matter. But there’s also a huge draw back to all this enjoyable: These applications are primarily mining the current work of designers and photographers who get no AI licensing charges in a fast evolving discipline that will have unfavorable downstream consequences for the marketplace.

Ideal now, this video clip demonstrates that AI’s usually otherworldly results are nevertheless restricted: properly-suited for poetry and excellent literature, but not everything as well literal. That would seem to be the concept that moved aidontknow to turn some of Ziggy Stardust’s music into songs slideshows.

https://www.youtube.com/look at?v=qaJytCoP2So

Aidontknow used the exact same methodology inside Midjourney to make this rendition of “Starman.” The movie description suggests that there are minimum variations and influence from the creator, which I uncovered to be required when I tried using to do the similar using Midjourney in Discord.

From time to time a verse will use the term it to reference an item or person named before in the music, for instance, so I required to swap it back again to the subject’s more distinct title so that the AI could recognize what “it” was.

The initially strophe of Tom Waits’s “Alice” as interpreted by artificial intelligence. [Midjourney]

I only tried out a handful of verses for each song to get an strategy of how nicely it labored with distinct tracks. But making use of Midjourney for the job felt exhilarating: All I did was paste the lyrics, and the images slowly materialized in entrance of my eyes without any other effort, like a genie pluming out of a lamp.

And in truth, I located out that there would seem to be a obvious correlation in between natural beauty and surrealism. The visuals for Tom Waits’s “Alice” (success pictured more than this paragraph) ended up as magical as the music alone:

It is dreamy temperature
We’re on [first image]
You waved your crooked wand
Alongside an icy pond
With a frozen moon [second image]
A murder of silhouette
Crows I observed [third image]
And the tears on my confront
And the skates on the pond
They spell Alice [fourth image]

I bought likewise fantastical outcomes for the Beatles’ “Across the Universe” and the Rolling Stones’ “Gimme Shelter,” which also have very visually evocative lyrics. The magic also labored for the poppy R&B riffs in Snoop Dogg’s “Fall It Like It is Hot.”

AI visualizations for Snoop Dogg’s “Drop It Like It is Incredibly hot,” from remaining: Uh! I’m a wonderful dude, with some wonderful dreams / See these ice cubes, see these ice lotions? / Eligible bachelor, million-dollar boat / Which is whiter than what is spilling down your throat. [Midjourney]

The Beatles’ “Across the Universe,” from left: Words are flowing out like endless rain into a paper cup / They slither wildly as they slip absent across the universe / Pools of sorrow, waves of pleasure are drifting by my opened head / Possessing and caressing me. [Midjourney]

At times, the AI created some glitches in the literal interpretation of the words and phrases. Like in Waits’s “Tom Traubert’s Blues,” the line “See ya tomorrow, hey Frank can I borrow/ A couple of bucks from you?” turned cash into literal male deer. (A “buck” I guess.) Which, mind you, in fact adds to the lyricism of it all. Like Bob Ross would say: “There’s no mistakes. Just happy incidents.”

Tom Waits’s “Tom Traubert’s Blues”: See ya tomorrow, hey Frank can I borrow / A few of bucks from you? [Midjourney]