Generative art
Page 3 of 10 Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10  Next
vurt




Posts: 14936
Location: Sweden
PostPosted: Mon, 28th Feb 2022 14:05    Post subject:
yeah, good idea.
i started reading about doing a local install and i think i'll skip that, it takes over 100gb..i probably need a better GPU too.

Hope it can do faces eventually, they're terrible now.. people overall isn't very good, sometimes they get extra limbs too Laughing

LOTR stuff. From poems from the books, or descriptions of flora in middle earth. Sauron's Tower, Lothlorien..



share more! don't by shy. no one is an expert at this yet, we're just getting started Smile
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Mon, 28th Feb 2022 14:55    Post subject:
Heh, yes. Running it on your own machine isn't really ideal. You'd need a 3090 to get anything done. I'm not sure how much of a difference the CPU makes for this kind of task.

(what we really want for this is the Nvidia A100 which is the latest/best monster-card for AI/neural-net/deep learning... for a mere ~$30,586)


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Mon, 28th Feb 2022 15:22    Post subject:
Okay, here we go. First post:

Neuromancer
(I tried to recreate a scene from William Gibson's book Neuromancer.. it didn't turn out like I thought.. instead it turned into a really cool surreal piece of art of Neuromancer itself):


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Mon, 28th Feb 2022 15:27    Post subject:
I generated a bunch of Blade Runner/Cyberpunk-style cityscapes. I restricted the side on this page with [imgwidth=800 ]. Rightclick on the image and select "Open image in a new tab" to see it fullsize.






Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
DXWarlock
VIP Member



Posts: 12631
Location: Florida, USA
PostPosted: Mon, 28th Feb 2022 15:29    Post subject:
Frant wrote:
(what we really want for this is the Nvidia A100 which is the latest/best monster-card for AI/neural-net/deep learning... for a mere ~$30,586)

We get google cloud boxes for work our SaaS software runs on to do PDF to jpg/tiff rasterization and upscaling on. So I 'borrowed' of one of the ones not used or assigned to any workflow to use and connected to it with the 'Connect to a custom GCE VM' in colab.

And for some reason A100 will not work, at least for me. No matter WHAT I do I get out of memory error on it, saying "39.9GB of blah blah assigned, 2GB trying to be wrote" or whatever the error is.
Strangely with the same settings a v100 works fine. if I edit the GCE instance and change from a100 to v100 it works...so not sure if a EBKAC error on my side or just it doesnt like it. I cannot see how changing the GPU and nothing else on a VM could cause it to be an error I am doing.
But think I will just stick with a v100, with a res of around 1800x1024 only takes 5-6 minutes on a 300 step image, thats fast enough for me.


-We don't control what happens to us in life, but we control how we respond to what happens in life.
-Hard times create strong men, strong men create good times, good times create weak men, and weak men create hard times. -G. Michael Hopf

Disclaimer: Post made by me are of my own creation. A delusional mind relayed in text form.


Last edited by DXWarlock on Mon, 28th Feb 2022 15:46; edited 2 times in total
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Mon, 28th Feb 2022 15:42    Post subject:
Eon
I tried to recreate The Way from Greg Bears novel Eon, a human made "pocket" universe in the shape of a cylinder/tube with a diameter of ~200-250 km, extending infinitely. The first attempt (2 images) looked like chrome (the second one actually reminded me a little of what the far-into-the-future city The Hexamon might look like):




I edited the description, added tags and so on:




It's tricky to get what you see in your mind.


Oh, I also tried rendering Putin as a bloodthirsty vampire.
Let's just say that the result is quite "interesting". Wink



Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
DXWarlock
VIP Member



Posts: 12631
Location: Florida, USA
PostPosted: Mon, 28th Feb 2022 15:46    Post subject:
Those are some pretty amazing pics guys Smile
I'll share some of mine when I get some good ones, as now I am trying weird obtuse stuff just to see what it will make. Not going for a style or theme, more just what the AI thinks a 'concept' of words looks like.
Giving it random phrases, or keyword mashups and seeing what it spits out...so nothing post worthy unless you want to see what things like "1990's look JNCO Grunge Goth" spits out..was curious what it would say the visual mashup of that is if I give it all the styles of the 90s in one handful looked out.
Or "Rally England Subaru", or even just "Nothing emptiness void"


-We don't control what happens to us in life, but we control how we respond to what happens in life.
-Hard times create strong men, strong men create good times, good times create weak men, and weak men create hard times. -G. Michael Hopf

Disclaimer: Post made by me are of my own creation. A delusional mind relayed in text form.
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Mon, 28th Feb 2022 15:51    Post subject:
Trying to create specific scenarios is like trying to control an airplane by blowing on it. You have to write very specific details of the scene as well as use other tricks mentioned in the thread.


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
DXWarlock
VIP Member



Posts: 12631
Location: Florida, USA
PostPosted: Mon, 28th Feb 2022 15:56    Post subject:
Very true I noticed...haha.
But I am enjoying it more for the 'failed but interesting attempt at it' aspect.
Its like asking a very talented artist that is an advanced alien lifeform to paint/draw/generate a photo of what I ask it. When it only visited earth for a week trying to absorb all the knowledge of everything about earth in that time.
I enjoy watching what it tries its best to make with its alien concept of what those things are.

Like if I asked it to make the Mona Lisa and it did even a remotely vaguely passable job, I would be let down and disappointed in the results.
I am fascinated more by how it does it wrong, but tries so hard to get it right its acceptable how wrong the 'wrong' parts are. the visual version of the hitchhiker's guides asking for tea and getting "a cupful of liquid that was almost, but not quite, entirely unlike tea."


-We don't control what happens to us in life, but we control how we respond to what happens in life.
-Hard times create strong men, strong men create good times, good times create weak men, and weak men create hard times. -G. Michael Hopf

Disclaimer: Post made by me are of my own creation. A delusional mind relayed in text form.
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Mon, 28th Feb 2022 16:38    Post subject:
It's very easy to create very specific scenarios, that's what the init_image is for.

A black rectangle in the init_image and a prompt that says "house" - the AI will render the house over the box because it's the shape that fits best. It's also the best way to create people. Create people-shapes and you get proper people (so not people with 3 legs etc). Use simple shapes (just steal from google and use silhouettes). Complex shapes will obviously be as unpredictable as noise since it can be anything to the AI.

The whole idea is that it latches onto random (or not random) noise, from this it paints the image from one point to the other until there's a complete image that corresponds with a specific part of the prompt.

If you played around with Deep Dream (make people, items look like dogs etc etc, very trippy) when that was available, this is a continuation of that...

I do think the most creative way to use this tool is to direct the AI with the init_image, that way it actually is your work. it's your noise, not the default. No one can replicate this image unless they have your init_image. I'm not using it for most images here, i'm still to eager to try things out, i did use it for the very first cyberpunk image (in first post).

Cool images Smile
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Mon, 28th Feb 2022 17:19    Post subject:
I haven't use any kind of init_image so far. I've only "told" DD what I want it to do in text.


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Mon, 28th Feb 2022 19:29    Post subject:
The AI is incredibly stupid with the prompts, you have to figure out its language and it's not totally clear, there's not syntax to follow, well there's some, like "made of" is one that seems to work "made of beads", and "by" when it comes to artist etc.. if you state any of this differently then it might not work, the result can be cool anyways of course.

Edit: it also helps if you actually write the code as you should Laughing


Last edited by vurt on Mon, 28th Feb 2022 20:12; edited 1 time in total
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Mon, 28th Feb 2022 19:51    Post subject:
ohh, so with negative weights you can remove stuff, that's fucking awesome. if it generates
people and it's not wanted, just remove people with a negative weight Smile

also figured out you should using array elements to separate things in the prompt, so i've been doing it wrong lol.. much of it actually is already as default and explained, and i should learn to not just ignore stuff or just follow others blindly (which i did here) i've been using a "|" to separate stuff, but that syntax is not used for DD.
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Mon, 28th Feb 2022 23:42    Post subject:
Aaaand... No more GPU available until tomorrow. Meanwhile I can post some of my experiments.

First I tried to generate creepy deep-forest fairy tale scenes (they are 1280 wide so you may have to rightclick them and open in new tabs to watch them in their original size):





Then I tried something that just didn't work out (and wasted ~2 hours of rendering time). Then I decided to use the first couple of lines from a song as the description to see what DD would do with it.

"It was 20 years ago today, Sgt. Pepper taught the band to play."






(is Paul McCartney serving vegetables or something? Laughing )

The final render before I was disconnected was this one:



Can anyone guess what I wrote?
 Spoiler:
 
Laughing


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!


Last edited by Frant on Tue, 1st Mar 2022 21:12; edited 1 time in total
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Tue, 1st Mar 2022 17:26    Post subject:
This one was actually quite cool:

Black Sabbath - The Wizard

"Misty morning, clouds in the sky, Without warning, the wizard walks by, Casting his shadow, weaving his spell, Funny clothes, tinkling bell, by Ted Nasmith."



Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
DXWarlock
VIP Member



Posts: 12631
Location: Florida, USA
PostPosted: Tue, 1st Mar 2022 18:17    Post subject:
vurt wrote:

also figured out you should using array elements to separate things in the prompt, so i've been doing it wrong lol.. much of it actually is already as default and explained, and i should learn to not just ignore stuff or just follow others blindly (which i did here) i've been using a "|" to separate stuff, but that syntax is not used for DD.

I did the same to start. Laughing

The best/correct way is:
Code:

text_prompts = {
  0: ["prompt one:5", "prompt two:10"],
  50: ["prompt three:5", "prompt four:10"],
}

If you wanted it to do two prompts starting at step 0 one with weight 5, the other 10. Then add in two more starting at step 50 with 5 and 10 weights.
--
Dont NEED the weights, or the later step ones. can just be:
Code:

text_prompts = {
  0: ["prompt one"],
}

IF you wanted simply one thing.


-We don't control what happens to us in life, but we control how we respond to what happens in life.
-Hard times create strong men, strong men create good times, good times create weak men, and weak men create hard times. -G. Michael Hopf

Disclaimer: Post made by me are of my own creation. A delusional mind relayed in text form.
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Tue, 1st Mar 2022 22:25    Post subject:
It's a bit complicated to understand how starting prompts on different frames works, i mean the result.. i'll have to set up something simplistic and test it.. eg tree on frame 0, sky frame 100, chair frame 140 etc.. then swap.

LOTR, Lothlorien, Realm of very white elves.





Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Wed, 2nd Mar 2022 00:33    Post subject:
Sauron and, uh, his cute pet eye! (not that i asked for the eye, but thanks AI! It's... yeah.. It's... something! i want to call it "Frankie"! Laughing Laughing )



Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Wed, 2nd Mar 2022 09:05    Post subject:
Just tried 4 images of "Skyrim Flora Overhaul" as the only thing in the prompt.

Result;

* Grass growing through and ON grey rocks in all images. LOL so good, it's exactly how it is in this game.

* Overbright, ugly Creation Engine graphics. it totally has the right idea but it has also learned the worst images possible.

* Awful representation of my work lol

No images were worth sharing (i'll share 1), very ugly apart from some of the close ups of the flora which i could steal and use in my mod actually, that would be funny. The graphics would match the game's overall graphics really well.

Fun and very good to learn from, how it copies (it doesn't, it makes something completely unique, no copy/paste part of some flora yet it gets super close)... I know this engine and its images (default + my own) way better than i know any painter so a nice test...

 Spoiler:
 
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Wed, 2nd Mar 2022 18:20    Post subject:
Hey, a dancing thistle-bloom nymf. Laughing

So.. I continued with my song-lyric renderings, this time using the first couple of lines from Black Sabbath's "Fairies Wear Boots":





The first one actually looks like a real illustration in a childrens fairy tale book. The second one is like a purple and blurry variation of the first.

After that I tried to do some very abstract stuff which unfortunately didn't lead to anything useful, esp. not since I stopped the jobs halfway through to tweak my prompts to get closer to what I wanted. When it looked like I was finally getting something that I wanted to complete I got the prompt that I had been disconnected. Trying to connect again = "No GPU due to limits, do you still want to connect?". Meh..


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Wed, 2nd Mar 2022 20:54    Post subject:
How many steps?

Seems like doing a local install is the way to go for faster renderings, someone said on the official Discord for DD that even the 3070 is 2x faster than the old (but super expensive) cards you get from Google on Colab.. they do have 16GB which is nice though and why they were expensive and still decent.

Ordered a 3090 OC with (24GB) so it should be a bit quicker!

Been messing with animations all day, so much fun. DD5 Turbo (special version for faster animations).
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Wed, 2nd Mar 2022 21:19    Post subject:
500 steps. It seems to be the sweet spot for quality/performance for just playing around with while getting a pretty good result.

How does the syntax work for animations? I wish there was a full guide for every setting as well as a guide on how to write the most effective prompts. Experimenting to see what works and what doesn't takes a lot of time and waste a lot of runtime.


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Wed, 2nd Mar 2022 21:25    Post subject:
It's on 5) Create Video. just click that, but of course you also must have created a ton of batches so that it has a lot of images to process for the video. Then there are functions lite rotate and zoom etc, those i'm still learning i'm not gonna pretend i can explain those lol, at least not yet.

500 steps, wow. I rarely go over 150, the images i've posted here are 100-250 steps.

More steps is not always better either, i once tried 100 and something like 800 and i liked the one which was 100 better (same seed), had more interesting details that were gone in 800 and turned into something else. Depends on the image i guess.
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Wed, 2nd Mar 2022 21:30    Post subject:
I'm still trying to figure out how to put something in the center of the image. "A yellow dot in the center of the image" doesn't really work. I guess I have to do some more research on how to use init_picture to tell the engine where I want to place stuff or overall how to control the dimensions, angles, view directions etc.

EDIT: I MAY use an unnecessarily high steps-setting. It does increase the rendering time and it waste valuable runtime usage. I'll back down to 150. That way I can continue to experiment with the prompt without wasting an unnecessary amount of runtime.


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Wed, 2nd Mar 2022 22:09    Post subject:
yeah, the fun in this is experimenting imo, not getting poster-quality work. that's for when you've mastered it (imo at least).

small video (takes hours to render!)

https://i.imgur.com/W3ywCsg.mp4

Not really the most fun scene. i just entered "cyberpunk city" and then i went out for a few hours. I could have spent some minutes looking for a better seed.

what's so incredibly cool is that it's totally 3D. so whatever creation you've done you can move around in 3D for that scene. but yes, doing camera work for it, that's a total pain...

Things will get better though because there's a lot of smart people involved now, very eager to take this to the next level.
Back to top
Frant
King's Bounty



Posts: 24978
Location: Your Mom
PostPosted: Wed, 2nd Mar 2022 22:54    Post subject:
Wow, that's cool. Can't wait for smarter/better versions of Disco Diffusion or even a competitor.


Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn!
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Sat, 5th Mar 2022 23:38    Post subject:


Fun Very Happy This forced me to also bother saving some actual music from my modular synths, something i rarely do.
Back to top
TheZor
VIP Member



Posts: 5991

PostPosted: Sun, 6th Mar 2022 13:26    Post subject:
Fantastic stuff, keep them coming Very Happy


R5 5600X - 3070FE - 16GB DDR4 3600 - Asus B550 TUF Gaming Plus - BeQuiet Straight Power 11 750W - Pure Base 500DX
Back to top
Il_Padrino




Posts: 8284
Location: Greece by the North Sea
PostPosted: Sun, 6th Mar 2022 14:11    Post subject:
Jesus, those LOTR renders in particular look awesome.


The numbers don't decide, the system is a lie. The river running dry, the wings of butterflies.
And you may pour us away like soup. Like we're pretty broken flowers.
We'll take back what is ours. One day at a time.
Back to top
vurt




Posts: 14936
Location: Sweden
PostPosted: Tue, 8th Mar 2022 01:46    Post subject:
Just compared my local install with Google Colab and a Tesla P100, same settings, 1152x512 resolution.

Tesla P100: 4.50 min
Nvidia RTX 3090: 1.46 min

Pretty decent upgrade.. a 2496x1088 image with 100 steps takes me 4:10 mins Smile (using DD v5 TurboSmooth). The interface is TONS better with a local install too, notebook sucks working with, having the google account / drive verified etc + overall that scrolling BS on the page itself.

this is the last image i'm doing with google notebook



now onto experimenting with tons of settings for days Very Happy


Last edited by vurt on Tue, 8th Mar 2022 02:22; edited 2 times in total
Back to top
Page 3 of 10 All times are GMT + 1 Hour
NFOHump.com Forum Index - General chatter Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10  Next
Signature/Avatar nuking: none (can be changed in your profile)  


Display posts from previous:   

Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB 2.0.8 © 2001, 2002 phpBB Group