微软交流社区

 找回密码
 立即注册
搜索
热搜: 活动 交友 discuz
查看: 153|回复: 0

【AI绘画】极乐disco,生成油画风你需要知道的一切

[复制链接]

3

主题

7

帖子

13

积分

新手上路

Rank: 1

积分
13
发表于 2023-4-19 18:29:29 | 显示全部楼层 |阅读模式
风格介绍

这次测试的是极乐disco风格的lora模型。
极乐disco是一款来自爱沙尼亚(现总部在英国伦敦)ZA/UM游戏工作室的CRPG类游戏,以独特的叙事风格,画风与音乐著称。当然,毕竟我们讨论的主要是AI绘画,所以无关绘画的部分就不过多赘述。
关于极乐disco的画风,它主要源自俄罗斯绘画历史上最伟大的画派——巡回画派,巡回画派的基本主张是:坚持车尔尼雪夫斯基“美就是生活”的艺术思想,反对俄罗斯艺术上的西欧化,强调民族特点,以反映本国人民的生活与人民的苦难为自己的责任。



故而在极乐disco的美术风格中也贯彻了这一主张,提倡现实主义,画面粗犷、笔触奔放、色彩大胆。
下载链接

大模型下载链接:
链接:https://pan.baidu.com/s/1DS8oAkpOVmM6O7_n6gIjNw?pwd=0m2p
提取码:0m2p

lora:
链接:https://pan.baidu.com/s/1-WNDnvh7sO5O-LnDhEN6pQ?pwd=0f1c
提取码:0f1c
视频链接

先说结论

极乐disco大模型在画面表现非常不错,一些写实风格ckpt大模型环境下甚至可能融合出意想不到的效果。但兼容性较差,若是想用它还原一些人物,需要小型的调整权重。在图生图的风格迁移方面表现令人惊喜,不过在提示词方面需要注意写的更详细一些。
日常使用权重建议:0.8~1.0
人物生成权重建议:0.4~0.8
图生图风格迁移时,权重建议:0.8~1.25  重绘幅度建议:0.4~0.5
<hr/>测试使用的模型

大模型


(以下简称A)revAnimated


(以下简称B)Dosmix_




(以下简称C)anything-v4.5
无预览图

(以下简称D)realisticVisonV20


(以下简称E)fiveNutsMixedMix_v10



lora


DiscoElysiumStyle




实际使用案例


大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle 权重:1
Step:40  /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:512x823
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar,
Soft Lighting,strong rim light,(close-up:1.3),
1 man,drunkoak,  on desk, (depressed:0.7),cigarette, sitting, face,ready to draw,
(black coat, shotgun, holster, sling, bleeding, short hair, beard, (blowing smoke),Cowboy hat),
desk , ceiling fan , open window,
dusk, The City Outside the Window,
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,







大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle 权重:1
Step:40  /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:512x823
正:
masterpiece, best quality, 8k, oil painting, soft lighting,ZaUm, elysiumChar,colorful, detailed and intricate,
Soft Lighting,strong rim light, Tyndall effect,Looking towards the sun,
1 man, (lever action, revolver), (cowboy:0.6),blood on bandages, injury,  
cowboy boots, cowboy hat, denim jacket, spurs, whiskers, exhausted,
brown horse,
farm,Colorful Sky,cloud, dusk, exhaust, tree,
against fence,over shoulder,  
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,







大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle 权重:1
Step:40  /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:1204x720
开启高清修复
放大算法:潜变量  /  重绘幅度:0.4  /  高清修复采样次数:0  /  放大倍率:1.2
正:
masterpiece, best quality, 8k, oil painting, soft lighting,ZaUm, elysiumChar,colorful, scenery,,detailed and intricate,
(Heavy Industry Factory,Iron making plant ,  (smokestack), machinery, ruins, crowd,railroad crossing, railroad tracks, train), crane \(machine\), cargo pallet, people,
exhaust, winter, cumulonimbus cloud
sunset, cumulonimbus cloud
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,








大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle 权重:1.25
图生图模式
Step:40  /  CFG Scale:7  / Sampler : DPM++ SDE  a Karras /   分辨率:720x512
重绘幅度:0.4
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar,colorful, detailed and intricate,
People
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,







大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle 权重:1.25
图生图模式
Step:40  /  CFG Scale:7  / Sampler : DPM++ SDE  a Karras /   分辨率:720x512
重绘幅度:0.65
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar,colorful, detailed and intricate,
train, railroad tracks, tree,railing,exhaust,  
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,





<hr/>大模型测试

人物生成测试

测试不同权重的极乐disco lora在不同大模型环境下的人物生成表现。
大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle 权重:1
Step:40  /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:512x512
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  portrait, (close-up:1.2),
Soft Lighting,strong rim light,
1 man,standing, (angry:0.5), lever action,
sombrero, (coat on shoulders), black shirt, blowing smoke,
city,pine tree , cliff, rising sun, cumulonimbus cloud,
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,
对比图




场景生成测试


测试不同权重的极乐disco lora在不同大模型环境下的场景生成表现。
大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle 权重:1
Step:25 /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:720x512
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm , elysiumChar , colorful, scenery,,detailed and intricate,
(Heavy Industry Factory,Iron making plant ,  (smokestack), machinery, ruins, crowd,railroad crossing, railroad tracks, train), crane \(machine\), cargo pallet, people,
exhaust, winter, cumulonimbus cloud
sunset, cumulonimbus cloud
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

对比图




结论


图中的横轴为CKPT大模型,从A到E依次排列,纵轴为极乐disco lora的权重,从0.8到1.1。
在无论从人物还是场景,都可以看出,极乐disco lora的兼容能力。并且在一些情况下融合成了独特的画风。
A,E模型都是相对平面的画风,在此环境下生成的作品则比较忠于原始画风。
B,D模型则为相对立体的画风,其中D为完全的真实照片风格,在此环境下则融合诞生出了一种更加强调色彩与线条的全新风格。
<hr/>兼容性测试

测试不同权重的极乐disco lora在不同大模型环境下的场景生成表现。
人物lora兼容性测试

大模型(ckpd):revAnimated
Lora:DiscoElysiumStyle
Lora:genshinImpactNoelle
Step:25 /  CFG Scale:7  / Sampler :   /   分辨率:700x700
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar ,  portrait,
Soft Lighting,strong rim light,
1girl,hair ornamen, gloves,  gilded frame, ganyu, twin horn, bare shoulder, bodysuit,
noelle_\(genshin_impact\), 1girl,(green_eyes:1.2//),silver hair, short_hair, medium_breasts, rose, red_flower,hair_flower, <lora:genshinImpactNoelle_nV1:NUM>
city,pine tree,cliff, rising sun, cumulonimbus cloud,
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,
对比图:



服装lora兼容性测试

基础参数
Lora:DiscoElysiumStyle
lora:hanfu_v29
Step:25  /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:512x512
Seed:4260405912
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar ,  portrait,
floating hair,chromatic aberration, bowdepth of field,monochrome,
(1girl, solo),
hanfu,song,
strong rim light,upper body
wind, autumn, maple leaf, falling leaves, blurry background, day, ginkgo leaf, depth of field,
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,



结论


原神诺艾尔测试中,横轴为人物lora的权重,从0.4到0.8以0.1递进。纵轴为极乐disco画风lora,从0.4到0.8以0.1递进。
汉服lora测试中,横轴为汉服lora权重,从0.4到0.8以0.1递进。纵轴为极乐disco画风lora,从0.6到1.0以0.1递进。其中权重偏差为额外测试所得,超出该范围可能导致画面崩溃。
在测试过程中,明显感觉对人物lora兼容性稍差,在无数次调整后确认权重在0.4到0.8之间才能有比较好的画面效果,并且使用人物lora时需要稍大的画幅,不然可能会导致面部崩溃。
汉服lora则出现了一些盖过原画风的问题,因为再开大权重可能导致面部变形,所以也无法通过改变权重解决问题。不过在画面融合时依然产生了一些有趣的效果,也是一种不错的尝试。
<hr/>图生图改变画风

人物肖像图生图

基础参数
Lora:DiscoElysiumStyle
Step:30  /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:720x556
Denoising: 0.4
Seed:470772336
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  portrait, (close-up:1.2),
Soft Lighting,strong rim light,blurry background,
1man,old man,asian,straw hat, white shirt, farmer ,tree
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,





测试不同权重与不同重绘幅度的影响
对比图
横轴为重绘幅度,从0.35到0.55,以0.05为递进。
纵轴为lora权重,从0.8到1.4,以0.15递进。




人物+场景图生图


基础参数
Lora:DiscoElysiumStyle
Step:30  /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:720x556
Seed:105519802
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  portrait, (full body:1.2),
Soft Lighting,strong rim light,blurry background,
1 girl , asian , sitting , basket, kakiman, tree, stone, against rock,
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,





测试不同权重与不同重绘幅度的影响
对比图
横轴为重绘幅度,从0.35到0.55,以0.05为递进。
纵轴为lora权重,从0.8到1.4,以0.15递进。




场景图生图


基础参数
Lora:DiscoElysiumStyle
Step:30  /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:720x556
Seed:105519802
正:
masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  scenery,
Soft Lighting,
village, building, fog, hill, chinese building,
负:
(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,





测试不同权重与不同重绘幅度的影响
对比图
横轴为重绘幅度,从0.35到0.55,以0.05为递进。
纵轴为lora权重,从0.8到1.4,以0.15递进。




结论


在人物肖像方面的表现让人惊喜,在稍低重绘幅度情况下完整的保留了极乐disco风格的笔触,对原始人物面部有轻微影响。在稍高重绘幅度情况下则偏向模型的训练集风格,人物开始偏向西方人种特征,即便提示词中已经有了相关的提示。
人物全身的生成方面则有些差强人意,虽然画风依然保留,但已经完全看不出原始人物特征,低重绘幅度情况下人脸崩溃情况严重,开高重绘又会极大降低还原度。具体使用时可以参控测试结果进行取舍。
场景方面则非常惊喜,无论是最开始对场景的还原,抑或是高重绘情况下对场景“极乐disco”化改造。都展现出了不俗的可能性,给了我不少灵感。在后续其他测试中,我也可能会尝试用白模场景进行生成,看看它基于有限构图的创作能力。

<hr/>资料引用:《极乐迪斯科》——世纪末的纯粹浪漫与孤独


<hr/>交流群

QQ: 697080799
VX:

回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

Archiver|手机版|小黑屋|微软交流社区

GMT+8, 2024-5-18 17:39 , Processed in 0.143434 second(s), 18 queries .

Powered by Discuz! X3.4

Copyright © 2001-2021, Tencent Cloud.

快速回复 返回顶部 返回列表