lllyasviel

Compile agent conversations!

Let us control diffusion models!

ControlNet lets you guide AI image generation with visual inputs, body poses, sketch edges, depth maps, or scribbles, so you control the exact structure of the result, not just describe it in text.

More relighting!

IC-Light is an AI tool that changes the lighting in photos. You describe the lighting you want in text, or supply a background image, and it relights your subject to match.

Understand Human Behavior to Align True Needs

sketch + style = paints :art: (TOG2018/SIGGRAPH2018ASIA)

AI tool that automatically colorizes line art sketches into layered artwork, matching how digital artists actually work with separate color, gradient, and shading passes.

Lets make video diffusion practical!

Desktop software that turns a still image and a text prompt into a video by generating frames one chunk at a time, using a fixed-memory technique that lets a 6 GB laptop GPU produce 60-second clips at 30 fps.

Focus on prompting and generating

Free, offline image generator that turns text descriptions into pictures on your own computer, no accounts, no internet, no technical setup needed.

No description.

Stable Diffusion WebUI Forge is an enhanced version of the popular AI image-generation browser interface, offering faster generation, better GPU memory management, and a one-click Windows installer.

Your image is almost there!

Nightly release of ControlNet 1.1

[WIP] Layer Diffusion for WebUI (via Forge)

Transparent Image Layer Diffusion using Latent Transparency

Illumination Drawing Tools for Text-to-Image Diffusion Models

Generating Digital Painting Lighting Effects via RGB-space Geometry (SIGGRAPH2020/TOG2020)

This project has been abandoned.

an u-net with some algorithm to take sketch from paints

LayerDiffuse in pure diffusers without any GUI

DanbooRegion: An Illustration Region Dataset (ECCV 2020)

A sample version of ygopro in Unity

Erasing Appearance Preservation in Optimization-based Smoothing (ECCV 2020)

A project to decompose the components in cartoon animations.

A single file implementation of key-value database for Python 3.

lllyasviel

A simple tool to guess an HuggingFace repo URL from a state dict.

"Generating Manga from Illustrations via Mimicking Manga Creation Workflow" in CVPR 2021

Style2Paints Research Website

"User-Guided Line Art Flat Filling with Split Filling Mechanism" in CVPR 2021

Official tensorflow implementation for CVPR2020 paper “Learning to Cartoonize Using White-box Cartoon Representations”

Stable Diffusion web UI

lllyasviel.github.io

WebUI extension for ControlNet (v1 archived)

Experiments in VCC paper

some archived legacy forge extensions

No description.

No description.

GitHub Page of ToonDecompose

Misc files.

some github pages