Vibe Transfer

Today's release is a new feature for NovelAI Diffusion V3 called "Vibe Transfer".
With Vibe Transfer, you can upload an input image that will be used as a sort of inspiration for generations while enabled. You can control the strength of the transfer, as well as how much information is extracted from the input image and considered during the transformation.

Starry Night by Vincent Van Gogh

Starry Maid by NovelAI

Reference Strength

The Reference Strength parameter is fairly intuitive. The closer it is to 1, the stronger the AI will try to emulate visual cues, such as stylistic aspects, colors etc., from the given input image. You might need to experiment a bit to get the best results, as the AI may tend to ignore your text prompt if the Vibe Transfer is too strong, but it will also be able to replicate features from the input more precisely.

Information Extracted

The "Information Extracted" setting can be a bit more complicated, and we recommend using the default value. The Vibe Transfer feature refers to the input image, extracting concepts or features before transferring them to the output generation. In some cases, it can be tricky to control exactly which concepts are transferred from the input. For example, if your input image has a white background, the Vibe Transfer tool will likely also force the output image to have a white background. By reducing the information extracted, you can sometimes avoid unwanted elements from being considered.