Style Transfer
Style transfer models offer near limitless opportunities for customization. They are special in that they only require one style image to train and have a few different hyperparameters that can be tuned to change the resulting filter. To help you achieve the best results, we've created this guide with examples from ready-to-use styles and heuristics developed from our own experiments.
1. Create a new Style Transfer project
First, create a new project and select the Style Transfer project type.
2. Train your style transfer model
After creating your project, select the Training tab in the menu and click
TRAIN A NEW MODEL.
Choosing a Style Image
Not all style images are equal. For the best results, pick images that:
- Have large geometric patterns on the scale of 10% - 33% of the image's width
- Have bold, contrasting color palletes
- Have strong edges
If you're looking for inspiration, consider searching Unsplash or Flickr for terms like "abstract" or "geometric".
Make sure any images you use have an appropriate license.
Adjustable parameters
Changing the relative magnitude of each loss weight is the best way to change the aesthetic of your model.
There are four loss terms:
style weight: The higher this weight, the more the output images will resemble the style of your style image.content weight: The higher this weight, the more your stylized image will retain the content of the original.total variation weight: The higher this value, the smoother your stylized images will be. This may wash out small textures.stability weight: The higher this value, the more the model will attempt to stabilize videos. This can have the effect of washing out smaller textures.
Below are example configurations for a number of sample style images.
| Name | Style Image | Output | Content Weight | Style Weight | Total Variation Weight | Stability Weight |
|---|---|---|---|---|---|---|
| bicentennial_print |  |  | 1 | 5 | 5 | 5 |
| blue_arrow |  |  | 1 | 1 | 5 | 5 |
| comic |  |  | 1 | 5 | 5 | 5 |
| femmes |  |  | 1 | 10 | 5 | 5 |
| filament |  |  | 1 | 4 | 5 | 5 |
| green_blocks |  |  | 1 | 10 | 5 | 5 |
| head_of_clown |  |  | 1 | 10 | 5 | 5 |
| horses_on_seashore |  |  | 1 | 10 | 5 | 5 |
| kaleidoscope |  |  | 1 | 5 | 5 | 5 |
| lamp_post |  |  | 1 | 4 | 5 | 5 |
| mosaic |  |  | 3 | 10 | 5 | 5 |
| notre_dame |  |  | 1 | 4 | 5 | 5 |
| pink_blue_rhombus |  |  | 1 | 5 | 5 | 5 |
| poppy_field |  |  | 3 | 10 | 5 | 5 |
| ritmo_plastico |  |  | 1 | 10 | 5 | 5 |
| shades |  |  | 1 | 1 | 5 | 5 |
| sketch |  |  | 1 | 4 | 5 | 5 |
| snowflake |  |  | 5 | 10 | 5 | 5 |
| sprinkles |  |  | 2 | 1 | 5 | 5 |
| starry_night |  |  | 1 | 10 | 5 | 5 |
| swirl |  |  | 5 | 10 | 5 | 5 |
| the_scream |  |  | 1 | 20 | 5 | 5 |
| the_trial |  |  | 1 | 10 | 5 | 5 |
| tile |  |  | 1 | 5 | 5 | 5 |
| vector |  |  | 2 | 1 | 5 | 5 |
3. Export your Lens Studio project
Once your model is trained, you can export it as part of a pre-built Lens Studio project directly from the Models table in Fritz AI Studio.
4. Configure your model in Lens Studio
Once downloaded, unzip the project archive and open the .lsproj file in Snap
Lens Studio. Follow the instructions in the README.js file to configure your project.