What Projects Are Featured on Justin Pinkney's Blog?

Updated

Justin Pinkney's blog highlights five recent projects: the Trailer Faces HQ Dataset (187k high-resolution face images with varied expressions taken from movie trailers, August 2024), Experiments with Swapping Autoencoder (using a model that separates an image into style and content components, May 2024), Image Mixer Diffusion (blending images by fine-tuning an Image Variation Diffusion model, April 2024), Face Mixer Diffusion (training face-conditioned diffusion models, January 2024), and Würstchen v2 Pokémon (fine-tuning Würstchen v2 for text-to-Pokémon generation, January 2024). All of them sit at the intersection of machine learning and creative image work, which is how Pinkney describes the blog's focus.

The Five Featured Projects

Project Date What it involves
Trailer Faces HQ Dataset August 2024 A dataset of 187k high-resolution face images with varied expressions, sourced from movie trailers
Experiments with Swapping Autoencoder May 2024 Exploring a model that breaks images into style and content components, and the creative uses that follow
Image Mixer Diffusion April 2024 Blending or mixing images together by fine-tuning an Image Variation Diffusion model
Face Mixer Diffusion January 2024 Experiments training face-conditioned diffusion models
Würstchen v2 Pokémon January 2024 A quick experiment fine-tuning Würstchen v2 for text-to-Pokémon generation

What Each Project Tells You

Trailer Faces HQ Dataset

This is a resource release rather than a model experiment: a large collection of high-resolution face images with varied expressions, drawn from movie trailers. If you work on face-related generation or analysis and need diverse expressions at high resolution, this is the entry point on the blog.

Experiments with Swapping Autoencoder

The premise is a model that decomposes an image into style and content. The post covers the "fun things" that decomposition enables — useful if you are curious about image manipulation through component separation rather than end-to-end prompting.

Image Mixer Diffusion and Face Mixer Diffusion

These two posts are companion experiments in blending. Image Mixer Diffusion fine-tunes an Image Variation Diffusion model to mix images; Face Mixer Diffusion trains face-conditioned diffusion models. Pinkney frames the latter with a candid note about "the best model checkpoint I ever lost," so expect practical lessons alongside results.

Würstchen v2 Pokémon

A short fine-tuning experiment: take Würstchen v2 and adapt it for text-to-Pokémon generation. It is the most self-contained of the five if you want a small, concrete fine-tuning example.

How to Decide Where to Start

  • Looking for data? Start with Trailer Faces HQ Dataset.
  • Interested in image decomposition and style/content control? Read Experiments with Swapping Autoencoder.
  • Want image blending or face-conditioned generation? Read Image Mixer Diffusion and Face Mixer Diffusion together.
  • Want a compact fine-tuning walkthrough? Start with Würstchen v2 Pokémon.

The blog notes that it is "occasionally updated," and a "See more posts" link leads to the full archive, so the five above are the latest rather than the complete list.