Pinterest Outlines AI Background Generation Process for Product Shots
Pinterest is developing its own AI text-to-image generation process, called the “Canvas” model, which focuses on creating background options for product images without altering the main product shot. Unlike other apps, Pinterest’s approach involves training models to separate and isolate the background and foreground, facilitating background generation with simple commands. The process includes using a segmentation model to generate product masks, incorporating detailed captions from a visual language model, and fine-tuning with a curated set of high-engagement images to align with Pinterest’s aesthetic. This enables brands to request specific background styles for their product images, potentially enhancing their appeal. Pinterest is currently testing this system with selected advertising partners.

