How swag.ai finds clothes.
swag.ai finds the clothes in a photo or screenshot. Upload a picture of an outfit and you get a card for each garment, with the best match we could find and more options, including cheaper ones.
How a scan works
Find the garments
An image model finds each piece of clothing in your picture and where it sits on the body: top, bottom, shoes, bag, and accessories such as caps, glasses and belts. Socks are left out. For screenshots, app buttons, captions and black bars are removed first where we can find them.
Search for each one
Each garment is cut out and searched on its own with Google Lens, through a service called SerpApi, as the country you shop from (the United States until you choose one in Settings). That returns listings from shops across the web.
Start from Google’s order
Listings start in the order Google Lens ranks them, the same as searching the picture on Google. Only shops’ pages are kept: links to social media, music and video sites, magazines, news, picture sites, blogs and stock photos are left out, and so are pages that show the clothes without selling them, such as a song, an article or a wallpaper. So are listings from the children’s section and listings whose title names a different kind of garment or a clashing colour. Listings that name the garment’s brand come first: the brand on its logo when we can read it, or else the brand most of the shops name. After that, shops with your country’s own web address (such as .de or .co.uk) come first, then listings written in English, then listings in Danish, then the rest, and shops selling the garment new come before resale. Resale the rest of a card doesn’t show has a Secondhand row of its own.
Show the matches
The first listing left is the best match, unless people who scanned the same picture said it was wrong, and a shop’s search or category page doesn’t come first while a product’s own page is there. The next ones are more options, marked with how much less they cost when they’re cheaper. Then similar pieces from everyday shops like Zara, H&M, COS and Uniqlo: for clothes and shoes with few of them in the results, that takes a second search told to look for those shops. After them come up to three more listings that have a price, all cheaper than the best match when it has a price. If none are left, we say no shop listing was found. Prices come from the search results, so they’re shown as approximate.
What to expect
It won’t find everything
It depends on how clearly the garment shows, and on whether it’s sold somewhere Google Lens can see. When we can’t find a match, we say so rather than show a guess.
Your pictures
Uploaded pictures are deleted within 24 hours, and we don’t use facial recognition. The Privacy Policy has the details.
Quick when it can be
The garments show up first, and each one’s shop links appear as soon as its search answers. The same picture again comes back straight away.
Try it on a picture.
