Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set

  • Si Liu*
  • , Zheng Song
  • , Meng Wang
  • , Changsheng Xu
  • , Hanqing Lu
  • , Shuicheng Yan
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We address a cross-scenario clothing retrieval problem- given a daily human photo captured in general environment, e.g., on street, finding similar clothing in online shops, where the photos are captured more professionally and with clean background. There are large discrepancies between daily photo scenario and online shopping scenario. We first propose to alleviate the human pose discrepancy by locating 30 human parts detected by a well trained human detector. Then, founded on part features, we propose a two-step calculation to obtain more reliable one-to-many similarities between the query daily photo and online shopping photos: 1) the within-scenario one-to-many similarities between a query daily photo and an extra auxiliary set are derived by direct sparse reconstruction; 2) by a cross-scenario many-to-many similarity transfer matrix inferred offline from the auxiliary set and the online shopping set, the reliable cross-scenario one-to-many similarities between the query daily photo and all online shopping photos are obtained.

Original languageEnglish
Title of host publicationMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia
Pages1335-1336
Number of pages2
DOIs
StatePublished - 2012
Externally publishedYes
Event20th ACM International Conference on Multimedia, MM 2012 - Nara, Japan
Duration: 29 Oct 20122 Nov 2012

Publication series

NameMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

Conference

Conference20th ACM International Conference on Multimedia, MM 2012
Country/TerritoryJapan
CityNara
Period29/10/122/11/12

Keywords

  • clothing pairing
  • clothing recommendation
  • latent SVM

Fingerprint

Dive into the research topics of 'Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set'. Together they form a unique fingerprint.

Cite this