Gradient field descriptor for sketch based retrieval and localization

Rui Hu; Mark Barnard; John Collomosse

doi:10.1109/ICIP.2010.5649331

Gradient field descriptor for sketch based retrieval and localization

Rui Hu
, Mark Barnard
, John Collomosse

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

We present an image retrieval system driven by free-hand sketched queries depicting shape. We introduce Gradient Field HoG (GF-HOG) as a depiction invariant image descriptor, encapsulating local spatial structure in the sketch and facilitating efficient codebook based retrieval. We show improved retrieval accuracy over 3 leading descriptors (Self Similarity, SIFT, HoG) across two datasets (Flickr160, ETHZ extended objects), and explain how GF-HOG can be combined with RANSAC to localize sketched objects within relevant images. We also demonstrate a prototype sketch driven photo montage application based on our system.

Original language	English
Title of host publication	Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE
Pages	1025 - 1028
DOIs	https://doi.org/10.1109/ICIP.2010.5649331
Publication status	Published - Sept 2010

Bibliographical note

Note: Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924

Organising Body: IEEE

Organising Body: IEEE

Keywords

Computer science and informatics

Access to Document

10.1109/ICIP.2010.5649331

https://doi.org/10.1109/ICIP.2010.5649331

Gradient field descriptor for sketch based retrieval and localization
Hu, R., Barnard, M. & Collomosse, J., Sept 2010.
Research output: Contribution to conference › Paper › peer-review

Cite this

Hu, R., Barnard, M., & Collomosse, J. (2010). Gradient field descriptor for sketch based retrieval and localization. In Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE (pp. 1025 - 1028) https://doi.org/10.1109/ICIP.2010.5649331

@inproceedings{5372335aba484d368291965c9ef402ee,

title = "Gradient field descriptor for sketch based retrieval and localization",

abstract = "We present an image retrieval system driven by free-hand sketched queries depicting shape. We introduce Gradient Field HoG (GF-HOG) as a depiction invariant image descriptor, encapsulating local spatial structure in the sketch and facilitating efficient codebook based retrieval. We show improved retrieval accuracy over 3 leading descriptors (Self Similarity, SIFT, HoG) across two datasets (Flickr160, ETHZ extended objects), and explain how GF-HOG can be combined with RANSAC to localize sketched objects within relevant images. We also demonstrate a prototype sketch driven photo montage application based on our system.",

keywords = "Computer science and informatics",

author = "Rui Hu and Mark Barnard and John Collomosse",

note = "Note: Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE",

year = "2010",

month = sep,

doi = "10.1109/ICIP.2010.5649331",

language = "English",

pages = "1025 -- 1028",

booktitle = "Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE",

}

Hu, R, Barnard, M & Collomosse, J 2010, Gradient field descriptor for sketch based retrieval and localization. in Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE. pp. 1025 - 1028. https://doi.org/10.1109/ICIP.2010.5649331

Gradient field descriptor for sketch based retrieval and localization. / Hu, Rui; Barnard, Mark; Collomosse, John.
Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE. 2010. p. 1025 - 1028.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Gradient field descriptor for sketch based retrieval and localization

AU - Hu, Rui

AU - Barnard, Mark

AU - Collomosse, John

N1 - Note: Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE

PY - 2010/9

Y1 - 2010/9

N2 - We present an image retrieval system driven by free-hand sketched queries depicting shape. We introduce Gradient Field HoG (GF-HOG) as a depiction invariant image descriptor, encapsulating local spatial structure in the sketch and facilitating efficient codebook based retrieval. We show improved retrieval accuracy over 3 leading descriptors (Self Similarity, SIFT, HoG) across two datasets (Flickr160, ETHZ extended objects), and explain how GF-HOG can be combined with RANSAC to localize sketched objects within relevant images. We also demonstrate a prototype sketch driven photo montage application based on our system.

AB - We present an image retrieval system driven by free-hand sketched queries depicting shape. We introduce Gradient Field HoG (GF-HOG) as a depiction invariant image descriptor, encapsulating local spatial structure in the sketch and facilitating efficient codebook based retrieval. We show improved retrieval accuracy over 3 leading descriptors (Self Similarity, SIFT, HoG) across two datasets (Flickr160, ETHZ extended objects), and explain how GF-HOG can be combined with RANSAC to localize sketched objects within relevant images. We also demonstrate a prototype sketch driven photo montage application based on our system.

KW - Computer science and informatics

U2 - 10.1109/ICIP.2010.5649331

DO - 10.1109/ICIP.2010.5649331

M3 - Conference contribution

SP - 1025

EP - 1028

BT - Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE

ER -

Hu R, Barnard M, Collomosse J. Gradient field descriptor for sketch based retrieval and localization. In Published in: 2010 IEEE International Conference on Image Processing. Piscataway, NJ : Institute of Electrical and Electronics Engineers. ISSN 1522-4880 ISBN 9781424479924 Organising Body: IEEE Organising Body: IEEE. 2010. p. 1025 - 1028 doi: 10.1109/ICIP.2010.5649331

Gradient field descriptor for sketch based retrieval and localization

Abstract

Bibliographical note

Keywords

Access to Document

Fingerprint

Research output

Gradient field descriptor for sketch based retrieval and localization

Cite this