Browse State-of-the-Art › Sketch-Based Image Retrieval
Sketch-Based Image Retrieval
40 papers with code · 3 benchmarks · 4 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Chairs (8 rows) | EdgeMAC + whitening | Deep Shape Matching | code | — | Compare |
| Handbags (8 rows) | EdgeMAC + whitening | Deep Shape Matching | code | — | Compare |
| Shoes (1 row) | EdgeMAC + whitening | Deep Shape Matching | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 110 · with a code link: 40 · where Syntology ran a sample: 7 (4 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (7 of 110 tagged: 4 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 110, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
ARNet: Self-Supervised FG-SBIR with Unified Sample Feature Alignment and Multi-Scale Token Recycling17 Jun 2024 2 repositories listedFine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims to minimize the distance between sketches and corresponding images in the embedding space.
-
8 Dec 2020 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)Grounded in information theory, we cast the simultaneous learning of domain-invariant and domain-specific representations as a joint objective of multiple information constraints, which does not require adversarial…
-
11 Sep 2017 2 repositories listedWe cast shape matching as metric learning with convolutional networks.
-
12 Feb 2025 1 repository listedFurther, as a solution to this problem, we propose a pretrained multimodal transformer-based baseline, STNET (Sketch+Text Network), that uses a hand-drawn sketch to localize relevant objects in the natural scene image…
-
5 Jul 2024 1 repository listedSpLIP implements a bi-directional prompt-sharing strategy that enables mutual knowledge exchange between CLIP's visual and textual encoders, fostering a more cohesive and synergistic prompt processing mechanism that…
-
12 Mar 2024 1 repository listedThis paper unravels the potential of sketches for diffusion models, addressing the deceptive promise of direct sketch control in generative AI.
-
10 Jan 2024 1 repository listedZero-shot learning offers an efficient solution for a machine learning model to treat unseen categories, avoiding exhaustive data collection.
-
16 Dec 2023 1 repository listedIn this paper, we propose a novel Symmetrical Bidirectional Knowledge Alignment for zero-shot sketch-based image retrieval (SBKA).
-
5 Apr 2023 1 repository listedTo our knowledge, this is the first publicly available instance-level logo sketch dataset.
-
25 Mar 2023 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 9 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 16 harvested samples)This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross…
-
14 Mar 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)For the first time, we identify that for data-scarce tasks like Sketch-Based Image Retrieval (SBIR), where the difficulty in acquiring paired photos and hand-drawn sketches limits data-dependent cross-modal learning…
-
1 Jan 2023 1 repository listedThis lack of sketch data has imposed on the community a few "peculiar" design choices -- the most representative of them all is perhaps the coerced utilisation of photo-based pre-training (i. e., no sketch), for many…
-
19 Oct 2022 1 repository listedRepresentation learning for sketch-based image retrieval has mostly been tackled by learning embeddings that discard modality-specific information.
-
19 Aug 2022 1 repository listedImage retrieval under generalized test scenarios has gained significant momentum in literature, and the recently proposed protocol of Universal Cross-domain Retrieval is a pioneer in this direction.
-
27 Jul 2022 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 4 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 16 harvested samples) · 16 pointer-only (licence)Toward equipping machines with such capabilities, we propose the Primitive-based Sketch Abstraction task where the goal is to represent sketches using a fixed set of drawing primitives under the influence of a budget.
-
4 Jul 2022 1 repository listedTo solve this new problem, we introduce a novel model-agnostic meta-learning (MAML) based framework with several key modifications: (1) As a retrieval task with a margin-based contrastive loss, we simplify the MAML…
-
28 Mar 2022 1 repository listedWe first conducted a pilot study that revealed the secret lies in the existence of noisy strokes, but not so much of the "I can't sketch".
-
15 Dec 2021 1 repository listedBy combining two fundamental learning approaches in DML, e. g., classification training and pairwise training, we set up a strong baseline for ZS-SBIR.
-
21 Nov 2021 1 repository listedFine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims at finding a specific image from a large gallery given a query sketch.
-
22 Jun 2021 1 repository listedMost existing methods regard ZS-SBIR as a traditional classification problem and employ a cross-entropy or triplet-based loss to achieve retrieval, which neglect the problems of the domain gap between sketches and…
-
15 Jun 2021 1 repository listedWe present an algorithm for searching image collections using free-hand sketches that describe the appearance and relative positions of multiple objects.
-
More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image Retrieval25 Mar 2021 1 repository listedA fundamental challenge faced by existing Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) models is the data scarcity -- model performances are largely bottlenecked by the lack of sketch-photo pairs.
-
14 Aug 2020 1 repository listedWe refer to this problem as sketch-guided object localization.
-
29 Jul 2020 1 repository listedIn this paper, we study a further trait of sketches that has been overlooked to date, that is, they are hierarchical in terms of the levels of detail -- a person typically sketches up to various extents of detail to…
-
1 Jun 2020 1 repository listedFine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch.
-
24 Feb 2020 1 repository listedFine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch.
-
24 Feb 2020 1 repository listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Sketchformer is a novel transformer-based representation for encoding free-hand sketches input in a vector form, i. e. as a sequence of strokes.
-
18 Sep 2019 1 repository listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 3 pointer-only (licence)Humans can envision a realistic photo given a free-hand sketch that is not only spatially imprecise and geometrically distorted but also without colors and visual details.
-
27 Aug 2019 1 repository listedHistorical watermark recognition is a highly practical, yet unsolved challenge for archivists and historians.
-
6 Apr 2019 1 repository listedHighly abstract amateur human sketches are purposefully sourced to maximize the domain gap, instead of ones included in existing datasets that can often be semi-photorealistic.
-
5 Apr 2019 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
8 Mar 2019 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
11 Dec 2018 1 repository listed
-
1 Sep 2018 1 repository listed
-
7 Aug 2018 1 repository listed
-
31 Jul 2018 1 repository listed
-
6 Mar 2018 1 repository listed
-
1 Dec 2017 1 repository listed
-
5 Sep 2017 1 repository listed
-
16 Mar 2017 1 repository listed
-
Sketch Down the FLOPs: Towards Efficient Networks for Human Sketch29 May 2025 0 repositories listed
-
Enhancing Product Search Interfaces with Sketch-Guided Diffusion and Language Agents21 Mar 2025 0 repositories listed
-
Freestyle Sketch-in-the-Loop Image Segmentation27 Jan 2025 0 repositories listed
-
Cross-Modal Attention Alignment Network with Auxiliary Text Description for zero-shot sketch-based image retrieval1 Jul 2024 0 repositories listed
-
Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image Retrieval1 Jul 2024 0 repositories listed
-
SketchTriplet: Self-Supervised Scenarized Sketch-Text-Image Triplet Generation29 May 2024 0 repositories listed
-
Dual-Modal Prompting for Sketch-Based Image Retrieval29 Apr 2024 0 repositories listed
-
Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakers12 Mar 2024 0 repositories listed
-
How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?11 Mar 2024 0 repositories listed
-
Bridging Generative and Discriminative Models for Unified Visual Perception with Diffusion Priors29 Jan 2024 0 repositories listed
-
Active Learning for Fine-Grained Sketch-Based Image Retrieval15 Sep 2023 0 repositories listed
-
A Recipe for Efficient SBIR Models: Combining Relative Triplet Loss with Batch Normalization and Knowledge Distillation30 May 2023 0 repositories listed
-
Adapt and Align to Improve Zero-Shot Sketch-Based Image Retrieval9 May 2023 0 repositories listed
-
If At First You Don't Succeed: Test Time Re-ranking for Zero-shot, Cross-domain Retrieval30 Mar 2023 0 repositories listed
-
Sketch-an-Anchor: Sub-epoch Fast Model Adaptation for Zero-shot Sketch-based Image Retrieval29 Mar 2023 0 repositories listed
-
What Can Human Sketches Do for Object Detection?27 Mar 2023 0 repositories listed
-
Exploiting Unlabelled Photos for Stronger Fine-Grained SBIR24 Mar 2023 0 repositories listed
-
CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained or Not23 Mar 2023 0 repositories listed
-
Picture that Sketch: Photorealistic Image Generation from Abstract Sketches20 Mar 2023 0 repositories listed
-
Ontology-aware Network for Zero-shot Sketch-based Image Retrieval20 Feb 2023 0 repositories listed
-
Distribution Aligned Feature Clustering for Zero-Shot Sketch-Based Image Retrieval17 Jan 2023 0 repositories listed
-
Democratising 2D Sketch to 3D Shape Retrieval Through Pivoting1 Jan 2023 0 repositories listed
-
Transformers and CNNs both Beat Humans on SBIR14 Sep 2022 0 repositories listed
-
Three-Stream Joint Network for Zero-Shot Sketch-Based Image Retrieval12 Apr 2022 0 repositories listed
-
Partially Does It: Towards Scene-Level FG-SBIR with Partial Input28 Mar 2022 0 repositories listed
-
Sketch3T: Test-Time Training for Zero-Shot SBIR28 Mar 2022 0 repositories listed
-
WAD-CMSN: Wasserstein Distance based Cross-Modal Semantic Network for Zero-Shot Sketch-Based Image Retrieval11 Feb 2022 0 repositories listed
-
Zero-Shot Sketch Based Image Retrieval using Graph Transformer25 Jan 2022 0 repositories listed
-
BDA-SketRet: Bi-Level Domain Adaptation for Zero-Shot SBIR17 Jan 2022 0 repositories listed
-
Multi-granularity Association Learning Framework for on-the-fly Fine-Grained Sketch-based Image Retrieval13 Jan 2022 0 repositories listed
-
ACNet: Approaching-and-Centralizing Network for Zero-Shot Sketch-Based Image Retrieval24 Nov 2021 0 repositories listed
-
SwAMP: Swapped Assignment of Multi-Modal Pairs for Cross-Modal Retrieval10 Nov 2021 0 repositories listed
-
Towards Unsupervised Sketch-based Image Retrieval18 May 2021 0 repositories listed
-
Sketch-QNet: A Quadruplet ConvNet for Color Sketch-based Image Retrieval22 Apr 2021 0 repositories listed
-
Compact and Effective Representations for Sketch-based Image Retrieval20 Apr 2021 0 repositories listed
-
CrossATNet - A Novel Cross-Attention Based Framework for Sketch-Based Image Retrieval20 Apr 2021 0 repositories listed
-
StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrieval29 Mar 2021 0 repositories listed
-
An Efficient Framework for Zero-Shot Sketch-Based Image Retrieval8 Feb 2021 0 repositories listed
-
SketchAA: Abstract Representation for Abstract Sketches1 Jan 2021 0 repositories listed
-
Adaptive Margin Diversity Regularizer for handling Data Imbalance in Zero-Shot SBIR1 Aug 2020 0 repositories listed
-
SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches1 Aug 2020 0 repositories listed
-
Unsupervised Sketch to Photo Synthesis1 Aug 2020 0 repositories listed
-
Semantically Tied Paired Cycle Consistency for Any-Shot Sketch-based Image Retrieval20 Jun 2020 0 repositories listed
-
Solving Mixed-Modal Jigsaw Puzzle for Fine-Grained Sketch-Based Image Retrieval1 Jun 2020 0 repositories listed
-
Progressive Domain-Independent Feature Decomposition Network for Zero-Shot Sketch-Based Image Retrieval22 Mar 2020 0 repositories listed
-
Stacked Adversarial Network for Zero-Shot Sketch based Image Retrieval18 Jan 2020 0 repositories listed
-
Zero-Shot Sketch-Based Image Retrieval with Structure-aware Asymmetric Disentanglement29 Nov 2019 0 repositories listed
-
Semi-Heterogeneous Three-Way Joint Embedding Network for Sketch-Based Image Retrieval10 Nov 2019 0 repositories listed
-
Deep Semantic Parsing of Freehand Sketches with Homogeneous Transformation, Soft-Weighted Loss, and Staged Learning14 Oct 2019 0 repositories listed
-
Sketch-Specific Data Augmentation for Freehand Sketch Recognition14 Oct 2019 0 repositories listed
-
Generalising Fine-Grained Sketch-Based Image Retrieval1 Jun 2019 0 repositories listed
-
Semantic Adversarial Network for Zero-Shot Sketch-Based Image Retrieval7 May 2019 0 repositories listed
-
Generative Model for Zero-Shot Sketch-Based Image Retrieval18 Apr 2019 0 repositories listed
-
Stacked Semantic-Guided Network for Zero-Shot Sketch-Based Image Retrieval3 Apr 2019 0 repositories listed
-
Instance-level Sketch-based Retrieval by Deep Triplet Classification Siamese Network28 Nov 2018 0 repositories listed
-
A Zero-Shot Framework for Sketch based Image Retrieval1 Sep 2018 0 repositories listed
-
Universal Sketch Perceptual Grouping1 Sep 2018 0 repositories listed
-
Deep Factorised Inverse-Sketching7 Aug 2018 0 repositories listed
-
Learning to Sketch with Shortcut Cycle Consistency1 May 2018 0 repositories listed
-
Learning Deep Sketch Abstraction13 Apr 2018 0 repositories listed
Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections