Finding Task-Relevant Features for Few-Shot Learning by Category Traversal
Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common practice. Recent effective approaches to few-shot learning employ a metric-lea...
Gespeichert in:
| Veröffentlicht in: | Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) S. 1 - 10 |
|---|---|
| Hauptverfasser: | , , , , |
| Format: | Tagungsbericht |
| Sprache: | Englisch |
| Veröffentlicht: |
IEEE
01.06.2019
|
| Schlagworte: | |
| ISSN: | 1063-6919 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common practice. Recent effective approaches to few-shot learning employ a metric-learning framework to learn a feature similarity comparison between a query (test) example, and the few support (training) examples. However, these approaches treat each support class independently from one another, never looking at the entire task as a whole. Because of this, they are constrained to use a single set of features for all possible test-time tasks, which hinders the ability to distinguish the most relevant dimensions for the task at hand. In this work, we introduce a Category Traversal Module that can be inserted as a plug-and-play module into most metric-learning based few-shot learners. This component traverses across the entire support set at once, identifying task-relevant features based on both intra-class commonality and inter-class uniqueness in the feature space. Incorporating our module improves performance considerably (5%-10% relative) over baseline systems on both miniImageNet and tieredImageNet benchmarks, with overall performance competitive with the most recent state-of-the-art systems. |
|---|---|
| AbstractList | Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common practice. Recent effective approaches to few-shot learning employ a metric-learning framework to learn a feature similarity comparison between a query (test) example, and the few support (training) examples. However, these approaches treat each support class independently from one another, never looking at the entire task as a whole. Because of this, they are constrained to use a single set of features for all possible test-time tasks, which hinders the ability to distinguish the most relevant dimensions for the task at hand. In this work, we introduce a Category Traversal Module that can be inserted as a plug-and-play module into most metric-learning based few-shot learners. This component traverses across the entire support set at once, identifying task-relevant features based on both intra-class commonality and inter-class uniqueness in the feature space. Incorporating our module improves performance considerably (5%-10% relative) over baseline systems on both miniImageNet and tieredImageNet benchmarks, with overall performance competitive with the most recent state-of-the-art systems. |
| Author | Eigen, David Wang, Xiaogang Li, Hongyang Dodge, Samuel Zeiler, Matthew |
| Author_xml | – sequence: 1 givenname: Hongyang surname: Li fullname: Li, Hongyang organization: The Chinese Univ. of Hong Kong – sequence: 2 givenname: David surname: Eigen fullname: Eigen, David organization: Clarifai Inc – sequence: 3 givenname: Samuel surname: Dodge fullname: Dodge, Samuel organization: Clarifai Inc – sequence: 4 givenname: Matthew surname: Zeiler fullname: Zeiler, Matthew organization: Clarifai Inc – sequence: 5 givenname: Xiaogang surname: Wang fullname: Wang, Xiaogang organization: Chinese Univ. of Hong Kong |
| BookMark | eNotjMFOhEAQREejievK2YMXfgCcnlmG6aMhsmpINCt63TROs6IIZsA1_L0YrUulXl7qVBx1fcdCnIOMASReZs8Pm1hJwFjOwQMRYGohVRa0Qm0PxQKk0ZFBwBMRDMPbbGkFYNAuxF3edK7pdmFJw3u04Zb31I1hzjR-eR7Cuvfz-I4eX_sxLJh89ytXU5jRyLveT2Hpac9-oPZMHNfUDhz891I85ddldhMV9-vb7KqIGiX1GNXGvBhCp5105BKLBKo2CitklKlcWTY25TpRypKuIHHOzTShxGisrU71Ulz8_TbMvP30zQf5aWsxWcHs_AAlkE5s |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IH CBEJK RIE RIO |
| DOI | 10.1109/CVPR.2019.00009 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan (POP) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP) 1998-present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Applied Sciences |
| EISBN | 9781728132938 1728132932 |
| EISSN | 1063-6919 |
| EndPage | 10 |
| ExternalDocumentID | 8954156 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IH 6IL 6IN AAWTH ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK IJVOP OCL RIE RIL RIO |
| ID | FETCH-LOGICAL-i203t-f66c6a9d3d0dad589a12f629b9e907048e687ef5228a3b15ddd7045a5639f8373 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 239 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000529484000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Aug 27 07:39:11 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | true |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i203t-f66c6a9d3d0dad589a12f629b9e907048e687ef5228a3b15ddd7045a5639f8373 |
| PageCount | 10 |
| ParticipantIDs | ieee_primary_8954156 |
| PublicationCentury | 2000 |
| PublicationDate | 2019-June |
| PublicationDateYYYYMMDD | 2019-06-01 |
| PublicationDate_xml | – month: 06 year: 2019 text: 2019-June |
| PublicationDecade | 2010 |
| PublicationTitle | Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) |
| PublicationTitleAbbrev | CVPR |
| PublicationYear | 2019 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0003211698 |
| Score | 2.6117191 |
| Snippet | Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 1 |
| SubjectTerms | Benchmark testing Computer vision Deep Learning Feature extraction Few shot learning Hands Pattern recognition Pragmatics Training |
| Title | Finding Task-Relevant Features for Few-Shot Learning by Category Traversal |
| URI | https://ieeexplore.ieee.org/document/8954156 |
| WOSCitedRecordID | wos000529484000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NSwMxEB3a4sFT1Vb8JgePxu5HN5uci0U8lFKr9FZmNxMtSlf2Q-m_N9kuFcGLtySXwIQw7yXz3gBc6yGJwAQJjz0kPkxMxKVxX4g-OqsS8inAutlEPJnIxUJNW3Cz08IQUV18RrduWP_l6yyt3FPZQKrI8Y02tOM43mq1du8poWUyQsnGvcf31GD0PJ252i1VexSqX-1T6uwx7v5v3wPo_8jw2HSXYA6hResj6Da4kTW3sujBw3hVa1PYHIs3PnOKcRsv5tBdZdk0s7jUTr7442tWssZQ9YUlGzZyNhFZvmFz14QoL_C9D0_ju_nonjc9Evgq8MKSGyFSgUqH2tOoI6nQD4wIVKLI0l57PUnImIxFWRLDxI-01nY1wsgiE2PJaXgMnXW2phNgGJpAEUpFXjr0pFYhYirReXmaJJXRKfRcaJYfWxuMZROVs7-Xz2HfxX5bVXUBnTKv6BL20s9yVeRX9dl9A500m0o |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NTwIxEJ0gmugJFYzf9uDRym73g_ZMJKhICK6GG-lup0o0rNldNPx722WDMfHire2lyTTNvNfOewNwqXwMmWYx7TgSqR_rgHJtvxBdaa1K0EUmy2YTneGQTyZiVIOrtRYGEcviM7y2w_IvX6XJwj6VtbkILN_YgM3A95m7UmutX1Q8w2VCwSv_HtcR7e7zaGyrt0TpUih-NVAp80ev8b-dd6H1I8Qjo3WK2YMazvehUSFHUt3LvAl3vVmpTiGRzN_o2GrGTcSIxXcLw6eJQaZm8kUfX9OCVJaqLyRekq41ikizJYlsG6Isl-8teOrdRN0-rbok0BlzvILqMExCKZSnHCVVwIV0mQ6ZiAUa4msuKIa8g9rgLC692A2UUmY1kIHBJtrQU-8A6vN0jodApKeZQMkFOonvcCU8KRMurZunjhMeHEHThmb6sTLCmFZROf57-QK2-9HDYDq4Hd6fwI49h1WN1SnUi2yBZ7CVfBazPDsvz_Eb4KiekQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+%28IEEE+Computer+Society+Conference+on+Computer+Vision+and+Pattern+Recognition.+Online%29&rft.atitle=Finding+Task-Relevant+Features+for+Few-Shot+Learning+by+Category+Traversal&rft.au=Li%2C+Hongyang&rft.au=Eigen%2C+David&rft.au=Dodge%2C+Samuel&rft.au=Zeiler%2C+Matthew&rft.date=2019-06-01&rft.pub=IEEE&rft.eissn=1063-6919&rft.spage=1&rft.epage=10&rft_id=info:doi/10.1109%2FCVPR.2019.00009&rft.externalDocID=8954156 |