Finding Task-Relevant Features for Few-Shot Learning by Category Traversal
Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common practice. Recent effective approaches to few-shot learning employ a metric-lea...
Uloženo v:
| Vydáno v: | Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) s. 1 - 10 |
|---|---|
| Hlavní autoři: | , , , , |
| Médium: | Konferenční příspěvek |
| Jazyk: | angličtina |
| Vydáno: |
IEEE
01.06.2019
|
| Témata: | |
| ISSN: | 1063-6919 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common practice. Recent effective approaches to few-shot learning employ a metric-learning framework to learn a feature similarity comparison between a query (test) example, and the few support (training) examples. However, these approaches treat each support class independently from one another, never looking at the entire task as a whole. Because of this, they are constrained to use a single set of features for all possible test-time tasks, which hinders the ability to distinguish the most relevant dimensions for the task at hand. In this work, we introduce a Category Traversal Module that can be inserted as a plug-and-play module into most metric-learning based few-shot learners. This component traverses across the entire support set at once, identifying task-relevant features based on both intra-class commonality and inter-class uniqueness in the feature space. Incorporating our module improves performance considerably (5%-10% relative) over baseline systems on both miniImageNet and tieredImageNet benchmarks, with overall performance competitive with the most recent state-of-the-art systems. |
|---|---|
| AbstractList | Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common practice. Recent effective approaches to few-shot learning employ a metric-learning framework to learn a feature similarity comparison between a query (test) example, and the few support (training) examples. However, these approaches treat each support class independently from one another, never looking at the entire task as a whole. Because of this, they are constrained to use a single set of features for all possible test-time tasks, which hinders the ability to distinguish the most relevant dimensions for the task at hand. In this work, we introduce a Category Traversal Module that can be inserted as a plug-and-play module into most metric-learning based few-shot learners. This component traverses across the entire support set at once, identifying task-relevant features based on both intra-class commonality and inter-class uniqueness in the feature space. Incorporating our module improves performance considerably (5%-10% relative) over baseline systems on both miniImageNet and tieredImageNet benchmarks, with overall performance competitive with the most recent state-of-the-art systems. |
| Author | Eigen, David Wang, Xiaogang Li, Hongyang Dodge, Samuel Zeiler, Matthew |
| Author_xml | – sequence: 1 givenname: Hongyang surname: Li fullname: Li, Hongyang organization: The Chinese Univ. of Hong Kong – sequence: 2 givenname: David surname: Eigen fullname: Eigen, David organization: Clarifai Inc – sequence: 3 givenname: Samuel surname: Dodge fullname: Dodge, Samuel organization: Clarifai Inc – sequence: 4 givenname: Matthew surname: Zeiler fullname: Zeiler, Matthew organization: Clarifai Inc – sequence: 5 givenname: Xiaogang surname: Wang fullname: Wang, Xiaogang organization: Chinese Univ. of Hong Kong |
| BookMark | eNotjMFOhEAQREejievK2YMXfgCcnlmG6aMhsmpINCt63TROs6IIZsA1_L0YrUulXl7qVBx1fcdCnIOMASReZs8Pm1hJwFjOwQMRYGohVRa0Qm0PxQKk0ZFBwBMRDMPbbGkFYNAuxF3edK7pdmFJw3u04Zb31I1hzjR-eR7Cuvfz-I4eX_sxLJh89ytXU5jRyLveT2Hpac9-oPZMHNfUDhz891I85ddldhMV9-vb7KqIGiX1GNXGvBhCp5105BKLBKo2CitklKlcWTY25TpRypKuIHHOzTShxGisrU71Ulz8_TbMvP30zQf5aWsxWcHs_AAlkE5s |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IH CBEJK RIE RIO |
| DOI | 10.1109/CVPR.2019.00009 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan (POP) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP) 1998-present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Xplore url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Applied Sciences |
| EISBN | 9781728132938 1728132932 |
| EISSN | 1063-6919 |
| EndPage | 10 |
| ExternalDocumentID | 8954156 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IH 6IL 6IN AAWTH ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK IJVOP OCL RIE RIL RIO |
| ID | FETCH-LOGICAL-i203t-f66c6a9d3d0dad589a12f629b9e907048e687ef5228a3b15ddd7045a5639f8373 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 239 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000529484000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Aug 27 07:39:11 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | true |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i203t-f66c6a9d3d0dad589a12f629b9e907048e687ef5228a3b15ddd7045a5639f8373 |
| PageCount | 10 |
| ParticipantIDs | ieee_primary_8954156 |
| PublicationCentury | 2000 |
| PublicationDate | 2019-June |
| PublicationDateYYYYMMDD | 2019-06-01 |
| PublicationDate_xml | – month: 06 year: 2019 text: 2019-June |
| PublicationDecade | 2010 |
| PublicationTitle | Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) |
| PublicationTitleAbbrev | CVPR |
| PublicationYear | 2019 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0003211698 |
| Score | 2.6117191 |
| Snippet | Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 1 |
| SubjectTerms | Benchmark testing Computer vision Deep Learning Feature extraction Few shot learning Hands Pattern recognition Pragmatics Training |
| Title | Finding Task-Relevant Features for Few-Shot Learning by Category Traversal |
| URI | https://ieeexplore.ieee.org/document/8954156 |
| WOSCitedRecordID | wos000529484000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NSwMxEB3a4sFT1Vb8JgePxu5mm69zsYiHUmqV3ko2yWpRurIfSv-9SbpUBC_eklwCE8K8l8x7A3CdxRl3iUThoaNt2MtmsaCEYaai1ItnKKE6NJvgk4lYLOS0BTc7LYy1NhSf2Vs_DH_5Jte1fyobCEk932hDm3O-1Wrt3lMSx2SYFI17TxzJweh5OvO1WzJ4FMpf7VNC9hh3_7fvAfR_ZHhoukswh9Cy6yPoNrgRNbey7MHDeBW0KWiuyjc884pxFy_k0V3t2DRyuNRNvvDja16hxlD1BaUbNPI2EXmxQXPfhKgo1XsfnsZ389E9bnok4BWJkgpnjGmmpElMZJShQqqYZIzIVFpHe931tExwmzmUJVSSxtQY41apog6ZZI6cJsfQWedrewKIaxmRVCcx0XoYcyVTkRmiYyP8d-EwOoWeD83yY2uDsWyicvb38jns-9hvq6ouoFMVtb2EPf1ZrcriKpzdN38imbw |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PT8IwFH5BNNETKhh_24NHK2u3bu2ZSFCREJyGG-naTomGmQ00_Pe2Y8GYePHW9tLkNc37vvZ93wO4TEka2UQicWBpG3ayWcwZDXEovcSJZxhlqmw2EQ0GfDwWwxpcrbUwxpiy-Mxcu2H5l68ztXBPZW0umOMbG7DJgoCSlVpr_aLiWy4TCl759xBPtDvPw5Gr3hKlS6H41UClzB_dxv923oXWjxAPDdcpZg9qZrYPjQo5oupeFk24605LdQqKZfGGR04zbiOGHL5bWD6NLDK1ky_8-JrNUWWp-oKSJeo4o4gsX6LYtSHKC_negqfuTdzp4apLAp5Sz5_jNAxVKIX2taelZlxIQtOQikQYS3ztBTUhj0xqcRaXfkKY1tquMsksNkktPfUPoD7LZuYQUKSERxPlE6pUQCIpEp5qqojm7sMw8I6g6UIz-VgZYUyqqBz_vXwB2734oT_p3w7uT2DHncOqxuoU6vN8Yc5gS33Op0V-Xp7jN64gnQM |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+%28IEEE+Computer+Society+Conference+on+Computer+Vision+and+Pattern+Recognition.+Online%29&rft.atitle=Finding+Task-Relevant+Features+for+Few-Shot+Learning+by+Category+Traversal&rft.au=Li%2C+Hongyang&rft.au=Eigen%2C+David&rft.au=Dodge%2C+Samuel&rft.au=Zeiler%2C+Matthew&rft.date=2019-06-01&rft.pub=IEEE&rft.eissn=1063-6919&rft.spage=1&rft.epage=10&rft_id=info:doi/10.1109%2FCVPR.2019.00009&rft.externalDocID=8954156 |