Learning deep networks with crowdsourcing for relevance evaluation

In this paper, we propose a novel relevance evaluation method using labels collected from crowdsourcing. The proposed method not only predicts the relevance between query texts and responses in information retrieval systems but also performs the label aggregation tasks simultaneously. It first merge...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:EURASIP journal on wireless communications and networking Ročník 2020; číslo 1; s. 1 - 11
Hlavní autoři: Wu, Ming, Yin, Xiaochun, Li, Qianmu, Zhang, Jing, Feng, Xinqi, Cao, Qi, Shen, Haiyuan
Médium: Journal Article
Jazyk:angličtina
Vydáno: Cham Springer International Publishing 25.04.2020
Springer Nature B.V
SpringerOpen
Témata:
Artificial neural networks
Communications Engineering
Crowdsourcing
Deep learning
Engineering
Evaluation
Information retrieval
Information Systems Applications (incl.Internet)
Labels
Machine learning
Multi-modal Sensor Data Fusion in Internet of Things
Networks
Relevance evaluation
Signal,Image and Speech Processing
Crowdsourcing
Deep learning
Information retrieval
Relevance evaluation
ISSN:1687-1499, 1687-1472, 1687-1499
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:In this paper, we propose a novel relevance evaluation method using labels collected from crowdsourcing. The proposed method not only predicts the relevance between query texts and responses in information retrieval systems but also performs the label aggregation tasks simultaneously. It first merges two kinds of heterogeneous data (i.e., image and query text) and constructs a CNN-like deep neural network. Then, on the top of its softmax layer, an additional layer was built to model the crowd workers. Finally, classification models for relevance prediction and aggregated labels for training examples can be simultaneously learned from noisy labels. Experimental results show that the proposed method significantly outperforms other state-of-the-art methods on a real-world dataset.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1687-1499
1687-1472
1687-1499
DOI:10.1186/s13638-020-01697-2