Automated Hashtag Hierarchy Generation Using Community Detection and the Shannon Diversity Index

Developing semantic hierarchies from user-created hashtags in social media can provide useful organizational structure to large volumes of data. However, construction of these hierarchies is difficult using established ontologies (e.g. WordNet [1]) due to the differences in the semantic and pragmati...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:2022 IEEE 16th International Conference on Semantic Computing (ICSC) s. 59 - 66
Hlavní autori: Torene, Spencer, Howald, Blake
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 01.01.2022
Predmet:
Indexes
information entropy
recommender systems
Refining
Semantics
social computing
Social networking (online)
tagging
text analysis
Time series analysis
Training data
twitter
Weight measurement
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Developing semantic hierarchies from user-created hashtags in social media can provide useful organizational structure to large volumes of data. However, construction of these hierarchies is difficult using established ontologies (e.g. WordNet [1]) due to the differences in the semantic and pragmatic use of words vs. hashtags in social media. While alternative construction methods based on hashtag frequency are relatively straightforward, these methods can be susceptible to the dynamic nature of social media, such as hashtags associated with surges in popularity. We drew inspiration from the ecologically-based Shannon Diversity Index (SDI) [2] to create a more representative and resilient method of semantic hierarchy construction that relies upon graph-based community detection and a novel, entropy-based ensemble diversity index (EDI) score. The EDI quantifies the contextual diversity of each hashtag, resulting in thousands of semantically-related groups of hashtags organized along a general-to-specific spectrum. Through an application of EDI to Twitter data and a comparison of our results to prior approaches, we demonstrate our method's ability to create semantically consistent hierarchies that can be flexibly applied and adapted to a range of use cases.
DOI:10.1109/ICSC52841.2022.00016