Contextual BI-Directional Attention Flow With Embeddings From Language Models: A Generative Approach to Emotion Detection

Fitness, turnover,
stability, evenness—
all due to constraints.
Deep Learning
Word Embeddings
BiDAF
ELMo
RoBERT
Phrase Mining

Prashant Kumar Nag and R. Vishnu Priya, “Contextual BI-Directional Attention Flow With Embeddings From Language Models: A Generative Approach to Emotion Detection” Advances in Robotics - 5th International Conference of The Robotics Society(AIR2021) Jun 30- July 4, 2021, Kanpur, India, ACM, New York, NY, USA, 6 pages, doi: 10.1145/3478586.3478629

Authors
Affiliations

Prashant Kumar Nag

Maulana Azad National Institue of Technology, Bhopal

Dr. R. Vishnu Priya

National Institute of Technology Tiruchirappalli, Tamilnadu

Published

June 2021

Doi

Abstract

Detection of Emotions from the text is a tedious task. Presently, existing models failed to detect the emotion in absence of the emotional word in the text. The cause phrase selection which gives a deep insight into emotions is considered to be a tough task. The proposed model for detecting emotions is developed through seven layers. Initially, the dataset is represented in the Topical documents using Adversarial Topic Modelling (ATM). Convolutional Neural Network (CNN) maps each phrase in the topical document to Higher-dimensional vectors, followed by the ELMo Model to obtain the fixed word Embeddings vectors. LSTM is responsible for making the interaction between the words in word embeddings and produces the context and query vectors. The bi-directional Attention flow layer determines the most relevant similarity between Context and Query. Finally, Robustly Optimized BERT (RoBERT) architecture is used to detect the Emotion. It is noted that the proposed multi-stage model detects better emotions than all the existing state-of-art models for detecting emotions.

Important figure

 Add to Zotero

@inproceedings{10.1145/3478586.3478629,
author = {Nag, Prashant Kumar and Priya R, Vishnu},
title = {Contextual BI-Directional Attention Flow With Embeddings From Language Models: A Generative Approach to Emotion Detection},
year = {2022},
isbn = {9781450389716},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3478586.3478629},
doi = {10.1145/3478586.3478629},
booktitle = {Advances in Robotics - 5th International Conference of The Robotics Society},
articleno = {51},
numpages = {6},
keywords = {ELMo, RoBERT, Deep Learning, Word Embeddings, Phrase Mining, BiDAF},
location = {Kanpur, India},
series = {AIR2021}
}