Abstract
Sentiment analysis involving the identification of sentiment polarities from textual data is a very popular area of research. Many research works that have explored and extracted sentiments from textual data such as financial news have been able to do so by employing Bidirectional Encoder Representations from Transformers (BERT) based algorithms in applications with high computational needs, and also by manually labelling sample data with help from financial experts. We propose an approach which makes possible the development of quality Natural Language Processing (NLP) models without the need for high computing power, or for inputs from financial experts on labelling focused dataset for NLP model development. Our approach introduces a two-step optimised BERT-based NLP model for extracting sentiments from financial news. Our work shows that with little effort that involves manually labelling a small but relevant and focused sample data of financial news, one could achieve a high performing and accurate multi-class NLP model on financial news.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Baevski, A., Edunov, S., Liu, Y., Zettlemoyer, L., Auli, M.: Cloze-driven pretraining of self-attention networks, arXiv preprint arXiv:1903.07785 (2019)
Bechara, A.: The role of emotion in decision-making: Evidence from neurological patients with orbitofrontal damage. Brain Cogn. Dev. Orbitofrontal Function 55(1), 30–40 (2004)
Hatfield, A., Cacioppo, J., Rapson, R.L.: Emotional Contagion. Cambridge University Press, Cambridge (1994)
Dai, A.M., Le, Q.V.: Semi-supervised sequence learning. In: Advances in Neural Information Processing Systems, pp. 3079–3087 (2015)
Parikh, A., Täckström, O., Das, D., Uszkoreit, J.: A decomposable attention model. In: Empirical Methods in Natural Language Processing (2016)
Vaswani, A., et al.: Attention is all you need (2017) arXiv:1706.03762
Sun, C., Huang, L., Qiu, X.: Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence, arXiv:1903.09588 (2019)
Araci, D.: FinBERT: Financial sentiment analysis with pre-trained language models, arXiv:1908.10063 (2019)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate, CoRR, abs/1409.0473 (2014)
Miller, D.: Leveraging BERT for extractive text summarization on lectures, arXiv:1906.04165 (2019)
Vayanos, D., Wang, J.: Market Liquidity - Theory and Empirical Evidence. In: Handbook of the Economics of Finance Volume 2, Part B, pp. 1289–1361 (2013)
Marechal, F., Stamate, D., Olaniyan, R., Marek, J.: On XLE index constituents’c social media based sentiment informing the index trend and volatility prediction. In: Proceedings of the 10th International Conference on Computatational Collective Intelligence (ICCCI). LNCS. Springer (2018)
Qiu, G., He, X., Zhang, F., Shi, Y., Bu, J., Chen, C.: DASA: dissatisfaction-oriented advertising based on sentiment analysis. Expert Syst. Appl. 37(9), 6182–6191 (2010)
Malo, P., Sinha, A., Takala, P., Korhonen P.J.: FinancialPhraseBank-v1.0, July 2013. https://www.researchgate.net/publication/251231364_FinancialPhraseBank-v10
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding, 2018, arXiv preprint arXiv:1810.04805
Gehring, J., Auli, M., Grangier, D., Yarats, D., Dauphin, Y.N.: Convolutional sequence to sequence learning, arXiv preprint arXiv:1705.03122v2 (2017)
Howard, J., Ruder, S.: Universal Language Model Fine-tuning for Text Classification, arXiv:1801.06146 http://arxiv.org/abs/1801.06146 (2018)
Li, J., Sun, A., Han, J., Li, C.: A Survey on Deep Learning for Named Entity Recognition, arXiv:1812.09449 (2018)
Smales, L.A.: Non-scheduled news arrival and high frequency stock market dynamics: evidence from the Australian Securities Exchange. Res. Int. Bus. Financ. 32, 122–138 (2014)
Peters, M.E., et al.: Deep contextualized word representations, 2018 from https://doi.org/10.18653/v1/N18-1202. arXiv:1802.05365
Maia, M., et al.: Companion of the the web conference: on the web conference 2018, WWW 2018, Lyon, France, pp. 23–27, 2018 (2018)
Kalchbrenner, N., Espeholt, L., Simonyan, K., Oord, A.V.D., Graves, A., Kavukcuoglu, K: Neural machine translation in linear time. arXiv preprint arXiv:1610.10099v2 (2017)
Malo, P., Sinha, A., Korhonen, P., Wallenius, J., Takala, P.: Good debt or bad debt: detecting semantic orientations in economic texts. J. Assoc. Inf. Sci. Technol. 65(4), 782–796 (2014)
Shiller, R.J.: Irrational Exuberance. Princeton University Press, Princeton (2000)
Olaniyan, R., Stamate, D., Logofatu, D., Ouarbya, L.: Sentiment and stock market volatility predictive modelling - a hybrid approach. In: Proceedings of the 2nd IEEE/ACM International Conference on Data Science and Advanced Analytics (2015)
Krishnamoorthy, S.: Sentiment analysis of financial news articles using performance indicators. Knowledge and Information Systems 56(2), 373–394 (2017). https://doi.org/10.1007/s10115-017-1134-1
Dolan, W.B., Brockett, C.: Automatically constructing a corpus of sentential paraphrases. In: Proceedings of the Third International Workshop on Paraphrasing (IWP2005) (2005)
Kim, Y., Denton, C., Hoang, L., Rush, A.M.: Structured attention networks. In: International Conference on Learning Representations (2017)
Liu, Y., et al.: RoBERTa: a robustly optimized BERT pretraining approach, arXiv:1907.11692 (2019)
Zhu, Y., et al.: Aligning books and movies: towards story-like visual explanations by watching movies and reading books. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 19–27 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Olaniyan, R., Stamate, D., Pu, I. (2021). A Two-Step Optimised BERT-Based NLP Algorithm for Extracting Sentiment from Financial News. In: Maglogiannis, I., Macintyre, J., Iliadis, L. (eds) Artificial Intelligence Applications and Innovations. AIAI 2021. IFIP Advances in Information and Communication Technology, vol 627. Springer, Cham. https://doi.org/10.1007/978-3-030-79150-6_58
Download citation
DOI: https://doi.org/10.1007/978-3-030-79150-6_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79149-0
Online ISBN: 978-3-030-79150-6
eBook Packages: Computer ScienceComputer Science (R0)
