64151735-db8d-49f1-9174-36fdd37b9b5f20221107064723887wseas:wseasmdt@crossref.orgMDT DepositWSEAS TRANSACTIONS ON COMPUTERS2224-28721109-275010.37394/23205http://wseas.org/wseas/cms.action?id=40261520221520222110.37394/23205.2022.21https://wseas.com/journals/computers/2022.phpMohsen A.HassanInformation System, Faculty of Computers & Artificial Intelligence, Helwan University, Cairo, EGYPTAliaa AaYoussifComputer Science, Arab Academy for Science, Technology and Maritime Transportation (AASTMT), Cairo, EGYPTOsamaImamInformation System, Faculty of Computers & Artificial Intelligence, Helwan University, Cairo, EGYPTAmr S.GhoneimComputer Science, Faculty of Computers & Artificial Intelligence, Helwan University, Cairo, EGYPTStock market (SM) prediction methods can be divided into two categories based on the number of information sources used: single-source methods and dual-source approaches. To estimate the price of a stock, single-source approaches rely solely on numerical data. The Efficient Market Hypothesis (EMH), [1]. States that the stock price will represent all important information. Different sources of information might complement one another and influence the stock price. Machine learning and deep learning techniques have long been used to anticipate stock market movements, [2], [3]. The researcher gathered the dataset, [4], [5], [6], [7]. The dataset contains the date of the reading, the opening price, the high and low value of the stock, news about the stock, and the volume. The researcher uses a variety of machine Learning and deep learning approaches to compare performance and prediction error rates, in addition, the researcher also compared the effect of adding the news text as a feature and as a label model. and using a dedicated model for news sentiment analysis by applying the FinBERT word embedding and using them to construct a Long Short-Term Memory (LSTM). From our observation, it is evident that Deep learning-based models performed better than their Machine learning counterparts. The author shows that information extracted from news sources is better at predicting rather than its direction of price movement. And the best-performing model without news is the LSTM with an RMSE of 0.0259 while the best-performing model with news is the LSTM with a stand-alone and LSTM model for news yields RMSE of 0.0220.1172022117202229430336https://wseas.com/journals/computers/2022/a725105-1432.pdf10.37394/23205.2022.21.36https://wseas.com/journals/computers/2022/a725105-1432.pdf10.1111/j.1540-6261.1970.tb00518.xE. F. Fama, ‘‘Efficient capital markets: A review of theory and empirical work,’’ J. Finance, 1970, vol. 25, (2) pp: 383–417. 10.1109/cimca.2005.1631572PD. Yoo, MH. Kim, and T. Jan, “Machine learning techniques and use of event information for stock market prediction: A survey and evaluation”, In International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce Nov 28 (Vol. 2, pp. 835-841). IEEE, 200510.1016/j.eswa.2017.04.030E. Chong, C. Han, Park F.C, “Deep learning networks for stock market analysis and prediction”, Methodology: data representations, and case studies. Expert Systems with Applications. Oct 15 2017, 83:187-205, Retrieved from: https://dro.dur.ac.uk/21533/Mubashir. (n.d. a) Egyptian Iron and Steel (IRON). Retrieved from: https://english.mubasher.info/markets/EGX/stocks/IRONMubashir. (n.d.-b). Commercial International Bank - Egypt (COMI). Retrieved from: https://english.mubasher.info/markets/EGX/stocks/COMIMubashir. (n.d.-c). Orascom Development Egypt (ORHD). Retrieved from: https://english.mubasher.info/markets/EGX/stocks/ORHDMubashir. (n.d.-d). Palm Hills Development Co SAE (PHDC)). Retrieved from: https://english.mubasher.info/markets/EGX/stocks/PHDC 10.1007/978-3-642-01533-5_6Magoč T, Modave F, Ceberio M, Kreinovich V. Computational methods for investment portfolio: the use of fuzzy measures and constraint programming for risk management. In Foundations of Computational Intelligence Volume 2 2009 (pp. 133-173). Springer, Berlin, Heidelberg.Abdullah SS, Rahman MS, Rahman MS. Analysis of the stock market using text mining and natural language processing. In2013 International Conference on Informatics, Electronics and Vision (ICIEV) 2013 May 17 (pp. 1-6). IEEE.Wang Z, Ho SB, Lin Z. Stock market prediction analysis by incorporating social and news opinion and sentiment. In2018 IEEE International Conference on Data Mining Workshops (ICDMW) 20181210.1007/s11831-020-09413-5Kumar G, Jain S, Singh UP. Stock market forecasting using computational intelligence: A survey. Archives of Computational Methods in Engineering. 2021 May;28(3):1069-101.Shah D, Isah H, Zulkernine F. Stock market analysis: A review and taxonomy of prediction techniques. International Journal of Financial Studies. 2019 Jun;7(2):26.10.1017/s0022109015000186Chambers D, Dimson E, Foo J. Keynes the stock market investor: a quantitative analysis. Journal of Financial and Quantitative Analysis.2015 Aug;50(4):843-68.10.2307/2331212Jorion P. The pricing of exchange rate risk in the stock market. Journal of financial and quantitative analysis. 1991 Sep;26(3):363-76.10.2307/2330774Eun CS, Shim S. International transmission of stock market movements. Journal of financial and quantitative Analysis. 1989 Jun;24(2):241-56.Chowdhury M, Howe JS, Lin JC. The relation between aggregate insider transactions and stock market returns. Journal of Financial and Quantitative Analysis. 1993 Sep;28(3):431-7.Griffith J, Najand M, Shen J. Emotions in the stock market. Journal of Behavioural Finance. 2020 Jan 2;21(1):42-56.Fataliyev K, Chivukula A, Prasad M, Liu W. Stock Market Analysis with Text Data: A Review. arXiv preprint arXiv:2106.12985. 2021 Jun 23.10.1186/s40537-020-00400-yNti IK, Adekoya AF, Weyori BA. A novel multi-source information-fusion predictive framework based on deep neural networks for accuracy enhancement in stock market prediction. Journal of Big Data. 2021 Dec;8(1):1-28.10.1109/iacs.2018.8355458Althelaya KA, El-Alfy ES, Mohammed S. Evaluation of bidirectional LSTM for short-and long-term stock market prediction. In2018 9th international conference on information and communication systems (ICICS) 2018 Apr 3 (pp. 151-156). IEEE.10.1111/j.1540-6261.1970.tb00518.xFama EF. Efficient capital markets: A review of theory and empirical work. The journal of Finance. 1970 May 1;25(2):383-417.Liu G, Wang X. A numerical-based attention method for stock market prediction with dual information. IEEE Access. 2018 Dec 12; 7:7357-67.10.1016/j.ipm.2020.102212Li X, Wu P, Wang W. Incorporating stock prices and news sentiments for stock market prediction: A case of Hong Kong. Information Processing & Management. 2020 Sep 1;57(5):102212.Chen Y, Lin W, Wang JZ. A dual-attention-based stock price trend prediction model with dual features. IEEE Access. 2019 Oct 8; 7:148047-58.10.1109/iceca.2017.8212715Sharma A, Bhuriya D, Singh U. Survey of stock market prediction using machine learning approach. In2017 International conference of electronics, communication and aerospace technology (ICECA) 2017 Apr 20 (Vol. 2, pp. 506-509). IEEE.Najafabadi SR. Prediction of stock market indices using machine learning (Doctoral dissertation, McGill University).10.1109/cimca.2005.1631572Yoo PD, Kim MH, Jan T. Machine learning techniques and use of event information for stock market prediction: A survey and evaluation. In International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06) 2005 Nov 28 (Vol. 2, pp.835-841). IEEE.10.1016/j.eswa.2017.04.030Chong E, Han C, Park FC. Deep learning networks for stock market analysis and prediction: Methodology, data representations, and case studies. Expert Systems with Applications. 2017 Oct 15; 83:187-205.Hochester S, Schmidhuber J. Long short-term memory. Neural computation. 1997 Nov 15;9(8):1735-80.Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. 2014 Sep 1.Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I. Attention is all you need. Advances in neural information processing systems. 2017;30.10.5121/ijcsit.2016.8306Kalyani J, Bharathi P, Jyothi P. Stock trend prediction using news sentiment analysis. arXiv preprint arXiv:1607.01958. 2016 Jul 7.Devlin J, Chang MW, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. 2018 Oct 11.10.15439/2021f79Sridhar S, Sanagavarapu S. Analysis of the effect of news sentiment on stock market prices through event embedding. In2021 16th Conference on Computer Science and Intelligence Systems (FedCSIS) 2021 Sep 2 (pp. 147-150). IEEE.10.1007/s10489-019-01458-9Vanstone BJ, Gepp A, Harris G. Do news and sentiment play a role in stock price prediction? Applied Intelligence. 2019 Nov;49(11):3815-20.Mate GS, Siddhant A, Rutuja K, Maitreyi M. Stock prediction through news sentiment analysis. Journal of Architecture & Technology. 2019 Aug;11(8):36-40.10.1080/24751839.2021.1874252Names L, Kiss A. Prediction of stock values changes using sentiment analysis of stock news headlines. Journal of Information and Telecommunication. 2021 Jul 3;5(3):375-94.10.1109/access.2017.2742001Liu Z. Ship adaptive course keeping control with nonlinear disturbance observer. IEEE access. 2017 Aug 21; 5:17567-75.10.1109/access.2018.2869735Zhang X, Qu S, Huang J, Fang B, Yu P. Stock market prediction via multi-source multiple instance learning. IEEE Access. 2018 Sep 13; 6:50720-8. Liu H. Leveraging financial news for stock trend prediction with attention-based recurrent neural network. arXiv preprint arXiv:1811.06173. 2018 Nov 15.10.1109/access.2019.2901842Wen M, Li P, Zhang L, Chen Y. Stock market trend prediction using high-order information of time series. Ieee Access. 2019 Feb 26; 7:28299-308.10.18653/v1/d19-1490Ma Y, Zong L, Yang Y, Su J. News2vec: News network embedding with subnode information. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) 2019 Nov (pp. 4843-4852).Araci D. Finbert: Financial sentiment analysis with pre-trained language models. arXiv preprint arXiv:1908.10063. 2019 Aug 27.Zhang Y, Xu Z. BERT for question answering on SQuAD 2.0. Stanford University Report. 2019. Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I. Language models are unsupervised multitask learners. Open AI blog. 2019 Feb 24;1(8):9.10.1016/j.procs.2020.03.049Moghar A, Hamiche M. Stock market prediction using LSTM recurrent neural network. Procedia Computer Science. 2020 Jan 1; 170:1168-73.10.1007/978-981-16-0419-5_8Mehtab S, Sen J, Dutta A. Stock price prediction using machine learning and LSTM-based deep learning models. In Symposium on Machine Learning and Metaheuristics Algorithms, and Applications 2020 Oct 14 (pp. 88-106). Springer, Singapore.10.1109/icisc44355.2019.9036442R. Zaheer and H. Shaziya, "A Study of the Optimization Algorithms in Deep Learning," 2019 Third International Conference on Inventive Systems and Control (ICISC), 2019, pp. 536-539, Doi: 10.1109/ICISC44355.2019.9036442.Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781. 2013 Jan 16.10.3115/v1/d14-1162Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. InProceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) 2014 Oct (pp. 1532-1543).Bojanowski P, Grave E, Joulin A, Mikolov T. Enriching word vectors with sub word information. Transactions of the association for computational linguistics. 2017 Dec 1; 5:135-46.10.3390/app10217557Ronran C, Lee S, Jang HJ. “Delayed combination of feature embedding in bidirectional LSTM CRF for NER”. Applied Sciences. 2020 Jan;10(21):7557.10.3115/v1/d14-1179Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078. 2014 Jun 3.