Manuscript
Manuscript
net/publication/383415689
CITATIONS READS
0 1,374
4 authors, including:
All content following this page was uploaded by Mohamad Ahadzadeh on 26 August 2024.
Abstract
The capabilities of AI in analyzing financial data have led to several studies. in this regard; This
piece delves into a thorough and systematic examination of scholarly research on the application
of AI in the realm of stock market investment for market participants, compiled from a selection
of 2053 articles retrieved from the Web of Science (WOS) database. The literature review
delineates five pivotal research domains where AI has significantly contributed; encompassing the
prediction of stock market trends and volatilities, risk management, portfolio optimization, and
investment optimization. This comprehensive analysis underscores the multifaceted role of AI in
the financial territory, highlighting its potential to revamp traditional financial practices and
decision-making processes. In addition, this review underscores the necessity for additional
research to elucidate unresolved inquiries and comprehend the wider implications of disruptive
technological advancements within the financial sector. Specifically, it discusses five principal
questions concerning the impact of AI on the stock market. This systematic review serves as a
pivotal resource for scholars, offering a comprehensive examination of the contemporary
landscape of AI applications within the financial sector.
Search query: ("artificial intelligence*" OR "deep learning*" OR " machine learning*") AND (stock market)
Identification
Title and abstract screening in database Title and abstract screening in database
Items unrelated to this research:
n2.1= 26
n1= 1420 n= 147 n2.2= 42
n2.3= 1
Publish records in Web of science core Included: Publish records in Web of science core Included:
n2.1= 20
n1= 1244 n2.2= 39
n2.3= 1
Included
n= 1304
This study demonstrates the effectiveness of Long Short-Term Memory (LSTM) networks in predicting out-of-sample
Fischer and Deep learning with long short-term directional movements for S&P 500 constituent stocks from 1992 to 2015, outperforming traditional memory-free
Krauss memory networks for financial market 845 classification methods, and identifies high volatility and short-term reversal return profiles as key predictors, suggesting
(2018) predictions a rules-based short-term reversal strategy for trading.
This paper evaluates the effectiveness of four prediction models—Artificial Neural Network (ANN), Support Vector
Predicting stock and stock price index Machine (SVM), Random Forest, and Naive-Bayes—for predicting the direction of movement and stock price index for
Patel et al movement using Trend Deterministic 473 Indian stock markets, using two approaches for input data, demonstrating that Random Forest outperforms the other
(2015) Data Preparation and machine learning models when technical parameters are represented as continuous values, and all models improve performance when these
techniques parameters are represented as trend deterministic data.
Deep learning networks for stock market This study provides a comprehensive analysis of deep learning networks for stock market analysis and prediction,
Chong at al. analysis and prediction: Methodology, 351 highlighting their potential for high-frequency prediction by extracting features from raw data without prior knowledge
(2017) data representations, and case studies of predictors, and evaluating their performance through various data representation methods.
This paper presents a comprehensive review of computational intelligent methods applied in financial applications,
Cavalcante et Computational Intelligence and 314 focusing on studies published from 2009 to 2015, highlighting techniques for data preprocessing, clustering, forecasting,
al. (2016) Financial Markets: A Survey and Future and text mining, aiming to provide a systematic approach to building intelligent trading systems and discussing the field's
Directions main challenges and open problems.
This paper explores the prediction of future stock market index values using a two-stage fusion approach, incorporating
Patel et al. Predicting stock market index using 268 Support Vector Regression (SVR) in the first stage and combining it with Artificial Neural Network (ANN), Random
(2015) fusion of machine learning techniques Forest (RF), and SVR in the second stage, resulting in hybrid models for forecasting.
Deep neural networks, gradient-boosted This paper explores the effectiveness of deep neural networks, gradient-boosted trees, random forests, and their ensembles
Krauss et al. trees, random forests: Statistical 267 in statistical arbitrage, demonstrating promising empirical findings that challenge the semi-strong form of market
(2017) arbitrage on the S&P 500 efficiency, despite declining profits in recent years.
Despite significant challenges, the quest for models to predict financial market prices remains a highly researched area,
Henrique et Literature review: Machine learning with machine learning models, particularly support vector machines and neural networks, emerging as prevalent tools for
al. (2019) techniques applied to 204 recognizing complex patterns and predicting market values, especially within North American markets, highlighting the
financial market prediction ongoing relevance and potential of developing market data in this research domain.
Table 3 The top 10 most cited papers by total citation and citation per year
This paper introduces a novel end-to-end model, the Multi-Filters Neural Network (MFNN), specifically
Long et al. Deep learning-based feature designed for feature extraction in financial time series and price movement prediction, demonstrating superior
(2019) engineering for stock price movement 192 performance over traditional models in accuracy, profitability, and stability.
prediction
This paper aims to provide a comprehensive review of recent advancements in deep learning models for stock
market prediction, focusing on data sources, neural network structures, evaluation metrics, and the
Applications of deep learning in stock 136 implementation and reproducibility of these models, with the goal of facilitating synchronization with the latest
Jiang (2021)
market prediction: Recent progress progress and enabling easy reproduction of previous studies as baselines, while also highlighting future research
directions in this field.
This study contributes to the burgeoning literature on empirical asset pricing in the Chinese stock market by
constructing and analyzing a comprehensive set of return prediction factors using various machine learning
algorithms, highlighting liquidity as a crucial predictor and examining the impact of transaction costs, with a
Leippold et al. Machine learning in the Chinese stock 88 focus on the distinct characteristics of the Chinese market compared to the U.S. market, including the
(2022) market predictability of large stocks and state-owned enterprises over longer horizons.
3.12 Descriptive results of AI
This segment provides an exhaustive examination of the trends in the dissemination of research
within the domain of AI, covering a wide array of scholarly contributions such as scholarly articles,
sections of books, presentations at conferences, and preliminary studies. Figure 7 illustrates the
annual distribution of AI-related publications across various types of academic outputs and
research domains. This visual representation provides a clear overview of the growth trajectory
and diversification of AI research over the years.
600
500
400
300
200
100
0
2015 2016 2017 2018 2019 2020 2021 2022 2023 2024
journal article book chapter conference paper working paper
The initial phase of the study focuses on the earliest AI publications, beginning with the year 2015.
This period is particularly noteworthy as it coincides with the onset of a substantial increase in the
volume and diversity of AI-related research. The subsequent analysis aims to elucidate the
evolution of AI research trends, shedding light on the expanding landscape of AI studies and their
implications for the broader academic and professional communities.
The exponential growth in the annual publication of scholarly articles underscores the escalating
interest and acknowledgment of data analysis as a pivotal methodology within the realm of AI
research. Until 2018, conference proceedings served as the predominant source for disseminating
papers related to this field. In 2019, a significant transformation was observed, leading to an
increase in the publication of scholarly articles within academic journals. Over the years, papers
related to Computer Science artificial intelligence initially held the majority of the discussion. This
prominence can be credited to the rigorous coding skills required for numerous AI-based data
analysis tasks.
On the other hand, In the recent past, there has been a notable increase in scholarly contributions
from the fields of Engineering Electrical Electronics and Business Finance. Additionally, research
from disciplines such as Computer Science Information Systems and Economics has significantly
enriched this domain. This trend underscores a broadening diversification of research areas,
indicating a shift in interest from Computer Science Artificial Intelligence towards these emerging
fields.
3.13 AI publishers
In this section, we delve into the analysis of the publishers of scholarly papers on artificial
intelligence (AI), as depicted in Figure 8. Our findings reveal that the Elsevier database leads in
the publication of AI-related articles, with a total of 593 publications. Springer Nature follows
closely in second place, with 358 publications. Mdpi database in third place, with 202 publications.
These statistics underscore the distribution of AI research across various databases, highlighting
the most prominent platforms for the dissemination of AI-related scholarly work. The dominance
of the Elsevier database in AI publications is particularly noteworthy, given its significant role in
the dissemination of AI research. This database's prominence suggests a robust and growing
interest in AI research, as evidenced by the high volume of publications. On the other hand,
Springer Nature's and mdpi substantial presence in the AI research landscape further supports the
field's growing importance and the increasing number of researchers contributing to this area.
These findings are significant as they provide insights into the publishing landscape of AI research.
They indicate that while the Elsevier, Springer Nature and mdpi database are leading platforms for
AI-related publications, the field's research is distributed across a range of databases. This
distribution reflects the multidisciplinary nature of AI research and its relevance across various
sectors of the finance.
700
600
500
400
300
200
100
0
Elsevier Springer Mdpi IEEE Taylor & Wiley Hindawi Emerald World Public Library
Nature Francis Publishing Group Scientific Science
Group Publishing
Fig. 8 Distribution of different types of publishers in AI field
Moreover, the growing diversification of research areas within AI research, as evidenced by the
increasing number of publications in fields such as Electrical Engineering Electronics, and
Business Finance, underscores the evolving landscape of AI applications. This shift in research
focus is indicative of the growing recognition of AI's transformative potential across sectors, from
enhancing operational efficiency to driving economic diversification and fostering innovation.
In conclusion, the analysis of AI-related publications across various databases provides valuable
insights into the current condition of AI research. It highlights the importance of continued research
and development in AI technologies to enhance financial analysis and decision-making processes.
The findings also underscore the need for fostering interdisciplinary collaboration to fully realize
the potential of AI technologies.
3.14 Average citations per year
Figure 9 illustrates a significant trend in the academic discourse surrounding the integration of AI
within the stock market. The majority of references cited in the publications under study date back
to 2017 or later, with a notable peak in the citation rate for the year 2023, averaging approximately
550 citations. This data point underscores the growing interest and engagement in this area of
research. The oldest reference traced in these publications dates back to 2003, suggesting a gradual
but persistent exploration of the potential applications and implications of AI in financial markets.
This historical perspective provides a foundation for understanding the evolution of research in
this field, highlighting the increasing relevance and sophistication of AI-driven financial market
analyses and predictions.
600.00
500.00
400.00
300.00
200.00
100.00
0.00
1992 1993 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024
Moreover, the temporal distribution of keywords, as indicated by the color coding of nodes,
suggests a dynamic and evolving field of study. The increasing frequency of AI-related keywords
over time indicates a growing recognition of the potential of AI in transforming financial markets.
This trend is likely driven by advancements in AI technologies, the accumulation of data, and the
increasing sophistication of financial models that incorporate AI components. The analysis of the
keyword network thus provides a comprehensive overview of the current condition of AI research
within the stock market. It highlights the importance of ML, DL, and AI as key concepts in this
field, underscoring the need for continued research and development in these areas. The findings
also suggest a promising future for the integration of AI in financial markets, where AI
technologies are poised to play a very Significant pivotal role in shaping market trends and
informing investment decisions. The analysis reveals that machine learning is the earliest concept
to appear in the dataset, with its applications spanning various aspects of the stock market,
including returns, information, news, Twitter, sentiment analysis, finance, portfolio management,
and prediction. This early emergence of machine learning as a keyword in the context of the stock
market underscores its foundational role in the field. The co-occurrence of machine learning with
other keywords suggests a multifaceted approach to leveraging AI technologies in financial
analysis and decision-making processes.
Deep learning, identified as the second most frequently occurring concept in our analysis, is
prominently associated with domains such as risk, volatility, and media, highlighting its pivotal
role in these areas. This association underscores the significant impact of deep learning on financial
risk control, market analysis, and quantitative investment, as well as its potential in predicting
market volatility and integrating with financial time series for intelligent investment and risk
management. The integration of DL into stock market not only enhances the accuracy of market
volatility prediction but also significantly reduces human costs and improves economic hazard
control and business processing capabilities. This integration marks a new era of innovation and
change in the financial territory, where DL serves as a catalyst for more intelligent management
and production methods. Furthermore, the keyword "artificial intelligence" is frequently
associated with specific applications in finance and markets, topic modeling, and relationship
analysis techniques such as ensemble methods and reinforcement analysis.
The analysis of keyword associations within the realm of artificial intelligence (AI) reveals distinct
patterns that correlate with specific financial activities, analyses, and approaches. While specific
terms related to full-text analysis are infrequently highlighted, they are consistently present across
various AI scopes. Sentiment analysis, in particular, is closely associated with DL and ML,
indicating a synergy between these techniques in financial contexts. Conversely, topic modeling
and its associated keywords are more closely linked to broader AI applications, highlighting the
diversity and interconnectedness of AI research within the financial domain.
JOURNAL OF RISK AND FINANCIAL MANAGEMENT 4 EMERGING MARKETS FINANCE AND TRADE 3
INTELLIGENT SYSTEMS IN ACCOUNTING FINANCE & MANAGEMENT 4 IEEE TRANSACTIONS ON NEURAL NETWORKS AND 3
LEARNING SYSTEMS
3.17 Thematic evolution of AI
In our study, we constructed a thematic evolution map (Figure 11) to elucidate the burgeoning
relevance and escalating scholarly interest in specific research domains. Our analysis revealed a
pronounced shift towards AI, ML, and DL analytics, with these fields receiving the majority of the
research attention. This trend underscores the growing of AI, ML, and DL in the scientific
community, highlighting their pivotal role in contemporary research endeavors. The upper right
quadrant of our analysis primarily concentrates on the utilization of ML in stock market
forecasting, encompassing a range of topics including volatility, asset allocation, and the
exploration of deep reinforcement learning methodologies. This focus underscores the
transformative potential of machine learning in enhancing financial market predictions, while also
acknowledging the broader scope of financial modeling and strategy development.
In the lower right quadrant, the emphasis shifts towards the exploration of NLP and AI, particularly
through the Long Short-Term Memory (LSTM) framework. This area also encompasses, albeit to
a lesser extent, discussions on deep reinforcement learning. These advancements in AI and ML are
pivotal in the financial sector, offering novel approaches to data analysis and prediction, thereby
enhancing decision-making processes and strategic planning. In the lower left quadrant, the
discussion encompasses the domains of production efficiency, portfolio management, trading
strategies, and deep reinforcement learning. These areas represent a critical intersection of
operational efficiency, financial asset management, algorithmic trading, and advanced machine
learning techniques. Production efficiency is a cornerstone of operational excellence, ensuring
resources are utilized optimally. Portfolio management, a critical component of financial planning,
involves the strategic allocation of assets to achieve desired returns and risk levels. Trading
strategies, particularly those employing algorithmic approaches, leverage data and analytics to
make informed decisions in the market. Deep reinforcement learning, a cutting-edge machine
learning technique, is increasingly applied to enhance these strategies by learning from data to
make more informed and potentially profitable trading decisions. This quadrant underscores the
convergence of technology and finance, highlighting the potential for innovative solutions in asset
management and trading.
In the upper left quadrant, the discussion encompasses the integration of ML models within asset
management, alongside the exploration of risk management and the analysis of network
complexity factors. This section delves into the application of advanced algorithms to optimize
asset allocation, while simultaneously addressing the multifaceted nature of risk and the intricate
dynamics of network complexity.
Fig. 12 Factorial analysis using management analysis method for 49 keywords distributed in 7 clusters
Volatility forecasting, a critical component of this domain, has evolved significantly over the years,
with advancements in estimation methods and data accessibility playing a pivotal role. The
importance of capturing both intraday and overnight market movements for effective risk
management cannot be overstated. Sophisticated forecasting techniques, which place a greater
emphasis on recent observations, have demonstrated superior performance compared to traditional
methods. Moreover, incorporating high-frequency return data has been shown to significantly
enhance the accuracy of volatility forecasts, thereby offering a more nuanced understanding of
market risk. Investors and financial professionals are increasingly relying on volatility forecasting
to inform their investment strategies and risk management practices. By accurately estimating
market volatility, investors can better prepare for potential market fluctuations and make more
informed decisions regarding portfolio diversification and risk tolerance. This process is not
without its challenges, as the measurement of forecast accuracy and the interpretation of volatility
data require a deep understanding of complex models and methodologies.
in conclusion, the field of management, particularly in the areas of portfolio management and
volatility analysis, is thus intertwined with market forecasting. This interplay is essential for the
development of robust investment strategies and the effective management of financial risks. As
financial markets continue to evolve, the importance of these disciplines will only grow,
underscoring the need for ongoing research and innovation in this domain.
The interplay between these two facets—the global collaboration in AI application within financial
markets and the educational efforts to bridge the gap in AI adoption—illustrates a dynamic and
evolving landscape in the financial sector. As AI continues to transform financial markets, the
importance of fostering international collaboration and addressing educational challenges becomes
increasingly critical. This dual focus ensures that the financial industry can harness the full
potential of AI, while also preparing future generations of professionals to navigate this rapidly
evolving technological landscape.
Artificial Intelligence (AI) emerges as a pivotal field in the realm of economic development, with
its applications significantly influencing a nation's economic trajectory. This burgeoning domain
of research has seen a predominant focus on collaborative endeavors among developed nations.
The interdisciplinary nature of AI's impact on economic activities necessitates a comprehensive
understanding of its current status, potential, and future research directions. This understanding is
crucial for identifying knowledge gaps and formulating strategies for future research. The
collaboration between scholars from different regions, particularly between the USA and China,
underscores the global significance of AI in economic development. This collaboration not only
strengthens the intellectual landscape of AI and economic development but also fosters a vibrant
exchange of ideas and methodologies across borders.
4. Discussion
The aim of a systematic review is to carefully identify, assess, and combine the results of all
previous reviews on a specific subject. This type of study is crucial because it provides a broad
overview of the current knowledge on the topic. By combining and analyzing the results from all
relevant analysis and reviews, we can gain a complete understanding of the field. This method and
approach helps to clarify the current knowledge and pinpoint areas that need further investigation.
Additionally, a systematic review can identify areas where studies agree or disagree. It helps in
resolving conflicting findings and highlights areas where more research is needed to address
inconsistencies. The systematic review as a critical tool in advancing knowledge within a specific
domain. It not only identifies gaps in the research but also underscores areas where consensus
exists. This dual role is crucial for guiding future research efforts, ensuring that the field progresses
in a coherent and meaningful manner. By synthesizing the findings of numerous reviews, this
approach allows for a nuanced understanding of the current landscape of knowledge. It enables
researchers to discern patterns, trends, and areas of contention within the literature, thereby
informing future research directions. This analysis acts as a crucial instrument for steering future
studies and investigation by identifying specific regions that need further research, exploration and
suggesting possible avenues for future studies. It ensures that future research is solidly grounded
and tackles essential questions and investigations that have not been thoroughly examined.
Furthermore, by giving a thorough summary of the present knowledge landscape and highlighting
research voids, this analysis elevates the caliber of future research. It assures that future studies are
solidly grounded and tackle very important questions and uncertainties that have not been
adequately addressed. Such a methodology, in turn, aids in advancing understanding in the realm
of stock market forecasting through AI (Lin & Marques, 2024).
In essence, the systematic reviews is a powerful tool for synthesizing and interpreting the vast
body of literature on a given topic. It provides a massive comprehensive review of the current
condition of knowledge, identifies gaps and areas of consensus, and highlights areas where
additional research is required. This approach not only aids in the clarification of the existing body
of knowledge but also serves as a roadmap for future research endeavors. Prior systematic reviews
have compiled statistical findings related to the utilization of AI in stock price prediction and
market analysis. However, these reviews often present fragmented insights into the complexities
of AI applications in stock prediction performance, risk management, portfolio optimization, and
investment strategies. This research endeavors to conduct a thorough examination and synthesis
of systematic reviews to pinpoint the most efficient AI techniques, data references, and
performance metrics for advancing stock market prediction, management, and optimization. This
exhaustive analysis is vital for guiding future strategies in the stock market, highlighting the pivotal
role of AI in financial investment. The research questions that guide this study are meticulously
crafted to identify the most widely used AI methods, informational resources, and performance
indicators within the domain of stock market forecasting, management, and optimization. By
addressing these questions, this study seeks to contribute to the ongoing discourse on the role of
AI in financial markets, offering valuable insights that could inform the development of more
sophisticated and effective investment optimization. The significance of this research lies in its
potential to bridge the gap between theoretical discussions on AI applications in finance and
practical implementations in stock market strategies. By identifying the most effective AI
approaches and performance metrics, this study aims to provide a foundation for future research
and innovation in the field of financial investment. This systematic review, confined to
publications between 2015 and March 2024, reveals that research focusing on the utilization of AI
for stock market forecasting analysis is relatively recent. Despite the inclusion and exclusion
criteria applied, the remaining articles, spanning from 2020 to 2023, underscore the novelty of this
research domain. A noteworthy observation is the prevalence of studies on AI methodologies in
stock market research, despite the absence of AI technology descriptions in the search terms. As
illustrated in Figure 7, there has been a notable increase in publications over time.
In this segment, we aim to explore the following inquiries:
[Link] are the prevalent AI methodologies and technologies used for forecasting stock
market trends?
[Link] AI methodologies and technologies are most frequently applied for predicting
stock market volatility?
[Link] AI methodologies and technologies are commonly used for risk management within
the stock market?
[Link] AI methodologies and technologies are most commonly applied for portfolio
optimization in the stock market?
[Link] AI methodologies and technologies are most commonly utilized for investment
optimization in the stock market?
We foresee that our deliberations will significantly contribute to the advancement of academic
research and the development of practical applications in the future.
RQ1 - What are the prevalent AI methodologies and technologies used for forecasting stock
market trends?
The most commonly utilized AI methods and technologies for predicting stock market trends
include ML algorithms, including LSTM models, and GNNs. These techniques have been
extensively employed due to their ability to handle the complex, nonlinear, and time-series nature
of stock market data. Machine Learning, particularly LSTM models, has emerged as a powerful
tool for predicting stock prices and trends. LSTM models are particularly adept at capturing the
temporal dependencies in stock market data, making them highly effective for time-series
forecasting. This method has been applied in various studies to predict stock prices with high
accuracy, demonstrating its effectiveness in capturing the intricate patterns within stock market
data. GNNs, including GCN and GAN, have also been utilized for stock market prediction. These
models are particularly suited for analyzing the complex relationships and dependencies within
financial data, making them a valuable tool for predicting stock market trends. GCN and GAT have
been identified as the most frequently utilized GNNs in stock market prediction, highlighting their
effectiveness in handling the complex, graph-structured data of financial markets. In addition to
LSTM and GNNs, other AI techniques such as SVM, ANN, and DRL have also been employed
for stock market prediction. These methods offer various advantages, including the ability to
handle high-dimensional data, the capacity for feature extraction, and the potential for dynamic
adjustment of investment strategies.
RQ2 - Which AI methodologies and technologies are most frequently applied for predicting
stock market volatility?
The most commonly utilized AI methods and technologies for predicting stock market volatilities
include DL, NLP, RL, SA, and QC. These advancements have significantly improved the accuracy
and data-driven nature of investment decisions, making AI an indispensable tool for navigating the
complexities of the stock market with precision and confidence. High-frequency trading (HFT) is
another critical application of AI in stock market prediction, where AI algorithms execute trades
within milliseconds, capitalizing on minuscule price discrepancies. This approach enhances the
ability to analyze market data and execute trades at high speeds with better accuracy. AI models
also play a crucial role in portfolio management by analyzing historical market data and volatility,
adjusting portfolios in real-time to align with changing market conditions, and suggesting
diversification strategies to mitigate potential risk. Technical analysis is another area where AI has
made significant contributions. AI-driven algorithms can analyze technical indicators such as
EMA, RSI, Bollinger bands, Fibonacci retracement, stochastic oscillator, and average directional
index to make accurate predictions about future price movements. Furthermore, AI's impartiality,
free from cognitive biases, human emotions, and other psychological factors, provides an objective
perspective, benefiting investors, traders, and financial institutions with objective and rational
insights, resulting in optimal investment decisions. ML methods, a branch of AI, offer a promising
solution for accurately forecasting stock prices by aggregating various factors to improve stock
return predictions. These methods have been shown to significantly outperform traditional
methods, achieving remarkable accuracy in predicting stock returns.
RQ3 - What AI methodologies and technologies are commonly used for risk management
within the stock market?
In the realm of stock market risk management, a variety of AI techniques and technologies are
frequently employed, such as ML and DL algorithms, NLP, predictive analytics, and data
visualization tools. These technologies facilitate the real-time analysis of extensive financial data,
enabling the detection of patterns, trends, and potential risks. Machine learning algorithms, in
particular, excel in analyzing historical data to predict future price fluctuations and market
volatility, thereby improving risk management strategies. DL algorithms, leveraging complex
neural networks, are proficient in deriving valuable insights from unstructured data types,
including trends, text, full text, audio, diagrams, figures, graphics and images, offering insights
into market dynamics and investor sentiment. NLP empowers computers to understand human
languages in news, documents, events, shocks and other forms of data, aiding in the identification
of events that can influence market movements. Predictive analytics and, utilizing ML, DL, data
mining, and statistical modeling, are crucial for forecasting future price movements and market
volatility based on historical data and current trends. Data visualization tools assist trading
professionals in comprehending intricate data sets and learning from AI-generated predicts and
recommendations. Moreover, the combination of AI algorithms with risk management systems
allows for the monitoring of trading activities and the evaluation of potential risks, thereby
enhancing market predictability, stability, and efficiency.
RQ4 - Which AI methodologies and technologies are most commonly applied for portfolio
optimization/management in the stock market?
In the domain of portfolio optimization, several sophisticated methodologies have gained
prominence, including Random Forest, SVM, and NN. Additionally, Reinforcement Learning,
NLP, and Sentiment Analysis offer unique approaches to this field. These methodologies are adept
at scrutinizing extensive datasets to uncover patterns and associations that can guide investment
decisions. The effectiveness of these methodologies in portfolio optimization underscores their
capacity to navigate intricate data and deliver practical insights. Random Forest (RF) stands out as
a versatile machine learning technique that is particularly adept at managing large datasets with
high dimensionality. It is particularly skilled at pinpointing patterns and associations within data,
making it an optimal choice for portfolio optimization. The operation of Random Forest algorithms
involves the creation of multiple decision trees and the consolidation of their outcomes to produce
a final prediction. This ensemble technique ensures reliable predictions, even when the data
contains noise or outliers. SVM represent another category of ML algorithms that have found
utility in portfolio optimization. SVMs are supervised learning models utilized for both
classification and regression analysis. They function by locating the hyperplane that most
effectively segregates the data into categories. In the context of portfolio optimization, SVMs can
be employed to categorize assets based on their performance attributes, thereby facilitating the
selection of the most suitable investments. Neural Networks (NN), a subset of machine learning
algorithms, draw inspiration from the structure and function of the human brain. They comprise
interconnected nodes, or "neurons," that process information. Neural Networks are particularly
proficient at identifying complex patterns and associations within data, making them highly
effective in portfolio optimization. They can learn from historical data to forecast future trends,
enabling investors to make informed decisions regarding asset allocation. RL is a form of ML
where an agent learns to make decisions by interacting with its environment. In the context of
portfolio optimization, reinforcement learning algorithms can adapt to fluctuating market
conditions and adjust the portfolio accordingly.
Techniques in Natural Language Processing (NLP) are employed to scrutinize textual information
such as news stories, financial reports, and social media opinions. By deriving significant insights
from unstructured information, NLP aids investors in making well-informed decisions. Sentiment
analysis (SA) encompasses evaluating public feelings towards stocks or the market as a whole. By
scrutinizing social media posts, news stories, and other sources, sentiment analysis offers crucial
data for portfolio optimization. The utilization of these ML methods in portfolio optimization
highlights their capability to augment investment decision-making processes. By harnessing the
capabilities of these algorithms, investors can obtain insights into market trends, pinpoint potential
investment opportunities, and manage risk more efficiently. This not only elevates the efficiency
of investment strategies but also enhances the overall performance of portfolios.
RQ5 - What AI methodologies and technologies are most commonly utilized for investment
optimization in the stock market?
The most commonly utilized AI methods and technologies for investment optimization in the stock
market include:
Predictive Analytics (PA): This tool uses ML algorithms to scrutinize historical market data,
aiming to discern patterns that could foreshadow future price fluctuations. This methodology offers
invaluable insights to investors by utilizing statistical modeling, data mining techniques, and
machine learning to anticipate future market movements based on past trends and data patterns.
Sentiment Analysis (SA): This technique evaluates the emotional tone of news articles, social
media posts, and other online content to determine public sentiment towards specific stocks or
markets. It serves as an additional criterion in the investment decision-making process, providing
insights into market sentiment that can influence investment strategies.
Quantitative Analysis (QA): Involves using mathematical models and statistical techniques to
evaluate securities, helping investors make decisions based on solid statistical evidence.
5. Conclusion
This paper presents a comprehensive systematic review examining the influence of AI on the stock
market, analyzing 2,053 articles related to AI within the WOS database. The selection of articles
was conducted from the WOS platform, focusing on documents with the highest citation counts to
identify the most pertinent research. The articles were subsequently categorized into four main
thematic areas: portfolio optimization, stock market prediction, risk management, optimization
investment using AI. In fact, the systematic review methodology ensures a rigorous and unbiased
analysis of the literature. By focusing on the most cited articles, the review aims to highlight the
most influential research in the field. The categorization of articles into specific thematic areas
allows for a focused examination of the impact of AI on different aspects of the stock market. The
analysis provides a comprehensive overview of the scholarly landscape concerning AI,
encompassing the most frequently cited papers across all time and those published annually. This
data serves as a critical indicator of the evolving interest in AI as a subject of investment, a trend
that parallels the technological advancements and widespread adoption of computing technologies.
The exponential growth in the number of papers published from 2015 to March 2024 underscores
AI's emergence as a rapidly expanding field of research, reflecting its increasing relevance and
appeal to scholars and practitioners alike. Given the emergence of artificial intelligence (AI) as a
pivotal technology, its application across various sectors within the stock market is of paramount
importance. Consequently, the exploration of AI's commercial applications is deemed crucial for
both academic and practical endeavors, underscoring the significance of this research area in the
broader context of financial investment and market analysis. For each area of study, we analyzed
the most cited papers from 2015 to 2024. Additionally, recent articles were identified to highlight
the latest findings and suggest potential future research directions. Tables were constructed to
visually distinguish the various methodologies and models presented in each paper, facilitating a
clear understanding of the research landscape.
We identify several promising research directions. The first significant area of focus is Risk
Management, where AI plays a crucial role in enhancing risk management practices. By utilizing
advanced analytics, AI can evaluate risk tolerance and suggest diversification strategies that align
with individual investor profiles. Machine learning models, trained on historical data, are capable
of analyzing patterns to identify potential risks, thereby facilitating proactive adjustments to
portfolios to mitigate these risks. This approach not only improves risk management but also
optimizes risk-adjusted returns, positioning AI as a proactive guardian in the investment landscape.
The second section pertains to the optimization of portfolios and investments. 2.1. Investment
Optimization: AI equips investors with sophisticated decision-making tools by leveraging machine
learning models to scrutinize extensive data for investment opportunities, risk assessment, and
portfolio optimization. NLP extracts insights from textual data, such as news and filings, offering
a comprehensive market perspective. Predictive analytics aim to forecast future market trends,
emphasizing explainability to enhance user trust. AI's capacity to analyze historical data, market
trends, and correlations enables the identification and evaluation of factors such as value, size,
momentum, quality, or volatility, facilitating the construction of targeted portfolios. [Link]
Optimization: The application of AI in portfolio optimization involves the analysis of extensive
datasets of historical asset performance and risk characteristics, including volatility and
correlation. This examination aids in the construction of tailored portfolios, focusing on low-risk
investments such as index funds and government bonds, in accordance with the principles of MPT.
By incorporating Risk Parity Optimization with artificial intelligence (AI) models, capital
allocation is determined by the risk contribution rather than the monetary value, providing a more
balanced risk profile for cautious investors.
The third potential research direction explores the prediction of stock market volatilities and
trends. 3.1. Stock Market Trend Prediction: The utilization of AI in predicting stock market trends
employs ML algorithms to analyze historical data, market trends, and correlations. This analysis
identifies and assesses factors such as value, size, momentum, quality, and volatility, enabling
targeted portfolio construction and the forecasting of future market trends. AI's predictive analytics
focus on ensuring explainability to build user trust. AI-powered factor investing models have
demonstrated significant performance improvements over traditional models, offering substantial
benefits to investors. 3.2. Forecasting Stock Market Volatilities: AI algorithms utilize historical
records, news, papers, social media opinions, and economic signals to Recognize patterns and
forecast potential market volatility. LSTM networks, a type of RNN , are employed for their ability
to learn long-term dependencies within market data, potentially leading to more accurate market
predictions. XAI techniques are being developed to enhance transparency in AI-driven market
forecasting, thereby fostering trust among investors.
This study acknowledges several limitations that are essential to consider in the context of its
findings and implications. Firstly, the analysis is confined to the literature available in the WOS
databases. This limitation may result in an incomplete representation of the relevant literature,
potentially overlooking significant studies that are not indexed within this database. Secondly, the
selection of literature was guided by subject categories within the WOS. This approach, while
methodologically sound, may have inadvertently excluded pertinent research that does not neatly
fit into the predefined categories. This limitation underscores the potential for bias in the literature
review process, which could affect the comprehensiveness and relevance of the findings. Lastly,
the recommendations derived from this study are inherently subjective. They are based on the
authors' interpretations and analyses of the existing literature, which are influenced by their
perspectives and the limitations of the data available. Recognizing these subjective limitations, the
authors express a commitment to fostering further research and scholarly discourse on these topics.
This commitment is aimed at enhancing the understanding and addressing the points raised in this
study. In this manner, it aids in enhancing understanding within the domain of AI and the stock
market.
In conclusion, while this study provides valuable insights into the subject matter, it is essential to
recognize and acknowledge its limitations. These limitations underscore the importance of
ongoing research and critical engagement with the literature to refine our understanding and to
address the gaps identified in this study.
Abbreviations
WOS Web Of Science
AI Artificial intelligence
DL Deep Learning
ML Machine Learning
XAI Explainable AI
LSTM Long Short-Term Memory
RNN Recurrent Neural Network
NLP Natural Language Processing
MPT Modern Portfolio Theory
SA Sentiment Analysis
QA Quantitative Analysis
PA Predictive Analytics
SVM Support Vector Machines
EMA exponential moving average
RSI relative strength index
HFT High-frequency trading
DRL Deep Reinforcement Learning
ANN Artificial Neural Networks
NN Neural Networks
RL Reinforcement learning
RF Random Forest
GNN Graph Neural Networks
GAN Graph Attention Networks
GCN Graph Convolutional Networks
CNN Convolutional Neural Networks
SM Stock Market
TA Technical Analysis
GAN Graph Attention Networks
ANN Artificial Neural Networks
SVM Support Vector Machines
DRL Deep reinforcement learning
QC Quantum Computing
Declaration
Availability of data and materials
Data used in this paper were collected from Web of Science Core Collection
Competing interests
The authors declare that they have no competing interests.
Funding
Not applicable.
Acknowledgements
We are grateful to the 4th international conference on management, business, economic and
accounting for their review and acceptance of our paper.
References
Lin, C. Y., & Marques, J. A. L. (2024). Stock market prediction using artificial intelligence: A systematic review of systematic
reviews. Social Sciences & Humanities Open, 9, 100864. [Link]
Najem, R., Amr, M. F., Bahnasse, A., & Talea, M. (2024). Advancements in Artificial Intelligence and Machine Learning for Stock
Market Prediction: A Comprehensive Analysis of Techniques and Case Studies. Procedia Computer Science, 231, 198-204.
[Link]
Lin, C. Y., & Marques, J. A. L. (2024). Stock market prediction using artificial intelligence: A systematic review of systematic
reviews. Social Sciences & Humanities Open, 9, 100864. Available at SSRN: [Link] or
[Link]
Jareño, F., & Yousaf, I. (2023). Artificial intelligence-based tokens: Fresh evidence of connectedness with artificial intelligence-
based equities. International Review of Financial Analysis, 89, 102826. [Link]
Nabeel, R. (2023). Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated
by machines, as opposed to intelligence displayed by non-human animals and humans. Example tasks in which this is done
include speech recognition, computer vision, translation between (natural) languages, as well as other mappings of inputs.
The Oxford English Dictionary of Oxford University Press defines artificial intelligence as (No. sz7mj). Center for Open
Science. doi: 10.31219/[Link]/sz7mj.
Han, Y., Chen, J., Dou, M., Wang, J., & Feng, K. (2023). The Impact of Artificial Intelligence on the Financial Services Industry.
Academic Journal of Management and Social Sciences, 2(3), 83-85. doi: [Link]
Papanicolaou, P. (2023). How AI is re-shaping the financial industry: lights, shades and perspectives. In Artificial Intelligence and
Financial Behaviour (pp. 205-214). Edward Elgar Publishing. [Link]
Mishra, S. (2023). Exploring the impact of ai-based cyber security financial sector management. Applied Sciences, 13(10), 5875.
[Link]
Mahajan, D., Vatsyayan, s., Kumar, s., Dadhich, p. (2023). Decision Strategies and Artificial Intelligence Navigating the Business
Landscape. doi:10.59646/edbook/009.
Abakah, E. J. A., Tiwari, A. K., Ghosh, S., & Doğan, B. (2023). Dynamic effect of Bitcoin, fintech and artificial intelligence stocks
on eco-friendly assets, Islamic stocks and conventional financial markets: Another look using quantile-based approaches.
Technological Forecasting and Social Change, 192, 122566. doi: 10.1016/[Link].2023.122566.
Suresh, N., Neelam, H., Chakrapani, E., Kumar, K. A., & Ali, S. S. (2023, January). Artificial Intelligence Advances and Their
Repercussions on the Financial System. In 2023 International Conference on Computer Communication and Informatics
(ICCCI) (pp. 1-4). IEEE.
Jang, J., & Seong, N. (2023). Deep reinforcement learning for stock portfolio optimization by connecting with modern portfolio
theory. Expert Systems with Applications, 218, 119556. [Link]
Sahiner, M., McMillan, D. G., & Kambouroudis, D. (2023). Do artificial neural networks provide improved volatility forecasts:
Evidence from Asian markets. Journal of Economics and Finance, 47(3), 723-762. doi: 10.1007/s12197-023-09629-8.
Yuyan, G., Di, H., Yan, M., & Hongmin, Z. (2023). Realised volatility prediction of high-frequency data with jumps based on
machine learning. Connection Science, 35(1), 2210265. [Link]
Yu, Y., Lin, Y., Hou, X., & Zhang, X. (2023). Novel optimization approach for realized volatility forecast of stock price index based
on deep reinforcement learning model. Expert Systems with Applications, 233, 120880.
[Link]
Seifi, N., & Shavarani, H. S. (2023). Predicting Idiosyncratic Volatility from Stock Market Trade Records: A Machine Learning
Approach. [Link]
Kanthimathi, N., Saranya, N., & Hermina, C. I. (2023, May). Stock Market Prediction Using AI. In 2023 2nd International
Conference on Vision Towards Emerging Trends in Communication and Networking Technologies (ViTECoN) (pp. 1-5).
IEEE. doi:10.1109/ViTECoN58111.2023.10157327.
Nabiee, S., & Bagherzadeh, N. (2023). Stock Trend Prediction: A Semantic Segmentation Approach. arXiv preprint
arXiv:2303.09323.
[Link]
Mita, D., & Takahashi, A. (2023). Multi-agent model based proactive risk management for equity investment. Engineering
Applications of Artificial Intelligence, 125, 106701. [Link]
Parisi, L., & Manaog, M. L. (2023). Optimal Machine Learning-and Deep Learning-driven algorithms for predicting the future
value of investments: A systematic review and meta-analysis. doi:10.21203/[Link]-2658566/v1.
Kim, J., & Lee, M. (2023). Portfolio optimization using predictive auxiliary classifier generative adversarial networks. Engineering
Applications of Artificial Intelligence, 125, 106739. [Link]
Gao, R., Gu, F., Sun, R., Stefanidis, A., Ren, X., & Su, J. (2022, October). A Novel DenseNet-based Deep Reinforcement
Framework for Portfolio Management. In 2022 International Conference on Cyber-Enabled Distributed Computing and
Knowledge Discovery (CyberC) (pp. 158-165). IEEE.
Bhuyan, B. P., & Singh, T. P. (2022). Artificial intelligence in financial portfolio management. In Revolutionizing Business
Practices Through Artificial Intelligence and Data-Rich Environments (pp. 108-139). IGI Global. doi: 10.4018/978-1-6684-
4950-9.ch007.
Adebiyi, S. O., Ogunbiyi, O. O., & Amole, B. B. (2022). Artificial intelligence model for building investment portfolio optimization
mix using historical stock prices data. Rajagiri Management Journal, 16(1), 36-62. doi:10.1108/RAMJ-07-2020-0036.
Santos, G. C., Barboza, F., Veiga, A. C. P., & Gomes, K. (2022). Portfolio optimization using artificial intelligence: a systematic
literature review. Exacta. doi:10.5585/exactaep.2022.21882.
Petrozziello, A., Troiano, L., Serra, A., Jordanov, I., Storti, G., Tagliaferri, R., & La Rocca, M. (2022). Deep learning for volatility
forecasting in asset management. Soft Computing, 26(17), 8553-8574. doi:10.1007/s00500-022-07161-1.
Song, G. H., & Jain, A. (2022). Can artificial intelligence beat the stock market?. Studies in Economics and Finance, 39(5), 772-
785.
doi: 10.1108/SEF-03-2022-0133.
Lee, P., Huang, Z., & Tang, Y. (2022). Trend Prediction Model of Asian Stock Market Volatility Dynamic Relationship Based on
Machine Learning. Security and Communication Networks, 2022. [Link]
Chaajer, P., Shah, M., & Kshirsagar, A. (2022). The applications of artificial neural networks, support vector machines, and long–
short term memory for stock market prediction. Decision Analytics Journal, 2, 100015.
[Link]
Gonzales, R. M. D., & Hargreaves, C. A. (2022). How can we use artificial intelligence for stock recommendation and risk
management? A proposed decision support system. International Journal of Information Management Data Insights, 2(2),
100130. doi:10.1016/[Link].2022.100130.
Rubesam, A. (2022). Machine learning portfolios with equal risk contributions: Evidence from the Brazilian market. Emerging
Markets Review, 51, 100891. [Link]
Leippold, M., Wang, Q., & Zhou, W. (2022). Machine learning in the Chinese stock market. Journal of Financial Economics,
145(2), 64-82. [Link]
Jiang, W. (2021). Applications of deep learning in stock market prediction: recent progress. Expert Systems with Applications, 184,
115537. [Link]
Samitas, A., Kampouris, E., & Kenourgios, D. (2020). Machine learning as an early warning system to predict financial crisis.
International Review of Financial Analysis, 71, 101507. [Link]
Henrique, B. M., Sobreiro, V. A., & Kimura, H. (2019). Literature review: Machine learning techniques applied to financial market
prediction. Expert Systems with Applications, 124, 226-251. [Link]
Long, W., Lu, Z., & Cui, L. (2019). Deep learning-based feature engineering for stock price movement prediction. Knowledge-
Based Systems, 164, 163-173. [Link]
İpek, İ. (2019). Organizational learning in exporting: A bibliometric analysis and critical review of the empirical research.
International Business Review, 28(3), 544-559. [Link]
Fischer, T., & Krauss, C. (2018). Deep learning with long short-term memory networks for financial market predictions. European
journal of operational research, 270(2), 654-669. [Link]
Chong, E., Han, C., & Park, F. C. (2017). Deep learning networks for stock market analysis and prediction: Methodology, data
representations, and case studies. Expert Systems with Applications, 83, 187-205.
[Link]
Krauss, C., Do, X. A., & Huck, N. (2017). Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on
the S&P 500. European Journal of Operational Research, 259(2), 689-702. [Link]
Cavalcante, R. C., Brasileiro, R. C., Souza, V. L., Nobrega, J. P., & Oliveira, A. L. (2016). Computational intelligence and financial
markets: A survey and future directions. Expert Systems with Applications, 55, 194-211.
[Link]
Patel, J., Shah, S., Thakkar, P., & Kotecha, K. (2015). Predicting stock and stock price index movement using trend deterministic
data preparation and machine learning techniques. Expert systems with applications, 42(1), 259-268.
[Link]
Patel, J., Shah, S., Thakkar, P., & Kotecha, K. (2015). Predicting stock market index using fusion of machine learning techniques.
Expert systems with applications, 42(4), 2162-2172. [Link]