In 1973, Princeton University professor Burton Malkiel claimed in his bestselling book, A Random Walk Down Wall Street, that “A blindfolded monkey throwing darts at a newspaper’s financial pages could select a portfolio that would do just as well as one carefully selected by experts.” While what the professor said was hilarious, this research paper explores the effectiveness of AI in Stock Market Prediction, which, at least theoretically, could improve market predictions compared to the human baseline.
Sohrab Mokhtari, Kang K Yen and Jin Liu have discussed this in their research paper titled “Effectiveness of Artificial Intelligence in Stock Market Prediction Based on Machine Learning”, which forms the basis of the following text.
Importance of this research
Stock markets are a very lucrative and popular way to grow capital. The use of AI in stock market prediction is also growing increasingly popular. Blindly trusting AI to invest money in the stock market could lead to loss of capital for the investors. The research paper evaluates if AI can predict the stock market with reliable accuracy.
Analyzing Stock Market
The below two broad methodologies can be used to analyze a stock in the stock market:
Modelling Stock Market
The problem statement & the underlying motivation are described in detail in the research paper. The research paper also measures the performance of ML algorithms on a stock market testbed.
In this research paper, ML models were not found to be an effective predictor of the stock market. In the words of the researchers
This study tries to address the problem of stock market prediction leveraging ML algorithms. To do so, two main categories of stock market analysis (technical and fundamental) are considered. The performance of ML algorithms on the forecast of the stock market is investigated based on both of these categories. For this, labeled datasets are used to train the supervised learning algorithms, and evaluation metrics are employed to examine the accuracy of ML algorithms in the prediction process. The results show that the linear regression model predicts the closing price remarkably with a shallow error value in the technical analysis. Moreover, in the fundamental analysis, the SVM model can predict public sentiment with an accuracy of 76%. These results imply that although AI can predict the stock price trends or public sentiment about the stock markets, its accuracy is not good enough. Furthermore, while the linear regression can predict the closing price with a sensible range of error, it cannot precisely predict the same value for the next business day. Thus, this model is not sufficient for long-term investments. On the other hand, the accuracy of classification algorithms in predicting buying, selling, or holding a stock is not satisfying enough and can result in loss of capital. Based on this study, it seems that AI is not close to the prediction of the stock market with reliable accuracy.
Source: Sohrab Mokhtari, Kang K Yen and Jin Liu’s “Effectiveness of Artificial Intelligence in Stock Market Prediction Based on Machine Learning”