Chinthalapati, V.L.R., Mitra, S. and Serguieva, A. 2019. Big Data And PAC Learning In The Presence Of Noise: Implications For Financial Risk Management. International Journal of Artificial Intelligence. 17 (1), pp. 34-56.
| Title | Big Data And PAC Learning In The Presence Of Noise: Implications For Financial Risk Management |
|---|---|
| Type | Journal article |
| Authors | Chinthalapati, V.L.R., Mitra, S. and Serguieva, A. |
| Abstract | High accuracy forecasts are essential to financial risk management, where machine learning algorithms are frequently employed. We derive a new theoretical bound on the sample complexity for PAC learning in the presence of noise, and does not require specification of the hypothesis set |H|. Consequently, we demonstrate that for realistic financial applications (where |H|is typically infinite) that big data is necessary, contrary to prior theoretical conclusions. Secondly, we show that noise (which is a non-trivial component of big data) has a dominating impact on the data size required for PAC learning. Consequently, contrary to current big data trends, we argue that high quality data is more important than large volumes of data. Thirdly, we demonstrate that the level of algorithmic sophistication (specifically the Vapnik Chervonenkis dimension) needs to be traded-off against data requirements to ensure optimal algorithmic performance. Finally, our new Theorem can be applied to a wider range of machine learning algorithms, as it does not impose finite |H| requirements. This paper will be of interest to researchers and industry specialists who are interested in machine learning in financial |
| Keywords | Big Data |
| Risk Management | |
| Noisy Data | |
| Machine Learning | |
| VC Dimension | |
| Sample Complexity | |
| Journal | International Journal of Artificial Intelligence |
| Journal citation | 17 (1), pp. 34-56 |
| ISSN | 0974-0635 |
| Year | 2019 |
| Publisher | Centre for Environment & Socio-Economic Research Publications |
| Web address (URL) | http://www.ceser.in/ceserp/index.php/ijai/article/view/5955 |
| Publication dates | |
| Published | 2019 |