Multi-Fractional Gradient Descent: A Novel Approach to Gradient Descent for Robust Linear Regression

Authors: , ,

Abstract: This work introduces a novel gradient descent method by generalizing the fractional gradient descent (FGD) such that instead of the same fractional order for all variables, we assign different fractional orders to each variable depending on its characteristics and its relation to other variables. We name this method Multi-Fractional Gradient Descent (MFGD) and by using it in linear regression for minimizing loss function (residual sum of square) and apply it on four financial time series data and also tuning their hyperparameters, we can observe that unlike GD and FGD, MFGD is robust to multicollinearity in the data and also can detect the real information in it and obtain considerable lower error.

Engineering World, E-ISSN: 2692-5079, Volume 6, 2024, Art. #12

PDF
DOI
XML
Cite
×
Citation Tools
WSEAS AMA
Robab Kalantari, Khashayar Rahimi, Saman Naderi Mezajin, "Multi-Fractional Gradient Descent: A Novel Approach to Gradient Descent for Robust Linear Regression," Engineering World, vol. 6, pp. 118-127, 2024, DOI:10.37394/232025.2024.6.12
Robab Kalantari, Khashayar Rahimi, Saman Naderi Mezajin. Multi-Fractional Gradient Descent: A Novel Approach to Gradient Descent for Robust Linear Regression. Engineering World. 2024;6:118-127. 10.37394/232025.2024.6.12
Copy to Clipboard
Citation copied to Clipboard

Certification

---