论文标题

指数加权的L_2正则化策略在构建加强的二阶模型模型中

Exponentially Weighted l_2 Regularization Strategy in Constructing Reinforced Second-order Fuzzy Rule-based Model

论文作者

Zhang, Congcong, Oh, Sung-Kwun, Pedrycz, Witold, Fu, Zunwei, Lu, Shanzhen

论文摘要

在传统的高海高吉果(TSK) - 型模型模型中,常数或线性函数通常被用作模糊规则的一部分,但它们无法有效地描述由前部部分定义的地方区域内部行为。在本文中,开发了一种理论和实用的设计方法来解决此问题。首先,应用信息颗粒(模糊c均值)方法来捕获数据中的结构,并将输入空间拆分为子空间,并形成了前提部件。其次,二次多项式(QP)被用作随之而来的部分。与恒定和线性函数相比,QP可以通过完善输入和输出变量之间的关系来描述本地区域(子空间)内的输入输出行为。但是,尽管QP可以提高模型的近似能力,但它可能导致模型的预测能力(例如,过拟合)的预测能力恶化。为了解决这个问题,我们引入了一种指数级的体重方法,灵感来自谐波分析中遇到的重量函数理论。更具体地说,我们采用指数函数作为有针对性的惩罚项,配备了L2正则化(L2)(即指数加权L2,EWL_2),以适当地匹配所提出的增强二阶模糊模型(RSFRM)。与普通L2相比,EL 2的优势在于在系数估计中分别识别和惩罚不同类型的多项式项,其结果不仅减轻了过度拟合并防止通用能力的恶化,而且还可以有效地释放模型的预测潜力。

In the conventional Takagi-Sugeno-Kang (TSK)-type fuzzy models, constant or linear functions are usually utilized as the consequent parts of the fuzzy rules, but they cannot effectively describe the behavior within local regions defined by the antecedent parts. In this article, a theoretical and practical design methodology is developed to address this problem. First, the information granulation (Fuzzy C-Means) method is applied to capture the structure in the data and split the input space into subspaces, as well as form the antecedent parts. Second, the quadratic polynomials (QPs) are employed as the consequent parts. Compared with constant and linear functions, QPs can describe the input-output behavior within the local regions (subspaces) by refining the relationship between input and output variables. However, although QP can improve the approximation ability of the model, it could lead to the deterioration of the prediction ability of the model (e.g., overfitting). To handle this issue, we introduce an exponential weight approach inspired by the weight function theory encountered in harmonic analysis. More specifically, we adopt the exponential functions as the targeted penalty terms, which are equipped with l2 regularization (l2) (i.e., exponential weighted l2, ewl_2) to match the proposed reinforced second-order fuzzy rule-based model (RSFRM) properly. The advantage of el 2 compared to ordinary l2 lies in separately identifying and penalizing different types of polynomial terms in the coefficient estimation, and its results not only alleviate the overfitting and prevent the deterioration of generalization ability but also effectively release the prediction potential of the model.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源