论文标题
mionet:通过张量产品学习多输入操作员
MIONet: Learning multiple-input operators via tensor product
论文作者
论文摘要
作为科学机器学习中的新兴范式,神经操作员的目的是通过神经网络学习无限函数函数空间之间的映射。最近开发了几个神经操作员。但是,所有现有的神经操作员仅旨在学习在单个Banach空间上定义的操作员,即操作员的输入是一个函数。在这里,我们首次通过神经网络研究了操作员回归,以针对Banach空间产品定义的多输入操作员进行回归。我们首先证明连续多输入运算符的通用近似定理。我们还提供了详细的理论分析,包括近似错误,该分析提供了网络体系结构设计的指导。基于我们的理论和低级别的近似,我们提出了一个新型的神经操作员Mionet,以学习多输入操作员。 Mionet由几个用于编码输入函数的分支网和用于编码输出函数域的中继网络。我们证明,Mionet可以学习涉及由普通和部分微分方程支配的系统的解决方案操作员。在我们的计算示例中,我们还表明,我们可以赋予对基础系统(例如线性和周期性)的先验知识,以进一步提高准确性。
As an emerging paradigm in scientific machine learning, neural operators aim to learn operators, via neural networks, that map between infinite-dimensional function spaces. Several neural operators have been recently developed. However, all the existing neural operators are only designed to learn operators defined on a single Banach space, i.e., the input of the operator is a single function. Here, for the first time, we study the operator regression via neural networks for multiple-input operators defined on the product of Banach spaces. We first prove a universal approximation theorem of continuous multiple-input operators. We also provide detailed theoretical analysis including the approximation error, which provides a guidance of the design of the network architecture. Based on our theory and a low-rank approximation, we propose a novel neural operator, MIONet, to learn multiple-input operators. MIONet consists of several branch nets for encoding the input functions and a trunk net for encoding the domain of the output function. We demonstrate that MIONet can learn solution operators involving systems governed by ordinary and partial differential equations. In our computational examples, we also show that we can endow MIONet with prior knowledge of the underlying system, such as linearity and periodicity, to further improve the accuracy.