Document Type
Article
Publication Date
7-16-2026
Abstract
A growing body of literature has been leveraging techniques of machine learning (ML) to build novel approaches to approximating the solutions to partial differential equations. Noticeably absent from the literature is a systematic exploration of the stability of the solutions generated by these ML approaches. Here, a recurrent network is introduced that matches precisely the evaluation of a multi-step method paired with a collocation method for approximating spatial derivatives in the advection–diffusion equation. This allows for two things: (1) the use of traditional tools for analyzing the stability of a numerical method for solving PDEs and (2) bringing to bear efficient techniques of ML for the training of approximations for the action of (spatial) linear operators. Observations on impacts of varying the large number of parameters in even this simple linear problem are presented. Further, in a limited setting, it is demonstrated that stable solutions can be found even where traditional numerical methods may fail.
Source Publication
Mathematics (eISSN 2227-7390)
Recommended Citation
Reeger, J. A. (2026). Observations on Recurrent Loss in the Neural Network Model of a Partial Differential Equation: The Advection–Diffusion Equation. Mathematics, 14(14), 2577. https://doi.org/10.3390/math14142577
Comments
© 2026 by the author. Licensee MDPI, Basel, Switzerland.
This article is published by MDPI, licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Sourced from the published version of record cited below.