Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
We are interested in the development of surrogate models for uncertainty quantification and propagation in problems governed by stochastic PDEs using a deep convolutional encoder-decoder network in a similar fashion to approaches considered in deep learning for image-to-image regression tasks. Since...
Uložené v:
| Vydané v: | arXiv.org |
|---|---|
| Hlavní autori: | , |
| Médium: | Paper |
| Jazyk: | English |
| Vydavateľské údaje: |
Ithaca
Cornell University Library, arXiv.org
21.01.2018
|
| Predmet: | |
| ISSN: | 2331-8422 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | We are interested in the development of surrogate models for uncertainty quantification and propagation in problems governed by stochastic PDEs using a deep convolutional encoder-decoder network in a similar fashion to approaches considered in deep learning for image-to-image regression tasks. Since normal neural networks are data intensive and cannot provide predictive uncertainty, we propose a Bayesian approach to convolutional neural nets. A recently introduced variational gradient descent algorithm based on Stein's method is scaled to deep convolutional networks to perform approximate Bayesian inference on millions of uncertain network parameters. This approach achieves state of the art performance in terms of predictive accuracy and uncertainty quantification in comparison to other approaches in Bayesian neural networks as well as techniques that include Gaussian processes and ensemble methods even when the training data size is relatively small. To evaluate the performance of this approach, we consider standard uncertainty quantification benchmark problems including flow in heterogeneous media defined in terms of limited data-driven permeability realizations. The performance of the surrogate model developed is very good even though there is no underlying structure shared between the input (permeability) and output (flow/pressure) fields as is often the case in the image-to-image regression models used in computer vision problems. Studies are performed with an underlying stochastic input dimensionality up to \(4,225\) where most other uncertainty quantification methods fail. Uncertainty propagation tasks are considered and the predictive output Bayesian statistics are compared to those obtained with Monte Carlo estimates. |
|---|---|
| AbstractList | We are interested in the development of surrogate models for uncertainty quantification and propagation in problems governed by stochastic PDEs using a deep convolutional encoder-decoder network in a similar fashion to approaches considered in deep learning for image-to-image regression tasks. Since normal neural networks are data intensive and cannot provide predictive uncertainty, we propose a Bayesian approach to convolutional neural nets. A recently introduced variational gradient descent algorithm based on Stein's method is scaled to deep convolutional networks to perform approximate Bayesian inference on millions of uncertain network parameters. This approach achieves state of the art performance in terms of predictive accuracy and uncertainty quantification in comparison to other approaches in Bayesian neural networks as well as techniques that include Gaussian processes and ensemble methods even when the training data size is relatively small. To evaluate the performance of this approach, we consider standard uncertainty quantification benchmark problems including flow in heterogeneous media defined in terms of limited data-driven permeability realizations. The performance of the surrogate model developed is very good even though there is no underlying structure shared between the input (permeability) and output (flow/pressure) fields as is often the case in the image-to-image regression models used in computer vision problems. Studies are performed with an underlying stochastic input dimensionality up to \(4,225\) where most other uncertainty quantification methods fail. Uncertainty propagation tasks are considered and the predictive output Bayesian statistics are compared to those obtained with Monte Carlo estimates. |
| Author | Zhu, Yinhao Zabaras, Nicholas |
| Author_xml | – sequence: 1 givenname: Yinhao surname: Zhu fullname: Zhu, Yinhao – sequence: 2 givenname: Nicholas surname: Zabaras fullname: Zabaras, Nicholas |
| BookMark | eNotj8tOAjEUQBujiYh8gLsmrgf7ns5SAR8Jaoy4JpeZWzI4abHtoPy9-FidxUlOcs7IsQ8eCbngbKys1uwK4le7G3PL-JgZW1ZHZCCk5IVVQpySUUobxpgwpdBaDsjmBvaYWvB0irilk-B3oetzGzx0dObr0GAspvhL-oT5M8T3RF2I9LWPMawhI308yK71awq-oW--xpih9XlPX3rwuXVtDT_Bc3LioEs4-ueQLG5ni8l9MX--e5hczwvQwhYrJxsubMMrbbliXLgGWINGgTRcKsNgZa2rtDCVMlBKXSoNojZOCMSqdHJILv-y2xg-ekx5uQl9POykpWClOJwzbuU3eC1b3g |
| ContentType | Paper |
| Copyright | 2018. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| Copyright_xml | – notice: 2018. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| DBID | 8FE 8FG ABJCF ABUWG AFKRA AZQEC BENPR BGLVJ CCPQU DWQXO HCIFZ L6V M7S PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS |
| DOI | 10.48550/arxiv.1801.06879 |
| DatabaseName | ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central ProQuest Central UK/Ireland ProQuest Central Essentials ProQuest Central ProQuest Technology Collection ProQuest One ProQuest Central Korea SciTech Premium Collection ProQuest Engineering Collection Engineering Database ProQuest Central Premium ProQuest One Academic (New) ProQuest Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection |
| DatabaseTitle | Publicly Available Content Database Engineering Database Technology Collection ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection ProQuest Central (New) ProQuest One Academic ProQuest One Academic (New) Engineering Collection |
| DatabaseTitleList | Publicly Available Content Database |
| Database_xml | – sequence: 1 dbid: PIMPY name: Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Physics |
| EISSN | 2331-8422 |
| Genre | Working Paper/Pre-Print |
| GroupedDBID | 8FE 8FG ABJCF ABUWG AFKRA ALMA_UNASSIGNED_HOLDINGS AZQEC BENPR BGLVJ CCPQU DWQXO FRJ HCIFZ L6V M7S M~E PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS |
| ID | FETCH-LOGICAL-a528-bf3d128d195814012fda0de64a3613460ab88f9526946a735745a2c6f22ee97f3 |
| IEDL.DBID | PIMPY |
| IngestDate | Mon Jun 30 09:36:56 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a528-bf3d128d195814012fda0de64a3613460ab88f9526946a735745a2c6f22ee97f3 |
| Notes | SourceType-Working Papers-1 ObjectType-Working Paper/Pre-Print-1 content type line 50 |
| OpenAccessLink | https://www.proquest.com/publiccontent/docview/2072267018?pq-origsite=%requestingapplication% |
| PQID | 2072267018 |
| PQPubID | 2050157 |
| ParticipantIDs | proquest_journals_2072267018 |
| PublicationCentury | 2000 |
| PublicationDate | 20180121 |
| PublicationDateYYYYMMDD | 2018-01-21 |
| PublicationDate_xml | – month: 01 year: 2018 text: 20180121 day: 21 |
| PublicationDecade | 2010 |
| PublicationPlace | Ithaca |
| PublicationPlace_xml | – name: Ithaca |
| PublicationTitle | arXiv.org |
| PublicationYear | 2018 |
| Publisher | Cornell University Library, arXiv.org |
| Publisher_xml | – name: Cornell University Library, arXiv.org |
| SSID | ssj0002672553 |
| Score | 1.6450257 |
| SecondaryResourceType | preprint |
| Snippet | We are interested in the development of surrogate models for uncertainty quantification and propagation in problems governed by stochastic PDEs using a deep... |
| SourceID | proquest |
| SourceType | Aggregation Database |
| SubjectTerms | Algorithms Artificial neural networks Bayesian analysis Computer simulation Computer vision Encoders-Decoders Gaussian process Machine learning Neural networks Parameter uncertainty Performance evaluation Permeability Propagation Regression models Statistical inference |
| Title | Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification |
| URI | https://www.proquest.com/docview/2072267018 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV07T8MwELagBYmJt3iUygOraRonsT0h9YFgIAq0SGWqnNiRilBSkrai_x6fk8KAxMSUIYpk-c53l_N334fQNeWxz1nMSUyNGTztKyKcxCdKCx2YjMPjRFmxCRaGfDIRUT0eXdawyk1MtIG6YnsG3LYJwh2VJ9Axh76IqRuY0-W38w8CGlJw11oLamyjJhBvOQ3UjB4eo9fvnov5wlTQtLrctFReHVl8zlY3XQ7UnQFn4ldItnnmbv9_V3hgVibnujhEWzo7QrsW7ZmUx-itJ9capifxQOs57ufZqvZA-Y6HGYy5F2Sg7ROHFVC8xKa8xaNlUeTQecMgogaj7FhmCr8Y17HQgsUaPy1lBUCyNj9B47vhuH9PatEFIn3XmCylyqQsBRw08O_lpko6SgeepCbxe4EjY85TAbrkXiAZ9ZnnSzcJUtfVWrCUnqJGlmf6DGGpKOOeL2iqtScdGjORcGHiaRpIaKKco9ZmH6f1wSmnP9t28ffrS7RnahcA4hG320KNRbHUV2gnWS1mZdFGzd4wjJ7bAOUctWs_-AJpW8Q4 |
| linkProvider | ProQuest |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1LT8MwDLZgA8GJt3iTAxwLXdM2yQEhwUBMg2mIIcFpShtXGkLdaLfBfhT_Eafb4IDEjQOnHiJVSezYjvPZH8Ahl1EgRSSdiJMYfAyMo9w4cAwqDMnjyCg2BdmEaDTk46NqzsDHtBbGwiqnNrEw1KYb2xy5zYRQpCDcijzrvTqWNcq-rk4pNMZqUcfRG13Z8tNaleR75HlXl62La2fCKuDowKM5JdyQTTa2yYq9XHiJ0a7B0NecPJsfujqSMlGWeNsPteCB8APtxWHieYhKJJx-Owtln3TdLUG5WbttPn0ldWiCFKLz8etp0SvsRGfvneFxRdreoKEU6ofNLxzZ1dI_24JlWrruYbYCM5iuwnyBV43zNXg-1yO09Z-sithjF910ODlD-oVdprZQP3OqWHxZYwx1zxkF6Ox-kGVdmztklgbOFuMznRr2QMpfgCP6I3Y30GMIVaG169D6i9VtQCntprgJTBsupB8oniD62uWRULFU5BGSUNs00BbsTgXVnhz9vP0tpe3fhw9g4bp1e9O-qTXqO7BIkZiFFTpeZRdK_WyAezAXD_udPNufqBmD9h9L9RPIdQ9W |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Bayesian+Deep+Convolutional+Encoder-Decoder+Networks+for+Surrogate+Modeling+and+Uncertainty+Quantification&rft.jtitle=arXiv.org&rft.au=Zhu%2C+Yinhao&rft.au=Zabaras%2C+Nicholas&rft.date=2018-01-21&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.1801.06879 |