New horizons in sphere-packing theory, part II: lattice-based derivative-free optimization via global surrogates
Derivative-free algorithms are frequently required for the optimization of nonsmooth scalar functions in n dimensions resulting, for example, from physical experiments or from the statistical averaging of numerical simulations of chaotic systems such as turbulent flows. The core idea of all efficien...
Uloženo v:
| Vydáno v: | Journal of global optimization Ročník 56; číslo 1; s. 61 - 91 |
|---|---|
| Hlavní autoři: | , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
Boston
Springer US
01.05.2013
Springer Springer Nature B.V |
| Témata: | |
| ISSN: | 0925-5001, 1573-2916 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Shrnutí: | Derivative-free algorithms are frequently required for the optimization of nonsmooth scalar functions in
n
dimensions resulting, for example, from physical experiments or from the statistical averaging of numerical simulations of chaotic systems such as turbulent flows. The core idea of all efficient algorithms for problems of this type is to keep function evaluations far apart until convergence is approached.
Generalized pattern search
(
GPS
) algorithms, a modern class of methods particularly well suited to such problems, accomplish this by coordinating the search with an underlying grid which is refined, and coarsened, as appropriate. One of the most efficient subclasses of GPS algorithms, known as the
surrogate management framework
(
SMF
; see Booker et al. in Struct Multidiscip Optim 17:1–13,
1999
), alternates between an exploratory
search
over an interpolating function which summarizes the trends exhibited by existing function evaluations, and an exhaustive
poll
which checks the function on neighboring points to confirm or confute the local optimality of any given
candidate minimum point
(
CMP
) on the underlying grid. The original SMF algorithm implemented a GPS step on an underlying Cartesian grid, augmented with a Kriging-based surrogate search. Rather than using the
n
-dimensional Cartesian grid (the typical choice), the present work introduces for this purpose the use of lattices derived from
n
-dimensional sphere packings. As reviewed and analyzed extensively in Part I of this series (see Belitz, PhD dissertation, University of California, San Diego,
2011
, Chap. 2), such lattices are significantly more uniform and have many more nearest neighbors than their Cartesian counterparts. Both of these facts make them far better suited for coordinating GPS algorithms, as demonstrated here in a variety of numerical tests. |
|---|---|
| Bibliografie: | SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 ObjectType-Article-2 content type line 23 |
| ISSN: | 0925-5001 1573-2916 |
| DOI: | 10.1007/s10898-012-9866-7 |