Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games

In two-player static and differential games, strategic players often use available or delayed information about the other player's decisions and solve an optimization or optimal control problem to determine their strategic choices. Without this information, the player's ability to determin...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access Vol. 13; pp. 2694 - 2704
Main Authors: Hossain, Mohammad Safayet, Simaan, Marwan A., Qu, Zhihua
Format: Journal Article
Language:English
Published: Piscataway IEEE 2025
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Algorithms
Convergence
Decisions
Delays
Differential games
Eigenvalues and eigenfunctions
Game theory
Games
gradient-based minimization algorithms
Linear programming
Nash equilibrium
Optimal control
Optimization
Polynomials
Static games
Sufficient conditions
Zero sum games
ISSN:2169-3536, 2169-3536
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In two-player static and differential games, strategic players often use available or delayed information about the other player's decisions and solve an optimization or optimal control problem to determine their strategic choices. Without this information, the player's ability to determine its optimal decisions becomes problematic. In this paper, we propose an approach in which each player implements an iterative discrete-time gradient-based algorithm that relies only on intermediate either current or prior observations about the other player's actions. We explore the implementation of such gradient play algorithms in the case of non-zero-sum static games and in the more complex case of differential games. We discuss the properties of these algorithms with heterogeneous stepsizes and derive explicit necessary and sufficient conditions on the game parameters in the objective functions and stepsizes that guarantee convergence to the Nash equilibrium in static games with quadratic objective functions. Examples in both static and differential games are presented to illustrate the results.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2024.3523258