SIAM Journal on Control and Optimization · 2012 · 135 citations · 28 references
EngineeringEconomicsDynamical SystemsGame TheoryStochastic ProcessesMarkov ChainsMarkov ProcessesMulti-agent SystemsNash EquilibriumStochastic GamesStochastic Systems ModelingHeterogeneityMean-field ModelsMean-field Stochastic Differential EquationsStackelberg EquilibriumStackelberg GamesTime-varying ParametersTwo-player GamesTwo-player Stochastic Games
In this paper, distributed games for large-population multiagent systems with random time-varying parameters are investigated, where the agents are coupled via their individual costs and the structure parameters are a family of independent Markov chains with identical generators. The cost function of each agent is a long-run average tracking-type functional with an unknown mean field coupling nonlinear term as “reference signal.” To reduce the computational complexity, the mean field approach is applied to construct distributed strategies. The population statistics effect (PSE) is used to approximate the average effect of all the agents, and the distributed strategies are given through solving a Markov jump tracking problem. Here the PSE is a deterministic quantity and can be obtained by solving the Stackelberg equilibrium of an auxiliary two-player game. It is shown that the closed-loop system is uniformly stable, and the distributed strategies are asymptotically optimal in the sense of Nash equilibrium, as the number of agents grows to infinity. A numerical example is provided to demonstrate the procedure of designing the strategies as well as the influence of the heterogeneity intensity and the parameter jump rate of the agents on the closed-loop system.
28
Flocks, herds and schools: A distributed behavioral model
Craig W. Reynolds · 1987 · 7.8K citations
Life Sciences, Biology, Zoology +17
Flocks, herds and schools: A distributed behavioral model
Craig W. Reynolds · ACM SIGGRAPH Computer Graphics · 1987 · 5.1K citations
Life Sciences, Biology, Zoology +17
Sensor networks: Evolution, opportunities, and challenges
Chee-Yee Chong, Sanjeev Kumar · Proceedings of the IEEE · 2003 · 3.1K citations
Jean‐Michel Lasry, Pierre-Louis Lions · Japanese journal of mathematics · 2007 · 2.6K citations
Felipe Cucker, Steve Smale · IEEE Transactions on Automatic Control · 2007 · 1.8K citations