• Complex
  • Title
  • Author
  • Keyword
  • Abstract
  • Scholars
Search

Author:

Zhang, Si-Ping (Zhang, Si-Ping.) | Dong, Jia-Qi (Dong, Jia-Qi.) | Liu, Li (Liu, Li.) | Huang, Zi-Gang (Huang, Zi-Gang.) | Huang, Liang (Huang, Liang.) | Lai, Ying-Cheng (Lai, Ying-Cheng.)

Indexed by:

SSCI SCIE EI Scopus PubMed

Abstract:

The main point of this paper is to provide an affirmative answer through exploiting reinforcement learning (RL) in artificial intelligence (AI) for eliminating herding without any external control in complex resource allocation systems. In particular, we demonstrate that when agents are empowered with RL (e.g., the popular Q-learning algorithm in AI) in that they get familiar with the unknown game environment gradually and attempt to deliver the optimal actions to maximize the payoff, herding can effectively be eliminated. Furthermore, computations reveal the striking phenomenon that, regardless of the initial state, the system evolves persistently and relentlessly toward the optimal state in which all resources are used efficiently. However, the evolution process is not without interruptions: there are large fluctuations that occur but only intermittently in time. The statistical distribution of the time between two successive fluctuating events is found to depend on the parity of the evolution, i.e., whether the number of time steps in between is odd or even. We develop a physical analysis and derive mean-field equations to gain an understanding of these phenomena. Since AI is becoming increasingly widespread, we expect our RL empowered minority game system to have broad applications.

Keyword:

Author Community:

  • [ 1 ] [Zhang, Si-Ping; Huang, Zi-Gang] Xi An Jiao Tong Univ, Key Lab Biomed Informat Engn, Minist Educ,Sch Life Sci & Technol, Key Lab Neuroinformat & Rehabil Engn,Minist Civil, Xian 710049, Shaanxi, Peoples R China
  • [ 2 ] [Zhang, Si-Ping; Huang, Zi-Gang] Xi An Jiao Tong Univ, Sch Life Sci & Technol, Inst Hlth & Rehabil Sci, Xian 710049, Shaanxi, Peoples R China
  • [ 3 ] [Zhang, Si-Ping; Dong, Jia-Qi; Huang, Liang] Lanzhou Univ, Inst Computat Phys & Complex Syst, Lanzhou 730000, Gansu, Peoples R China
  • [ 4 ] [Dong, Jia-Qi] Chinese Acad Sci, Key Lab Theoret Phys, Inst Theoret Phys, POB 2735, Beijing 100190, Peoples R China
  • [ 5 ] [Liu, Li] Chongqing Univ, Sch Software Engn, Chongqing 400044, Peoples R China
  • [ 6 ] [Lai, Ying-Cheng] Arizona State Univ, Dept Phys, Sch Elect Comp & Energy Engn, Tempe, AZ 85287 USA
  • [ 7 ] [Zhang, Si-Ping]Xi An Jiao Tong Univ, Key Lab Biomed Informat Engn, Minist Educ,Sch Life Sci & Technol, Key Lab Neuroinformat & Rehabil Engn,Minist Civil, Xian 710049, Shaanxi, Peoples R China
  • [ 8 ] [Huang, Zi-Gang]Xi An Jiao Tong Univ, Key Lab Biomed Informat Engn, Minist Educ,Sch Life Sci & Technol, Key Lab Neuroinformat & Rehabil Engn,Minist Civil, Xian 710049, Shaanxi, Peoples R China
  • [ 9 ] [Zhang, Si-Ping]Xi An Jiao Tong Univ, Sch Life Sci & Technol, Inst Hlth & Rehabil Sci, Xian 710049, Shaanxi, Peoples R China
  • [ 10 ] [Huang, Zi-Gang]Xi An Jiao Tong Univ, Sch Life Sci & Technol, Inst Hlth & Rehabil Sci, Xian 710049, Shaanxi, Peoples R China
  • [ 11 ] [Zhang, Si-Ping]Lanzhou Univ, Inst Computat Phys & Complex Syst, Lanzhou 730000, Gansu, Peoples R China
  • [ 12 ] [Dong, Jia-Qi]Lanzhou Univ, Inst Computat Phys & Complex Syst, Lanzhou 730000, Gansu, Peoples R China
  • [ 13 ] [Huang, Liang]Lanzhou Univ, Inst Computat Phys & Complex Syst, Lanzhou 730000, Gansu, Peoples R China
  • [ 14 ] [Dong, Jia-Qi]Chinese Acad Sci, Key Lab Theoret Phys, Inst Theoret Phys, POB 2735, Beijing 100190, Peoples R China
  • [ 15 ] [Liu, Li]Chongqing Univ, Sch Software Engn, Chongqing 400044, Peoples R China
  • [ 16 ] [Lai, Ying-Cheng]Arizona State Univ, Dept Phys, Sch Elect Comp & Energy Engn, Tempe, AZ 85287 USA

Reprint Author's Address:

  • Xi An Jiao Tong Univ, Key Lab Biomed Informat Engn, Minist Educ,Sch Life Sci & Technol, Key Lab Neuroinformat & Rehabil Engn,Minist Civil, Xian 710049, Shaanxi, Peoples R China.; Huang, ZG (reprint author), Xi An Jiao Tong Univ, Sch Life Sci & Technol, Inst Hlth & Rehabil Sci, Xian 710049, Shaanxi, Peoples R China.

Show more details

Related Keywords:

Related Article:

Source :

PHYSICAL REVIEW E

ISSN: 2470-0045

Year: 2019

Issue: 3

Volume: 99

2 . 2 9 6

JCR@2019

2 . 5 2 9

JCR@2020

ESI Discipline: PHYSICS;

ESI HC Threshold:79

JCR Journal Grade:2

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 4

SCOPUS Cited Count: 5

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

FAQ| About| Online/Total:347/168337357
Address:XI'AN JIAOTONG UNIVERSITY LIBRARY(No.28, Xianning West Road, Xi'an, Shaanxi Post Code:710049) Contact Us:029-82667865
Copyright:XI'AN JIAOTONG UNIVERSITY LIBRARY Technical Support:Beijing Aegean Software Co., Ltd.