Month: June 2023

Deep Reinforcement Meta-Learning and Self-Organization in Complex Systems: Applications to Traffic Signal Control

Marcin Korecki

Entropy 2023, 25(7), 982

We studied the ability of deep reinforcement learning and self-organizing approaches to adapt to dynamic complex systems, using the applied example of traffic signal control in a simulated urban environment. We highlight the general limitations of deep learning for control in complex systems, even when employing state-of-the-art meta-learning methods, and contrast it with self-organization-based methods. Accordingly, we argue that complex systems are a good and challenging study environment for developing and improving meta-learning approaches. At the same time, we point to the importance of baselines to which meta-learning methods can be compared and present a self-organizing analytic traffic signal control that outperforms state-of-the-art meta-learning in some scenarios. We also show that meta-learning methods outperform classical learning methods in our simulated environment (around 1.5–2× improvement, in most scenarios). Our conclusions are that, in order to develop effective meta-learning methods that are able to adapt to a variety of conditions, it is necessary to test them in demanding, complex settings (such as, for example, urban traffic control) and compare them against established methods.

Read the full article at: www.mdpi.com

Programmable self-organization of heterogeneous microrobot collectives

Steven Ceron, Gaurav Gardi, Kirstin Petersen, and Metin Sitti

PNAS 120 (24) e2221913120

Microscale collectives composed of simple, locally reactive constituents can harness the effects of self-organization to enable diverse global behaviors. While phase separation of homogeneous collectives is well studied, heterogeneous collectives are relatively unexplored. This study focuses on a collective of magnetic microdisks of different sizes and examines how the group can self-organize into homogeneous subgroups using an external magnetic field. We find that heterogeneity enables collective behaviors including morphology reconfiguration, organized aggregation, dispersion, and locomotion, and caging and expulsion of external objects. Our work furthers insights into self-organization of heterogeneous microrobot collectives and may provide useful insights into the future of active matter.

Read the full article at: www.pnas.org

Multi pathways temporal distance unravels the hidden geometry of network-driven processes

Sebastiano Bontorin & Manlio De Domenico 
Communications Physics volume 6, Article number: 129 (2023)

Network-based interactions allow one to model many technological and natural systems, where understanding information flow between nodes is important to predict their functioning. The complex interplay between network connectivity and dynamics can be captured by scaling laws overcoming the paradigm of information spread being solely dependent on network structure. Here, we capitalize on this paradigm to identify the relevant paths for perturbation propagation. We introduce a multi-pathways temporal distance between nodes that overcomes the limitation of focussing only on the shortest path. This metric predicts the latent geometry induced by the dynamics in which the signal propagation resembles the traveling wave solution of reaction-diffusion systems. We validate the framework on a set of synthetic dynamical models, showing that it outperforms existing approaches in predicting arrival times. On a set of empirical contact-based social systems, we show that it can be reliably used also for models of infectious diseases spread – such as the Susceptible-Infected-Susceptible – with remarkable accuracy in predicting the observed timing of infections. Our framework naturally encodes the concerted behavior of the ensemble of paths connecting two nodes in conveying perturbations, with applications ranging from regulatory dynamics within cells to epidemic spreading in social networks.

Read the full article at: www.nature.com

Arguments for building The Circle and not The Line in Saudi Arabia

Rafael Prieto-Curiel & Dániel Kondor 
npj Urban Sustainability volume 3, Article number: 35 (2023)

Saudi Arabia plans to construct a new city, home to 9 million people. The most relevant aspect is its form, a line with a surprising length of 170 km. We analyse whether this is the best plan for a new city and some inconveniences of the prolonged urban form.

Read the full article at: www.nature.com