Spatially-invariant opinion dynamics on the circle
Giovanna Amorim1, Alessio Franci2, and Naomi Ehrich Leonard1This work was supported in part by ONR grant N00014-19-1-2556.1 G. Amorim, N.E. Leonard are with the Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, NJ 08544 USA, {giamorim, naomi}@princeton.edu2 A. Franci is with the Department of Electrical Engineering and Computer Science, University of Liege, 10 Allée de la Découverte, 4000 Liège, Belgium, and with the WEL Research Institute, Wavre, Belgium, afranci@uliege.be
Abstract
We propose a nonlinear opinion dynamics model for an agent making decisions about a continuous distribution of options in the presence of distributed input.
Inspired by perceptual decision-making, we develop the theory for options distributed on the circle, representing, e.g., the set of possible heading directions in planar robotic navigation problems.
Interactions among options are encoded through a spatially invariant kernel. We design the kernel to ensure that decision-making is robust, in the sense that only a finite subset of options can be favored over the continuum.
We prove the spatial invariance of the model linearization and use this result to prove an opinion-forming bifurcation in the model with zero input. We then use space and time frequency domain analysis of the model linearization to infer the ultra-sensitive input-output behavior of the nonlinear dynamics with input.
We illustrate our model’s versatility with a robotic navigation example in crowded spaces.
I INTRODUCTION
In perceptual decision-making, animals use sensory information to respond to their environment.
Both the sensory information and the perceptual response are spatially distributed.
For example, visual information, like object positions, is distributed both in the physical world and in its neural representation in the visual cortex [1].
Similarly, in robotics, an agent can use a distributed representation of its visual field and the objects in it to drive
decisions, e.g., to
navigate crowded spaces or track targets as in [2, 3, 4, 5].
Motivated by perceptual decision-making, we propose a distributed nonlinear opinion dynamics model for an agent making decisions about a continuous distribution of options in the presence of continuously distributed input. We study option and input spaces defined by the unit circle, representing both a one-dimensional visual field and the set of possible heading directions. Our model generalizes the nonlinear opinion dynamics (NOD) of [6, 7] by extending it from a finite set to a continuous distribution of options.
NOD has been used in a variety of applications, such as robotics and automated driving [8, 9, 10, 11, 12, 13]. These works leverage the fast-and-flexible decision-making of NOD resulting from a bifurcation in the dynamics [7].
The distributed model we present here inherits the same features as a result of a bifurcation in its infinite-dimensional dynamics. The proposed dynamics also allow for increased scalability and use in more complex applications. For instance, in an obstacle avoidance scenario as the one in [8], the representation of objects
in the distributed NOD does not require prior knowledge of the number of objects to be avoided. In the finite-dimensional NOD this prior information is, in principle, fundamental to the formulation.
Our model and the bifurcation behavior we prove is closely related to the spatiotemporal neural field models of mathematical neuroscience [14, 15, 1, 16],
which consider spatially-invariant integro-differential equations with a convolution kernel that captures excitatory and inhibitory interactions between different regions of the neural field.
Response to input is considered in [16, 17, 18] but only for specific classes of inputs.
Our approach differs from those works by using a spatiotemporal transfer function approach, which allows us to predict the response of the nonlinear model to arbitrary inputs from the response of its linearization.
For illustration, we consider a robot navigation scenario where the visual input corresponds to the locations of (possibly many) obstacle-free “gaps”. This scenario is inspired by classical empirical approaches exploring the use of neural fields for robotic navigation [2, 3, 4, 5]. Our model provides a theoretical foundation to such approaches that can be used for analysis, design, and control in more general scenarios.
Our contributions are as follows. First, we propose a nonlinear opinion dynamics model for an agent making decisions about a continuous distribution of options and in the presence of continuously distributed inputs.
Second, we prove the spatial invariance of the model linearization.
Third, we use spatial-invariance of the linearized dynamics to prove the existence of an opinion forming bifurcation for the model with zero input.
Fourth, we use space and time frequency domain analysis of the model linearization to infer the input-output behavior of the nonlinear dynamics to arbitrary inputs.
Fifth, we propose a framework for designing kernels for an application of our model to robotic navigation.
Notation and mathematical background are in Section II. We introduce the nonlinear opinion dynamics for a continuous distribution of options in Section III. We prove the spatial invariance of the model linearization in Section IV. In Section V we leverage spatial-invariance of the linearized dynamics to prove an opinion forming bifurcation in the model with zero input. In Section VI, we use spatial and time frequency analysis of the model linearization to infer the model’s input-output behavior. We propose a frequency-domain kernel design approach and illustrate the benefits of our approach for robotic navigation in Section VII. A discussion and final remarks are provided in Section VIII.
II MATHEMATICAL PRELIMINARIES
We denote the set of integer values as ,
the set of non-negative integer values as ,
the set of real numbers as , and the set of complex numbers as . The unit circle is denoted by , i.e., . For , the notation indicates the limit
with .
For a complex number , the real and imaginary parts are denoted as and , respectively. We represent the complex conjugate as , the modulus as and the argument as for .
The Hilbert space of square-integrable real functions on is denoted by . Given , their inner product is . The induced norm is .
We denote operators with capital roman letters.
Let be a linear operator.
We let the set denote the point spectrum of , if it is not empty. Each eigenvalue satisfies , where denotes the eigenfunction corresponding to .
We denote as the leading eigenvalue of , and its corresponding eigenfunction, as , the leading mode.
Definition 1 (Differential operator):
Let be a nonlinear operator. The differential of in the direction of at a point , is
provided that the limit exists. If this limit exists, then is said to be differentiable in the direction at point .
Definition 2 (Multiplication Operator):
A multiplication operator is defined by , where is in the domain of . Multiplication operators are the infinite-dimensional equivalent of diagonal matrices.
We mainly work with a special class of spatially invariant linear operators, namely, spatial convolution operators
(1)
where the convolution kernel .
Definition 5 (Spatially Invariant Linear System [19], [20]):
Consider a spatiotemporal input-output linear system. Let be the scalar-valued input and output functions at time , respectively. Let be the spatial coordinate.
A linear system of the form
(2)
is spatially invariant if the linear operators , are spatially invariant.
Let be spatiotemporal fields with spatial and time coordinates and . Suppose for all . The spatial Fourier transform maps into its spatial Fourier coefficients
(3)
where is the spatial frequency.
The spatial Fourier transform is a coordinate transformation that expresses in terms of the spatial Fourier modes , i.e., the Fourier basis on , and the Fourier coefficients . The inverse spatial Fourier transform can be used to recover from its Fourier coefficients :
(4)
Parseval’s Identity [21] ensures that .
The spatial Fourier transform operator is denoted by , and
the inverse spatial Fourier transform operator by .
The spatial Fourier transform (3) diagonalizes convolution operators [19], i.e., if is a convolution operator (1), then , where is the Fourier transform of the kernal of . Thus, is mapped by into a multiplication operator over the spatial frequency .
For linear systems of the form (2), if and are convolution operators (1),
(5)
where and are the Fourier transforms of the kernels of and , respectively. Following [19], we refer to (5) as the diagonalization of (2).
Definition 7 (Temporal Laplace Transform):
Let be a spatiotemporal field with spatial and time coordinates and , respectively. Then, the temporal Laplace transform maps into
(6)
where , whenever the integral exists.
III OPINION DYNAMICS ON THE CIRCLE
We propose a nonlinear opinion dynamics model for an agent making decisions about a continuous distribution of options on the circle.
For every option , is the opinion of the agent for option at time , where the more positive (negative) is the more the agent favors (disfavors) option . When , the agent is neutral about option .
The relationship between each option is encoded by the
Lipschitz continuous kernel . A positive (negative) value of
corresponds to excitatory (inhibitory) interactions
between the options and .
The opinion evolves according to
(7)
where is the input and is the characteristic timescale. The parameter is the attention paid to option interactions, i.e., models the agent commitment to forming strong opinions. The nonlinear nature of (7) comes from , a saturating function with , .
IV SPECTRAL ANALYSIS OF LINEARIZATION
We study the spectrum of the linearization of (7) at the neutral equilibrium , .
We first prove spatial invariance, a property that enables the linearized system to be diagonalized.
Using the diagonalization, we then compute the eigenvalues and eigenfunctions of the linearized system and prove their relationship with the Fourier coefficients of the kernel and the spatial Fourier modes.
Lemma 1 (Spatial invariance of the model linearization):
The linearization of (7) at the neutral equilibrium ,
(10)
is a spatially invariant system in the sense of Definition 2.
Proof:
Consider the expansion . Then, we can express
,
where denotes higher order terms in . As , the higher order terms vanish and we are left with (9). Note that is a spatial convolution operator, which is spatially invariant.
Then, by linearity so is . Therefore, by Definition 2, (10) is a spatially invariant system.
∎
As a consequence of Lemma 1, we can diagonalize the model linearization (10). Since (9) is a convolution operator, we use (5) to get
(11)
Lemma 2 (Eigenvalues and eigenfunctions of the linearized system):
The eigenvalues of the linearized system (10) can be computed as
(12)
for . The corresponding eigenfunctions are the spatial Fourier modes .
Proof:
The form of the eigenvalues follows directly from the diagonalization (11) of the linearized dynamics (10). The eigenfunctions are the spatial Fourier modes because they form the basis of the Fourier transformation that is used to diagonalize the system.
∎
Lemma 12 reaffirms that, because of spatial invariance, the spatial Fourier modes are the eigenfunctions of the model linearization for any kernel design, provided it is spatially-invariant. Since the Fourier coefficients of the kernel determine the eigenvalues associated with each mode, they dictate which modes dominate. More precisely, if all modes are stable, i.e., for all , spatiotemporal inputs will be predominantly amplified along the Fourier modes with largest as detailed in Section VI.
When the leading modes becomes unstable, that is, when the real part of their eigenvalues change from negative to positive through, e.g., an increase of the attention parameter , the nonlinear model (7) undergoes a bifurcation that enables robust opinion formation even in the absence of inputs. The leading Fourier modes determine the number of maxima of the stable steady-state opinion patterns emerging at the bifurcation, as detailed in the next section.
V OPINION-FORMING BIFURCATIONS
We revisit the results presented in [15], [16] for (7) with zero input.
We prove that (7) undergoes a bifurcation and compute the bifurcation point.
A local bifurcation occurs when the number and/or stability of the equilibrium solutions
changes due to one or more eigenvalues of the model linearization crossing the imaginary axis as a parameter is varied. The state and parameter value at which this occurs is the bifurcation point.
We study how opinion patterns emerge and the role of kernel and show a bistability that enables rapid formation of strong opinions.
We make the following assumption to ensure the eigenvalues of (10) are real.
Assumption 1 (Symmetric kernels):
The kernel in (7)) is symmetric, i.e. . In particular, its Fourier coefficients are real and .
Lemma 3 (Existence of a bifurcation point at the neutral equilibrium):
Consider (7).
Let Assumption 1 hold. Let , , denote the spatial frequency corresponding to the largest .
Then, system (7) undergoes a bifurcation at the neutral equilibrium and . In particular, for the neutral equilibrium is locally asymptotically stable and for the neutral equilibrium is unstable. The bifurcation branches emerging at bifurcation for are tangent to the subspace of generated by and . That is, steady-state opinion patterns along the bifurcation branches have the form for . In particular,
the number of maxima exhibited in the opinion patterns forming at bifurcation is fixed by .
Proof:
From Lemma 12, are given by (12).
We solve for .
Then, the first eigenvalue crossing occurs at with two eigenvalues crossing at .
For we have so the origin is stable. However, once , there exist at least two positive eigenvalues so the origin will be unstable. For the linearization, at the bifurcation, , , so the corresponding spatial Fourier modes belong to the stable manifold. The spatial Fourier modes and form a basis for the center manifold; hence, they determine the dominating bifurcation direction and emerging pattern of the model linearization.
∎
The bifurcation of system (7) with zero input is studied in [15], [16]. There a perturbation analysis is used to show that the spatial pattern that appears is determined by the leading modes.
There are infinitely many branches of non-zero equilibria which exhibit the same pattern with maxima up to spatial translation.
As discussed in [15][Theorem 4.1], [16][Section 4.2.1], the stability of the bifurcating branches can be computed as functions of , and . Generally, when all of the non-zero branches of equilibria that bifurcate from the origin are stable. When , all non-zero branches bifurcating at the origin are unstable; however, due to higher order terms, stable branches of non-zero equilibria exist farther away from the origin.
Fig. 1 illustrates at the equilibria as a function of the bifurcation parameter with
(13)
a shifted hyperbolic tangent with shift. Note that for and .
We see that for , there are regions below the bifurcation point for which the neutral and a non-neutral solution are both stable. This bistable region enables rapid formation of strong opinions in response to spatially distributed input, as discussed in Section VI.
The patterns of opinion formation depend on the kernel, which can be designed. Fig. 2 shows how , the spatial frequency corresponding to the largest Fourier coefficient of the kernel, determines the number of maxima exhibited in the steady-state opinion pattern of the agent for (7) with zero-input.
Spatial invariance ensures that for all initial conditions the solution converges to the same opinion pattern modulo a spatial translation (Fig. 2c).
VI
DISTRIBUTED DECISION-MAKING ON THE CIRCLE WITH TUNABLE SENSITIVITY
We reintroduce distributed inputs to the model, and use its linearization, together with spatial and temporal frequency analysis, to infer the nonlinear input-output behavior.
We make the following assumptions.
Assumption 2 (Shifted sigmoid):
We assume to ensure that a bistable region exists (see Fig. 1 for ).
Assumption 3 (Input assumptions):
Inputs for all . Furthermore, for all , is slowly varying, that is, it is Lipschitz continuous with Lispschitz constant , for in (7).
The condition implies that inputs vary much more slowly than the characteristic time constant of model (7). Hence, under Assumption 3, we can use the quasi-static input approximation and let .
For any diagonalized spatially distributed system of the form (5), if , exist, then the transfer function characterizes the input-output response in terms of the Laplace transforms of and , i.e.,
By the Final Value Theorem, if the input is constant in time and (5) is stable, then . This leads us to the following definition.
Let Assumptions 1–3 hold.
Let denote the spatial frequencies corresponding to the largest . Spatial transfer function (14) of the linearized model (10) is
(15)
In particular, for , .
Proof:
From Lemma 12 we know the eigenvalues of (11), the diagonalization of (10). So we can compute .
Then
As , .
∎
Theorem 15 implies that close to bifurcation, i.e., for , the input-output response of the linearized system is dominated by the leading spatial Fourier modes . This means that the alignment of with is the main determinant of the model response to inputs.
For the nonlinear system with , the input-output response takes place in the bistable region. If , the input is aligned with the leading modes . These modes filter input nonlinearity and amplify the input because, by Theorem 15, the direction of these modes are ultrasensitive to input. The result is a steady-state opinion pattern with maxima and , as illustrated in the top row of Fig. 3. As shown in Fig. 3a (top), the Fourier coefficients of the input for are nonzero meaning the input is aligned with . The input distribution in Fig. 3b (top) is small in magnitude (less than 0.01), while the resulting steady-state opinion pattern in Fig. 3c (top) has maximum that is greater than 1.5 in magnitude.
If , the input is unaligned with the leading modes and the steady-state opinion pattern will not exhibit large maxima. I.e., because the input does not have a component along the ultrasensitive direction, by Theorem 15 it does not get amplified, as illustrated in the bottom row of Fig. 3.
As shown in Fig. 3a (bottom), the Fourier coefficients of the input for are zero meaning the input is unaligned with .
The input distribution in Fig. 3b (bottom) is small in magnitude (less than 0.01) and the resulting steady-state opinion pattern in Fig. 3c (bottom) has no large maximum.
Our results show how even very small distributed inputs can trigger the formation of a strong opinion and whether or not this happens depends on the design of kernel . Thus, can be designed to tune response to be ultrasensitive to inputs that matter for function and robust to inputs that don’t.
VII APPLICATION TO ROBOT NAVIGATION
We illustrate the benefits of our approach to perceptual decision-making with an application of the dynamics (7) to robot spatial navigation. We consider the case of a robot
moving in a crowded space, such as an airport, where it must pass through gaps of different sizes (e.g., between people in a line) that may change over time. We assume the robot has a (visual) sensor so that it can perceive these gaps.
We specialize to a scenario where a robot finds itself trapped inside a circle of people and needs to choose and cross through a large enough gap between people.
Choosing a gap is challenging as people may be distributed unevenly around the circle, resulting in multiple gap options, only a select few of which may be suitable for the robot to cross. Also, the size of the gaps may change over time due to people moving for their own purposes or in response to the robot, e.g., people may move to make space for the robot to cross.
In Section VII-A we present a framework for designing from its Fourier coefficients to allow the robot to select a single gap.
We discuss four scenarios that demonstrate how our model can be used for fast-and-flexible decision-making in this robotic navigation problem. In Section VII-B two scenarios demonstrate the robot’s ability to choose a single gap, while in Section VII-C the two other scenarios show how the robot can quickly adapt to changes in gap sizes.
We take to represent the circular visual field for the robot. Then an option represents the angle associated to a point in the visual field.
The input is the visual observation (e.g., pixel) at angle at time . We let a point in the input distribution that reflects a gap be represented by , in blue in Fig. 4 (bottom). We assume changes in gaps occur slowly enough that Assumption 3 holds. The opinion as shown in Fig. 4 (top), captures the robot’s preference over time for one gap, where the preference corresponds to the strongest opinion (in yellow).
VII-AFourier-Based Kernel Design
We leverage the results of Theorem 15 to design kernel on that imposes the desired
opinion formation behavior in response to distributed input on . Options (angles) that are close (far) to each other should have an excitatory (inhibitory) interaction. And the opinion pattern should have a single maximum, so that the robot selects a single gap. From the results summarized in Section VI, to achieve this we design as follows and ensure that :
(16)
where is strictly decreasing, square-summable and symmetric. The strictly decreasing property ensures that while the square-summability property ensures that the inverse Fourier transform of (16) exists and that , by Parseval’s identity [21]. Symmetry is required to satisfy Assumption 1. We take so that the homogeneous state is never a solution. Examples of functions that meet this criteria include with and a Gaussian function of the form where adjusts the width of the Gaussian. For the following simulations, we take .
VII-BChoosing the Best Gap and Avoiding Deadlock
We illustrate the model’s ability to pick the best among multiple gaps and to rapidly avoid deadlock when faced with two equally suitable gaps. We assume the people in the circle are not moving.
In Fig. 4a (bottom) there are several gaps but one that is clearly wider than the others. In Fig. 4a (top), the robot forms a strong preference for the widest gap. In Fig. 4b (bottom), there are two equally wide gaps. In Fig. 4b (top), the robot forms strong opinions for one of the two widest gaps and avoids deadlock.
VII-CRobustness and Responsiveness to Change
We illustrate the model’s robustness to unimportant change and responsiveness to important change in input. We assume the people in the circle are moving. In Fig. 5 (bottom), there is initially one very wide gap and one narrow gap. However, over time, the wide gap becomes narrower, and the narrower gap becomes wider. In Fig. 5a, the decrease in size of the initially wide gap is small enough that the robot can still fit through it and thus it does not change its choice. In Fig. 5b, the decrease in size of the initially wide gap is large enough that the robot changes its choice to the other emerging gap.
VIII DISCUSSION AND FINAL REMARKS
We presented a nonlinear opinion dynamics model for an agent making decisions about a continuous distribution of options in response to distributed input on the circle. We proved spatial invariance of the model linearization and a bifurcation of the model with zero input, which yields fast and flexible decision-making. We studied the input-output behavior of the model and design of the kernel. We demonstrated key advantages of the model in robot perceptual decision-making problem. In future work we aim to generalize the analysis to a continuous distribution of agents and extend the analysis to manifolds other than , e.g. . We also aim to implement this model for perceptual decision-making in robotics where the dynamics are in a closed loop with the physical dynamics of the agent.
ACKNOWLEDGMENTS
The authors thank Prof. Anastasia Bizyaeva (Cornell University) for important input and ideas provided during the initial phase of this project. They thank Dr. Juncal Arbelaiz (Princeton University) for insights and references on spatially-invariant systems.
References
[1]
P. C. Bressloff, J. D. Cowan, M. Golubitsky, P. J. Thomas, and M. C. Wiener, “What geometric visual hallucinations tell us about the visual cortex,” Neural Comput., vol. 14, no. 3, pp. 473–491, 2002.
[2]
M. Oubbati, M. Schanz, and P. Levi, “Neural fields for behavior-based control of mobile robots,” IFAC Proc. Vol., vol. 39, no. 15, pp. 61–66, 2006.
[3]
W. Erlhagen and E. Bicho, “The dynamic neural field approach to cognitive robotics,” J. Neural Eng., vol. 3, no. 3, p. R36, jun 2006.
[4]
P. Dahm, C. Bruckhoff, and F. Joublin, “A neural field approach for robot motion control,” in SMC’98 Conf. Proc. 1998 IEEE Int. Conf. Syst., Man, Cybern., vol. 4, 1998, pp. 3460–3465.
[5]
G. Schöner, M. Dose, and C. Engels, “Dynamics of behavior: Theory and applications for autonomous robot architectures,” Robot. Auton. Syst., vol. 16, no. 2, pp. 213–245, 1995.
[6]
A. Bizyaeva, A. Franci, and N. E. Leonard, “Nonlinear opinion dynamics with tunable sensitivity,” IEEE Trans. Autom. Control, vol. 68, no. 3, pp. 1415–1430, 2023.
[7]
N. E. Leonard, A. Bizyaeva, and A. Franci, “Fast and flexible multiagent decision-making,” Annu. Rev. Control Robot. Auton. Syst., vol. 7, no. 1, 2024.
[8]
C. Cathcart, M. Santos, S. Park, and N. E. Leonard, “Proactive opinion-driven robot navigation around human movers,” in IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), 2023, pp. 4052–4058.
[9]
A. Bizyaeva, G. Amorim, M. Santos, A. Franci, and N. E. Leonard, “Switching transformations for decentralized control of opinion patterns in signed networks: Application to dynamic task allocation,” IEEE Control Syst. Lett., vol. 6, pp. 3463–3468, 2022.
[10]
G. Amorim, M. Santos, S. Park, A. Franci, and N. E. Leonard, “Threshold decision-making dynamics adaptive to physical constraints and changing environment,” in 2024 Eur. Control Conf. (ECC), 2024, pp. 1908–1913.
[11]
S. Park, A. Bizyaeva, M. Kawakatsu, A. Franci, and N. E. Leonard, “Tuning cooperative behavior in games with nonlinear opinion dynamics,” IEEE Control Syst. Lett., vol. 6, pp. 2030–2035, 2022.
[12]
H. Hu, K. Nakamura, K.-C. Hsu, N. E. Leonard, and J. F. Fisac, “Emergent coordination through game-induced nonlinear opinion dynamics,” in IEEE Conf. Decis. Control (CDC), 2023, pp. 8122–8129.
[13]
H. Hu, J. DeCastro, D. Gopinath, G. Rosman, N. E. Leonard, and J. F. Fisac, “Think deep and fast: Learning neural nonlinear opinion dynamics from inverse dynamic games for split-second interactions,” 2024, arXiv: 2406.09810.
[14]
S.-I. Amari, “Dynamics of pattern formation in lateral-inhibition type neural fields,” Biol. Cybern., vol. 27, no. 2, pp. 77–87, 1977.
[15]
R. Curtu and B. Ermentrout, “Pattern formation in a network of excitatory and inhibitory cells with adaptation,” SIAM J. App. Dyn. Syst., vol. 3, no. 3, pp. 191–231, 2004.
[16]
G. B. Ermentrout, S. E. Folias, and Z. P. Kilpatrick, “Spatiotemporal pattern formation in neural fields with linear adaptation,” in Neural Fields: Theory and Applications. Springer Berlin Heidelberg, 2014, pp. 119–151.
[17]
S. E. Folias and P. C. Bressloff, “Breathing pulses in an excitatory neural network,” SIAM J. App. Dyn. Syst., vol. 3, no. 3, pp. 378–407, 2004.
[18]
S. E. Folias, “Nonlinear analysis of breathing pulses in a synaptically coupled neural network,” SIAM J. App. Dyn. Syst., vol. 10, no. 2, pp. 744–787, 2011.
[19]
B. Bamieh, F. Paganini, and M. Dahleh, “Distributed control of spatially invariant systems,” IEEE Trans. Autom. Control, vol. 47, no. 7, pp. 1091–1107, 2002.
[20]
J. Arbelaiz, B. Bamieh, A. E. Hosoi, and A. Jadbabaie, “Optimal estimation in spatially distributed systems: how far to share measurements from?” 2024, arXiv: 2406.14781.
[21]
E. Titchmarsh, The Theory of Functions. Oxford Univ. Press, 1939.