Front. Comput. Neurosci. Frontiers in Computational Neuroscience Front. Comput. Neurosci. 1662-5188 Frontiers Media S.A. 10.3389/fncom.2017.00079 Neuroscience Original Research Homologous Basal Ganglia Network Models in Physiological and Parkinsonian Conditions Bahuguna Jyotika 1 * Tetzlaff Tom 1 Kumar Arvind 2 3 Hellgren Kotaleski Jeanette 2 Morrison Abigail 1 3 4 1Institute of Neuroscience and Medicine (INM-6), Institute for Advanced Simulation (IAS-6), JARA Brain Institute I, Jülich Research Center Jülich, Germany 2Computational Science and Technology, School of Computer Science and Communication, KTH Royal Institute of Technology Stockholm, Sweden 3Faculty of Biology, Bernstein Center Freiburg, University of Freiburg Freiburg, Germany 4Institute for Cognitive Neurosciences, Ruhr University Bochum, Germany

Edited by: James Kozloski, IBM Research (United States), United States

Reviewed by: Alekhya Mandali, Indian Institute of Technology Madras, India; Dieter Jaeger, Emory University, United States; Adam Ponzi, Okinawa Institute of Science and Technology, Japan

*Correspondence: Jyotika Bahuguna j.bahuguna@fz-juelich.de

22 08 2017 2017 11 79 30 03 2017 04 08 2017 Copyright © 2017 Bahuguna, Tetzlaff, Kumar, Hellgren Kotaleski and Morrison. 2017 Bahuguna, Tetzlaff, Kumar, Hellgren Kotaleski and Morrison

This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

The classical model of basal ganglia has been refined in recent years with discoveries of subpopulations within a nucleus and previously unknown projections. One such discovery is the presence of subpopulations of arkypallidal and prototypical neurons in external globus pallidus, which was previously considered to be a primarily homogeneous nucleus. Developing a computational model of these multiple interconnected nuclei is challenging, because the strengths of the connections are largely unknown. We therefore use a genetic algorithm to search for the unknown connectivity parameters in a firing rate model. We apply a binary cost function derived from empirical firing rate and phase relationship data for the physiological and Parkinsonian conditions. Our approach generates ensembles of over 1,000 configurations, or homologies, for each condition, with broad distributions for many of the parameter values and overlap between the two conditions. However, the resulting effective weights of connections from or to prototypical and arkypallidal neurons are consistent with the experimental data. We investigate the significance of the weight variability by manipulating the parameters individually and cumulatively, and conclude that the correlation observed between the parameters is necessary for generating the dynamics of the two conditions. We then investigate the response of the networks to a transient cortical stimulus, and demonstrate that networks classified as physiological effectively suppress activity in the internal globus pallidus, and are not susceptible to oscillations, whereas parkinsonian networks show the opposite tendency. Thus, we conclude that the rates and phase relationships observed in the globus pallidus are predictive of experimentally observed higher level dynamical features of the physiological and parkinsonian basal ganglia, and that the multiplicity of solutions generated by our method may well be indicative of a natural diversity in basal ganglia networks. We propose that our approach of generating and analyzing an ensemble of multiple solutions to an underdetermined network model provides greater confidence in its predictions than those derived from a unique solution, and that projecting such homologous networks on a lower dimensional space of sensibly chosen dynamical features gives a better chance than a purely structural analysis at understanding complex pathologies such as Parkinson's disease.

basal ganglia network models degeneracy oscillations Parkinson's disease

香京julia种子在线播放

    1. <form id=HxFbUHhlv><nobr id=HxFbUHhlv></nobr></form>
      <address id=HxFbUHhlv><nobr id=HxFbUHhlv><nobr id=HxFbUHhlv></nobr></nobr></address>

      1. Introduction

      Our understanding of the circuitry of the basal ganglia has been much refined in recent years due to the discovery of distinct sub-populations of neurons within nuclei previously assumed to be homogeneous (Gertler et al., 2008; Taverna et al., 2008; Planert et al., 2010; Mallet et al., 2012; Mastro et al., 2014) and additional projections between nuclei previously thought to be unconnected (Nadjar et al., 2006; Calabresi et al., 2014; Saunders et al., 2015). Whereas ideally we would instantly be able to incorporate these new findings into well validated computational models of the basal ganglia and determine the dynamical role of these sub-populations and projections, in practice this is not at all simple. Any attempt to model the basal ganglia rapidly runs into difficulties due to lack of knowledge, particularly with respect to the strengths of connections between nuclei. Although empirical data has been gathered on the strengths of many of the connections in the basal ganglia circuit, such as lateral inhibition in striatum (Taverna et al., 2008; Planert et al., 2010), many others remain uncertain (e.g., afferent and efferent projections of the GPe-arkypallidal neurons).

      Faced with this high degree of under-specification, modelers typically choose one of two alternatives: make simplifying assumptions on the unknown parameters, or strive for a unique or locally optimal solution by performing an extensive and computationally demanding parameter fit with respect to a cost function based on desired model dynamics. The former approach has the disadvantage that there will always be a question mark remaining over whether the simplifying assumptions underlying the specific choice of model parameters were valid. While the robustness of obtained results with respect to the parameter choice has been extensively studied in the context of single-cell (e.g., Achard and De Schutter, 2006) and small network models (e.g., Prinz et al., 2004), this has hardly been done for large-scale networks, specifically basal ganglia.

      The latter approach has the disadvantages that defining criteria tightly enough to allow a unique solution to be located does not take variability of biology into account; for example a measurement of spiking activity in a given area can vary substantially between animals and labs. Further, one can generally assume that an alternative solution would have been found, if the cost function had been defined slightly differently, with no assurances that the solutions would have been close in parameter space. Therefore even when a solution has been generated by this method, it is still unclear what other points in parameter space might have been selected by equally well motivated cost functions, or whether they might even be more representative of the system to be modeled. The existence of alternative solutions may reflect either the lack of constraints from experimental observations or the variability that is prevalent in biological systems (Gutenkunst et al., 2007), and clearly demonstrates the problems of trying to converge on a single “best” solution for a high-dimensional and substantially under-specified system.

      In this study, we propose an alternative approach for dealing with the multiple uncertainties in the basal ganglia circuit. We perform an extensive parameter search, but instead of striving for a unique solution, we embrace the uncertainty and use a genetic algorithm to generate a large ensemble of network configurations for both physiological and parkinsonian conditions. This allows us to investigate the common dynamics of the whole ensemble of configurations, thus permitting a higher degree of confidence in the results than the standard approach of generating and examining only one configuration for each condition.

      Specifically, we develop a mean field model (Section 3.1) with a structure that incorporates the recent findings on the Globus pallidus externus (GPe), indicating that it is organized into two distinct subpopulations (Mallet et al., 2008, 2012; Abdi et al., 2015). One of the subpopulations projects upstream to striatum, expresses preproenkephalin and fires in phase with cortical slow wave and beta activity in parkinsonian conditions. These neurons are termed as arkypallidal neurons or GPe tonically active (TA) neurons. The other subpopulation of neurons mostly projects downstream in basal ganglia, expresses parvalbumin and fires anti-phase with cortical slow wave and beta activity in parkinsonian conditions. These neurons are termed as prototypical or GPe tonically inactive (TI) neurons. The existence of two types of GPe neurons with distinct projection patterns and dynamics suggests that they might be parts of different functional pathways.

      As indicated above, not much is known about the effective connectivities within these subpopulations as well as between these subpopulations and rest of the basal ganglia. Whereas a search for connectivity strengths of these newly discovered GPe subpopulations that produce consistent activity has been carried out in the recent and thorough modeling study by Nevado-Holgado et al. (2014), this analysis was restricted to the GPe-STN subcircuit and considered striatal input as feedforward inhibition. Since at least one of the GPe subpopulation is known to project massively upstream to striatum, the striatum forms a rather strong recurrent loop with GPe. This recurrency is bound to affect the parameter search and hence is integral to understand the role of these sub-populations. We therefore model a larger set of the basal ganglia nuclei and include the reciprocal connections.

      Our genetic algorithm (Section 3.2) is configured to accept all network configurations that reproduce the experimentally observed network activity for either a physiological or parkinsonian condition (Mallet et al., 2008; Abdi et al., 2015). This process reveals a large number of valid configurations for both conditions, with substantial variation in the values found for the free connectivity parameters (Section 3.3). We call these valid configurations homologies or homologous networks, since for different values of effective connectivities, they result in similar dynamics. We further investigate the significance of the homologies by replacing the individual parameter values by the mean of the corresponding distribution, or alternatively shuffling parameter values between the members of an ensemble, and determining how many networks retain their original physiological or parkinsonian classification. We find that the classification of the networks is more sensitive to some parameters than others, and that shuffling values within a distribution causes more networks to become invalid, i.e., no longer fulfill the dynamic criteria for a physiological or parkinsonian network, than replacing the distribution by its mean. Moreover, if the parameters are shuffled cumulatively, the proportion of networks retaining their original classification monotonically decreases for both physiological and parkinsonian networks. We also observe that the sensitivity of parkinsonian network dynamics to manipulations of a given parameter strongly depend on how correlated that parameter is with other free parameters.

      The generation of ensembles of network configurations also enables some predictions to be made about effective connectivities within the basal ganglia. Some of them are consistent with the known data [e.g., strengthened (weakened) cortical connections to D2-MSNs (D1-MSNs) in Parkinson's disease] and some of them are novel and require experimental validation (e.g., reduced self inhibition of GPe-TI in Parkinson's disease). These predictions are discussed in more detail in the Section 4.2.

      To gain insight into the essential properties of the network configurations classified as physiological and parkinsonan, we project them onto a 2-dimensional space defined by dynamical properties of the network, namely its ability to suppress activity in the globus pallidus internus (GPi) and the network's susceptibility to oscillations in response to a square wave stimulus (Section 3.4). Although each parameter exhibits overlap in the distributions generated for the physiological and parkinsonian ensembles, this functional classification reveals distinct separation between the two ensembles.

      Our results show that these dynamical features serve as good predictors of the network classification, and indicate that the discovered homologies do not come about merely as a result of lack of constraints used for the parameter search, but reflect common non-trivial dynamic properties. We conclude that the generation of large ensembles of valid network configurations based on simple dynamical features (such as rate and phase) and investigating their collective behavior with respect to higher level features (such as oscillation) is a fruitful method for acquiring insight into under-specified neural circuits, and gives a better chance at understanding complex pathologies like Parkinson's disease, which involves alterations to multiple pathways in the basal ganglia.

      2. Materials and methods 2.1. Mean field model of the basal ganglia

      We used a Wilson-Cowan model of the mean activity of seven basal ganglia nuclei, namely, D1-MSN (D1-medium spiny neuron), D2-MSN, FSI (fast spiking interneuron), GPe-TA (globus pallidus externus—tonically active), GPe-TI (GPe-tonically inactive), STN (subthalamic nucleus) and GPi (globus pallidus internus). The dynamics of the system is given by

      τY˙=Yleak+ S (A·Y+B·λCTXrecurrent+ext. input)

      with the population-firing-rate vector

      Y(t)=[λD1(t),λD2(t),λFSI(t),λTA(t),λTI(t),λSTN(t),λGPi(t)]T

      and the sigmoidal activation function

      S(x,θ,λmax)=λmax1+e-a(x-θ).

      Here, λCTX denotes the firing rate of cortical inputs, =dYdt=[dλD1dt,dλD2dt,dλFSIdt,dλTAdt,dλTIdt,dλSTNdt,dλGPidt]T the temporal derivative of the rate vector Y(t), and T the matrix transpose. For the sake of simplicity, the time constant τ = 15 ms is kept constant for all nuclei. To test the sensitivity of the results to this choice, parameter search and simulations are also performed for τ = 1ms. This produces qualitatively similar results, but shifts the frequency of beta oscillations (peaks in spectra in Figure 6D) out of the experimentally observed range (data not shown).

      The values of θ and λmax (Table 1) were chosen in order to get realistic distributions of instantaneous firing rates under different input conditions (Supplementary Figure 2). For a specific nucleus, λmax and θ are fixed across all network configurations and for both physiological and pathological conditions. Activity is modeled assuming zero delays (i.e., instantaneous update), as this is convenient for the overall ease of analysis of the system. Moreover, oscillations in a circuit can be purely delay driven. As we are interested in the role of effective connectivities on oscillations, a choice of zero delay removes the confounding factor.

      Nucleus specific parameters for the sigmoidal activation function.

      Nucleus name θ λmax
      D1-MSN 0.1 65 (Kiyatkin and Rebec, 1999)
      D2-MSN 0.1 65 (Kiyatkin and Rebec, 1999)
      FSI 0.1 80
      GPe-TA 0.4 75
      GPe-TI 0.4 125
      STN 0.4 500 (Kita et al., 1983; Nakanishi et al., 1987)
      GPi 0.1 250 (Nakanishi et al., 1987; Hashimoto et al., 2003)

      The coupling matrices

      A=[JD1,D1JD1,D2JD1,FSIJD1,TAJD1,T100JD2,D1JD2,D2JD2,FSIJD2,TAJD2,T100000JFSI,TAJFSI,T1000JTA,D20JTA,TAJTA,T1JTA,STN00JT1,D20JT1,TAJT1,T1JT1,STN0000JSTN,TAJSTN,T100JGPi,D1000JGPi,T1JGPi,STN0]

      and

      B=[JD1,CTX,JD2,CTX,JFSI,CTX,0,0,JSTN,CTX,0]T

      denote the recurrent and input connection matrices, respectively. An element Ji,j of A or B represents the effective strength of the connection from population j to population i. The colors of the parameters in Equations (3) and (4) indicate whether a particular projection is considered as a free (red) or fixed (blue) parameter. The calculation of the fixed parameters is described in detail in Section 2.1.1. The code for this model and analysis scripts are shared in the git repository https://github.com/jyotikab/Homology_BG.git.

      2.1.1. Fixed parameters

      The effective connectivity parameters considered fixed in coupling matrix A (Ji,j in blue) are calculated from the experimental data used to tune the spiking network model presented in Lindahl et al. (2013). We did not perform a direct conversion from the parameters of the spiking model, since it is non-trivial to calculate the effective connectivities analytically from the adaptive exponential integrate and fire model used in the paper. The analytical method to calculate the effective connectivity assumes a LIF neuron, with membrane potential dynamics given by

      τmv=-v+Ri(t)

      where τm is the membrane time constant and R=τmC is the membrane resistance. The impulse response for a delta input (Ri(t) = δ(t)) can be calculated as :

      h(t)=1τme-tτmΘ(t)

      with Θ(t) = 1 for t ≥ 0 and 0 otherwise. A post synaptic current (PSC) depends on the synaptic conductance G(t), reversal potential of the synaptic connection (Erev) and potential at which the membrane is clamped, also known as the holding potential (Vhold).

      I=G(t)(Erev-Vhold)

      Assuming exponential currents with a decay constant τs

      i(t)=Ie-tτsΘ(t)

      then the postsynaptic potential can then be calculated as the convolution of neuron's impulse response and the incoming PSC

      v(t)=(i*h)(t)=RIτsτs-τm(e-tτs-e-tτm)Θ(t)

      The effective connectivity per synapse is the total area of the PSP, which can be calculated by integrating

      v̄=0dtv(t)

      In order to calculate the total effective connectivity, the integrated PSP needs to be multiplied by the number of synapses or in-degree (K) of the circuit.

      J=Kv̄

      Some experimental studies report the average integrated PSPs of a synapse, in which case the effective connectivity is calculated by simply scaling it with the in-degree as above.

      However, often connectivity strengths are reported in other units. Some studies report just the average amplitude of the PSP (Vpsp), so an integrated PSP is calculated by multiplying the PSP with synaptic time constant (assuming an exponential shape PSP) i.e.,

      J=KVpspτs

      Other studies measure post synaptic currents (Ipsc) or integrated PSCs, i.e., the total charge (Q = Ipscτs) in which case, we calculate the effective connectivity by multiplying the integrated PSCs with the input resistance R and in-degree, i.e.,

      J=KRIpscτs =KRQ

      Finally, if the experiment measures conductance instead of PSCs, the effective connectivity can be estimated by calculating the PSC for a given holding potential (Vhold) and reversal potential of the synaptic connection (Erev) as Ipsc = G(t)(ErevVhold) τs, leading to

      J=KRG(t)(Erev-Vhold)τs Estimation of <italic>J</italic><sub>GPi,D1</sub>

      The data for D1-MSNs connections to GPi were estimated from Chuhma et al. (2011). This study measures the functional connectivity between MSNs and their afferent and efferent nuclei in brain slices of bidirectional tetO-rhodopsin (BTR) mice. This is done by optogenetically stimulating either the afferent nuclei or incoming fibers from the afferent nuclei while recording IPSCs from the target nucleus. The effective connectivity is hence calculated from Equation (13) (row 1 in Table 2). This value does not need to be scaled by an in-degree since the method aimed to stimulate all incoming projections to a target cell; hence the recorded post-synaptic current is indeed the effective connectivity as perceived by the cell of the target nucleus. The value however, had to be scaled up by ten, as suggested by Chuhma et al. (2011) since only 10% of MSNs expressed ChR2 in BTR mice. This is indicated by a multiplier of “×10” for the IPSCs value in row 1 in Table 2.

      Calculation of the fixed parameters.

      No. Conn. Qij (pA.ms) Kij Ipsc (pA) Ri (MΩ) G (nS) Vhold (mV) Erev Vpsp (mV) τij (ms) v̄ (mVs) Jij (mVs)
      1 JGPi,D1 276.3 × 10 [1] 141.7 [1] 7.1 [2] −2.8
      1a JGPi,D1 25* 144 [6] 3 × 2 [6] −60 [6] −80 [6] 5.2[6] −2.2
      2 JGPi,STN 106[9] 97.3[5] 1.4 [5] 1.6 [5] 0.24
      2a JGPi,STN 900[4] 3* 97.3[5] 4.2 [4] 0.26
      3 JGPi,GPe 32 [3] 144 [6] 20 × 0.2 −60 [6] −72 [6] 2.1[6] −0.78
      4 JD1,D1 208.25*[9] 0.24 [7] 14 [8] −0.69
      4a JD1,D1 291.8*[9] 0.055 [8] −16.
      4b JD1,D1 7.3*[12] 0.055 [8] −0.4
      5 JD1,D2 386.75*[9] 0.27 [7] 11 [8] −1.15
      5a JD1,D2 303.1*[9] 0.223 [8] −67.6
      5b JD1,D2 7.6*[12] 0.223 [8] −1.7
      6 JD2,D2 497.6*[9] 0.45 [7] 13 [8] −2.9
      6a JD2,D2 510*[9] 0.117 [8] −59.67
      6b JD2,D2 12.8*[12] 0.117 [8] −1.5
      7 JD2,D1 97.3*[9] 0.33 [7] 10 [8] −0.32
      7a JD2,D1 85*[9] 0.078 [8] −6.63
      7b JD2,D1 2.14*[12] 0.078 [8] −0.16
      8a JMSN-MSN 103.8 × 10 [1] 231 [1] 13 [8] −3.35
      8b JMSN-MSN 595[9] 0.45 [7] 13 [8] −3.48
      9 JD1,FSI 27 [10] 4.5 × 0.6 [7] 8.1 [11] −0.65
      9a JD1,FSI 27 [10] 501 × 0.6 [11] 142 [11] 8.1 [11] −0.06
      10 JD2,FSI 20.3*[10] 3.1 × 0.6 [7] 7.6 [11] −0.3
      10a JD2,FSI 18.3*[10] 578 × 0.6 [11] 142 [11] 7.6 [11] −0.04

      The non-grayed rows are the values used in the model. The grayed rows are alternative methods for estimating the connection strengths using the parameters from other studies. Numbers marked with an asterisk had to be calculated, see main text for details. Data sources: [1], Chuhma et al. (2011); [2], Borgkvist et al. (2015); [3], Lindahl et al. (2013); [4], Ammari et al. (2010); [5], Nakanishi et al. (1997); [6], Connelly et al. (2010); [7], Planert et al. (2010); [8], Taverna et al. (2008); [9], Steiner and Tseng (2017); [10], Koós and Tepper (1999); [11], Gittis et al. (2010); [12], López-Huerta et al. (2013).

      The value of synaptic time constant τGPi,D1 was obtained from Borgkvist et al. (2015). Connelly et al. (2010) also measured the strength of striatonigral projection, but in paired recordings and in form of synaptic conductance. Since the striatonigral connections undergo short term facilitation, the conductance is scaled by a factor of two, as indicated by a “×2” in row 1a. If we assume an in-degree of 500 as estimated by Lindahl et al. (2013), the effective connectivity calculated using the data from Connelly et al. (2010) gives much higher values. Since Connelly et al. (2010) specifically mentioned that they were unable to measure clear unitary striatonigral connections during minimal striatal stimulation, the measured synaptic response might represent a combined effect of multiple incoming projections. With an in-degree of 25, the effective connectivity calculated is in the same range as the value from Chuhma et al. (2011) (grayed row 1a in Table 2).

      Estimation of <italic>J</italic><sub>GPi,STN</sub>

      The effective connectivity for STN projections to GPi were estimated from Nakanishi et al. (1997), who measured EPSCs in SNr during STN stimulation. An in-degree of 106 synapses was used as estimated in Steiner and Tseng (2017) and effective connectivity is calculated using Equation (12) (row 2 in Table 2). In order to further verify this value, the effective connectivity was calculated from Ammari et al. (2010), who measured synaptic strength in terms of total charge (QGPi,STN) in a completely preserved basal ganglia slice (BGS). Since this study did not measure the input resistance of GPi, the value from Nakanishi et al. (1997) was used. The effective connectivity is calculated using Equation (14) (row 2 in Table 2). However, with an in-degree of 106, the values are around 50 times larger than values calculated from Nakanishi et al. (1997). However, since Ammari et al. (2010) used a basal ganglia slice and STN was stimulated using bipolar electrodes, the synaptic strength calculated cannot be interpreted as if measured in a paired recording. If the in-degree is rescaled to 3, a value is obtained in the range of Nakanishi et al. (1997) (row 2a in Table 2).

      Estimation of <italic>J</italic><sub>GPi,GPe</sub>

      The aforementioned study by Connelly et al. (2010) also measures pallidonigral connections (JGPi,GPe) in paired recordings in terms of synaptic conductance. We used this data to calculate the effective connectivity of pallidonigral connections in a similar method to striatonigral effective connectivity (Equation 15 and row 3 in Table 2). Since this connection undergoes short term depression, it is rescaled by 0.2, where the PSP reaches a steady state after the initial short term plasticity. This is indicated as “× 0.2” in the conductance.

      Estimation of lateral inhibition in striatum (<italic>J</italic><sub>D1,D1</sub>, <italic>J</italic><sub>D1,D2</sub>, <italic>J</italic><sub>D2,D2</sub>, <italic>J</italic><sub>D2,D1</sub>)

      The striatal MSNs are classified into two groups depending on the dopamine receptor they express, i.e., D1-MSNs and D2-MSNs. Data on the synaptic strengths and connectivity is available separately for these category pairs as well as unseparated MSN pairs. The effective connectivity between D1 and D2-MSNs was calculated using data from Planert et al. (2010). The in-degree was calculated by rescaling the in-degree for unclassified MSN (KMSN = 595 synapses per MSN cell—Steiner and Tseng, 2017) by the connectvity of classified MSN pairs, e.g.,

      KD1,D1=ρD1,D1ρD1,D1+ρD1,D2KMSN

      For values of ρD1,D1 and ρD1,D2 of 0.07 and 0.13 resp. (from Planert et al., 2010), the scaled indegree (KD1,D1) for D1-D1-MSNs is 208.25. The effective connectivity of all the four connections was calculated using Equation (12) (rows 4–7 in Table 2).

      We also estimated effective connectivity for an average MSN-MSN connection from data supplied by Chuhma et al. (2011), which after scaling up by ten, gives a value of approximately −3.4 (row 8a). This value is strongly supported by effective connectivity calculated for MSN-MSN PSPs from Planert et al. (2010), resulting in approximately −3.5 (row 8b). Due to the paucity of projections from D1-MSNs and their weak synaptic strengths, it is likely that on an average a measured MSN-MSN connection is a projection from D2-MSN (either to D2-MSN or D1-MSN). This corresponds to a mean effective connectivity of −2.0 (refer to JD2,D2, JD1,D2, with means of −2.9 and −1.15). This fits well with the value estimated from Chuhma et al. (2011) and Planert et al. (2010).

      The work by Taverna et al. (2008) measures the integrated PSPs (v̄) between D1-D2MSNs, but when these values are multiplied by the in-degree, the values obtained are ten times larger than the values calculated above (row 4a, 5a, 6a, 7a). A possible explanation for this is that the analysis in Taverna et al. (2008) is limited to IPSCs with a short rise time (<1ms) that likely arise from proximal synapses. The distal synapses, as suggested by Taverna et al. (2008), might show different properties. If they were weaker, they would reduce the average measured integrated PSP for the neuron pairs, thereby yielding an effective connectivity in the correct range. Alternatively, we used the distance dependent connectivity data measured by López-Huerta et al. (2013), that suggests that in a slice of around 100μm from surface, as also used by Taverna et al. (2008), the in-degree drops to around 5–15 per MSNs. Using KMSN = 15 in Equation (16), the in-degree for D1-D1MSNs (KD1,D1) is 7.3. Recalculating the effective strengths with this in-degree, we get a good match to the values obtained by Planert et al. (2010) (rows 4b, 5b, 6b, 7b).

      Estimation of interneuronal inhibition to striatum (<italic>J</italic><sub>D1,FSI</sub>, <italic>J</italic><sub>D2,FSI</sub>)

      The fast spiking interneurons (FSIs), in spite of being only 2% in number, provide strong feedforward inhibition to the striatal MSNs. We estimated their effective inhibition to D1 and D2-MSNs using the data provided by Planert et al. (2010). The in-degree was calculated by scaling the average in-degree of unclassified MSNs, which is 4-27 FSI neurons per MSN (Koós and Tepper, 1999). Since Planert et al. (2010) report that FSIs preferentially inhibit D1-MSNs, we assume that the in-degree to D1-MSNs (KD1,FSI) is 27, with the in-degree to D2-MSNs being scaled accordingly

      KD2,FSI=ρD2,FSIρD1,FSIKMSN-FSI

      With the values of ρD2,FSI = 0.89, ρD1,FSI = 0.67 and KMSN-FSI = 27, the rescaled of KD2,FSI is estimated as 20.3.

      The short term depression in FSI synapses to MSN is indicated by a factor of “×0.6” in the Vpsp column. The calculated effective connectivities are listed in rows 9 and 10 of Table 2. The synaptic time constants were taken from an another study (Gittis et al., 2010), that concurs with the finding of Planert et al. (2010) that FSIs inhibit D1-MSNs more than D2-MSNs. They measure the synaptic strengths in terms of post-synaptic currents, which are used to calculate the effective connectivities as shown in the table (rows 9a and 10a). Although these values preserve the qualitative relationship of effective inhibition to D1 and D2-MSNs (i.e., JD1,FSI > JD2,FSI), they are ten times smaller than those estimated from the data of Planert et al. (2010) (rows 9a and 10a). This maybe because of large variance in inhibition from FSIs to MSNs as observed by both studies [Planert et al. (2010): 4.8 mV±4.9, 3.1 mV±4.1 ; Gittis et al. (2010): 501pA±760, 578pA±834]. We chose to use the values from Planert et al. (2010), because we use the values from this study to estimate the other four striatal corrections (see Section 2.1.1).

      2.2. Effective connectivity parameter search

      We used a genetic algorithm to find valid network configurations that reproduce experimental observed phase and activity relationships in physiological and Parkinsonian conditions. The pseudocode is given in Algorithm 1.

      Pseudocode of the genetic algorithm generating network configurations.

      The crossover number X (number of elements among the 20 free parameters to be swapped) and the random mutation probability Y (probability of a random mutation) were tuned in order to cover a reasonable amount of parameter space in a time span of 3 days (≈3,000 iterations). A value of X = 2 and Y = 0.1 gave the best results (data not shown). The range for all the negative parameters was (0, −6.) and positive parameters was (0, 13). In the case of a random mutation, the new value was drawn from the corresponding positive or negative uniform distribution. The parameter search was run for three different seeds to ensure that the results didn't depend on the initial conditions. The distributions are shown in Supplementary Figure 1.

      The cost function used in the parameter search is binary rather than real-valued. We derive a series of phase and activity relationships based on experimental findings on the response of the GPe-nuclei (arkypallidal and prototypical) to cortical slow wave activity (SWA) and beta activation (Beta) (Mallet et al., 2008; Abdi et al., 2015). The SWA was recorded under the influence of anesthesia, whereas the cortical activity showed beta activation during hindpaw stimulation of the animal. For each candidate network configuration, we set λCTX in Equation (1) to provide SWA and beta stimulus as defined in Table 3. We then test whether the network's activity fulfills the relationships set out in Table 4. If it fulfills all the criteria in the left column, the network configuration is considered a valid example of a physiological network. If it fulfills all the criteria in the right column, it is considered a valid example of a parkinsonian network. If neither, than the configuration is discarded (see Algorithm 1).

      Cortical input parameters.

      Input type Frequency (Hz) Amplitude
      SWA (Slow wave activity) 2 2.0 (Ballion et al., 2008; Nevado-Holgado et al., 2014)
      Beta (Beta Activation) 20 2.5 (Mallet et al., 2005; Nevado-Holgado et al., 2014)

      Criteria for classifying physiological and parkinsonian activities as shown in Mallet et al. (2008) and Abdi et al. (2015).

      No. Property Physiological Parkinsonian
      (1) λTI(SWA) [9.5, 45] spikes/s [19, 35] spikes/s
      (2) λTI(Beta) [12,50] spikes/s [7,19] spikes/s
      (3) λTA(Beta) [5,25] spikes/s [7,15] spikes/s
      (4) λTA(SWA) [0,5] spikes/s [1,6] spikes/s
      (5) λGPeTATI λGPe(SWA) < λGPe(Beta) λGPe(SWA) > λGPe(Beta)
      (6) Corr(λSTN(SWA)CTX(SWA)) >0 >0
      (7) FF(λTA(SWA)) <1 >1
      (8) Corr(λTA(SWA)STN(SWA)) >0
      (9) FF(λTI(SWA)) <1 >1
      (10) Corr(λTI(SWA)STN(SWA)) <0

      Square brackets represent ranges of firing rates.

      The (Pearson's) cross-correlation coefficients Corr(λxy) in Table 4 are used to test phase relationships between the activities of the nuclei x and y. A positive cross-correlation between the activities of STN (λSTN) and GPe-TA (λTA), for example, imply an in-phase relationship. Although cross-correlation is not a direct test for phase relationship, it is sufficient in this case since the input is sinusoidal. The phase differences between λTA/TI and λSTN in Figures 2C,D are calculated from the Fourier transformed signals (using Fast Fourier Transform of the NumPy library) at stimulus frequency. For physiological networks, the experimental data suggests that GPe-TA and GPe-TI are largely non-modulated by the cortical activity (Mallet et al., 2008). This was imposed by selecting the networks with low Fano factor

      FF=Var(λTA/TI)Mean(λTA/TI)

      for the GPe-TA and GPe-TI activity. Here, Var(·) and Mean(·) correspond to the variance across time and the time average, respectively. For parkinsonian conditions, the experimental data shows that λTA and λTI are strongly modulated by cortical activity which is reflected in a significant (positive/negative) cross-correlation and large Fano factors.

      2.3. GPi suppression and susceptibility to oscillations

      GPi suppression (GS) measures the ability of the network dynamics to effectively suppress the GPi activity and is defined as the ratio of the change in average GPi activity after the stimulus onset t* to the activity before stimulus onset, i.e.,

      GS=λGPi(t)[t*-Δ1,t*]-λGPi(t)[t*,t*+Δ2]λGPi(t)[t*-Δ1,t*]

      where Δ1 = Δ2 = 500 ms.

      Susceptibility to oscillations (SO) denotes the tendency of the system to oscillate under a transient stimulus (here a square wave). It is calculated as one minus the mean spectral energy, i.e.,

      SO=1-SE SE=SEii   SEi=-ω|Λi(ω)|·loge|Λi(ω)|logeN(ω) Λi(ω)=𝔉(λi(t))(ω)

      where i ∈ {GPi, GPe-TA, STN, GPe-TI} and SEi denotes the spectral entropy for the amplitude spectrum Λi(ω) of nucleus i, calculated as the Fourier transform of the activity, λi.

      We measure these dynamical properties of the system following a perturbation with a single square pulse of amplitude 4 spikes/s. Analogous results were obtained for amplitudes in the range 1–8 spikes/s (data not shown). Note that the square pulse input contains components in all frequency bands and is therefore an appropriate test stimulus for susceptibility to oscillations.

      2.4. Manipulations of parameter distributions

      The distributions of values generated for the free effective connectivity parameters are manipulated in two ways, “replace by mean” and “shuffle.” The manipulations are carried out either individually (one parameter at a time, restoring the original values of a parameter after each manipulation) or cumulatively (manipulating each parameter in succession, without restoring the original values of previously considered parameters).

      2.4.1. Replace by mean

      For a given connection Jxy, the specific value of that connection in all network configurations is replaced by the mean of that connection taken across all network configurations in that ensemble, i.e.,

      Jxy=1Mi=1MJxyi

      where M = 1, 214 for the physiological ensemble and 1, 265 for the parkinsonian ensemble.

      2.4.2. Shuffle

      For a given connection Jxy, the specific values of that connection are randomly permutated between all members of the corresponding ensemble. This procedure was repeated for ten independent permutations.

      2.5. Simulation and data analysis tools

      All network simulations and the genetic algorithm are implemented in Python (http://www.python.org). Results were analyzed using SciPy and NumPy libraries and visualizations were carried out using Matplotlib (Hunter, 2007).

      3. Results 3.1. Firing rate model of the basal ganglia

      We developed a firing rate model of the basal ganglia consisting of seven neuronal populations, namely, D1-MSN(D1-medium spiny neuron), D2-MSN, FSI (fast spiking interneuron), GPe-TA (globus pallidus externus - tonically active, or arkypallidal), GPe-TI (GPe-tonically inactive, or prototypical), STN (subthalamic nucleus) and GPi (globus pallidus internus) as shown in Figure 1. These nuclei were chosen with the purpose of modeling a minimal basal ganglia circuit implementing the three main functional pathways, i.e., the direct pathway (D1 → GPi), the indirect pathway (D2 → GPe → GPi) and the hyperdirect pathway (STN → GPi). For the sake of simplicity, we limit our analysis to the basal ganglia dynamics and its output. Consequently, other connected nuclei such as thalamus are not represented, and cortex is modeled as a feedforward excitatory input. Consistent with the recent experimental findings (Mallet et al., 2012; Abdi et al., 2015) we modeled GPe as a network of two subpopulations. These subpopulations are distinct in terms of their response to cortical activity and may be part of different functional pathways. Since the strengths of the majority of the projections emanating from and projecting to GPe-TA and GPe-TI are unknown, they are considered to be free parameters (marked as red dashed lines in Figure 1). These include projections to striatum (D2-MSNs, D1-MSNs and FSIs), projections from D2-MSNs to GPe and recurrent projections between GPe and STN. Although it has been suggested that GPe-TA populations (arkypallidal) projects upstream to striatum much more than GPe-TI population (prototypical), here both are included as free parameters in order to include the possibility of few but strong projections from prototypical neurons to striatum. Similarly, the projections from both arkypallidal and prototypical neurons to STN are considered, even though it is assumed that the prototypical population projects downstream. All the cortical projections, i.e., to the striatum as well as to STN are also considered as free parameters, since their relative effective strengths are also unknown. The model dynamics and structure, and the estimation of the fixed connectivity parameters (blue solid lines in Figure 1), are defined in Section 2.1 in Materials and Methods.

      Network schematic for mean field model of basal ganglia. Connectivity strengths that can be estimated from experimental data are are fixed in this study shown as blue solid lines. The strengths of red dashed projections are considered to be free parameters in the model.

      3.2. An ensemble of network model configurations

      The firing rate model described in Sections 2.1 and 3.1 and is incompletely specified due to the large number of unknown connectivity strengths. To address this issue, rather than making assumptions to specify these, we generate a large ensemble of model configurations by performing a parameter search across the 20 free parameters (see matrices A and B in Section 2.1). A genetic algorithm is used to find configurations of the free parameters shown in Figure 1 that conform to a series of criteria based on their activity and phase relationships (see Table 4 in Materials and Methods). A configuration is considered valid if the firing activity and phase relationships of arkypallidal and prototypical GPe subpopulations fit the experimental observations made for healthy and 6OHDA-lesioned rats (i.e., modeling Parkinson's disease) presented in Abdi et al. (2015) and Mallet et al. (2008).

      The method is described in Section 2.2 and resulted in 1,214 network configurations classified as “physiological” and 1,265 classified as “parkinsonian.” The corresponding activity and phase relationships are shown in Figure 2 (c.f. Figures 6 and 10 in Abdi et al., 2015). In the physiological condition, the beta activation in cortex tends to increase the average activity in both arkypallidal and prototypical subpopulations (Figure 2A) and both populations mostly fire in-phase with the STN and cortical activity (Figure 2B). In the parkinsonian condition, however, beta activation has an opposite effect on the subpopulations. The activity in prototypical neurons decreases, whereas the activity in arkypallidal neurons increases, when the cortical activity switches from SWA (slow wave activity) to beta activation (Figure 2C). The subpopulations also differ in their phase relationship with STN activity in the parkinsonian condition, with arkypallidal neurons firing in-phase and prototypical neurons firing anti-phase with STN activity (Figure 2D).

      Mean firing rates (A,B) and phase difference with respect to STN activity (C,D) for prototypical neurons (GPe-TI; green) and arkypallidal neurons (GPe-TA; cyan) during slow-wave (SWA) and beta activity (Beta). Left column: physiological condition. Right column: parkinsonian condition. Each line (symbol) corresponds to one network configuration resulting from the genetic algorithm. For visual clarity, only 25% of network configurations are shown. Compare results to Figures 6–10 in Abdi et al. (2015).

      It should be noted that every data point in Figures 2A,C indicates the activity of the arkypallidal and prototypical populations in one example network (i.e., one valid parameter configuration that fits the criteria). In contrast, each data point shown in Figures 6 and 10 in Abdi et al. (2015) corresponds to a different recorded neuron. Since this experimental data was gathered from many animals (20 healthy and 16 6OHDA-lesioned), these neurons may well belong to different homologous networks. It is also noteworthy that the model results are consistent with experimental results even in an aspect not used as a validity criterion (Table 4), namely that the phase differences in physiological networks show a wider distribution (with a peak ≈ 0°, but some points showing a phase difference of 270° or 180°), as compared to the narrow distribution of phase differences in parkinsonian networks (with peak ≈ 180° for prototypical and peak ≈ 0° for arkypallidal neurons). This might be due to relatively looser constraints on the phase difference in the heathy condition, where only weak modulation of arkypallidal and prototypical neurons by cortical activity is required (see Section 2.2).

      Figure 3 shows the response of the seven neuronal populations in the model to slow wave and beta activity in the cortex. The activity is shown for four randomly selected networks from both the physiological and parkinsonian classes. In the physiological condition (Figures 3A,C), both GPe-TA and GPe-TI show less modulation by cortical activity than in parkinsonian networks (Figures 3B,D), in which the opposite phase relationships between STN-arkypallidal (GPe-TA) and STN-prototypical (GPe-TI) can clearly be seen. Moreover, the parkinsonian networks exhibit an increase in GPi activity when cortical activity is high, whereas GPi mostly shows a decrease in its activity during high cortical activity in physiological networks, suggesting an anti-phase relationship between GPi and cortex (CTX). The parkinsonian networks also show a high frequency oscillation over the imposed slow wave activity unlike the physiological networks (Figures 3A,B), indicating an overall higher susceptibility to oscillations.

      Nucleus specific response to cortical stimulation. Left column: physiological condition, right column: parkinsonian condition. (A,B) Activity in the seven modeled nuclei in response to cortical slow wave activity (black curve) for four randomly selected networks. (C,D) As in (A,B) but for cortical beta activity.

      Table 5 gives the medians and quartiles of the effective connectivities generated for the physiological and parkinsonian ensembles. Although relationships between effective connectivities did not form part of the classification criteria, there is a good fit between many of the structural relationships observed in the generated ensembles and experimentally observed data. Some of the matches to well explored structural relationships include:

      Corticostriatal projections to D1-MSNs are stronger than those to D2-MSNs in physiological networks, but the situation reverses in parkinsonian networks. This is in agreement with the general trend for Parkinson's disease, i.e., the indirect pathway becomes stronger than the direct pathway due to dopamine depletion (Flores-Barrera, 2010; Escande et al., 2016)

      (physiological: JD1,CTX = 7.8, JD2,CTX = 2.6; parkinsonian: JD1,CTX = 2.7, JD2,CTX = 9.7)

      Corticosubthalmic projections are weaker in parkinsonian networks. Although the hyperdirect pathway is known to strengthen in Parkinson's disease, corticosubthalamic projections are shown to break down, characterized by loss of vGluT1-positive terminals in STN of parkinsonian monkeys (Villalba et al., 2015) as also shown by our results. In rodent models, although there is no direct evidence for this prediction, it is corroborated by the observation that optogenetic stimulation of corticosubthalamic projections ameliorate bradykinesia and akinesia in 6-OHDA lesioned mice (Sanders and Jaeger, 2016)

      (physiological: JSTN,CTX = 3.8, parkinsonian: JSTN,CTX = 0.83)

      Medians and quartiles (25%, 75%) of the effective weight distributions for physiological and parkinsonian networks (cf. Figure 4A).

      Connection Physiological Parkinsonian
      JD1,TA −0.83 (−0.18, −1.5) −0.93 (−0.08, −2.0)
      JD1,TI −0.3 (−0.0, −0.79) −0.18 (−0.0, −0.61)
      JD2,TA −1.2 (−0.4, −2.1) −1.4 (−0.61, −2.3)
      JD2,TI −0.2 (−0.0, −0.76) −0.6 (−0.16, −1.1)
      JFSI,TA −0.23 (−0.0, −0.8) −0.23 (−0.0, −0.81)
      JFSI,TI −0.82 (−0.0, −1.75) −1.0 (−0.04, −2.1)
      JTA,D2 −0.4 (−0.0, −1.0) −2.1 (−1.2, −4.3)
      JTI,D2 −0.45 (−0.0, −1.0) −1.6 (−1.2, −2.62)
      JTA,TA −0.6 (−0.0, −1.65) −1.2 (−0.17, −2.2)
      JTA,TI −0.9 (−0.22, −1.6) −0.5 (−0.0, −1.3)
      JTI,TA −0.27 (−0.0, −0.8) −0.25 (−0.0, −0.71)
      JTI,TI −0.64 (−0.15, −1.2) −0.03 (−0.0, −0.14)
      JSTN,TA −0.75 (−0.0, −1.41) −0.4 (−0.0, −0.81)
      JSTN,TI −2.0 (−1.2, −2.8) −1.2 (−0.54, −1.9)
      JTI,STN 0.92 (0.0, 1.97) 0.2 (0.0, 0.6)
      JTA,STN 1.7 (0.7, 2.6) 1.4 (0.5, 2.3)
      JD1,CTX 7.8 (0.4, 13.4) 2.7 (0.0, 7.4)
      JD2,CTX 2.6 (0.0, 10.6) 9.7 (7.3, 12.0)
      JFSI,CTX 1.9 (0.0, 6.4) 8.9 (4.4, 13.2)
      JSTN,CTX 3.8 (1.5, 6.4) 0.83 (0.0, 2.6)

      Our results also predict that cortical projections to FSIs are stronger in parkinsonian networks (physiological: JFSI,CTX = 1.9, parkinsonian: JFSI,CTX = 8.9). This prediction, however, is in contradiction with the studies like Wiltschko et al. (2010), Clarke and Adermark (2015) which show that dopamine agonists increase FSI activity due to presence of D1 like D5 receptors.

      Experimental data on the effective strengths of projections emanating from and projecting to GPe-TA-TI has been largely missing, until recently. In one such study, Glajch et al. (2016) measured IPSCs in ex vivo slices from two types of GPe neurons, one expressing NPas1+ and other expressing PV+. Neurons expressing NPas1+ correspond to arkypallidal (GPe-TA) neurons and those expressing PV+ correspond to prototypical (GPe-TI) neurons, as also shown by Abdi et al. (2015). It turns out that several relationships between the effective strengths of GPe-TA-TI connections in physiological and parkinsonian conditions observed by Glajch et al. (2016) can also be found in our generated ensembles:

      The projections from GPe-TA to D2-MSNs are stronger than those to D1-MSNs. Moreover, both of these projections are stronger in in 6-OHDA conditions

      (physiological: JD2,TA = −1.2, JD1,TA = −0.83; parkinsonian: JD2,TA = −1.4, JD1,TA = −0.93).

      The projections from GPe-TA population to striatal MSNs (see above) are stronger than the corresponding projections from GPe-TI population; this is also consistent with the observations in Mallet et al. (2012) and Abdi et al. (2015).

      (physiological: JD2,TI = −0.2, JD1,TI = −0.3; parkinsonian: JD2,TI = −0.6, JD1,TI = −0.18).

      GPe-TI projections to D2-MSNs increased in parkinsonian conditions

      (physiological: JD2,TI = −0.2; parkinsonian: JD2,TI = −0.6)

      GPe-TI projects more strongly to FSIs than GPe-TA

      (physiological: JFSI,TI = −0.82, JFSI,TA = −0.23; parkinsonian: JFSI,TI = −1.0, JFSI,TA = −0.23)

      GPe-TI projects more strongly to STN than GPe-TA in naive mice; this is also consistent with the observations in Mallet et al. (2012) and Abdi et al. (2015) that GPe-TI mostly projects to downstream nuclei in basal ganglia.

      (physiological: JSTN,TI = −2.0, JSTN,TA = −0.75).

      Only one prediction is in contradiction with Glajch et al. (2016), which predicts that GPe-TI projections to D1-MSNs remain unchanged when measured in naive and 6-OHDA lesioned mice, whereas our distributions show a slight decrease in GPe-TI projections to D1-MSNs in parkinsonian conditions (JD1,TI = −0.18) as compared to physiological conditions (JD1,TI = −0.3). Predictions of the relationships that go beyond current experimental observations are listed and discussed in Section 4.2. In total, the good fit of the generated structural relationships in our network ensembles to experimentally observed relationships from a variety of sources allow us to conclude that these structural relationships are crucial to evoke the different dynamics in the physiological and parkinsonian conditions.

      3.3. Variability and correlations in the effective connectivities for physiological and parkinsonian networks

      The effective connection strengths generated by the genetic algorithm show a considerable variation across the ensemble of 1,214 physiological and 1,265 parkinsonian network configurations, respectively (Figure 4A and Table 5). Whereas some parameters have a narrow distribution (e.g., JD1,TI for both categories, JTI,TI and JTI,STN for parkinsonian networks), others are broadly distributed (e.g., JTA,D2 for parkinsonian networks, JD1,CTX and JFSI,CTX for both categories). Moreover, pairs of effective connection strengths are typically correlated (Figures 4B,C). Both in physiological and parkinsonian networks, a number of effective-weight pairs are positively correlated (e.g., {JD1,TA, JD1,TI}, {JFSI,TA, JFSI,TI}, {JTA,STN, JTI,STN},{JD1,CTX, JD2,CTX}), others exhibit negative correlations (e.g., {JTA,TI, JTA,TA}, {JTI,TA, JTI,TI},{JTI,TA, JTI,STN}). For most connection pairs, the magnitude of correlations is slightly smaller in parkinsonian networks. Exceptions are, for example, strong positive correlations for {JTI,TI, JD2,TI} and {JTI,TI, JD2,TA} pairs in parkinsonian networks, which are not observed in the physiological case. Further, {JTI,STN, JTI,D2} and {JTI,STN, JTI,TA} pairs are more negatively correlated in parkinsonian networks as compared to the physiological case.

      Variability of parameters for parkinsonian and physiological network configurations. (A) Distributions of values generated by the genetic algorithm for each of the free parameters displayed as box plots for physiological (yellow) and parkinsonian (red) networks. The black lines within the box plots represent the median values, whereas the box caps represent the 25% (Q1) and 75% (Q3) quartiles of the distributions. The whiskers represents the margin: (Q1–1.5×IQR, Q3+1.5×IQR), where IQR = Q1 − Q3. Outliers to the margins are represented by “+” markers. The values of the medians and quartiles are listed in Table 5. (B) Correlation coeffiecients between the free parameters for physiological networks (C) As in (B) but for parkinsonian networks.

      For some projections, the difference between the physiological and parkinsonian distributions is striking, for example the much reduced cortical projection strength to D1-MSNs JD1,CTX. The distributions of other connections, e.g., inhibition from GPe-TA to GPe-TI, JTI,TA, are more similar.

      To evaluate the functional significance of the observed variability and covariability in the effective connectivity, we test whether the classification of networks into “physiological” and “parkinsonian” networks according to the criteria described in Table 4 is robust with respect to (i) replacing effective connection weights by the mean for that connection across the ensemble (Figure 5A, top row), or (ii) shuffling the weights across network configurations in the same ensemble (Figure 5A, bottom row). The classification robustness is defined as the fraction of networks that retain their original classification after a given manipulation. The two manipulations are described in further detail in Section 2.4.

      Robustness of network classification for physiological (yellow) and parkinsonian (red) networks with respect to manipulation of the parameters. (A) Classification robustness, i.e., fraction of networks that retain (solid bars) or lose (hatched bars) their respective classification under manipulation of each free parameter. Top row: parameter value is replaced by the mean of the corresponding distribution (replace by mean). Bottom row: parameter values are randomly shuffled within the ensembles of network configurations with the same classification (shuffle); classification robustness is averaged over ten shuffle realizations. (B) Classification robustness as a function of the number of parameters manipulated in a cumulative fashion. Circles: replace by mean. Stars: shuffle. Order of manipulations is given by decreasing order of classification robustness in (A).This order is fixed for the replace by mean manipulation (see annotations next to circles); for the shuffle manipulation (stars), the order depends on the realization of the random shuffle. Stars depict robustness averaged over ten shuffle realizations. (C) Classification robustness as a function of the mean correlation coefficient of each free parameter (from matrices shown in Figures 4B,C). A line fit shows a strong dependence with a R-value of −0.75 for parkinsonian networks and a weak dependence with R-value of −0.33 for physiological networks.

      The replace by mean manipulation tests the assumption that the distribution of a parameter is just fluctuations around a mean and is thus not important for the dynamics of the network. The shuffle manipulation allows us to investigate whether it is sufficient for the network dynamics to preserve the marginal weight distributions across network configurations. Both types of assumptions are very common in modeling studies integrating experimentally obtained parameters, and neglect correlations between the effective weights.

      For the majority of connections, replacing the weight by the corresponding ensemble average preserves the original classification for more than 50% of both physiological and parkinsonian networks. For some cases the classication robustness is very high, for instance, replacing the weight JD1,TA of the GPe-TA inhibition to D1-MSNs by the ensemble average preserves the classification of about 95% of networks. However, for a number of connections (e.g., JTI,STN), replacing the weight by the ensemble average causes a substantial fraction of networks (more than 50%) to no longer exhibit the dynamics described in Table 4 for their original classifications. Similar results are obtained by shuffling weights across the ensemble of network configurations (bottom panel in Figure 5A). Overall, the classification robustness is lower in this case.

      The above analysis is based on replacing the weight of individual connections, leaving the other connections unaltered. It is not clear whether manipulations of one parameter affect the robustness with respect to other parameters. To address this, we repeat the analysis in a cumulative fashion, i.e., performing the manipulations for each parameter in turn without resetting the values changed in the previous manipulation. The parameters are manipulated in order of decreasing classification robustness in the individual case, as shown in Figure 5A. For the replace by mean manipulation, this order is fixed, and shown as annotations to the data points (Figure 5B, solid curves). The shuffle manipulation is carried out ten times to test the robustness of the results with respect to different random weight realizations. Potentially, each of these ten realizations has a distinct classification-robustness order. The dashed curves in Figure 5B depict averages across the ensemble of ten realizations.

      With this ordering, a cumulative replacement of weights by their respective ensemble averages leads to a maximum reduction of classification robustness to about 0.3 for physiological networks and 0.5 for parkinsonian networks, although initially the physiological networks are more robust with respect to multiple manipulations. Counterintuitively, if all weights are replaced by their ensemble averages (rightmost circles in Figure 5B), the fraction of unchanged networks jumps back to 1. This suggests that the correlations observed between the parameters in Figures 4B,C are not artifactual, but are necessary for producing the dynamics of the two categories. By restricting some parameters to their means, but allowing others to maintain their distributions, some of the resulting network configurations fall outside of the volume in 20-dimensional parameter space that contains the original ensemble, and no longer exhibit the correct dynamics. As more parameters are restricted, the effect increases. However, once all parameters are set to the means of their respective distributions, the resulting network configuration is within the original volume, and thus retains the original classification. A similar effect can be seen with the shuffle manipulation, which transforms an n-dimensional ellipsoid of network configurations into an n-dimensional sphere, thus also causing many network configurations to be shifted to points outside the original volume. Here, the classification robustness decays monotonically.

      To quantify the relationship between correlation and classification robustness, in Figure 5C we plot the fraction of networks that retained their classification for each parameter against the average cross correlation coefficient between that parameter and the others, calculated from the matrices shown in Figures 4B,C. A strong dependency for parkinsonian and a weak dependency for physiological networks is evident, with a line fit yielding an R-value of −0.75 for parkinsonian and −0.33 for physiological networks.

      In total, these results demonstrate that there is a wide variability in the parameter configurations that pass the selection criteria and can reproduce the network activity shown in Figure 2. Our results show the dangers of restricting the parameter search to produce a single set of parameters, especially by taking the mean of distributions, unless this is carried out systematically for all distributions. Similarly, our results illustrate that the variability in parameter configurations cannot be boiled down to the marginal distributions of the individual parameters, due to presence of correlations between them.

      3.4. Physiological and parkinsonian networks form distinct clusters in the dynamical feature space

      In order to investigate the functional consequences of the variability of the generated solutions shown in Figures 4, 5, we evaluated the network configurations on the basis of their dynamical properties, identified from experimental observations on basal ganglia activity in physiological conditions and Parkinson's disease. It has been shown that insufficient GPi suppression is usually associated with stymied movement. For example, Boraud et al. (2000) showed that the ratio of inhibited-to-activated GPi neurons is significantly reduced during movement in a MPTP-treated monkey. In an another experiment, the delayed suppression of GPi neurons was shown to be correlated with slowing down of movement (Leblois et al., 2006). Akinesia, which is the loss or impairment of voluntary movements, is also associated with oscillations in the basal ganglia system. The akinetic symptoms of the Parkinson's patients have been shown to grow worse with an imposed low-frequency stimulation of 10–20 Hz in STN (Timmermann et al., 2004; Chen et al., 2007). A tACS (transcranial alternating stimulation) of 20 Hz in cortex leads to slowing of movements in healthy individuals (Pogosyan et al., 2009).

      Another parkinsonian symptom associated with the oscillation frequency of basal ganglia, specifically the GPe, STN, GPi and thalamus, is tremor. Electrophysiological studies have found single units oscillating at tremor frequencies in STN and pallidum (Raz et al., 2000; Levy et al., 2002) as well as oscillations of large populations in STN oscillating at 8 − 20Hz in tremor-dominant Parkinson's patients (Moran et al., 2008). These dynamical features also reflect the effect of striatal bias downstream in the basal ganglia. A lack of striatal bias toward “Go” can contribute to insufficient suppression of GPi rates. Moreover, we previously showed in a numerical study that an excess of striatal bias toward “No-Go” can initiate oscillations in the GPe-STN circuit (Kumar et al., 2011).

      We therefore evaluate the networks' responses to a transient square pulse with respect to two dynamical features, namely the effective suppression of GPi rates to a transient cortical activity (GS) and the susceptibility of basal ganglia circuit to oscillations (SO). It should be noted that this input was not used for parameter fitting in genetic algorithms to distinguish between parkinsonian and physiological networks; the response to this input is an emergent feature of the effective connectivities generated to fulfill the parkinsonian or physiological criteria given in Table 4. The GPi suppression (GS) is calculated as the normalized difference of GPi rates in presence and absence of the cortical activity, such that a value of one for GS represents efficient suppression of GPi and zero or negative values indicate ineffective suppression of GPi rates. The susceptibility to oscillations (SO) is calculated from the spectral entropy (SE). A white noise signal, for example, will show a power spectrum with no clear peak and hence high entropy, whereas for an oscillatory signal, the power will be concentrated in a certain frequency band, yielding a lower entropy. We define the susceptibility to oscillations as (1 − SE), such that values toward zero indicate low SO (high SE) and values toward one indicate high SO (low SE). A full definition of both measures and the details of the transient cortical input used as stimulation are given in Section 2.3.

      An illustration of the relationship of these measures to the activity evoked in the GPi by a transient square pulse is given for some example networks in Figures 6A,B. The physiological networks (Figure 6A) show no oscillatory activity (SO = 0.03 and SO = 0.09) with either effective (brown; GS = 1.0) or ineffective suppression of GPi activity (orange; GS = −0.93). The two examples of parkinsonian networks in Figure 6B both show an increase in the GPi activity (hence ineffective GPi suppression) during the cortical transient input (shown in black), the corresponding values for GS are therefore negative (−0.9 and −0.93). One example shows strong oscillatory activity (brown; SO = 0.93) whereas the other shows no oscillations (orange; SO = 0.03). The absence and presence of oscillatory activity in physiological and parkinsonian networks, respectively, can also be seen in the amplitude spectrum plotted in Figures 6C,D. The mean normalized spectrum (thick curves) for parkinsonian networks (Figure 6D) shows a clear peak in the beta range (15–25 Hz) for all nuclei, whereas the mean spectrum for physiological networks shows no such peak (Figure 6C).

      Dynamical features of physiological (left column) and parkinsonian networks (right column). Top row: response of the GPi to a 1s square pulse from the cortex (black). (A) Two example physiological networks (brown: GS = 1.0, SO = 0.03, orange: GS = −0.93, SO = 0.09). (B) Two example parkinsonian networks (brown: GS = −0.93, SO = 0.93, orange: GS = −0.9, SO = 0.03). (C, D) Amplitude spectrum (normalized by area) of activity in response to the transient square pulse for all nuclei in the model. Thick curves: mean across network configurations. Shaded areas: mean±standard deviation across network configurations. Frequency resolution: 1 Hz.

      The results of projecting the network configurations classified as physiological and parkinsonian onto the dynamical feature space defined by SO and GS is given as 2D histograms in Figure 7. The physiological networks displayed in Figure 7A have a mean at SO = 0.06, GS = 0.97 (indicated by a cyan marker), which indicates low susceptibility to oscillations and sufficient suppression of GPi activity. The distribution of SO values is well fit by a gamma distribution with shape parameter k = 1.48, scale parameter θ = 0.045 and a mean of 0.06. The distribution of GS values is well fit by a power law, with parameter α = 45 with a mean of 0.97. The parkinsonian networks (Figure 7B) show a mean at SO = 0.53, GS = −0.86, indicating a much higher susceptibility to oscillations and insufficient suppression of GPi activity. Unlike the physiological networks, in this case a closer look at the 1D histograms reveals distributions of values that are well fit by a triangular distribution for SO with lower limit a = 0.07, upper limit b = 1.07 and mode c = 0.3, and a uniform distribution for GS between −1.0 and −0.75 but also exhibiting a small scattering of outliers reaching up to much higher values.

      Clustering of networks in dynamical feature space. (A) 2D histogram of physiological networks projected into the feature space spanned by susceptibility to oscillations (SO) and GPi suppression (GS), mean indicated by a cyan marker. Margins give the corresponding 1D histograms, with means indicated by black dashed lines. (B) As in (A) but for parkinsonian networks.

      These results demonstrate clearly that although the physiological and parkinsonian networks generated by the genetic algorithm exhibit large variability in the 20-dimensional structural space, they cluster together in the 2-dimensional dynamical feature space and exhibit an unambiguous separation between networks classified as physiological and those classified as parkinsonian. Most of the parkinsonian networks show low GS and high SO (Figure 7B, bottom), whereas most of the physiological networks show high GS and low SO (Figure 7A, top left).

      However, there is some overlap between the physiological and parkinsonian networks (e.g., bottom left corner, SO ≈ 0.1 and GS ≈ −0.9). This could indicate that these two dynamical features are not enough to disambiguate these parkinsonian and physiological networks. However, it may also turn out that some networks are barely distinguishable even when projected onto a space of many such functional features. Such networks might be particularly useful for giving insight into the transition from physiological state to parkinsonian and vice versa.

      It should also be noted, that although the homologies were constrained based on the characteristics of GPe(TA/TI)-STN subnetwork, they show expected dynamical features that depend on the activity of the entire BG network. That is, 70% of parkinsonian networks show a GS < −0.5 and a SO > 0.35, whereas 95% of physiological networks show GS > 0.8 and SO < 0.2. This indicates that the network characteristics of the BG subcircuit (GPe-STN) such as firing rate and phase relationships as shown in Mallet et al. (2008) and Abdi et al. (2015) are predictive of the network state of the entire BG in GS-SO space.

      4. Discussion

      In this study, we used a genetic algorithm to perform a search over 20 free effective connectivity parameters, generating thousands of basal ganglia network configurations that fulfill the firing rate and phase relationships reported by Mallet et al. (2008) and Abdi et al. (2015) for physiological and parkinsonian networks. Although relationships between effective connectivity strengths were not included in our classification criteria, we observe a very good fit of many of the structural relationships exhibited by our generated ensembles of networks to experimental data. We observed that both the breadth of the distribution of the individual parameters and the degree of overlap in the distributions between physiological and parkinsonian distributions were subject to substantial variation.

      To determine whether the variance for individual parameters was simply a side effect of our method of generation, and could therefore be reduced, we replaced the distributions by their means and checked what proportion of the networks retained their physiological or parkinsonian classification (i.e., according to the criteria listed in Table 4). For most connections, replacing the weight by the corresponding ensemble average preserves the original classification for at least 50% of both physiological and parkinsonian networks. A similar effect was observed when parameter values were shuffled between members of the same ensemble.

      When the replace-by-mean manipulation was performed cumulatively, the classification robustness fell until it saturated at about 0.3 for physiological networks and 0.5 for parkinsonian networks. However, when all parameters were replaced by their means, the remaining networks retained the correct classification. Cumulative application of the shuffle manipulation resulted in a monotonic decrease in robustness. We interpret these results as indicating that the ensembles generated by the genetic algorithm give a good approximation of the 20-dimensional volume in the parameter space that produces the correct dynamics for the physiological and parkinsonian conditions. Parameter manipulation that take a network configuration out of this space tend to result in the network no longer exhibiting the corresponding dynamics. Further, these results demonstrate that the correlations between the parameters are necessary for producing the dynamics associated with the two categories. Beyond the current study, this suggests that modelers should be cautious in taking an approach in which some parameters are allowed to be heterogeneous whereas others are restricted to mean values; networks constructed in this fashion may be less representative of the target system than a more reduced, simpler model where all parameters are fixed to mean values.

      We projected the 20-dimensional space spanned by connection weights to a 2-dimensional space of dynamical features defined by the response of a network to a transient cortical pulse, namely: (1) its capacity to suppress GPi activity (GS), and (2) its susceptibility to oscillations (SO). Our results show that despite the high variability and overlap in the 20-dimensional structural space, solutions form distinct physiological and parkinsonian clusters in the dynamical space. Most of the networks classified as parkinsonian show ineffective suppression of GPi activity (low GS) and high susceptibility to oscillations (high SO). Conversely, the majority of physiological networks show effective suppression of GPi activity (high GS) and low susceptibility to oscillations (low SO). This suggests that the characteristics of the BG subcircuit (GPe-STN) as shown in Mallet et al. (2008) and Abdi et al. (2015) are predictive of the network state of the entire BG and can serve as viable biomarkers of the network state.

      It should be emphasized that the response of the network to the transient input used to measure GS and SO was not used in the parameter search, or to classify the networks as physiological or parkinsonian. The emerging dynamical features (GS and SO) are not a trivial consequence of the constraints in Table 4. For example, due to the complex recurrent interplay between all nuclei, the absence of cortical modulation of GPe in physiological conditions [constraints (7) and (9)] does not directly imply a suppression of the GPi response. Similarly, due to the constraints (6)–(10) in Table 4, one may expect an increased susceptibility of the network to SWA oscillations at 2 Hz, but not in the beta range at 20 Hz (cf. peaks in spectra in Figure 6D).

      In the rest of this sections we briefly delineate the limitations arising from our approach on interpreting our results, before discussing novel predictions of our study and the implications of the existence of the homologous networks generated by our parameter search.

      4.1. Limitations

      The model used here is a firing rate model, which is a highly simplified formulation that captures solely the evolution of the mean activity of a population. This kind of model inherently limits the insights that can be gained about the dynamics of the system, for example it can give no information about the structure of individual spike trains or higher order correlations within a population. However, it has the advantage of being computationally less expensive and with a restricted parameter space with respect to higher resolution simulation methods (e.g., spiking neuronal networks). It should be noted, that an another modeling work has described a spiking neural network model of the basal ganglia by including the GPe-TA/TI subpopulations (Lindahl and Hellgren Kotaleski, 2016). Although, the model description of the aforementioned work is more detailed (spiking neural networks) as compared to mean field models in our case, the former constrains the system to exactly one solution of effective weights. It would be interesting to check if these effective weights falls under the solution space spanned by the homologies in this work.

      In this study we considered those parameters, for which experimental data sets exist, to be fixed. However, in Section 3.3 we discovered that replacing the generated values for the free parameters with the mean of the corresponding distribution does not necessarily preserve the dynamical properties of the networks, at least in part due to correlations between the free parameters. This argument could be equally well applied to the “fixed” parameters. A better approach might be to consider the fixed parameters as free, albeit within the biological range suggested by the experimental data. We plan to incorporate this extension in the future work. This extension will enables us to address changes in effective connectivities in the fixed parameters such as increase in the inhibition from FSI to D2 (Gittis et al., 2011; Corbit et al., 2016) and decrease in striatal lateral inhibition during parkinsonian conditions (Taverna et al., 2008) which are expected to be emergent trends in the weight distributions or can be used as additional post-hoc constraints to reduce the number of homologies.

      Ideally one would choose the parameters of the activation function according to F-I curves obtained in in-vitro experiments. However, the activation function S(·) used in the model corresponds to the stationary firing rate response of an entire nucleus, rather than a single neuron. One could consider the parameters of the activation function as free parameters which are adjusted during the optimization process together with the synaptic weights. This would lead to a scenario where not only the synaptic weights but also the activation function parameters are widely distributed across network configurations. Future work can determine whether the additional insight gained by such an approach is sufficient to justify the increased computational complexity.

      The cortical input in this model is considered as a feedforward input; the feedback connections from basal ganglia to cortex such as the pallidocortical (Chen et al., 2015) and thalamocortical projections are not included. Hence, the model cannot make predictions with respect to experimental observations such as pharmacological blocking of FSIs cause large negative suppressions of cortical LFPs which are time locked to fast involuntary movements (Klaus and Plenz, 2016). Only excitatory corticostriatal projections are considered, whereas recent data shows that somatostatin interneurons in the cortex also affect the striatal MSNs (Rock et al., 2016). The framework is sufficiently flexible to allow the inclusion of other projections and nuclei, however this would inevitably lead to an increase in number of free parameters.

      The oscillations measured in our model in response to a square pulse of cortical input arise due to the change in the effective connectivities between the nuclei. However, oscillations might arise due to other causes, e.g., they may be purely delay driven. Since this model does not consider any delays, the results cannot provide any insight on the role of delays on the oscillations. Secondly, it has also been shown that the beta oscillations arise in striatum by increasing the activity of the striatal cholinergic interneurons pharmacologically (McCarthy et al., 2011). This model does not account for striatal cholinergic interneurons and make an alternative suggestion for the origin of oscillations in the absence of striatal cholinergic interneurons.

      4.2. Predictions

      In this study we collated experimental data on the strengths of connections within the basal ganglia to determine the fixed parameters of the model (see Section 2.1.1), and showed in Section 3.2 that the relationships between the distributions generated for the free effective connectivity parameters are a good match to experimental observations. On the basis of the connectivity strengths generated by our parameter search (see Table 5), we can also predict structural relationships for physiological and parkinsonian networks which are yet to be verified by experimental results:

      Striatopallidal projections are stronger in parkinsonian networks; this is consistent with the hypothesis that the indirect pathway becomes stronger in parkinsonian networks. Parkinsonian networks in our results also show a higher susceptibility to oscillations. These oscillations could initiate in the GPe-STN circuit and could be initiated by a strong indirect pathway, (i.e., a strong inhibition from striatum to GPe), as demonstrated in our recent numerical study (Kumar et al., 2011).

      (physiological: JTA,D2 = −0.4, JTI,D2 = −0.45; parkinsonian: JTA,D2 = −2.1, JTI,D2 = −1.6).

      Intrapallidal projections for GPe-TI are weaker in parkinsonian networks, but those for GPe-TA are stronger.

      (physiological: JTI,TI = −0.64, JTA,TA = −0.6; parkinsonian: JTI,TI = −0.03, JTA,TA = −1.2).

      GPe-TI-STN coupling is weaker in parkinsonian networks.

      (physiological: JSTN,TI = −2.0, JTI,STN = 0.92; parkinsonian: JSTN,TI = −1.2, JTI,STN = 0.2).

      It is also noteworthy that these predictions are not a result of one model specification, but around thousand models that meet the firing rate and phase relationships to be considered physiological or parkinsonian. Therefore, firstly, we can state these predictions more confidently than if they had emerged from a fitting to a unique model specification, and secondly, as no limits on the structural relationships were placed on the parameter search, it seems reasonable to conclude that these emergent differences in these relationships for the physiological and parkinsonian ensemble are relevant for generating the differential dynamics of the two conditions.

      We also checked these predictions under three different conditions: (a) increasing the inhibition from D2 to FSI (JD2,FSI) for parkinsonian networks; (b) keeping the projections from GPe-TA to STN (JSTN,TA) fixed and set to zero; (c) including the projections from D1-MSNs to GPe (JTA,D1, JTI,D1) as free parameters. The parameters distributions for first two conditions are largely similar to the original distributions with no or few differences as described below.

      Experimental data shows that in parkinsonian networks, the FSI increase their connection to D2-MSNs (Gittis et al., 2011; Corbit et al., 2016). We checked this condition by increasing the fixed parameter JD2,FSI given in Table 2 by a factor of 2.5 to −0.75, leaving JD1,FSI fixed at its original value of −0.65. The resulting weight distributions (Supplementary Figure 3A) are qualitatively unchanged from those shown in Figure 4A, however some subtle alterations to the correlations between parameters can be observed (compare Figures 4B,C and Supplementary Figures 3B,C).

      For ensembles generated with JSTN,TA set to zero (Supplementary Figure 4), the distributions for most parameters are qualitatively similar to the original distributions (Figure 4A), except for D2 projections to GPe-TA (JTA,D2) and cortical projections to FSIs (JFSI,CTX). The former is weaker than D2 projections to GPe-TI(JTI,D2) in both physiological and parkinsonian networks, in contrast to the results shown in Figure 4, where they are approximately equal. Moreover, the projection JFSI,CTX becomes weaker in parkinsonian than in physiological networks in contrast to the original ensembles where this finding is reversed.

      We also checked the predictions under the condition that projections from D1-MSNs to GPe (JTA,D1, JTI,D1) were also included as free parameters for the genetic algorithms. This inclusion showed significant qualitative changes in the parameter distributions (Supplementary Figure 5). Although some of the predictions are still consistent with the original distributions (Figure 4A), such as decrease in intrapallidal projections for GPe-TI (JTI,TI) in parkinsonian conditions, some predictions are at odds with the original model findings. For example, JD2,CTX in physiological networks is approximately the same as JD1,CTX, whereas in the original distributions it is weaker.

      In this work, we demonstrated that a particular limited set of features (Table 4) from the GPe-STN sub-circuit can predict dynamical characteristics (GS and SO) relevant for the behavior of the entire BG network under physiological and parkinsonian conditions. It remains to be investigated whether other feature sets have a similar predictive power and what the minimal set of predictive features is.

      To test whether the mapping from the feature set in Table 4 to the dynamical characteristics (GS and SO) is one to one (injective), we performed a new set of numerical experiments where networks were constrained by the dynamical features GS and SO rather than by the original firing rates and phase relationships. We then checked whether the firing rate and phase relationships listed in Table 4 emerged as a result. Here, a transient square pulse was used as an input signal in the genetic algorithm. All the networks that showed GS ≤ −0.7 and SO ≥ 0.45 were classified as parkinsonian networks whereas the ones that showed GS ≥ 0.85 and SO ≤ 0.2 were classified as physiological networks. Only a fraction of the resulting networks are consistent with the criteria in Table 4 (Supplementary Figure 7). Hence, we can infer the dynamical feature GS and SO from the firing rates and phase relationships of GPe-TA-TI-STN subnetwork, but not vice versa. For the networks that fulfill the criteria in Table 4, the marginal weight distributions are very similar to the ones shown in Figure 4 (Supplementary Figure 6).

      4.3. Homologous networks

      Our parameter search led to over a thousand valid solutions (in 20 dimensional space) for both the physiological and the parkinsonian classification criteria. Although this could simply be a result of lack of constraints on the model, this could also indicate the presence of homologous networks in basal ganglia, in the sense that quite different parameter combinations can give rise to essentially the same dynamics. Homology has not yet been shown to occur in basal ganglia although other neuronal networks have shown occurrences of this phenomenon. However, it seems rather likely due to the complexity of the connectivity (Prinz et al., 2004).

      What does the presence of homologous networks in our results imply? One possibility is that it is simply a consequence of the fact that we are mapping a high-dimensional parameter space (here network connections) onto a low dimensional space of network activity features (firing rates and phase relationships). Another possibility is that some parameters have only a small effect on the network activity features that we are interested in studying and can therefore be defined in a “sloppy” manner, i.e., with values are distributed over a large area in the parameter space (Gutenkunst et al., 2007). Our results show that indeed some parameters can be replaced by the mean or shuffled, whilst retaining the original classification for more than 95% of the ensemble. However, other parameters are much more sensitive to such manipulations. Thus, the existence of homologous networks could imply that that rather than absolute values of the parameters, it is their relative values that determine the dynamical state.

      This interpretation is supported by the presence of correlations between the generated connectivity values, and the greater sensitivity of the dynamical system to those parameters that exhibit stronger cross-correlations (Figures 4B,C, 5C). The presence of correlations between the free parameters is also suggested as a possible reason for the presence of multiple solutions by Achard and De Schutter (2006). We propose that the approach of generating ensembles of homologous networks and analyzing them in terms of dynamical features is advantageous, as it gives us a framework for investigating complex interacting biological systems such as the basal ganglia which exhibit variability in structural parameters either due to nature (genetic tendencies) or nurture (plasticity in response to environmental factors).

      In particular, it will enable us to examine whether the diversity shown by Parkinson's disease as a pathology is rooted in structural variability, to characterize the dynamic and structural properties of the transitions between different dynamical regimes, and uncover possible compensatory mechanisms. For example, we note that whereas the vast majority of physiological network configurations are located in a cluster characterized by effective suppression of GPi activity (high GS) and low susceptibility to oscillations (low SO), and parkinsonian networks typically display low GS and high SO, some network configurations do not fall into these clusters. Specifically, some networks classified as physiological with respect to their rates and phase relationships exhibit low GS, and some parkinsonian networks have low SO. These networks may simply be outliers, but they could also indicate the existence of transitional states between physiological and parkinsonian conditions.

      Apart from the two suggested dynamical features (GS and SO), many others could be used to decompose a parkinsonian or physiological dynamical regime into more easily understandable dynamical features. Recent work by Escande et al. (2016) shows that the activity of D1-MSNs in response to optogenetic stimulation in cortex showed a gradient decrease from sham to partially lesioned 6-OHDA (and asymptomatic animals) to heavily lesioned (symptomatic animals). Hence, the gain of D1-MSNs could be yet another dynamical feature that could used for further functional classification.

      On the basis of our results, we conclude that it may ultimately be more fruitful to study Parkinson's disease in terms of its dynamical features rather than its structural changes. Not only are dynamical features relatively low-dimensional, they also provide symptomatic targets for therapy (e.g., reduce susceptibility to oscillations) without presupposing specific underlying structures which may hold only in the mean, and not be applicable to a given patient.

      Author contributions

      Conceived and designed the experiments: JB, TT, AK, AM. Performed the experiments: JB. Contributed reagents/materials/analysis tools: AK, TT, JH, AM. Contributed to the writing of the manuscript: JB, TT, AK, JH, AM.

      Conflict of interest statement

      The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

      We thank Mikael Lindahl for sharing his model.

      Supplementary material

      The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fncom.2017.00079/full#supplementary-material

      Physiological and Parkinsonian weight distributions for three different random seeds.

      Firing rate distributions of physiological and parkinsonian homologies during cortical SWA and Beta input conditions. The histograms for each nuclei was calculated by pooling the activity (shown in Figure 3) across all parkinsonian and physiological networks.

      Parameters distributions when JD2,FSI was increased by a factor 2.5 for parkinsonian networks. (A–C) same as Figures 4A–C.

      Parameters distributions when JSTN,TA was fixed to zero. (A–C) same as Figures 4A–C.

      Parameter distributions when connections from D1 to GPe-TA/TI are included as free parameters in the genetic algorithm. (A–C) same as Figures 4A–C.

      Parameter distributions when GPi suppression (GS) and Susceptibility to oscillations (SO) are used as constraints. (A–C) same as Figures 4A–C.

      Firing rates and phase relationships for valid and invalid networks when constrained using GS and SO. Gray lines: invalid networks. Cyan lines: Valid networks for GPe-TA. Green lines: Valid networks for GPe-TI. Compare with Figure 2.

      References Abdi A. Mallet N. Mohamed F. Y. Sharott A. Dodson P. D. Nakamura K. C. . (2015). Prototypic and arkypallidal neurons in the dopamine-intact external globus pallidus. J. Neurosci. 35, 66676688. 10.1523/JNEUROSCI.4662-14.201525926446 Achard P. De Schutter E. (2006). Complex parameter landscape for a complex neuron model. PLoS Comput. Biol. 2:e94. 10.1371/journal.pcbi.002009416848639 Ammari R. Lopez C. Bioulac B. Garcia L. Hammond C. (2010). Subthalamic nucleus evokes similar long lasting glutamatergic excitations in pallidal, entopeduncular and nigral neurons in the basal ganglia slice. Neuroscience 166, 808818. 10.1016/j.neuroscience.2010.01.01120074618 Ballion B. Mallet N. Bézard E. Lanciego J. L. Gonon F. (2008). Intratelencephalic corticostriatal neurons equally excite striatonigral and striatopallidal neurons and their discharge activity is selectively reduced in experimental parkinsonism. Eur. J. Neurosci. 27, 23132321. 10.1111/j.1460-9568.2008.06192.x18445222 Boraud T. Bezard E. Bioulac B. Gross C. E. (2000). Ratio of inhibited-to-activated pallidal neurons decreases dramatically during passive limb movement in the MPTP-treated monkey. J. Neurophysiol. 83, 17601763. 10712496 Borgkvist A. Avegno E. M. Wong M. Y. Kheirbek M. A. Sonders M. S. Hen R. . (2015). Loss of striatonigral GABAergic presynaptic inhibition enables motor sensitization in Parkinsonian mice. Neuron 87, 976988. 10.1016/j.neuron.2015.08.02226335644 Calabresi P. Picconi B. Tozzi A. Ghiglieri V. Di Filippo M. (2014). Direct and indirect pathways of basal ganglia: a critical reappraisal. Nat. Neurosci. 17, 10221030. 10.1038/nn.374325065439 Chen C. C. Litvak V. Gilbertson T. Kühn A. Lu C. S. Lee S. T. . (2007). Excessive synchronization of basal ganglia neurons at 20 Hz slows movement in Parkinson's disease. Exp. Neurol. 205, 214221. 10.1016/j.expneurol.2007.01.02717335810 Chen M. C. Ferrari L. Sacchet M. D. Foland-Ross L. C. Qiu M.-H. Gotlib I. H. . (2015). Identification of a direct GABAergic pallidocortical pathway in rodents. Eur. J. Neurosci. 41, 748759. 10.1111/ejn.1282225581560 Chuhma N. Tanaka K. F. Hen R. Rayport S. (2011). Functional connectome of the striatal medium spiny neuron. J. Neurosci. 31, 11831192. 10.1523/JNEUROSCI.3833-10.201121273403 Clarke R. Adermark L. (2015). Dopaminergic regulation of striatal interneurons in reward and addiction: focus on alcohol. Neural Plast. 2015:814567. 10.1155/2015/81456726246915 Connelly W. M. Schulz J. M. Lees G. Reynolds J. N. J. (2010). Differential short-term plasticity at convergent inhibitory synapses to the substantia nigra pars reticulata. J. Neurosci. 30, 1485414861. 10.1523/JNEUROSCI.3895-10.201021048144 Corbit V. L. Whalen T. C. Zitelli K. T. Crilly S. Y. Rubin J. E. Gittis A. H. (2016). Pallidostriatal projections promote oscillations in a dopamine-depleted biophysical network model. J. Neurosci. 36, 55565571. 10.1523/JNEUROSCI.0339-16.201627194335 Escande M. V. Taravini I. R. E. Zold C. L. Belforte J. E. Murer M. G. (2016). Loss of homeostasis in the direct pathway in a mouse model of asymptomatic Parkinson's disease. J. Neurosci. 36, 56865698. 10.1523/JNEUROSCI.0492-15.201627225760 Flores-Barrera E. (2010). Different corticostriatal integration in spiny projection neurons from direct and indirect pathways. Front. Syst. Neurosci. 4:15. 10.3389/fnsys.2010.0001520589098 Gertler T. S. Chan C. S. Surmeier D. J. (2008). Dichotomous anatomical properties of adult striatal medium spiny neurons. J. Neurosci. 28, 1081410824. 10.1523/JNEUROSCI.2660-08.200818945889 Gittis A. H. Hang G. B. LaDow E. S. Shoenfeld L. R. Atallah B. V. Finkbeiner S. . (2011). Rapid target-specific remodeling of fast-spiking inhibitory circuits after loss of dopamine. Neuron 71, 858868. 10.1016/j.neuron.2011.06.03521903079 Gittis A. H. Nelson A. B. Thwin M. T. Palop J. J. Kreitzer A. C. (2010). Distinct roles of GABAergic interneurons in the regulation of striatal output pathways. J. Neurosci. 30, 22232234. 10.1523/JNEUROSCI.4870-09.201020147549 Glajch K. E. Kelver X. D. A. Hegeman D. J. Cui Q. Xenias X. H. S. Augustine E. C. . (2016). Npas1+ pallidal neurons target striatal projection neurons. J. Neurosci. 36, 54725488. 10.1523/JNEUROSCI.1720-15.201627194328 Gutenkunst R. N. Waterfall J. J. Casey F. P. Brown K. S. Myers C. R. Sethna J. P. (2007). Universally sloppy parameter sensitivities in systems biology models. PLoS Comput. Biol. 3:18711878. 10.1371/journal.pcbi.003018917922568 Hashimoto T. Elder C. M. Okun M. S. Patrick S. K. Vitek J. L. (2003). Stimulation of the subthalamic nucleus changes the firing pattern of pallidal neurons. J. Neurosci. 23, 19161923. 12629196 Hunter J. D. (2007). Matplotlib: a 2D graphics environment. Comput. Sci. Eng. 9, 9095. 10.1109/MCSE.2007.55 Kita H. Chang H. Kitai S. (1983). Pallidal inputs to subthalamus: intracellular analysis. Brain Res. 264, 255265. 10.1016/0006-8993(83)90823-56303502 Kiyatkin E. A. Rebec G. V. (1999). Striatal neuronal activity and responsiveness to dopamine and glutamate after selective blockade of D1 and D2 dopamine receptors in freely moving rats. J. Neurosci. 19, 35943609. 10212318 Klaus A. Plenz D. (2016). A low-correlation resting state of the striatum during cortical avalanches and its role in movement suppression. PLoS Biol. 14:e1002582. 10.1371/journal.pbio.100258227923040 Koós T. Tepper J. M. (1999). Inhibitory control of neostriatal projection neurons by GABAergic interneurons. Nat. Neurosci. 2, 467472. 10.1038/813810321252 Kumar A. Cardanobile S. Rotter S. Aertsen A. (2011). The role of inhibition in generating and controlling Parkinson's disease oscillations in the Basal Ganglia. Front. Syst. Neurosci. 5:86. 10.3389/fnsys.2011.0008622028684 Leblois A. Meissner W. Bezard E. Bioulac B. Gross C. E. Boraud T. (2006). Temporal and spatial alterations in GPi neuronal encoding might contribute to slow down movement in Parkinsonian monkeys. Eur. J. Neurosci. 24, 12011208. 10.1111/j.1460-9568.2006.04984.x16930445 Levy R. Hutchison W. D. Lozano A. M. Dostrovsky J. O. (2002). Synchronized neuronal discharge in the basal ganglia of parkinsonian patients is limited to oscillatory activity. J. Neurosci. 22, 28552861. 11923450 Lindahl M. Hellgren Kotaleski J. (2016). Untangling basal ganglia network dynamics and function: role of dopamine depletion and inhibition investigated in a spiking network model. eNeuro 3:ENEURO.0156-16.2016. 10.1523/ENEURO.0156-16.201628101525 Lindahl M. Kamali Sarvestani I. Ekeberg O. Kotaleski J. H. (2013). Signal enhancement in the output stage of the basal ganglia by synaptic short-term plasticity in the direct, indirect, and hyperdirect pathways. Front. Comput. Neurosci. 7:76. 10.3389/fncom.2013.0007623801960 López-Huerta V. G. Carrillo-Reid L. Galarraga E. Tapia D. Fiordelisio T. Drucker-Colin R. . (2013). The balance of striatal feedback transmission is disrupted in a model of parkinsonism. J. Neurosci. 33, 49644975. 10.1523/JNEUROSCI.4721-12.201323486967 Mallet N. Le Moine C. Charpier S. Gonon F. (2005). Feedforward inhibition of projection neurons by fast-spiking GABA interneurons in the rat striatum in vivo. J. Neurosci. 25, 38573869. 10.1523/JNEUROSCI.5027-04.200515829638 Mallet N. Micklem B. R. Henny P. Brown M. T. Williams C. Bolam J. P. . (2012). Dichotomous organization of the external globus pallidus. Neuron 74, 10751086. 10.1016/j.neuron.2012.04.02722726837 Mallet N. Pogosyan A. Márton L. F. Bolam J. P. Brown P. Magill P. J. (2008). Parkinsonian beta oscillations in the external globus pallidus and their relationship with subthalamic nucleus activity. J. Neurosci. 28, 1424514258. 10.1523/JNEUROSCI.4199-08.200819109506 Mastro K. J. Bouchard R. S. Holt H. A. K. Gittis A. H. (2014). Transgenic mouse lines subdivide external segment of the globus pallidus (GPe) neurons and reveal distinct GPe output pathways. J. Neurosci. 34, 20872099. 10.1523/JNEUROSCI.4646-13.201424501350 McCarthy M. M. Moore-Kochlacs C. Gu X. Boyden E. S. Han X. Kopell N. (2011). Striatal origin of the pathologic beta oscillations in Parkinson's disease. Proc. Natl. Acad. Sci. U.S.A. 108, 1162011625. 10.1073/pnas.110774810821697509 Moran A. Bergman H. Israel Z. Bar-Gad I. (2008). Subthalamic nucleus functional organization revealed by parkinsonian neuronal oscillations and synchrony. Brain 131, 33953409. 10.1093/brain/awn27018986993 Nadjar A. Brotchie J. M. Guigoni C. Li Q. Zhou S.-B. Wang G.-J. . (2006). Phenotype of striatofugal medium spiny neurons in parkinsonian and dyskinetic nonhuman primates: a call for a reappraisal of the functional organization of the basal ganglia. J. Neurosci. 26, 86538661. 10.1523/JNEUROSCI.2582-06.200616928853 Nakanishi H. Kita H. Kitai S. T. (1987). Intracellular study of rat substantia nigra pars reticulata neurons in an in vitro slice preparation: electrical membrane properties and response characteristics to subthalamic stimulation. Brain Res. 437, 4555. 10.1016/0006-8993(87)91525-33427482 Nakanishi H. Tamura A. Kawai K. Yamamoto K. (1997). Electrophysiological studies of rat substantia nigra neurons in an in vitro slice preparation after middle cerebral artery occlusion. Neuroscience 77, 10211028. 10.1016/S0306-4522(96)00555-69130783 Nevado-Holgado A. J. Mallet N. Magill P. J. Bogacz R. (2014). Effective connectivity of the subthalamic nucleus-globus pallidus network during Parkinsonian oscillations. J. Physiol. 592, 14291455. 10.1113/jphysiol.2013.25972124344162 Planert H. Szydlowski S. N. Hjorth J. J. J. Grillner S. Silberberg G. (2010). Dynamics of synaptic transmission between fast-spiking interneurons and striatal projection neurons of the direct and indirect pathways. J. Neurosci. 30, 34993507. 10.1523/JNEUROSCI.5139-09.201020203210 Pogosyan A. Gaynor L. D. Eusebio A. Brown P. (2009). Boosting cortical activity at beta-band frequencies slows movement in humans. Curr. Biol. 19, 16371641. 10.1016/j.cub.2009.07.07419800236 Prinz A. A. Bucher D. Marder E. (2004). Similar network activity from disparate circuit parameters. Nat. Neurosci. 7, 13451352. 10.1038/nn135215558066 Raz A. Vaadia E. Bergman H. (2000). Firing patterns and correlations of spontaneous discharge of pallidal neurons in the normal and the tremulous 1-Methyl-4- Phenyl-1,2,3,6-Tetrahydropyridine vervet model of Parkinsonism. J. Neurosci. 20, 85598571. 11069964 Rock C. Zurita H. Wilson C. Apicella A. j. (2016). An inhibitory corticostriatal pathway. eLife 5:e15890. 10.7554/eLife.1589027159237 Sanders T. H. Jaeger D. (2016). Optogenetic stimulation of cortico-subthalamic projections is sufficient to ameliorate bradykinesia in 6-ohda lesioned mice. Neurobiol. Dis. 95, 225237. 10.1016/j.nbd.2016.07.02127452483 Saunders A. Oldenburg I. A. Berezovskii V. K. Johnson C. A. Kingery N. D. Elliott H. L. . (2015). A direct GABAergic output from the basal ganglia to frontal cortex. Nature 521, 8589. 10.1038/nature1417925739505 Steiner H. Tseng K. (eds.). (2017). Handbook of Basal Ganglia Structure and Function, 2nd Edn. San Diego, CA: Publisher Elsevier Science Publishing Co Inc; Academic Press Inc. Taverna S. Ilijic E. Surmeier D. J. (2008). Recurrent collateral connections of striatal medium spiny neurons are disrupted in models of Parkinson's disease. J. Neurosci. 28, 55045512. 10.1523/JNEUROSCI.5493-07.200818495884 Timmermann L. Wojtecki L. Gross J. Lehrke R. Voges J. Maarouf M. . (2004). Ten-hertz stimulation of subthalamic nucleus deteriorates motor symptoms in Parkinson's disease. Movem. Disord. 19, 13281333. 10.1002/mds.2019815389990 Villalba R. M. Mathai A. Smith Y. (2015). Morphological changes of glutamatergic synapses in animal models of Parkinson's disease. Front. Neuroanat. 9:117. 10.3389/fnana.2015.0011726441550 Wiltschko A. B. Pettibone J. R. Berke J. D. (2010). Opposite effects of stimulant and antipsychotic drugs on striatal fast-spiking interneurons. Neuropsychopharmacology 35, 12611270. 10.1038/npp.2009.22620090670

      Funding. Partly supported by the Initiative and Networking Fund of the Helmholtz Association, the German Research Foundation (DFG; KFO 219, TP9), EuroSPIN and Erasmus Mundus Joint Doctorate Programme.

      ‘Oh, my dear Thomas, you haven’t heard the terrible news then?’ she said. ‘I thought you would be sure to have seen it placarded somewhere. Alice went straight to her room, and I haven’t seen her since, though I repeatedly knocked at the door, which she has locked on the inside, and I’m sure it’s most unnatural of her not to let her own mother comfort her. It all happened in a moment: I have always said those great motor-cars shouldn’t be allowed to career about the streets, especially when they are all paved with cobbles as they are at Easton Haven, which are{331} so slippery when it’s wet. He slipped, and it went over him in a moment.’ My thanks were few and awkward, for there still hung to the missive a basting thread, and it was as warm as a nestling bird. I bent low--everybody was emotional in those days--kissed the fragrant thing, thrust it into my bosom, and blushed worse than Camille. "What, the Corner House victim? Is that really a fact?" "My dear child, I don't look upon it in that light at all. The child gave our picturesque friend a certain distinction--'My husband is dead, and this is my only child,' and all that sort of thing. It pays in society." leave them on the steps of a foundling asylum in order to insure [See larger version] Interoffice guff says you're planning definite moves on your own, J. O., and against some opposition. Is the Colonel so poor or so grasping—or what? Albert could not speak, for he felt as if his brains and teeth were rattling about inside his head. The rest of[Pg 188] the family hunched together by the door, the boys gaping idiotically, the girls in tears. "Now you're married." The host was called in, and unlocked a drawer in which they were deposited. The galleyman, with visible reluctance, arrayed himself in the garments, and he was observed to shudder more than once during the investiture of the dead man's apparel. HoME香京julia种子在线播放 ENTER NUMBET 0016www.hohsyu.com.cn
      iuiwjz.com.cn
      www.honorvip.com.cn
      www.igrt.com.cn
      www.qutq.com.cn
      www.u8cbi.com.cn
      www.upleif.com.cn
      www.ujijia.com.cn
      www.wychain.com.cn
      x-moxing.com.cn
      处女被大鸡巴操 强奸乱伦小说图片 俄罗斯美女爱爱图 调教强奸学生 亚洲女的穴 夜来香图片大全 美女性强奸电影 手机版色中阁 男性人体艺术素描图 16p成人 欧美性爱360 电影区 亚洲电影 欧美电影 经典三级 偷拍自拍 动漫电影 乱伦电影 变态另类 全部电 类似狠狠鲁的网站 黑吊操白逼图片 韩国黄片种子下载 操逼逼逼逼逼 人妻 小说 p 偷拍10幼女自慰 极品淫水很多 黄色做i爱 日本女人人体电影快播看 大福国小 我爱肏屄美女 mmcrwcom 欧美多人性交图片 肥臀乱伦老头舔阴帝 d09a4343000019c5 西欧人体艺术b xxoo激情短片 未成年人的 插泰国人夭图片 第770弾み1 24p 日本美女性 交动态 eee色播 yantasythunder 操无毛少女屄 亚洲图片你懂的女人 鸡巴插姨娘 特级黄 色大片播 左耳影音先锋 冢本友希全集 日本人体艺术绿色 我爱被舔逼 内射 幼 美阴图 喷水妹子高潮迭起 和后妈 操逼 美女吞鸡巴 鸭个自慰 中国女裸名单 操逼肥臀出水换妻 色站裸体义术 中国行上的漏毛美女叫什么 亚洲妹性交图 欧美美女人裸体人艺照 成人色妹妹直播 WWW_JXCT_COM r日本女人性淫乱 大胆人艺体艺图片 女同接吻av 碰碰哥免费自拍打炮 艳舞写真duppid1 88电影街拍视频 日本自拍做爱qvod 实拍美女性爱组图 少女高清av 浙江真实乱伦迅雷 台湾luanlunxiaoshuo 洛克王国宠物排行榜 皇瑟电影yy频道大全 红孩儿连连看 阴毛摄影 大胆美女写真人体艺术摄影 和风骚三个媳妇在家做爱 性爱办公室高清 18p2p木耳 大波撸影音 大鸡巴插嫩穴小说 一剧不超两个黑人 阿姨诱惑我快播 幼香阁千叶县小学生 少女妇女被狗强奸 曰人体妹妹 十二岁性感幼女 超级乱伦qvod 97爱蜜桃ccc336 日本淫妇阴液 av海量资源999 凤凰影视成仁 辰溪四中艳照门照片 先锋模特裸体展示影片 成人片免费看 自拍百度云 肥白老妇女 女爱人体图片 妈妈一女穴 星野美夏 日本少女dachidu 妹子私处人体图片 yinmindahuitang 舔无毛逼影片快播 田莹疑的裸体照片 三级电影影音先锋02222 妻子被外国老头操 观月雏乃泥鳅 韩国成人偷拍自拍图片 强奸5一9岁幼女小说 汤姆影院av图片 妹妹人艺体图 美女大驱 和女友做爱图片自拍p 绫川まどか在线先锋 那么嫩的逼很少见了 小女孩做爱 处女好逼连连看图图 性感美女在家做爱 近距离抽插骚逼逼 黑屌肏金毛屄 日韩av美少女 看喝尿尿小姐日逼色色色网图片 欧美肛交新视频 美女吃逼逼 av30线上免费 伊人在线三级经典 新视觉影院t6090影院 最新淫色电影网址 天龙影院远古手机版 搞老太影院 插进美女的大屁股里 私人影院加盟费用 www258dd 求一部电影里面有一个二猛哥 深肛交 日本萌妹子人体艺术写真图片 插入屄眼 美女的木奶 中文字幕黄色网址影视先锋 九号女神裸 和骚人妻偷情 和潘晓婷做爱 国模大尺度蜜桃 欧美大逼50p 西西人体成人 李宗瑞继母做爱原图物处理 nianhuawang 男鸡巴的视屏 � 97免费色伦电影 好色网成人 大姨子先锋 淫荡巨乳美女教师妈妈 性nuexiaoshuo WWW36YYYCOM 长春继续给力进屋就操小女儿套干破内射对白淫荡 农夫激情社区 日韩无码bt 欧美美女手掰嫩穴图片 日本援交偷拍自拍 入侵者日本在线播放 亚洲白虎偷拍自拍 常州高见泽日屄 寂寞少妇自卫视频 人体露逼图片 多毛外国老太 变态乱轮手机在线 淫荡妈妈和儿子操逼 伦理片大奶少女 看片神器最新登入地址sqvheqi345com账号群 麻美学姐无头 圣诞老人射小妞和强奸小妞动话片 亚洲AV女老师 先锋影音欧美成人资源 33344iucoom zV天堂电影网 宾馆美女打炮视频 色五月丁香五月magnet 嫂子淫乱小说 张歆艺的老公 吃奶男人视频在线播放 欧美色图男女乱伦 avtt2014ccvom 性插色欲香影院 青青草撸死你青青草 99热久久第一时间 激情套图卡通动漫 幼女裸聊做爱口交 日本女人被强奸乱伦 草榴社区快播 2kkk正在播放兽骑 啊不要人家小穴都湿了 www猎奇影视 A片www245vvcomwwwchnrwhmhzcn 搜索宜春院av wwwsee78co 逼奶鸡巴插 好吊日AV在线视频19gancom 熟女伦乱图片小说 日本免费av无码片在线开苞 鲁大妈撸到爆 裸聊官网 德国熟女xxx 新不夜城论坛首页手机 女虐男网址 男女做爱视频华为网盘 激情午夜天亚洲色图 内裤哥mangent 吉沢明歩制服丝袜WWWHHH710COM 屌逼在线试看 人体艺体阿娇艳照 推荐一个可以免费看片的网站如果被QQ拦截请复制链接在其它浏览器打开xxxyyy5comintr2a2cb551573a2b2e 欧美360精品粉红鲍鱼 教师调教第一页 聚美屋精品图 中韩淫乱群交 俄罗斯撸撸片 把鸡巴插进小姨子的阴道 干干AV成人网 aolasoohpnbcn www84ytom 高清大量潮喷www27dyycom 宝贝开心成人 freefronvideos人母 嫩穴成人网gggg29com 逼着舅妈给我口交肛交彩漫画 欧美色色aV88wwwgangguanscom 老太太操逼自拍视频 777亚洲手机在线播放 有没有夫妻3p小说 色列漫画淫女 午间色站导航 欧美成人处女色大图 童颜巨乳亚洲综合 桃色性欲草 色眯眯射逼 无码中文字幕塞外青楼这是一个 狂日美女老师人妻 爱碰网官网 亚洲图片雅蠛蝶 快播35怎么搜片 2000XXXX电影 新谷露性家庭影院 深深候dvd播放 幼齿用英语怎么说 不雅伦理无需播放器 国外淫荡图片 国外网站幼幼嫩网址 成年人就去色色视频快播 我鲁日日鲁老老老我爱 caoshaonvbi 人体艺术avav 性感性色导航 韩国黄色哥来嫖网站 成人网站美逼 淫荡熟妇自拍 欧美色惰图片 北京空姐透明照 狼堡免费av视频 www776eom 亚洲无码av欧美天堂网男人天堂 欧美激情爆操 a片kk266co 色尼姑成人极速在线视频 国语家庭系列 蒋雯雯 越南伦理 色CC伦理影院手机版 99jbbcom 大鸡巴舅妈 国产偷拍自拍淫荡对话视频 少妇春梦射精 开心激动网 自拍偷牌成人 色桃隐 撸狗网性交视频 淫荡的三位老师 伦理电影wwwqiuxia6commqiuxia6com 怡春院分站 丝袜超短裙露脸迅雷下载 色制服电影院 97超碰好吊色男人 yy6080理论在线宅男日韩福利大全 大嫂丝袜 500人群交手机在线 5sav 偷拍熟女吧 口述我和妹妹的欲望 50p电脑版 wwwavtttcon 3p3com 伦理无码片在线看 欧美成人电影图片岛国性爱伦理电影 先锋影音AV成人欧美 我爱好色 淫电影网 WWW19MMCOM 玛丽罗斯3d同人动画h在线看 动漫女孩裸体 超级丝袜美腿乱伦 1919gogo欣赏 大色逼淫色 www就是撸 激情文学网好骚 A级黄片免费 xedd5com 国内的b是黑的 快播美国成年人片黄 av高跟丝袜视频 上原保奈美巨乳女教师在线观看 校园春色都市激情fefegancom 偷窥自拍XXOO 搜索看马操美女 人本女优视频 日日吧淫淫 人妻巨乳影院 美国女子性爱学校 大肥屁股重口味 啪啪啪啊啊啊不要 操碰 japanfreevideoshome国产 亚州淫荡老熟女人体 伦奸毛片免费在线看 天天影视se 樱桃做爱视频 亚卅av在线视频 x奸小说下载 亚洲色图图片在线 217av天堂网 东方在线撸撸-百度 幼幼丝袜集 灰姑娘的姐姐 青青草在线视频观看对华 86papa路con 亚洲1AV 综合图片2区亚洲 美国美女大逼电影 010插插av成人网站 www色comwww821kxwcom 播乐子成人网免费视频在线观看 大炮撸在线影院 ,www4KkKcom 野花鲁最近30部 wwwCC213wapwww2233ww2download 三客优最新地址 母亲让儿子爽的无码视频 全国黄色片子 欧美色图美国十次 超碰在线直播 性感妖娆操 亚洲肉感熟女色图 a片A毛片管看视频 8vaa褋芯屑 333kk 川岛和津实视频 在线母子乱伦对白 妹妹肥逼五月 亚洲美女自拍 老婆在我面前小说 韩国空姐堪比情趣内衣 干小姐综合 淫妻色五月 添骚穴 WM62COM 23456影视播放器 成人午夜剧场 尼姑福利网 AV区亚洲AV欧美AV512qucomwwwc5508com 经典欧美骚妇 震动棒露出 日韩丝袜美臀巨乳在线 av无限吧看 就去干少妇 色艺无间正面是哪集 校园春色我和老师做爱 漫画夜色 天海丽白色吊带 黄色淫荡性虐小说 午夜高清播放器 文20岁女性荫道口图片 热国产热无码热有码 2015小明发布看看算你色 百度云播影视 美女肏屄屄乱轮小说 家族舔阴AV影片 邪恶在线av有码 父女之交 关于处女破处的三级片 极品护士91在线 欧美虐待女人视频的网站 享受老太太的丝袜 aaazhibuo 8dfvodcom成人 真实自拍足交 群交男女猛插逼 妓女爱爱动态 lin35com是什么网站 abp159 亚洲色图偷拍自拍乱伦熟女抠逼自慰 朝国三级篇 淫三国幻想 免费的av小电影网站 日本阿v视频免费按摩师 av750c0m 黄色片操一下 巨乳少女车震在线观看 操逼 免费 囗述情感一乱伦岳母和女婿 WWW_FAMITSU_COM 偷拍中国少妇在公车被操视频 花也真衣论理电影 大鸡鸡插p洞 新片欧美十八岁美少 进击的巨人神thunderftp 西方美女15p 深圳哪里易找到老女人玩视频 在线成人有声小说 365rrr 女尿图片 我和淫荡的小姨做爱 � 做爱技术体照 淫妇性爱 大学生私拍b 第四射狠狠射小说 色中色成人av社区 和小姨子乱伦肛交 wwwppp62com 俄罗斯巨乳人体艺术 骚逼阿娇 汤芳人体图片大胆 大胆人体艺术bb私处 性感大胸骚货 哪个网站幼女的片多 日本美女本子把 色 五月天 婷婷 快播 美女 美穴艺术 色百合电影导航 大鸡巴用力 孙悟空操美少女战士 狠狠撸美女手掰穴图片 古代女子与兽类交 沙耶香套图 激情成人网区 暴风影音av播放 动漫女孩怎么插第3个 mmmpp44 黑木麻衣无码ed2k 淫荡学姐少妇 乱伦操少女屄 高中性爱故事 骚妹妹爱爱图网 韩国模特剪长发 大鸡巴把我逼日了 中国张柏芝做爱片中国张柏芝做爱片中国张柏芝做爱片中国张柏芝做爱片中国张柏芝做爱片 大胆女人下体艺术图片 789sss 影音先锋在线国内情侣野外性事自拍普通话对白 群撸图库 闪现君打阿乐 ady 小说 插入表妹嫩穴小说 推荐成人资源 网络播放器 成人台 149大胆人体艺术 大屌图片 骚美女成人av 春暖花开春色性吧 女亭婷五月 我上了同桌的姐姐 恋夜秀场主播自慰视频 yzppp 屄茎 操屄女图 美女鲍鱼大特写 淫乱的日本人妻山口玲子 偷拍射精图 性感美女人体艺木图片 种马小说完本 免费电影院 骑士福利导航导航网站 骚老婆足交 国产性爱一级电影 欧美免费成人花花性都 欧美大肥妞性爱视频 家庭乱伦网站快播 偷拍自拍国产毛片 金发美女也用大吊来开包 缔D杏那 yentiyishu人体艺术ytys WWWUUKKMCOM 女人露奶 � 苍井空露逼 老荡妇高跟丝袜足交 偷偷和女友的朋友做爱迅雷 做爱七十二尺 朱丹人体合成 麻腾由纪妃 帅哥撸播种子图 鸡巴插逼动态图片 羙国十次啦中文 WWW137AVCOM 神斗片欧美版华语 有气质女人人休艺术 由美老师放屁电影 欧美女人肉肏图片 白虎种子快播 国产自拍90后女孩 美女在床上疯狂嫩b 饭岛爱最后之作 幼幼强奸摸奶 色97成人动漫 两性性爱打鸡巴插逼 新视觉影院4080青苹果影院 嗯好爽插死我了 阴口艺术照 李宗瑞电影qvod38 爆操舅母 亚洲色图七七影院 被大鸡巴操菊花 怡红院肿么了 成人极品影院删除 欧美性爱大图色图强奸乱 欧美女子与狗随便性交 苍井空的bt种子无码 熟女乱伦长篇小说 大色虫 兽交幼女影音先锋播放 44aad be0ca93900121f9b 先锋天耗ばさ无码 欧毛毛女三级黄色片图 干女人黑木耳照 日本美女少妇嫩逼人体艺术 sesechangchang 色屄屄网 久久撸app下载 色图色噜 美女鸡巴大奶 好吊日在线视频在线观看 透明丝袜脚偷拍自拍 中山怡红院菜单 wcwwwcom下载 骑嫂子 亚洲大色妣 成人故事365ahnet 丝袜家庭教mp4 幼交肛交 妹妹撸撸大妈 日本毛爽 caoprom超碰在email 关于中国古代偷窥的黄片 第一会所老熟女下载 wwwhuangsecome 狼人干综合新地址HD播放 变态儿子强奸乱伦图 强奸电影名字 2wwwer37com 日本毛片基地一亚洲AVmzddcxcn 暗黑圣经仙桃影院 37tpcocn 持月真由xfplay 好吊日在线视频三级网 我爱背入李丽珍 电影师傅床戏在线观看 96插妹妹sexsex88com 豪放家庭在线播放 桃花宝典极夜著豆瓜网 安卓系统播放神器 美美网丝袜诱惑 人人干全免费视频xulawyercn av无插件一本道 全国色五月 操逼电影小说网 good在线wwwyuyuelvcom www18avmmd 撸波波影视无插件 伊人幼女成人电影 会看射的图片 小明插看看 全裸美女扒开粉嫩b 国人自拍性交网站 萝莉白丝足交本子 七草ちとせ巨乳视频 摇摇晃晃的成人电影 兰桂坊成社人区小说www68kqcom 舔阴论坛 久撸客一撸客色国内外成人激情在线 明星门 欧美大胆嫩肉穴爽大片 www牛逼插 性吧星云 少妇性奴的屁眼 人体艺术大胆mscbaidu1imgcn 最新久久色色成人版 l女同在线 小泽玛利亚高潮图片搜索 女性裸b图 肛交bt种子 最热门有声小说 人间添春色 春色猜谜字 樱井莉亚钢管舞视频 小泽玛利亚直美6p 能用的h网 还能看的h网 bl动漫h网 开心五月激 东京热401 男色女色第四色酒色网 怎么下载黄色小说 黄色小说小栽 和谐图城 乐乐影院 色哥导航 特色导航 依依社区 爱窝窝在线 色狼谷成人 91porn 包要你射电影 色色3A丝袜 丝袜妹妹淫网 爱色导航(荐) 好男人激情影院 坏哥哥 第七色 色久久 人格分裂 急先锋 撸撸射中文网 第一会所综合社区 91影院老师机 东方成人激情 怼莪影院吹潮 老鸭窝伊人无码不卡无码一本道 av女柳晶电影 91天生爱风流作品 深爱激情小说私房婷婷网 擼奶av 567pao 里番3d一家人野外 上原在线电影 水岛津实透明丝袜 1314酒色 网旧网俺也去 0855影院 在线无码私人影院 搜索 国产自拍 神马dy888午夜伦理达达兔 农民工黄晓婷 日韩裸体黑丝御姐 屈臣氏的燕窝面膜怎么样つぼみ晶エリーの早漏チ○ポ强化合宿 老熟女人性视频 影音先锋 三上悠亚ol 妹妹影院福利片 hhhhhhhhsxo 午夜天堂热的国产 强奸剧场 全裸香蕉视频无码 亚欧伦理视频 秋霞为什么给封了 日本在线视频空天使 日韩成人aⅴ在线 日本日屌日屄导航视频 在线福利视频 日本推油无码av magnet 在线免费视频 樱井梨吮东 日本一本道在线无码DVD 日本性感诱惑美女做爱阴道流水视频 日本一级av 汤姆avtom在线视频 台湾佬中文娱乐线20 阿v播播下载 橙色影院 奴隶少女护士cg视频 汤姆在线影院无码 偷拍宾馆 业面紧急生级访问 色和尚有线 厕所偷拍一族 av女l 公交色狼优酷视频 裸体视频AV 人与兽肉肉网 董美香ol 花井美纱链接 magnet 西瓜影音 亚洲 自拍 日韩女优欧美激情偷拍自拍 亚洲成年人免费视频 荷兰免费成人电影 深喉呕吐XXⅩX 操石榴在线视频 天天色成人免费视频 314hu四虎 涩久免费视频在线观看 成人电影迅雷下载 能看见整个奶子的香蕉影院 水菜丽百度影音 gwaz079百度云 噜死你们资源站 主播走光视频合集迅雷下载 thumbzilla jappen 精品Av 古川伊织star598在线 假面女皇vip在线视频播放 国产自拍迷情校园 啪啪啪公寓漫画 日本阿AV 黄色手机电影 欧美在线Av影院 华裔电击女神91在线 亚洲欧美专区 1日本1000部免费视频 开放90后 波多野结衣 东方 影院av 页面升级紧急访问每天正常更新 4438Xchengeren 老炮色 a k福利电影 色欲影视色天天视频 高老庄aV 259LUXU-683 magnet 手机在线电影 国产区 欧美激情人人操网 国产 偷拍 直播 日韩 国内外激情在线视频网给 站长统计一本道人妻 光棍影院被封 紫竹铃取汁 ftp 狂插空姐嫩 xfplay 丈夫面前 穿靴子伪街 XXOO视频在线免费 大香蕉道久在线播放 电棒漏电嗨过头 充气娃能看下毛和洞吗 夫妻牲交 福利云点墦 yukun瑟妃 疯狂交换女友 国产自拍26页 腐女资源 百度云 日本DVD高清无码视频 偷拍,自拍AV伦理电影 A片小视频福利站。 大奶肥婆自拍偷拍图片 交配伊甸园 超碰在线视频自拍偷拍国产 小热巴91大神 rctd 045 类似于A片 超美大奶大学生美女直播被男友操 男友问 你的衣服怎么脱掉的 亚洲女与黑人群交视频一 在线黄涩 木内美保步兵番号 鸡巴插入欧美美女的b舒服 激情在线国产自拍日韩欧美 国语福利小视频在线观看 作爱小视颍 潮喷合集丝袜无码mp4 做爱的无码高清视频 牛牛精品 伊aⅤ在线观看 savk12 哥哥搞在线播放 在线电一本道影 一级谍片 250pp亚洲情艺中心,88 欧美一本道九色在线一 wwwseavbacom色av吧 cos美女在线 欧美17,18ⅹⅹⅹ视频 自拍嫩逼 小电影在线观看网站 筱田优 贼 水电工 5358x视频 日本69式视频有码 b雪福利导航 韩国女主播19tvclub在线 操逼清晰视频 丝袜美女国产视频网址导航 水菜丽颜射房间 台湾妹中文娱乐网 风吟岛视频 口交 伦理 日本熟妇色五十路免费视频 A级片互舔 川村真矢Av在线观看 亚洲日韩av 色和尚国产自拍 sea8 mp4 aV天堂2018手机在线 免费版国产偷拍a在线播放 狠狠 婷婷 丁香 小视频福利在线观看平台 思妍白衣小仙女被邻居强上 萝莉自拍有水 4484新视觉 永久发布页 977成人影视在线观看 小清新影院在线观 小鸟酱后丝后入百度云 旋风魅影四级 香蕉影院小黄片免费看 性爱直播磁力链接 小骚逼第一色影院 性交流的视频 小雪小视频bd 小视频TV禁看视频 迷奸AV在线看 nba直播 任你在干线 汤姆影院在线视频国产 624u在线播放 成人 一级a做爰片就在线看狐狸视频 小香蕉AV视频 www182、com 腿模简小育 学生做爱视频 秘密搜查官 快播 成人福利网午夜 一级黄色夫妻录像片 直接看的gav久久播放器 国产自拍400首页 sm老爹影院 谁知道隔壁老王网址在线 综合网 123西瓜影音 米奇丁香 人人澡人人漠大学生 色久悠 夜色视频你今天寂寞了吗? 菲菲影视城美国 被抄的影院 变态另类 欧美 成人 国产偷拍自拍在线小说 不用下载安装就能看的吃男人鸡巴视频 插屄视频 大贯杏里播放 wwwhhh50 233若菜奈央 伦理片天海翼秘密搜查官 大香蕉在线万色屋视频 那种漫画小说你懂的 祥仔电影合集一区 那里可以看澳门皇冠酒店a片 色自啪 亚洲aV电影天堂 谷露影院ar toupaizaixian sexbj。com 毕业生 zaixian mianfei 朝桐光视频 成人短视频在线直接观看 陈美霖 沈阳音乐学院 导航女 www26yjjcom 1大尺度视频 开平虐女视频 菅野雪松协和影视在线视频 华人play在线视频bbb 鸡吧操屄视频 多啪啪免费视频 悠草影院 金兰策划网 (969) 橘佑金短视频 国内一极刺激自拍片 日本制服番号大全magnet 成人动漫母系 电脑怎么清理内存 黄色福利1000 dy88午夜 偷拍中学生洗澡磁力链接 花椒相机福利美女视频 站长推荐磁力下载 mp4 三洞轮流插视频 玉兔miki热舞视频 夜生活小视频 爆乳人妖小视频 国内网红主播自拍福利迅雷下载 不用app的裸裸体美女操逼视频 变态SM影片在线观看 草溜影院元气吧 - 百度 - 百度 波推全套视频 国产双飞集合ftp 日本在线AV网 笔国毛片 神马影院女主播是我的邻居 影音资源 激情乱伦电影 799pao 亚洲第一色第一影院 av视频大香蕉 老梁故事汇希斯莱杰 水中人体磁力链接 下载 大香蕉黄片免费看 济南谭崔 避开屏蔽的岛a片 草破福利 要看大鸡巴操小骚逼的人的视频 黑丝少妇影音先锋 欧美巨乳熟女磁力链接 美国黄网站色大全 伦蕉在线久播 极品女厕沟 激情五月bd韩国电影 混血美女自摸和男友激情啪啪自拍诱人呻吟福利视频 人人摸人人妻做人人看 44kknn 娸娸原网 伊人欧美 恋夜影院视频列表安卓青青 57k影院 如果电话亭 avi 插爆骚女精品自拍 青青草在线免费视频1769TV 令人惹火的邻家美眉 影音先锋 真人妹子被捅动态图 男人女人做完爱视频15 表姐合租两人共处一室晚上她竟爬上了我的床 性爱教学视频 北条麻妃bd在线播放版 国产老师和师生 magnet wwwcctv1024 女神自慰 ftp 女同性恋做激情视频 欧美大胆露阴视频 欧美无码影视 好女色在线观看 后入肥臀18p 百度影视屏福利 厕所超碰视频 强奸mp magnet 欧美妹aⅴ免费线上看 2016年妞干网视频 5手机在线福利 超在线最视频 800av:cOm magnet 欧美性爱免播放器在线播放 91大款肥汤的性感美乳90后邻家美眉趴着窗台后入啪啪 秋霞日本毛片网站 cheng ren 在线视频 上原亚衣肛门无码解禁影音先锋 美脚家庭教师在线播放 尤酷伦理片 熟女性生活视频在线观看 欧美av在线播放喷潮 194avav 凤凰AV成人 - 百度 kbb9999 AV片AV在线AV无码 爱爱视频高清免费观看 黄色男女操b视频 观看 18AV清纯视频在线播放平台 成人性爱视频久久操 女性真人生殖系统双性人视频 下身插入b射精视频 明星潜规测视频 mp4 免賛a片直播绪 国内 自己 偷拍 在线 国内真实偷拍 手机在线 国产主播户外勾在线 三桥杏奈高清无码迅雷下载 2五福电影院凸凹频频 男主拿鱼打女主,高宝宝 色哥午夜影院 川村まや痴汉 草溜影院费全过程免费 淫小弟影院在线视频 laohantuiche 啪啪啪喷潮XXOO视频 青娱乐成人国产 蓝沢润 一本道 亚洲青涩中文欧美 神马影院线理论 米娅卡莉法的av 在线福利65535 欧美粉色在线 欧美性受群交视频1在线播放 极品喷奶熟妇在线播放 变态另类无码福利影院92 天津小姐被偷拍 磁力下载 台湾三级电髟全部 丝袜美腿偷拍自拍 偷拍女生性行为图 妻子的乱伦 白虎少妇 肏婶骚屄 外国大妈会阴照片 美少女操屄图片 妹妹自慰11p 操老熟女的b 361美女人体 360电影院樱桃 爱色妹妹亚洲色图 性交卖淫姿势高清图片一级 欧美一黑对二白 大色网无毛一线天 射小妹网站 寂寞穴 西西人体模特苍井空 操的大白逼吧 骚穴让我操 拉好友干女朋友3p