Main

Aggressive behaviours are complex forms of social behaviour that have many functions, including acquiring resources to help ensure survival. These behaviours are composed of an appetitive and consummatory phase1. In mice, the appetitive phase involves approach and investigation, whereas the consummatory phase involves a series of motor behaviours such as biting, kicking or wrestling2,3. Our laboratory has previously characterized a population of outbred mice that exhibit individual differences in aggressive and pro-social behaviour in the resident-intruder (RI) test, allowing us to evaluate the underlying neural mechanisms3,4,5,6,7. Although studies have identified several brain regions in the hypothalamus and ventral striatum that enable aggressive behaviour4,6,8,9,10, little work has been done to identify the brain regions that have a role in the transition between appetitive and consummatory phases of aggressive behaviours. Understanding the mechanisms of this transition is crucial, because it is one of the processes that distinguishes aggressive mice (AGGs) from non-aggressive mice (NONs). Sensory processing has been shown to be key in the transition between these phases during other social behaviours such as parenting and social recognition11,12. However, whether activity in sensory-processing cortical regions drives differences in aggressive social behaviour is unknown.

We first used an iDISCO+ clearing procedure followed by whole-brain immunostaining to identity FOS+ cells. We then used an unsupervised whole-brain computational approach13 to identify a cluster of hypothalamic, amygdalar and olfactory cortical regions that are highly co-activated in male but not in female AGGs. Within this cluster, we found that the posterolateral cortical amygdala (COApl), which is part of the olfactory cortex, is a key node or ‘hub region’ that is highly connected within the broader network of this cluster. We further investigated the mechanisms by which the COApl mediates aggressive social behaviour using a variety of circuit techniques. We found that COAplEsr1 neurons, and downstream connections such as the ventromedial hypothalamus (VMH) and the central amygdala (CEA), are highly co-activated during bouts of social investigation that precede an attack, and that these circuits regulate the transition from the appetitive phase (approach and investigation) of aggressive interactions to the consummatory phase (attack).

The COApl is a key node in a male AGG network

After a RI test, we performed a cleared whole-brain FOS mapping experiment using the iDISCO+ method combined with a network analysis that is commonly used in RNA-sequencing studies to identify differentially activated regions between male and female AGGs and NONs (Fig. 1a). Before brain collection, male and female AGGs and NONs were exposed to an intruder mouse. We did not see a difference in total attack duration or investigation duration between the sexes (Fig. 1b,c), but we did observe that males and females engaged in distinct actions that made up the total duration metrics, as previously reported3 (Extended Data Fig. 1a–f). We then assembled a network for both AGGs and NONs (Fig. 1d). After constructing each network, we performed a module preservation analysis using the AGG network as the reference network and the NON network as the test network. We found that the ‘pink’ module was the least preserved module in the NON network (Fig. 1e, Extended Data Fig. 2a–c and Supplementary Data 1). Inspection of this module showed that subregions of the amygdala and hypothalamus are highly interconnected in the AGG network. In the NON network, however, subregions of the hypothalamus and amygdala are highly connected amongst themselves, but not between the amygdala and hypothalamus. Notably, male AGGs expressed this module, as determined by the eigenvalues, significantly more than female AGGs did (Fig. 1f). We also found that many of the top regions that showed a significant increase in FOS counts were different between male and female AGGs (Extended Data Fig. 2e,f). When using the NON network as a reference, we found that the ‘blue’ network, which was composed mainly of regions from the isocortex, was not preserved in the AGGs (Extended Data Fig. 3a). We also constructed a network of AGGs and NONs in response to a novel object. Only two regions from the pink module in male AGGs showed an increase in FOS relative to NONs (the dorsomedial hypothalamus and the subparaventricular zone; Extended Data Fig. 3b). In addition, we ran a preservation analysis comparing the pink module of AGGs and NONs in response to an intruder and in response to a novel object, and found that the pink module was not preserved in response to the novel object in either AGGs or NONs (Extended Data Fig. 3c,d). Of the 28 regions in the pink module (Supplementary Data 2), 11 regions differed in their total connectivity within the pink module between AGGs and NONs. Of the four regions that showed higher connectivity in the AGG network, the posterior cortical amygdala (COAp) had the highest average connectivity (Fig. 1g). Of note, the COAp showed stronger connectivity with the VMH in the AGG network than it did in the NON network.

Fig. 1: The COApl is a key node in a differentially connected module in aggressive males.
figure 1

a, Experimental timeline. b,c, Aggression duration was significantly higher in AGGs than in NONs (b; main effect of phenotype, F(1,44) = 83.30, P < 0.0001) and NONs exhibited more social investigation than did AGGs (c; main effect of phenotype, F(1,46) = 6.984, P = 0.0112) (n = 13 male AGGs, 14 female AGGs, 10 male NONs and 13 female NONs). d, Whole-brain FOS network analysis in AGGs and NONs. e, Network plot of the pink module in AGGs (top) and NONs (bottom). f, Male AGGs exhibited higher pink-module expression than did female AGGs (t(25) = 4.612, P = 0.0001). g, Regions in the pink module differed in intramodular connectivity between AGG and NON networks. All q values were less than 0.05. h, Coherency analysis in the COAp–VMH circuit during attack and investigation bouts (t3 = 5.412, P = 0.0124). i, Quantification of coherence in the delta (t3 = 3.915, P = 0.0296), theta (t3 = 3.904, P = 0.0298) and gamma (t3 = 3.241, P = 0.0478) bands. jl, FOS expression in the COAp. j,k, iDISCO+ revealed a significant phenotype × sex interaction (F(1,46) = 24.11, P < 0.0001), with male AGGs exhibiting higher FOS expression than male NONs (P < 0.0001, Tukey’s post-hoc) and female AGGs (P < 0.0001, Tukey’s post-hoc). l, Fluorescence in situ hybridization (FISH) revealed that male AGGs also exhibited a higher number of FOS+ cells expressing Esr1 (phenotype × sex interaction: F(1,16) = 23.09, P = 0.0002) than did male NONs (P < 0.0001, Tukey’s post-hoc) and female AGGs (P < 0.0001, Tukey’s post-hoc) (n = 6 male AGGs, 4 female AGGs, 4 male NONs and 6 female NONs). *P < 0.05, **P < 0.01, ***P < 0.001, ****P < 0.001. All data are mean ± s.e.m. All network data and corresponding behaviour were replicated in two cohorts. FISH and in vivo electrophysiology were carried out in a single cohort. ENTmv, entorhinal cortex medial part ventral zone; SBPV, subparaventricular zone; MPN, medial preoptic nucleus; AHN, anterior hypothalamic nucleus; LPO, lateral preoptic area; MPO, medial preoptic area; AAA, anterior aymgdala area; BA, bed nucleus of anterior commissure; FS, fundus of striatum; PA, posterior amygdala; TR, transition area; TU, tuberal nucleus; EPv, ventral endopiriform area; BMA, basomedial amygdala; CTX, cortical subplate; sAMY, striatal amygdala; BLAa, anterior basolateral amygdala; BLAp, posterior basolateral amygdala; IA, intercalated amygdala; DMH, dorsomedial hypothalamus. The illustrations in a were created with BioRender.

Source Data

To further confirm predictions from the network analysis, we recorded local field potentials (LFPs) in the COAp and VMH in awake, behaving mice during the RI test. We found that there was an increase in coherence between the COAp and the VMH during attack behaviour (Fig. 1h,i and Extended Data Fig. 4), but not during isolated bouts of investigation. In-depth analysis revealed that the increase in coherence was in the delta (1.5–4 Hz), theta (5–12 Hz) and gamma (40–100 Hz) bands (Fig. 1i). Further investigation of the COAp showed that male AGGs had more FOS+ cells in this region, compared with female AGGs and male NONs in the iDISCO+ dataset (Fig. 1j). Because ClearMap cannot distinguish between the lateral and the medial cortical amygdala, we manually analysed the lateral and the medial portions of the COAp, and found that male AGGs showed a significant increase in the number of cells expressing FOS in the lateral relative to the medial portion (Extended Data Fig. 5a). In the COApl, we found that male AGGs showed a significant increase in the proportion of Esr1 cells that expressed FOS, relative to female AGGs and male NONs (Fig. 1k–l). Detailed analyses of this cell population determined that most COAplEsr1 cells were glutamatergic (around 90%) and were equally expressed in the COApl in all four groups (Extended Data Fig. 5b–d). We also found that most of the cells that expressed FOS also expressed Esr1 (around 85%; Extended Data Fig. 5e).

To investigate the activity of COAplEsr1 neurons in vivo during aggressive encounters with an intruder mouse, we injected a Cre-dependent adeno-associated virus (AAV) expressing GCaMP6s (AAV-DIO-GCaMP6s) into the COApl of Esr1-Cre transgenic mice to label COAplEsr1+ neurons (Fig. 2a). We then measured fluorescent Ca2+ activity by fibre photometry across three days of the RI test in male and female AGGs. Because the COApl receives input from the main olfactory bulb, we first examined the response of COAplEsr1 neurons to six different odours (social (male, female and juvenile male), non-social (peanut scent, object) and predator (fox urine) scents). We found that COAplEsr1 neurons exhibited a significant increase in Ca2+ activity when mice investigated soiled bedding from a cage of male or female C57 mice, but not when they investigated the other odours (Fig. 2b,c). We also analysed the post–pre response to all six odours by generating a z-score that reflects a change from baseline, and found that the response to adult male odours was significantly higher than the response to all other odours, except juvenile males, which was trending but did not reach statistical significance (Extended Data Fig. 6a). Because previous work has shown that the COApl regulates aversive and appetitive responses to fox urine and peanut odour14, we performed RNAscope in odorant-naive mice and mice exposed to male bedding, peanut odour and fox urine. We confirmed that all odours elicited an increase in FOS in the COApl relative to naive mice (Extended Data Fig. 6b). However, when we restricted our analysis of FOS to COAplEsr1 cells, we found that only bedding elicited a significant increase in FOS relative to naive mice (Extended Data Fig. 6c,d). No significant changes in COAplEsr1 FOS were observed in response to peanut odour and predator scent. By contrast, we found that the peanut odour and fox urine elicited a significant increase in FOS cells that did not express Esr1. We observed complementary results in female mice, with a significant increase in Ca2+ activity during the investigation of soiled bedding from a cage of same-sex mice (Extended Data Fig. 6e), but not during the investigation of fox urine or an ethanol swab (Extended Data Fig. 7f,g).

Fig. 2: In vivo activity of COAplEsr1 cells during distinct bouts of investigation in male AGGs.
figure 2

a, Experimental timeline. b, COAplEsr1 activity before and after the investigation of an odour. c, There was a main effect of cue (F(5,40) = 3.689, P = 0.0077), time (F(1,8) = 10.89, P = 0.0108) and a cue × time interaction (F(5,24) = 7.716, P = 0.0002). Post-hoc comparisons revealed an increase in COAplEsr1 activity during the investigation of soiled male (P < 0.0001) and female (P = 0.0169) bedding (n = 9 male bedding, n = 9 female bedding, n = 5 peanut, n = 5 juvenile, n = 9 fox urine, n = 9 object). NS, not significant. di, COAplEsr1 activity before and after social behaviour. d,e, There was a significant increase in activity during investigation on an attack day (trial × time interaction: F(1,5) = 44.52, P = 0.0011; d) compared with investigation bouts during a no-attack day (P = 0.0002, Tukey’s post-hoc test; e). f,g, There was a significant increase in COAplEsr1 activity during investigation bouts that preceded an attack (behaviour × time interaction: F(1,5) = 9.054, P = 0.0298; f) compared with those that occurred in isolation (P = 0.0063, Tukey’s post-hoc (n = 6); g). h,i, There was a significant difference in COAplEsr1 activity before the onset of attack when mice were engaged in investigation before the attack (behaviour × time interaction: F(1,6) = 8.662, P = 0.0258; h) compared with when they were not investigating (P = 0.0175, Tukey’s post-hoc; i). No difference was observed in COAplEsr1 activity during attack, regardless of whether it was preceded by a bout of investigation (P = 0.9989, Tukey’s post-hoc) (n = 7). *P < 0.05, **P < 0.01, ***P < 0.001. All data are mean ± s.e.m. Scale bar, 200 μm. Data from this figure were replicated in two cohorts. The illustrations in a were created with BioRender.

Source Data

During the RI test, we observed that COAplEsr1 neurons exhibited a significant increase in Ca2+ activity during bouts of investigation in trials where an attack occurred, relative to bouts of investigation during trials in which no attack occurred (Fig. 2d,e). By contrast, we observed the opposite effect in females: COAplEsr1 neurons showed a significant increase in Ca2+ activity during investigation trials in which no attack occurred (Extended Data Fig. 6h). When examining individual investigation bouts during trials in which an attack occurred, we found that COAplEsr1 neurons increased Ca2+ activity only during bouts of investigation that preceded an attack, compared with bouts of investigation that occurred in isolation (Fig. 2f,g). In females, we did not detect any differences in Ca2+ activity in female AGGs between the two types of investigation (Extended Data Fig. 6i). Finally, when examining attack bouts, we found that when attacks were preceded by a bout of investigation, there was no further increase in Ca2+ activity during the attack. When an attack occurred spontaneously without prior investigation, we found that there was a significant increase in Ca2+ activity during the attack in male (Fig. 2h,i) but not in female (Extended Data Fig. 6j) AGGs. In a separate cohort, we recorded Ca2+ activity during social encounters across the four phases of the oestrous cycle, but did not observe any differences in the signal during attack or investigatory behaviours as a function of cycle stage (Extended Data Fig. 6k–m).

Manipulating COAplEsr1 cells alters consummatory drive

The results discussed above suggest that COAplEsr1 neurons are highly active during the transition from the appetitive phase (approach and investigate) of aggressive social interactions to the consummatory phase. To test the hypothesis that this cell population mediates this transition, we first used viral vectors expressing designer receptors exclusively activated by designer drugs (DREADDs) to bidirectionally manipulate the activity of COAplEsr1 neurons. Around three to four weeks before the RI and social self-administration tests, we injected AAV-DIO-hM3Dq, AAV-DIO-hM4Di or AAV-DIO-mCherry viruses into the COApl of eight-week-old Esr1-Cre mice (Fig. 3a,b). We found that inhibiting COAplEsr1 neurons led to a marked reduction in total attack duration and a concomitant increase in total investigation. Conversely, we found that exciting COAplEsr1 neurons led to a significant increase in total attack duration without a decrease in total investigation (Fig. 3c,d). We also injected AAV-DIO-hM4Di into the medial portion of the COAp and did not see any changes in attack behaviour (Extended Data Fig. 7j–l), which is consistent with a previous lesion study in rats15. When examining distinct aggressive actions, we found that the number of bites during RI was affected most by the inhibition or excitation of COAplEsr1 neurons (Extended Data Fig. 7a–c). Furthermore, we found that inhibiting COAplEsr1 with AAV-DIO-hM4Di increased anogenital investigation and decreased the number of active withdrawals (Extended Data Fig. 7d–f). Because COAplEsr1 neurons receive input from the main olfactory bulb14,16,17, we ran two control experiments to ensure that the observed alterations in social behaviour were not due to anosmia. We first ran a hidden food test to assess general olfactory processing18. In the test, mice are food-restricted overnight and must find a piece of food buried under bedding by using their sense of smell. Inhibiting COAplEsr1 neurons did not affect the ability of the mice to locate the food (Fig. 3e). Next, we tested the ability of male AGGs to differentiate between males and females19. Male AGGs were placed in an open-field arena with a male and a female mouse under wire mesh cups on opposite sides of the arena. We computed a discrimination ratio in which the difference in time spent investigating the male and the female was divided by the total time spent investigating both mice. A negative score indicates more time spent investigating the male, and a positive score indicates more time spent investigating the female. We found that inhibiting COAplEsr1 neurons did not affect the males’ preference for investigating the female mice (Fig. 3f).

Fig. 3: Manipulating COAplEsr1 cells alters consummatory drive in male AGGs.
figure 3

a, Experimental timeline. b, Virus expression in the COApl. 3V, third ventricle. c,d, Inhibition of COAplEsr1 significantly decreased total aggression (c; virus × drug interaction: F(2,27) = 9.687, P = 0.0007, Sidak’s post-hoc P = 0.0133) and increased total investigation (d; virus × drug interaction: F(2,27) = 8.305, P = 0.0035, Sidak’s post-hoc P = 0.0035). Excitation significantly increased aggression (Sidak’s post-hoc P = 0.0142) without affecting investigation (Sidak’s post-hoc P = 0.2174) (n = 10 HM4di, n = 10 HM3dq and n = 10 mCherry). e,f, Inhibition of COAplEsr1 did not affect the latency to find hidden food (e; virus × drug interaction: F(1,16) = 1.192, P = 0.2911) or affect sex discrimination (f; virus × drug interaction: F(1,16) = 0.5122, P = 0.4845) (n = 9 HM4di and n = 9 mCherry). gi, Closed-loop optogenetic inhibition reduced total time attacking (g; virus × laser interaction: F(1,11) = 6.838, P = 0.0240, Sidak’s post-hoc P = 0.0007), decreased the percentage of interactions with an attack (h; virus × laser interaction: F(1,11) = 12.84, P = 0.0043, Sidak’s post-hoc P = 0.0006) and slightly increased total investigation time (i; virus × laser interaction: F(1,11) = 4.919, P = 0.0485, Sidak’s post-hoc P = 0.0782) (n = 7 NpHR and n = 6 YFP). jl, Social self-administration experiments. Both groups increased the number of rewarded trials with attacks (j; main effect of session: F(15,135) = 5.382, P < 0.0001). Inhibition had no effect on lever pressing (k; virus × drug interaction: F(1,18) = 0.3147, P = 0.5817) but led to a significant reduction in the percentage of rewarded trials that led to an attack (l; virus × drug interaction: F(1,18) = 13.60, P = 0.0022, Sidak’s post-hoc P < 0.0001) (n = 11 HM4di and n = 9 mCherry). *P < 0.05, **P < 0.01, ***P < 0.001, ****P < 0.001. All data are mean ± s.e.m. Scale bar, 1 mm. Data from c,d,jl were replicated in two cohorts; all other data are from a single cohort. The illustrations in a were created with BioRender.

Source Data

To further support the idea that COAplEsr1 neurons have a role in mediating the transition from the appetitive to the consummatory phase of aggression, we performed a closed-loop optogenetic inhibition study. Male mice were injected with AAV-halorhodopsin (NpHR) or AAV-YFP. The laser was turned on as the resident approached the intruder, and was kept on for 10 s. We found that inhibiting COAplEsr1 neurons decreased attack behaviour (Fig. 3g,h) and increased investigation (Fig. 3i). We also tested whether optogenetic inhibition of the COAplEsr1 neurons altered mating behaviour, but did not find any differences in total mounting duration, number of mounts or investigation while the laser was on (Extended Data Fig. 7m–o). Finally, we tested whether inhibiting COAplEsr1 neurons altered the motivation to engage in attack behaviour by using the aggression self-administration paradigm20. We found that both the mCherry and the hM4Di groups learned the task equally well in terms of rewarded trials and the occurrence of attacks (Fig. 3j and Extended Data Fig. 7g). After the acquisition of the task, mice were tested using a counterbalanced injection regimen (clozapine-N-oxide (CNO) or saline). We did not observe any difference in lever presses (Fig. 3k) between the two groups on CNO, which suggests that COAplEsr1 cells do not affect the reinforcing properties of social interaction. However, we observed a marked decrease in the percentage of rewarded trials that led to an attack (Fig. 3l). We also tested mice on a progressive schedule and did not find a difference in the maximum number of lever presses made for access to an intruder, which suggests that the COAplEsr1 cells do not regulate the motivation to work for access to an intruder (Extended Data Fig. 7h). Finally, manipulations of COAplEsr1 neurons in female AGGs during the RI test did not affect attack (Extended Data Fig. 8a–c) or investigation behaviours (Extended Data Fig. 8d–f). Collectively, these results suggest that inhibiting COAplEsr1 neurons selectively alters the consummatory drive in social interactions in male AGGs.

Inhibiting COApl alters network connectivity

After determining the effect of inhibiting COAplEsr1 neurons on aggressive behaviour in males, we sought to investigate how inhibiting this cell population alters the connectivity of the pink module from the AGG network. To this end, we injected eight-week-old male AGGs with AAV-DIO-hM4Di or AAV-DIO-mCherry. After recovery from surgery, all mice were given an injection of CNO before the last RI test and were perfused 90 min later (Fig. 4a). As expected, inhibiting COAplEsr1 cells decreased attack duration and increased investigation duration (Fig. 4b,c and Extended Data Fig. 9a–f). Brains were perfused, cleared, imaged and registered to the Allen Brain Atlas. We then constructed a network for each group of mice. For visualization, the clusters were organized according to the original AGG network (pink module) to ensure that the same brain regions would make up similar clusters in the hM4Di and mCherry networks (Fig. 4d–g). As in the modules from Fig. 1, visual inspection indicated a high degree of interconnectedness between amygdalar and hypothalamic subregions under control mCherry conditions. After inhibition of COAplEsr1 cells, we observed high levels of interconnectedness within, but not between, amygdalar and hypothalamic subregions, which is consistent with the data from NONs in Fig. 1. We also found that inhibiting COAplEsr1 cells with hM4Di significantly decreased the expression of the pink module, relative to the mCherry group (Fig. 4d). We next determined whether the hM4Di and mCherry networks differed in how well they preserved the pink module in the original AGG network. To this end, we performed a module preservation analysis separately for each network, with the original AGG network serving as the reference network. Using the same metrics as those in Fig. 1, we found that the hM4Di network showed a significant decrease in these metrics compared with the mCherry network (Fig. 4e), which suggests that inhibiting COAplEsr1 neurons diminished the preservation of the pink module found in the original network. Of the remaining seven clusters, the hM4Di group only showed a significant decrease in the ‘red’ cluster (Extended Data Fig. 9g). Notably, this cluster contains regions to which COAplEsr1 neurons project, including the bed nucleus of the stria terminalis (BNST), the anteroventral periventricular nucleus and the substantia innominata. When examining FOS counts in individual regions of the pink network, we found that 78% of regions showed a significant reduction in FOS cells after inhibition with hM4Di (Fig. 4h and Extended Data Fig. 9h).

Fig. 4: Manipulating COAplEsr1 cells alters connectivity in the pink module.
figure 4

a, Experimental timeline. b,c, Inhibition of of COAplEsr1 cells reduces attack duration (b; t(38) = 3.731, P = 0.0006) and increases investigation duration (c; t(38) = 4.719, P < 0.0001). d,e, The mCherry network showed higher expression of the pink module (d; t(38) = 4.442, P < 0.0001) when the two networks were combined, and preserved the connectivity and density of the pink module better than the hM4Di network did (e; t(9) = 3.983, P = 0.0032) when they were separately analysed. Each pair of points connected by a line is a single preservation metric from each network (n = 19 (HM4di) and n = 21 (mCherry)). f, Whole-brain FOS network in mice injected with mCherry or hM4Di .g, Network plot of the pink module in mice injected with mCherry (top) or with hM4Di (bottom), from the wild-type AGG network. Regions from the mCherry and hM4Di networks were plotted using the colour label from the original network. h, Of the 28 regions in the pink module, inhibition of COAplEsr1 cells significantly decreased FOS expression in 24 regions (86%). Network analyses were replicated in two cohorts. *P < 0.05, **P < 0.01, ***P < 0.001 (n = 21 mCherry and n = 19 HM4Di). All data are mean ± s.e.m. The illustrations in a were created with BioRender.

Source Data

Inhibiting COAplEsr1 neuron outputs alters aggression

We next sought to understand the involvement of regions within the pink network downstream of COAplEsr1 neurons that contribute to the behavioural effects of local COAplEsr1 manipulation (Fig. 5a). We injected HSV-1 (H129 TK-TT) to identify monosynaptic connections in downstream regions within the pink module (Fig. 5b). Many of these regions have previously been shown to promote aggressive behaviour, including the VMH, the medial amygdala (MEA), the CEA and the BNST. Furthermore, we found that COAplEsr1 neurons also projected to several regions that are involved in olfaction, such as the piriform cortex (PIR), endopiriform cortex, piriform amygdala area (PAA), post-piriform transition area and anterior olfactory nucleus. Notably, COAplEsr1 neurons formed monosynaptic connections with 13 of the 28 regions in the pink module, indicating that many of these regions are both functionally and physically connected (Extended Data Fig. 10a). The monosynaptic nature of these connections was further confirmed by injecting AAV-hSyn-FLEx-mGFP-2A-Synaptophysin-mRuby into COAplEsr1 neurons to map the anterograde expression of presynaptic inputs to the VMH and CEA. AAV-DIO-ChR2 was injected into the COAplEsr1 neurons and ChR2-assisted ex vivo electrophysiology was performed to confirm that there are functional excitatory inputs in both the VMH and the CEA (Extended Data Fig. 10b–d). In addition, of the 13 connected regions, 12 of them showed a significant decrease in FOS after inhibiting COAplEsr1 with DREADDs (Fig. 4h). On the basis of this information, we chose to target the VMH (Fig. 5c), which is necessary for aggressive behaviour, and the CEA (Fig. 5d), which has been shown to modulate jaw movements during biting, a key component of aggressive behaviour. To evaluate whether these circuits alter aggressive behaviour, we injected AAV-DIO-NpHR into COAplEsr1 neurons of eight-week-old male AGGs and implanted ferrules into either the VMH or the CEA (Fig. 5e). Four weeks later, mice were tested for two days in the RI test in which the order of testing (laser on or off) was counterbalanced. We found that inhibiting the COApl–CEA pathway resulted in a significant decrease in total attack duration without affecting social investigation (Fig. 5f,g). Alternatively, we found that inhibiting the COApl–VMH pathway produced both a reduction in attack duration and an increase in social investigation, mirroring the effects of local inhibition of COAplEsr1 neurons.

Fig. 5: Optogenetic inhibition of regions downstream of COAplEsr1 cells alters social behaviour in male AGGs.
figure 5

a, Schematic of experimental timeline and regions that receive monosynaptic input from COAplEsr1 neurons revealed by HSV-1 trans-synaptic anterograde tracing. Scale bar, 100 μm. b,c, Images of FOS+ cells in the ventrolateral portion of the VMH (VMHvl) (b) and CEA (c) from mice injected with hM4Di or mCherry. d, Schematic of behavioural set-up. e, Inhibition of terminals in the VMH with NpHR reduces attack duration in mice injected (virus × laser interaction: F(1,14) = 7.893, P = 0.0139, Sidak’s post-hoc P = 0.0048) and increases investigation duration (virus × laser interaction: F(1,14) = 4.939, P = 0.0436, Sidak’s post-hoc P = 0.0402). f, Inhibition of terminals in the CEA reduces attack duration in mice injected with NpHR (virus × laser interaction: F(1,17) = 3.654, P = 0.0729, Sidak’s post-hoc P = 0.0239) but has no effect on investigation duration (virus × laser interaction: F(1,17) = 0.3555, P = 0.5589, Sidak’s post-hoc P = 0.3696) (n = 9 (VMH NpHR), n =  7 (VMH YFP), n = 11 (CEA NpHR) and n = 8 (CEA YFP)). Scale bar, 200 μm. *P < 0.05, **P < 0.01; NS, not significant. All data are mean ± s.e.m. The illustrations in a,d,e,f were created with BioRender. PVH, paraventricular nucleus of the hypothalamus; NAc, nucleus accumbens; AON, anterior olfactory nucleus; ARH, arcuate nucleus of hypothalamus; OT, olfactory tubercle; EP, endopiriform nucleus.

Source Data

Discussion

Using an unsupervised approach to analyse whole-brain FOS patterns, we identified COApl as a key region that controls the transition from social investigation to aggressive behaviour in male—but not in female—mice. Of note, many of the regions that are highly connected to the COApl have previously been identified as part of the ‘core aggression circuit’; for example, the MEA, VMH and BNST. Furthermore, many of these regions receive inputs from both the main olfactory bulb (COApl, anterior cortical amygdala (COAa), PIR and PAA) and the accessory olfactory bulb (MEA and COApm) and project to multiple downstream regions in the hypothalamus17. Because both of these sensory streams are necessary for aggressive social behaviour21,22, olfactory cues detected by each stream are likely to be detected in parallel and converge in hypothalamic regions such as the VMH to induce specific social behaviours. Given that these regions are clustered together with many other brain regions whose functions have not been examined in the context of aggression, it is possible that the core aggression circuit is larger than previously considered and requires further investigation.

According to our current understanding of the circuitry that mediates aggression, one might predict that a loss-of-function manipulation in the COApl would result in decreased aggression, owing to the lack of social approach10,23. This expectation is perhaps due to previous studies that have shown that loss-of-function manipulations in the main olfactory bulb, which projects to the COApl, reduce social investigation and aggression21,22. However, our findings that COAplEsr1 neurons are more active during RI trials in which an attack occurs, and are active specifically during investigation bouts that precede an attack, suggest that this region is not simply relaying olfactory ‘cues’ to downstream regions. This is further supported by our results showing that inhibiting COAplEsr1 neurons increases investigation rather than decreasing it, without resulting in anosmia. In addition, our finding that COAplEsr1 neurons respond to odours from conspecifics, but not those from predators, suggests that they are not acting as a simple ‘threat detector’, which is in line with a previous study that showed that the COApl is not involved in fear responses to predator odour19. Although it was previously reported that the COApl is required for attraction to non-social odorants such as 2-phenylethanol, these studies were not performed in a cell-type-specific manner14. Our data support the idea that COAplEsr1 neurons are activated exclusively by odours emitted from social conspecifics, and therefore shape the type of social encounter that ensues.

One potential explanation of our findings is that COAplEsr1 neurons are involved in the motivation to attack the intruder, thereby regulating the rewarding and reinforcing properties of aggression24 (Extended Data Fig. 11). In support of this explanation, inhibiting COAplEsr1 neurons with hM4Di robustly decreased the percentage of rewarded trials that led to an attack in an aggression self-administration task. However, inhibiting COAplEsr1 neurons did not change the number of lever presses, and mice in both groups worked equally hard for access to a social target, suggesting that their motivation to interact with the intruder—albeit in a less aggressive and more pro-social way—remained intact. Some previously published studies of other nuclei that make up the pallial amygdala (basolateral, basomedial, cortical and posterior amygdala) support its role in rodent social behaviour25,26,27. Inhibiting basolateral amygdala (BLA) inputs to the ventral hippocampus and the medial prefrontal cortex increases affiliative social behaviour in mice, although aggression was not assayed in these studies. Conversely, manipulating the posterior amygdala alters aggressive behaviour without affecting pro-social investigation28,29. Pallial amygdala subcircuits have also been implicated in social behaviour in studies of humans and non-human primates. These studies have focused largely on the BLA and the lateral amygdala, given their extensive connections with the visual system30,31, on which primates are highly reliant during social interactions. Some studies have shown that neurons in the BLA fire when primates make eye contact with one another, and bilateral lesions often reduce fear of others and limit aggression. However, some contradictory results have also been reported, perhaps owing to the use of non-specific excitotoxic lesions (reviewed in ref. 32). A study in which the GABA (γ-aminobutyric acid) agonist muscimol was used to reversibly inhibit the BLA increased affiliative behaviours between pairs of rhesus monkeys, whereas activating the BLA resulted in social withdrawals without affecting anxiety33, mirroring our findings in mice. Furthermore, single-unit recordings in humans indicate that neurons in the amygdala are sensitive to the subjective perception of emotions shown in facial stimuli, as opposed to just the features of the stimuli34. This suggests that the amygdala of different individuals can respond differently to the same sensory cues depending on the behavioural state or belief of the individual. Collectively, these findings have led to the interpretation that the amygdala has a key role in social perception35,36. Thus, it is tempting to speculate that COApl has a role in the perception of the intruder, which is affected by the ‘aggressive state’ of the resident. Internal states have previously been shown to bias perception towards specific actions in other areas of rodent research12,37,38,39. Given the marked sex differences observed, gonadal state might also contribute. Cells that express ESR1 are sensitive to oestradiol, and thus, it is possible that sex steroid hormones modify neural circuits that are involved in olfaction, thereby determining how particular odours are interpreted by the animal40. For example, gonadectomy eliminates males’ preference for receptive female odours and the avoidance of male odours with fighting experience. In the context of aggression, given that AGGs have higher levels of circulating testosterone than do NONs4, it is possible that this contributes to the perceived importance of odours from the intruder in a sex-specific way. Together, our research provides a foundation for understanding the neural mechanisms that underlie social perception and action selection. Future studies that aim to delineate the mechanisms by which internal states and perceptual processes interact to execute distinct behaviours during dyadic social interactions will thus be crucial.

Methods

Mice

Wild-type Swiss-Webster (SW) mice (male and female, 12–15 weeks; Charles River) and Esr1-Cre mice (017911, B6N.129S6(Cg)-Esr1tm1.1(cre)And/J; Jackson Laboratory) were crossed with SW females to obtain F1 mice used as experimental mice. Intruders for the RI test were 8–12-week-old male or female C57/BL6J mice (Jackson Laboratory). All delivered mice were allowed one week of acclimation to the housing facility before any experimental protocol. At four weeks, mice were separated from their littermates and paired with a member of the opposite sex for sexual experience for two days at eight weeks of age. Females were paired with castrated SW males (8–12 weeks; Charles River) to prevent pregnancy. All mice were maintained on a 12 h–12 h light–dark cycle (07:00–19:00) with ad libitum access to food and water. Housing and experimental rooms were maintained at 20–22 °C and 40–60% humidity. Experiments were performed during the light phase. Animals were randomly assigned to groups, arena or treatments, and data analysis was done in a double-blind fashion. Sample sizes were chosen according to experience and historical studies. Procedures were performed in accordance with the National Institutes of Health Guide for Care and Use of Laboratory Animals and were approved by the Icahn School of Medicine at Mount Sinai Institutional Animal Care and Use Committee.

RI test

Mice were screened using protocols adapted from previous studies3,41,42. In brief, cage tops were removed and replaced with plexiglass covers to monitor trials. A novel C57BL/6J mouse matching the sex of the resident was introduced into each cage and mice were allowed to freely interact for 5 min. After this, intruder mice were returned to their home cages and, in the case of female RI trials, cohabiting male mice were returned to their home cages. For the male mating assay, SW female intruders were pre-screened for sexual receptivity. All assays lasted 10 min and intruder mice were returned to their home cages at the end of the session. All videos were recorded for later analysis. Resident behaviours were manually annotated using Observer XT 11.5 (Noldus Interactive Technologies).

Aggression self-administration test

Aggression self-administration testing was performed as previously described. In brief, SW resident mice were placed in standard Med Associates operant chambers and underwent eight trials per day for 16 days in which they could press a lever (FR1) to receive access to a subordinate same-sex mouse through a guillotine door into their operant chamber. A house light illuminated the chambers during trials, and an inactive lever was extended at all times. At the beginning of a trial, the house light was turned on, and a lever was extended 10 s later. If the resident pressed for a reward, a 2-s tone played and a guillotine door next to the active lever opened for 12 s. A same-sex C57BL/6J intruder manually pushed into the chamber, and the intruder was removed at the end of the trial. If residents did not press, the active lever retracted after 60 s. All chambers also had recessed food pellet receptacles with beam–break registered entry ports. We performed all progressive ratio (PR) tests using the same parameters as those in self-administration training, except for the trial design. After reward obtaining (number of required active lever presses for a given trial), the automatic guillotine door was opened for 10 s and the same-sex intruder (C57BL/6J) was manually pushed inside the main operant chamber. Immediately after the automatic door closed, the active–inactive levers were re-extended. The intruder mouse was removed from the chamber after an attack or after 30 s had elapsed. The PR session was terminated if no reinforced responses occurred after a total duration of 20 min had elapsed. Throughout the sessions, for each trial, the number of responses required to activate the guillotine door and gain access to the intruder was incremented following an exponential progression (R = (5 × e0.12P) − 5, where P is the previous ratio). The breakpoint value corresponds to the total number of rewards (number access to the intruder during the whole session). Esr1-cre mice transfected in the COApl with AAV9-DIO-hM4Di-mCherry or AAV9-DIO-mCherry (see below for titre, surgery information and coordinates) were administered either saline or CNO, counterbalanced over the two days of the PR. Acquisition of self-administration was monitored in one of two cohorts. The data in Fig. 3j are from cohort 2.

Hidden food test

Mice were habituated to and allowed to consume a palatable food (a Reese’s mini peanut butter cup) two days before being tested. Mice were then food-restricted the night before the test. Mice were tested under red light and placed in a clean cage. The food was placed 8 cm deep in the bedding of the cage and the time to find the food was recorded with a stopwatch.

Sex discrimination test

Male and female C57BL/6J mice were used as target mice and placed on opposite sides of an open-field enclosure in mesh cups. Test mice were placed in the open field and allowed to explore the arena for five minutes under red light. Mice were recorded with an overhead Ethovision camera and the time spent interacting with each mouse was scored offline manually. To calculate the discrimination ratio, the total time spent interacting with both mice was divided by the difference between the time spent with the female and male. A positive discrimination ratio indicates more time spent with the female, and a negative ratio indicates more time spent with the male.

Perfusion and brain-tissue processing

For iDISCO+, mice were injected with 10% chloral hydrate and perfused transcardially with ice-cold 1× phosphate-buffered saline (PBS) (pH 7.4), followed by fixation with cold 4% paraformaldehyde in 1× PBS. Brains were post-fixed for 12 h in the same fixative at 4 °C. For FISH, brains were rapidly removed and flash-frozen in −30 °C isopentane for 5–10 s, then kept at −80 °C until sectioning. Slices were sectioned at 15 μm using a cryostat (Leica). Mice injected with H129ΔTK-TT were perfused 48 or 70 h after injection.

Histology and imaging

For FISH, RNAscope Multiplex Fluorescent Kits (Advanced Cell Diagnostics) were used according to the manufacturer’s instructions. Fresh-frozen brains were mounted on slides at a thickness of 15 μm, fixed for 15 min in cold 4% PFA and dehydrated serially with 50%, 70% and 100% EtOH/H2O for 2 min each, followed by 20 min Protease IV (RNAscope) treatment. Proprietary probes (Advanced Cell Diagnostics) for Fos (316921, accession no. NM_010234.2), Vglut1 (also known as Slc17a7) (SLC17A7-C3, accession no. NM_182993.2) and Esr1 (478201-C2, accession no. NM_007956.5) were hybridized at 40 °C for 2 h, then subjected to a series of amplification steps at 40 °C (1-FL, 30 min; 2-FL, 15 min; 3-FL, 30 min; 4-FL, 15 min). Reagent Alt-A was used for the fourth amplification step, with channel 1 at 488 nm, channel 2 at 550 nm and channel 3 at 647 nm. Finally, slides were treated for 30 s with DAPI and immediately coverslipped with Eco-Mount. All slices were imaged using a Zeiss LSM 780 confocal microscope. Cells from all ISH images (two per sample) were counted blindly across groups at 20×. Cells with at least five puncta for each probe were considered to be positive for the probe of interest. Cell nuclei were counted by creating a 16-bit greyscale image of the DAPI channel. A threshold was created and nuclei were counted using the ‘analyze particles’ plug-in. Two sections per sample were analysed for quantification of mRuby+ puncta at 40× using the ‘analyze particles’ function. Each section contained three or four optical sections at 4-μm intervals. Starter cells from two sections were manually counted.

iDISCO+ staining, imaging and ClearMap analysis

The iDISCO+ staining protocol was modified from http://www.idisco.info (ref. 43). Fixed whole brains were incubated with the primary FOS antibody (226003, 1:1,000, Synaptic Systems) and secondary donkey anti-rabbit IgG (H+L) highly cross-adsorbed secondary antibody, Alexa Fluor 647 (A-31573, 1:1,000, Thermo Fisher Scientific) for seven days each. A LaVision light-sheet microscope with zoom body was used for half-brain sagittal scanning, with dynamic focus and a step size of 4 μm. Cleared brains were processed as previously described using ClearMap13. FOS+ cells were quantified using the cell detection module, with cell detection parameters optimized and validated according to the intensity and shape parameters of the signal. The autofluorescence channel was aligned to the Allen Institute’s Common Coordinate Framework using the Elastix toolbox. To compare cell counts between AGGs and NONs in both sexes and hM4Di versus mCherry, a negative binomial regression was applied using the glm.nb function from the MASS package in R. Group classifications were dummy coded (0 for the AGG group and 1 for the NON group). The maximum-likelihood coefficients α and β were determined through iterative reweighted least squares. A significant β means that group status is related to cell count number at the specified region of interest. z-scores correspond to this β coefficient, normalized by its sample standard deviation. P values were corrected for multiple comparisons using the Benjamini–Hochberg procedure to decrease the false discovery rate. q values below 0.05 were considered significant. For network analysis, the data were expanded to 480 brain regions. For glm analysis, the data were collapsed to 271 regions.

Stereotaxic surgery and viral-gene transfer

Esr1-Cre mice (8–10 weeks old) were anaesthetized with an intraperitoneal injection of ketamine HCl (100 mg kg–1) and xylazine (10 mg kg–1) and positioned on a stereotaxic instrument (David Kopf Instruments). In the lateral portion of the COAp (COApl) (bregma: AP −1.7 mm; ML ±2.8 mm; DV −5.9 mm), 0.3 μl of virus was bilaterally infused using 33-gauge Hamilton needles over 5 min, with needles left in place for 5 min after injection. For virus delivery, 0.3 μl of AAV8-hSyn-DIO-hM3D-mCherry (2.0 × 1012 vg ml–1, no. 44361-AAV8, Addgene), AAV9-hSyn-DIO-hM4D-mCherry (2.0 × 1012 vg ml–1, no. 44362-AAV9, Addgene) or AAV9-hSyn-DIO-mCherry (2.0 × 1012 vg ml–1, no. 50459-AAV9, Addgene) was injected into the COApl. We also injected 0.3 μl AAV9-hSyn-DIO-hM4D-mCherry (2.0 × 1012 vg ml–1, no. 44362-AAV9, Addgene) into the COApm (bregma: AP −2.4 mm; ML ±2.0 mm; DV −5.6 mm). For anterograde tracing, 0.3 μl of AAV1-hSyn-FLEx-mGFP-2A-Synaptophysin-mRuby (3 × 1012 vg ml–1, no. 7161-AAV1, Addgene) or 0.2 μl of H129ΔTK-TT (4.0 × 109 vg ml–1, Center for Neuroanatomy with Neurotropic Viruses) was injected unilaterally into the COApl. For optogenetic manipulations, AAV9-Ef1a-DIO eNpHR3.0-YFP (3.0 × 1012 vg mL–1, no. 26966-AAV9, Addgene) or AAV9-EF1a-DIO-YFP (3.0 × 1012 vg ml–1, no. 20298-AAV9, Addgene) was injected into the COApl. All AAV injections were performed three to four weeks before behavioural experiments. For optogenetic (NpHR) and FP experiments, cannulae (NpHR: MFC_200/240-0.22_3mm_MF1.25_FLT; FP: MFC_200/250-0.57_3mm_MF1.25_FLT) were implanted at the same time as viral delivery (for COApl local, fibres were implanted 0.2 mm above the injection site). For optogenetic (eNpHR3.0) experiments of COApl terminal stimulation, cannulae (MFC_200/240-0.22_MF1.25_FLT, 6 mm for VMHvl, 5 mm for CEA) were bilaterally implanted into the VMHvl (from bregma: AP −1.7 mm; ML ±2.5 mm; DV −5.5 mm, 20° angle), or CEA (from bregma: AP −1.5 mm; ML ±2.5 mm; DV −4 mm, 0° angle). For secure fixture of the optic fibre, dental cement (Grip cement; Dentsply) was added to the skull and around the fibres.

DREADD manipulation

CNO (1 mg kg–1, Tocris) was given intraperitoneally 30 min before the RI test, open field, aggression self-administration, hidden food and sex discrimination tests.

Optogenetics manipulation

For yellow (eNpHR3.0) light stimulation, optical fibres (BFP(2)_200/220/900-0.22_4m_FCM-2xMF1.25, Doric Lenses) were connected to a 589-nm yellow laser diode (no. MGL-III-589-50mW, Opto Engine LLC) using a patch cord with a FC/PC adaptor (no. MFP_200/240/900-0.22_4m_FC-MF1.25, Doric Lenses). A function generator (no. 33220A, Agilent Technologies) was used to generate constant yellow light for eNpHR3.0 experiments during the five-minute RI test. For all optogenetics tests, experimental mice were habituated to patch cords for two days before testing in RI. For RI experiments, mice were tested over two days, counterbalanced under laser-on and laser-off conditions For closed-loop behavioural experiments, the laser was turned on for 10 s as the resident initiated approach of the intruder for every other approach bout in a counterbalanced manner. Attack behaviour was quantified during the period when the light was on. For mating experiments, the light was left on for the duration of the experiment.

Fibre photometry

Fibre photometry was performed according to the Neurophotometrics manual and published protocols5. A fibre-optic patch cord was attached to the implanted cannula with cubic zirconia sleeves covered with black tubing. The opposite end of the cable was coupled to a Neurophotometrics LED port. The open-source Bonsai programme was used to control the system; 470-nm and 415-nm LED lights were used for GCaMP6s signal and autofluorescence measurement. Light at the fibre tip ranged from 40 μW to 80 μW and was constant across trials over testing days. Simultaneous recording of 40 fps from both the 470-nm and the 415-nm channel was achieved phase-to-phase and visualized using Bonsai. Three weeks after virus injection and ferrule implantation, mice were tested in the RI test and were presented with different odours in a counterbalanced manner. Once connected to the apparatus, mice were allowed to rest and habituate for 3–5 min before starting. For the RI test and odour presentation, we recorded Ca2+ fluorescence during 2 min of baseline activity without an intruder, followed by 5 min of intruder or odour exposure. The 415-nm channel served as the control channel and was subtracted from the GCaMP6s channel to eliminate autofluorescence, bleaching and motion effects. Change in fluorescence (ΔF/F) was computed by subtracting the average value during the final minute of baseline recording and then dividing the resulting value by the averaged value during the final minute of baseline. This value was then z-scored by subtracting the average ΔF/F from each value and dividing by the standard deviation. Behavioural data were manually annotated in Ethovision and time stamps were aligned with fluorescence recording.

LFP recordings

Esr1-Cre × SW male mice (around three to four months old) were anaesthetized using a mix of ketamine and xylazine, and placed in a stereotaxic apparatus (David Kopf). After exposing the skull, custom-made platinum–iridium depth electrodes (Pinnacle Technology) were implanted in the CoApl (from bregma: AP −1.7 mm; ML ±2.8 mm; DV −5.7 mm) in the VMH (from bregma: AP −1.7 mm; ML ±0.7 mm; DV −5.8 mm) Before implantation, the electrodes were coated with Vybrant Dil cell-labelling solution (Invitrogen) to later check for the placement of the electrode. Two skull screws (0.25 cm, Pinnacle Technology) were implanted over the left and right cerebellum to serve as ground and common reference for recording LFPs. Electrodes and reference screws were connected to a 6-pin connector for mice (Pinnacle Technology) and sealed using dental cement (Metabond). After surgery, mice recovered for at least one week in standard housing conditions before behavioural testing. All recordings were performed in the mouse home cage and the behavioural sessions were videotaped with an overhead camera connected to Ethovision 15 (Noldus). A transistor–transistor logic signal was sent through Ethovision to the LFP acquisition software to synchronize behavioural and neurophysiological data. LFP signals were captured using a tethered data acquisition system (Model 8401HS, Pinnacle Technology) and acquired using Sirenia Acquisition software (Pinnacle Technology). Data were acquired at 2 kHz using a Pinnacle Technology preamplifier (gain ×100) and with high-pass (0.5 Hz) and low-pass (200 Hz) filters. Signals were segmented into single trial epochs aligned to stimulus-onset.

LFP analysis

Raw data files were loaded into R and analysed with the PSD package44. The signal was low-pass-filtered up to 200 Hz using a Butterworth filter before analyses. Signal from the first two seconds of an attack or investigation bout that did not precede an attack was selected for analysis. We chose the first two seconds because all behaviours of interest lasted at least two seconds. A fast Fourier transform with multiple sine tapers45 was performed on each segment. Data were then bandpass-filtered for the delta (1–4 Hz), theta (5–12 Hz) and gamma (40–100 Hz) frequency bands. Coherency (defined as the cross-spectral density divided by the auto-spectral density) values were computed from 0 Hz to 100 Hz using the pspectrum function for each event and averaged across all events for each value. Coherency values from a one-minute baseline period were subtracted from the coherency values obtained during social behaviours.

Ex vivo electrophysiology

For recording optically evoked excitatory postsynaptic currents (oEPSCs), AAV9-EF1a-DIO-ChR2-eYFP (0.5 μl, 3.0 × 1012 vg ml–1, Addgene, 35509-AAV9) was injected unilaterally into the COApl of eight-week-old male Esr1-Cre mice. At five to eight weeks after injection, coronal brain slices of the VMH and CEA were prepared using a Compresstome (no. VF-210-0Z, Precisionary Instruments) in cold (0–4 °C) sucrose-based artificial cerebrospinal fluid (aCSF) containing 87 mM NaCl, 2.5 mM KCl, 1.25 mM NaH2PO4, 4 mM MgCl2, 23 mM NaHCO3, 75 mM sucrose and 25 mM glucose. Slices were transferred to a recording chamber continuously perfused at 2–3 ml min–1 with oxygenated aCSF. Patch pipettes (4–7 MΩ) were pulled from thin-walled borosilicate glass using a micropipette puller (P-97, Sutter Instruments) and filled with a potassium gluconate (KGlu)-based intrapipette solution containing 116  mM KGlu, 20 mM HEPES, 0.5 mM EGTA, 6 mM KCl, 2 mM NaCl, 4 mM ATP, 0.3 mM GTP and 2 mg ml–1 biocytin (pH adjusted to 7.2). Cells were visualized using an upright microscope with an IR-DIC lens and illuminated with a white light source (Scientifica). Illumination with a 470-nm LED (pE-300ultra, CoolLED) through the microscope objective was used for visualizing eYFP+ cells. VMH and CEA neurons were recorded in voltage-clamp mode. COAplEsr1 terminals were stimulated through the microscope ×40 objective (5 ms per pulse, 470 nm; pE-300ultra, CoolLED). oEPSCs were recorded at −70 mV in the presence of tetrodotoxin (TTX, 1 μM, Tocris) and 4-aminopyridine (100 μM, Tocris) to probe monosynaptic effects. oEPSCs were blocked by bath application of NBQX (no. SR-95531, 5 μM, Tocris) confirming the glutamatergic nature of the synaptic contact. Whole-cell recordings were performed using a patch-clamp amplifier (Axoclamp 200B, Molecular Devices) connected to a Digidata 1550 LowNoise acquisition system (Molecular Devices). Signals were low-pass-filtered (Bessel, 2 kHz) and collected at 10 kHz using the data acquisition software pCLAMP 11 (Molecular Devices). Electrophysiological recordings were extracted and analysed using Clampfit (Molecular Devices).

Weighted correlation network analysis

For network construction, we followed previously published guidelines46. In brief, an n × n adjacency matrix was created that encodes the connection strengths between pairs of nodes (brain regions), using the power adjacency function: Aij = |sij|β. Aij refers to the adjacency matrix and sij refers to the correlation between regions i and j raised to the power of β. The correlation is raised to the power of β to reduce the influence of potentially specious correlations. To measure the similarity between the nodes for clustering, the topological overlap measure (TOM) was used: \({{\omega }}_{i,j}=\frac{{l}_{ij}\,+\,{a}_{ij}}{\min \{{k}_{i,}{k}_{j}\}+1-{a}_{ij}}\). ωi,j refers to the TOM matrix, \({l}_{ij}={\sum }_{u}{a}_{iu}{a}_{uj}\) and aij = |si|β. In words, this is the sum of the product of the shared connections between regions i and j plus the direct connection between regions i and j. This value is divided by the denominator to achieve a value between 0 and 1. To compare the expression of these modules between sexes within a network, a singular value decomposition (SVD) was computed on each module. The SVD is defined as: \({X}^{n}=U\times S\times {V}^{{\rm{T}}}\). Xn is the TOM matrix for the nth module in the network, U and VT are matrices of orthonormal vectors and S is a diagonal matrix of eigenvalues that denote how much variation is accounted for by each column of U and V. To determine which modules differed between the AGG and NON networks, or whether the mCherry and hM4Di networks conserved module connectivity and density, we used the module preservation function. For comparisons between networks we focused on the following measures for connectivity: Z.cor KIM, Z.cor.KME, Z.cor.KMEall, Z.cor.cor and Z.cor.MAR. For density measures, we focused on Z.propVarExplained, Z.meanSignAwareCorDat, Z.meanAdj and Zmean.MAR. All z values were derived by randomly permuting the module labels in the test network and calculating the corresponding preservation metric. The average value of each statistic from the permutations is subtracted from the observed statistic and divided by the standard deviation of the statistic from the permutations. For a detailed explanation of the preservation measures, see Supplementary Table 2. All of the above steps were performed using the WGCNA package in R.

Statistical analysis

All statistical tests and associated information are reported in the figure legends. All t-tests, one- and two-way ANOVAs were performed using GraphPad Prism software. Two-way ANOVA analysis was followed by Šídák’s or Tukey’s multiple-comparisons test for post-hoc analysis. One-way mixed-effects ANOVA was followed by Tukey’s post-hoc test. For comparisons between groups for region by region iDISCO+ analysis, P values were corrected for multiple comparisons using the Benjamini–Hochberg procedure to reduce the false discovery rate. q values below 0.05 were considered significant.

Reporting summary

Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.