Unveiling serotonergic dysfunction of obsessive-compulsive disorder on prefrontal network dynamics: a computational perspective

Serotonin (5-HT) regulates working memory within the prefrontal cortex network, which is crucial for understanding obsessive-compulsive disorder. However, the mechanisms how network dynamics and serotonin interact in obsessive-compulsive disorder remain elusive. Here, we incorporate 5-HT receptors (5-HT1A, 5-HT2A) and dopamine receptors into a multistable prefrontal cortex network model, replicating the experimentally observed inverted U-curve phenomenon. We show how the two 5-HT receptors antagonize neuronal activity and modulate network multistability. Reduced binding of 5-HT1A receptors increases global firing, while reduced binding of 5-HT2A receptors deepens attractors. The obtained results suggest reward-dependent synaptic plasticity mechanisms may attenuate 5-HT related network impairments. Integrating serotonin-mediated dopamine release into circuit, we observe that decreased serotonin concentration triggers the network into a deep attractor state, expanding the domain of attraction of stable nodes with high firing rate, potentially causing aberrant reverse learning. This suggests a hypothesis wherein elevated dopamine concentrations in obsessive-compulsive disorder might result from primary deficits in serotonin levels. Findings of this work underscore the pivotal role of serotonergic dysregulation in modulating synaptic plasticity through dopamine pathways, potentially contributing to learned obsessions. Interestingly, serotonin reuptake inhibitors and antidopaminergic potentiators can counteract the over-stable state of high-firing stable points, providing new insights into obsessive-compulsive disorder treatment.