Cognition and emotion

From Scholarpedia
Luiz Pessoa (2009), Scholarpedia, 4(1):4567. doi:10.4249/scholarpedia.4567 revision #91134 [link to/cite this article]
Jump to: navigation, search
Post-publication activity

Curator: Luiz Pessoa

Figure 1: Contrast of viewing fearful and neutral faces. Large portions of occipitotemporal cortex are more strongly driven by fearful faces. The arrows point to the fusiform gyrus, a ventral temporal area that is strongly driven by face stimuli. Adapted with permission from the National Academy of Sciences: Pessoa et al. (2002b), copyright (2002).

The relationship between cognition and emotion has fascinated important thinkers within the Western intellectual tradition. Historically, emotion and cognition have been viewed as largely separate. In the past two decades, however, a growing body of work has pointed to the interdependence between the two.



Cognition refers to processes such as memory, attention, language, problem solving, and planning. Many cognitive processes are thought to involve sophisticated functions that may be unique to primates. They often involve so-called controlled processes, such as when the pursuit of a goal (e.g., maintaining information in mind) needs to be protected from interference (e.g., a distracting stimulus). A prototypical example of a neural correlate of a cognitive process is the sustained firing of cells in dorsolateral prefrontal cortex as a monkey maintains information in mind for brief periods of time (Fuster and Alexander, 1971; Kubota and Niki, 1971). With the advent of functional MRI (fMRI), it appears that cognitive processes engage cortical regions of the brain (Gazzaniga et al., 2008).

Whereas there is relative agreement about what constitutes cognition, the same cannot be said about emotion. Some investigators use definitions that incorporate the concepts of drive and motivation: emotions are states elicited by rewards and punishers (Rolls, 2005). Others favor the view that emotions are involved in the conscious (or unconscious) evaluation of events (Arnold, 1960) (i.e., appraisals). Some approaches focus on basic emotions (Ekman, 1992) (e.g., fear, anger), others on an extended set of emotions, including moral ones (Haidt, 2003; Moll et al., 2005) (e.g., pride, envy). Strong evidence also links emotions to the body (Damasio, 1994). Brain structures linked to emotion are often subcortical, such as the amygdala, ventral striatum, and hypothalamus. These structures are often considered evolutionarily conserved, or primitive. They are also believed to operate fast and in an automatic fashion, such that certain trigger features (e.g., the white of the eyes in a fearful expression (Whalen et al., 2004)) are relatively unfiltered and always evoke responses that may be important for survival. Accordingly, an individual may not be necessarily conscious of a stimulus that may have triggered brain responses in an affective brain region, such as the amygdala. For discussion, see (Ohman, 2002; Pessoa, 2005).

Because of the inherent difficulty in providing clear definitions for both cognition and emotion, they will not be further defined here. We now turn to illustrating some of the interactions between emotion and cognition. Given the enormous scope of this topic, by necessity, this review will be relatively narrow in scope and will emphasize the brain systems involved in the interactions between emotion and i) perception and attention; ii) learning and memory; and iii) behavioral inhibition and working memory. Other valuable sources include (Damasio, 1994; LeDoux, 1996; Damasio, 1999; Dolan, 2003; Rolls, 2005; Phelps, 2006). A key conclusion from this review and from other current discussions of the relationship between cognition and emotion is that it is probably counterproductive to try to separate them. Instead, current thinking emphasizes their interdependence in ways that challenge a simple division of labor into separate cognitive and emotional domains. In particular, in the context of the brain, the general dichotomization alluded to above in terms of cortical-cognitive and subcortical-emotional brain areas is now viewed as largely simplified and breaks down rather quickly when more in-depth analyses are carried out; e.g., (Pessoa, 2008).

Before proceeding, however, a brief historical note is in order. The emotion/cognition debate came into sharp focus with the report of the mere-exposure effect (Kunst-Wilson & Zajonc, 1980), which led to a strong belief that affect was primary to and independent of cognition. It can be said that the mere-exposure effect and other behavioral findings shifted ongoing debates to focus on affect as being related to unconscious processing and subcortical activity, with cognition being related to conscious processing and cortical involvement. Interestingly, behavioral findings were interpreted in the context of the “low route” suggested by LeDoux (1996), which was purported to carry affective information subcortically. These early behavioral studies provided a strong impetus to the wave of neuroscience research in the late 1990s (and beyond) that investigated related phenomena. For some of the early theoretical arguments, see Fazio et al. (1986), Leventhal & Scherer (1987), Bornstein (1989), Lazarus (1994), Zajonc (1994), and Bargh (1997); also see Storbeck, Robinson, & McCourt (2006) and Storberk (2008).

Perception and attention

Viewing emotion-laden visual stimuli is linked to heightened and more extensive visual system activation (Pessoa et al., 2002a; Vuilleumier, 2005). For instance, viewing faces with emotional expressions evokes increased responses relative to viewing neutral faces throughout ventral occipitotemporal visual cortex ( Figure 1).

Visual responses are also stronger when subjects view emotional scenes (e.g., a war scene) compared do neutral scenes (e.g., a lake scene). Increased visual activation is observed in both late visual areas, such as the fusiform gyrus and superior temporal sulcus, and early visual cortex in occipital cortex. Recent studies suggest that, in humans, even retinotopically organized visual cortex, including visual areas V1 and V2 along the calcarine fissure, are modulated by the affective significance of a stimulus (Padmala and Pessoa, 2008).

Enhanced visual activation when viewing emotional stimuli is consistent with the observed improvements in behavioral performance in several visual tasks. For instance, angry and happy faces are detected faster in visual search tasks (Eastwood et al., 2001), and possibly other emotional stimuli, too, such as a snake or spider (Ohman et al., 2001) compared to neutral stimuli. Stronger evidence comes from studies of the attentional blink paradigm, in which subjects are asked to report the occurrence of two targets (T1 and T2) among a rapid stream of visual stimuli. When T2 follows T1 by a brief delay, participants are more likely to miss it, as if they had blinked (hence the name). The attentional blink is believed to reflect a capacity-limited processing stage, possibly linked to a process of consolidation of the detected item for conscious reports. Interestingly, the attentional blink has been shown to be modulated by emotional stimuli, as subjects are significantly better at detecting T2 when it is an emotion-laden word (e.g., rape) than when it is a neutral word (Anderson, 2005). Converging evidence for a link between perception, attention, and emotion comes from additional studies. For example, patients with unilateral inattention due to spatial hemineglect (often as a result of right hemisphere parietal lesions) are better at detecting happy or angry faces compared to neutral ones (Vuilleumier and Schwartz, 2001). These findings are consistent with the notion that emotional faces may direct the allocation of attention. For instance, in one study, emotional faces were flashed at spatial locations that subsequently displayed low-contrast visual stimuli (Phelps et al., 2006). They found that detection of the target was strongest when the fear face served as the spatial cue, suggesting that emotional stimuli can provide additional attentional guidance above and beyond a generic spatial cue. How is the increase in perceptual processing and attentional capture that is observed during the perception of affective stimuli mediated in the brain? Growing evidence links the amygdala, a subcortical region, with these effects.

Figure 2: Functional brain imaging results in humans support a role of the amygdala in modulating visual responses to emotional stimuli. Patients with medial temporal lobe sclerosis who have lesions involving the hippocampus alone (upper row) show normal activation of the fusiform cortex when contrasting fearful vs. neutral faces (right), as do healthy subjects (not shown). Patients with additional lesions involving the amygdala (lower row) show no effect of fear expression in visual cortex. However, fusiform cortex is still normally activated in both patient groups when they perform a task on faces relative to houses (left). These results suggest that amygdala damage can have distant functional consequences on the activity of visual cortex, selectively affecting emotional modulation. Adapted from Vuilleumier (2005), Trends Cogn Sci, How brains beware: neural mechanisms of emotional attention, copyright (2005), with permission from Elsevier. Original data from (Vuilleumier et al., 2004).
For instance, patients with amygdala lesions do not exhibit improved detection of T2 emotional targets during the attentional blink (i.e., a decrease in the magnitude of the blink effect) (Anderson and Phelps, 2001), and show less evidence of increased responses in visual cortex during the viewing of fearful faces (Vuilleumier et al., 2004); see Figure 2.

Thus, it appears that the amygdala may underlie a form of emotional modulation of information that in many ways parallels attentional effects that are observed with non-emotional information (Pessoa et al., 2002a; Vuilleumier, 2005). There are several ways in which emotional modulation may be accomplished. First, it is possible that direct projections from the amygdala to visual processing regions enhance visual processing. The amygdala sends projections across all levels of the visual system, including anterior regions in temporal cortex and posterior regions in occipital cortex (including V1 and V2) (Amaral et al., 1992). Thus, the amygdala is well situated to modulate sensory processing according to the affective significance of a visual object. A second possibility is that the amygdala interacts with other brain regions that are important for the control of attention, such as frontal and parietal regions (Barbas, 1995), which, by their turn, modulate visual processing. In the latter scenario, the amygdala (possibly indirectly) would recruit attentional circuits so as to enhance the sensory processing of emotion-laden stimuli.

A final issue that should be addressed when considering interactions between emotion and perception/attention is whether the perception of emotion-laden stimuli is automatic, namely independent of attention and awareness. This question has received considerable attention because specific answers to this question (no or yes) suggest potentially different relationships between emotion and cognition (more or less independence between the two, respectively). Interestingly, evidence both for and against automaticity has been presented. For instance, emotional faces evoke responses in the amygdala even when attention is diverted to other stimuli (Vuilleumier et al., 2001; Anderson et al., 2003). Perhaps even more strikingly, amygdala responses are sometimes reported for emotional faces of which subjects are not conscious (Morris et al., 1998; Whalen et al., 1998; Etkin et al., 2004; Whalen et al., 2004). Furthermore, cases of affective blindsight have been reported. These and other related findings suggest that at least some types of emotional perception occur outside of cognitive processing – and may rely on direct subcortical pathways conveying visual information to the amygdala (LeDoux, 1996). At the same time, recent findings have suggested that the perception of emotion-laden items requires attention, as revealed by attentional manipulations that consume most processing resources, leaving relatively few resources for the processing of unattended emotional items (Pessoa et al., 2002b; Bishop et al., 2004; Pessoa et al., 2005; Bishop et al., 2007; Hsu and Pessoa, 2007; Lim et al., 2008). Furthermore, it also appears that amygdala responses evoked by unaware stimuli depend somewhat on the manner by which awareness is operationally defined (Merikle et al., 2001), such that no unaware responses are observed when awareness is defined, for instance, via signal detection theory methods (Pessoa et al., 2006). Overall, the automaticity debate remains unresolved and controversial (Pessoa, 2005; Wiens, 2006; Bishop, 2007).

Memory and learning

Figure 3: Fear learning in the human amygdala. (a) The outlined box contains the area of the medial temporal lobe that includes the bilateral amygdala. (b–d) Amygdala activation to the CS is seen bilaterally after fear conditioning (b) and observational fear learning (c), and unilaterally (d) in the left amygdala after instructed fear. Reprinted by permission from Macmillan Publishers Ltd: Nature Neuroscience (Olsson and Phelps, 2007), copyright (2007).
Research on classical fear conditioning suggests that the amygdala is involved in the acquisition, storage, and expression of a conditioned fear response – such as when an animal learns that a neutral stimulus (e.g., tone) predicts an aversive event (e.g., mild shock). Whereas fear conditioning is believed to involve a more primitive form of affective learning, instructed fear illustrates a situation in which cognition and emotion interact more explicitly ( Figure 4C).
Figure 4: Nonsocial and social fear learning in humans. An individual learns to fear a CS through its pairing with (a) an electric shock to the wrist (fear conditioning), (b) a learning model’s expression of distress (observational fear learning), and (c) verbal information about its aversive qualities (instructed fear). Reprinted by permission from Macmillan Publishers Ltd: Nature Neuroscience (Olsson and Phelps, 2007), copyright (2007).
In this paradigm, subjects are verbally informed of the possibility of an aversive event given the presentation of one type of neutral stimulus (e.g., tone), while the presentation of another neutral stimulus (e.g., light) indicates that the aversive event will not occur. Interestingly, instructed fear generates robust physiological results to the threat stimulus that resemble the responses to a conditioned stimulus (e.g., tone) in fear conditioning, even though the aversive event is never administered to the subjects (only a verbal threat occurs) (Hugdahl and Ohman, 1977; Phelps et al., 2001) ( Figure 3D). Research with humans indicates that the left amygdala appears to be necessary for instructed fear (Funayama et al., 2001). Another example of cognitive-affective learning involves observational fear, in which an acquired fear response is learned via social observation ( Figure 4B). In this case, both humans and nonhuman primates are capable of learning the affective properties of stimuli through observing the emotional reactions of a conspecific (Ohman and Mineka, 2001). As in the case of instructed fear, observational fear results in the expression of conditioned fear that is similar to the one observed during fear conditioning (Olsson and Phelps, 2004) ( Figure 3C).

Emotional content can change the formation and recollection of a memory event, consistent with findings in both human and animal studies. Compared to neutral items, humans remember better emotionally arousing information, including emotionally charged stories, film clips, pictures, and words. For instance, in one study participants viewed two videos, one composed of neutral film clips and another composed of emotional film clips (Cahill et al., 1996). Although the two types of clips were taken from the same source and were equated in terms of levels of understandability, subjects were better at remembering emotional relative to neutral clips when tested approximately 3 weeks following the initial viewing of the films. In another study (Bradley et al., 1992), subjects viewed a large array of emotional and neutral pictures from the International Affective Picture System, a stimulus set that has been normed in terms of the dimensions of valence (positive/negative) and arousal (calm/excited). Participants initially rated the pictures along the dimensions of valence and arousal. An incidental free-recall test was administered both immediately and at one year following the rating sessions. Pictures rated as highly arousing were remembered better than all other pictures, including those rated as moderately arousing. Interestingly, the pattern of results was very similar when the subjects were tested a year later, namely, highly arousing pictures were better remembered.

In humans, the amygdala is known to be a critical structure for the enhancement of memory by emotion, consistent with both lesion (Adolphs et al., 1997) and neuroimaging work (for a review, see Phelps, 2004). Recent studies have begun to delineate some of the specific functions of this structure. For instance, it appears that the right amygdala is more strongly involved in emotional memory formation, whereas the left amygdala is engaged by the retrieval of those memories (Sergerie et al., 2006), suggesting a potential hemispheric dissociation of amygdala involvement at different stages of emotional memory. In addition, amygdala responses are also linked to a novelty effect on memory tasks – i.e., the tendency to classify items as new as opposed to old (Sergerie et al., 2007).

In humans, there is some support for the notion that the enhancement of memory due to emotion is due mainly to the arousal dimension of emotional items and not valence (positive/negative) per se (Phelps, 2006), a notion that is more firmly established in nonhuman animal studies (McGaugh, 2004). In these studies, the effects of emotion on memory have been revealed by a vast array of experimental manipulations, including inhibitory avoidance training, contextual fear conditioning, cued fear conditioning, water-maze spatial and cued training, among others. Typically, the effects of emotion on memory are investigated via drug administration, including agonists and antagonists of specific brain receptors. For instance, in one experiment, rats were trained to swim to an escape platform after being placed in a water tank (Packard et al., 1994). To mimic the effects of arousal, a group of animals received an injection of d-amphetamine immediately after training; a control group received a saline injection.
Figure 5: Projections from the basolateral complex of the amygdala to other brain areas involved in memory consolidation. Reprinted from McGaugh (2002), Trends Neurosci, Memory consolidation and the amygdala: a systems perspective, copyright (2002), with permission from Elsevier.
Behavioral testing revealed that d-amphetamine administration in the amygdala enhanced memory both on a spatial task and on a non-spatial cued task. A growing body of animal studies strongly supports a model in which emotion influences memory by modulating memory storage (McGaugh, 2004). In particular, the amygdala and the closely associated basal forebrain system involving the stria terminalis appear to play a major role in this modulatory process. These structures are thought to play a central role on memory consolidation by modulating activation in a network of brain regions, including the hippocampus, which is centrally involved in memory formation, but also additional brain structures, such as the nucleus accumbens, caudate nucleus, entorhinal cortex, in addition to other cortical regions (McGaugh, 2002) ( Figure 5).

Behavioral inhibition and working memory

An important dimension of cognition involves behavioral inhibition. Response inhibition, namely the processes required to cancel an intended action, is believed to involve control regions in prefrontal cortex (e.g., dorsolateral prefrontal cortex, anterior cingulate cortex, and inferior frontal cortex) (Rubia et al., 2003; Aron et al., 2004). Response inhibition is often investigated by using so-called go/no-go tasks in which subjects are asked to execute a motor response when shown the go stimulus (e.g., press a key as fast as possible when you see a letter stimulus), but to withhold the response when shown the no-go stimulus (e.g., do not respond when you see the letter Y). Typically, the go and no-go stimuli are shown as part of a rapid stream of stimuli (e.g., a sequence of letters). A recent study investigated the interaction between the processing of emotional words and response inhibition (Goldstein et al., 2007). Response inhibition following negative words (e.g., worthless) engaged the dorsolateral prefrontal cortex. Interestingly, this region was not recruited by negative valence or inhibitory task demands per se; instead, the dorsolateral cortex was sensitive to the explicit interaction between behavioral inhibition and the processing of negatively valenced words.

Working memory, another important cognitive operation, involves the maintenance and updating of information in mind when the information is no longer available to sensory systems (e.g., when keeping a phone number in mind for a few seconds before dialing the number). Evidence for cognitive-emotional interaction comes from working memory studies, too.
Figure 6: Emotion-cognition interaction in prefrontal cortex. Lateral prefrontal activity reflected equally the emotional and working memory task components, revealing the integration of emotional and cognitive processes in prefrontal cortex. Adapted with permission from the National Academy of Sciences: Gray et al. (2002), copyright (2002).
For instance, when participants were asked to keep in mind neutral or emotional pictures, maintenance-related activity in dorsolateral prefrontal cortex was modulated by the valence of the picture, with pleasant pictures enhancing activity and unpleasant pictures decreasing activity relative to neutral ones (Perlstein et al., 2002). Interestingly, emotional pictures did not affect dorsolateral responses during a second experimental condition during which participants were not required to keep information in mind, indicating that the modulation of sustained activity by emotional valence was particular to the experimental context requiring active maintenance. In another study, participants watched short videos intended to induce emotional states (e.g., clips from uplifting or sad movies), after which they performed challenging working memory tasks (Gray et al., 2002). Bilateral lateral prefrontal cortex activity reflected equally the emotional and working memory task components ( Figure 6). In other words, prefrontal activity did not stem from the working memory task alone or by the mood ensuing from the viewing of the video, but resulted from an interaction between cognition and emotion.

Impact of cognition on emotion

Although this short review focuses on the impact of emotional content on cognitive functions, here we briefly discuss another important line of studies that has investigated cognitive-emotional interactions, namely, cognitive emotion regulation (Ochsner and Gross, 2005; Ochsner and Gross, 2008). A particularly informative regulation strategy is “cognitive reappraisal”, which involves rethinking the meaning of affectively charged stimuli or events in terms that alter their emotional impact. Reappraisal appears to depend upon interactions between prefrontal and cingulate regions that are frequently implicated in cognitive control and systems like the amygdala and insula that have been implicated in emotional responding. Interestingly, having the goal to think about stimuli in ways that maintain or increase emotion may boost amygdala activity whereas having the goal to decrease emotion may diminish it. Furthermore, changes in emotional experience and autonomic responding may correlate with the concomitant rise or fall of prefrontal and/or amygdala activity. Although much of the work on the cognitive regulation of emotion has relied on a relatively strict separation between cognition and emotion, which are in this context viewed as engaged in tug-of-war for the control of behavior, this framework is likely overly simplistic. As proposed by Ochsner and Gross (2008), a more fruitful approach will entail developing an integrated framework for specifying what combinations of interacting subsystems are involved in emotional responding, as individuals exert varying degrees and types of regulatory control over their emotions.

Anatomical basis for cognitive-emotional interactions

In attempting to understand the relationship between emotion and cognition, it is important to consider anatomical information. Advances in our understanding of brain connectivity suggest that a given brain region is only a few synapses away from every other brain region(Sporns et al., 2004; Sporns and Zwi, 2004). Indeed, it appears that the brain is configured according to a small-world topology in which the path length between nodes is small – typically, cortical areas are connected directly or via just one or two intermediate areas (Hilgetag et al., 2000; Sporns et al., 2000) – and nodes are highly clustered (Sporns, 2006). Thus, a careful consideration of brain connectivity is informative in understanding potential cognitive-emotional interactions.

In the past decade, several quantitative analyses of brain connectivity have been undertaken (Young et al., 1994; Stephan et al., 2000). Not surprisingly, prefrontal areas are among those most distant from the sensory periphery, suggesting that they receive highly-processed and integrated sensory information. Such potential insulation of the prefrontal cortex from the periphery is thought to be a key anatomical feature of this region and presumably confers the primate brain with a greater degree of flexibility (Mesulam, 2002). Highly processed information would also be able to support more abstract processing that is required for cognition. Interestingly, the amygdala, a region often linked to emotional processing, appears to be equally removed from the sensory periphery – although in some species, direct sensory thalamic projections may be present (LeDoux, 1996). In addition, the amygdala makes very widespread projections. Overall, it appears that the amygdala is very well situated to integrate and distribute information ( Figure 7).
Figure 7: Brain connectivity graph. Quantitative analysis of brain connectivity reveals several clusters of highly interconnected regions (represented by different colors). In this analysis, the amygdala (Amyg, centre of figure) was connected to all but 8 cortical areas. These connections involved multiple region clusters, suggesting that the amygdala is not only highly connected, but that its connectivity topology might be consistent with that of a hub that links multiple functional clusters. In this manner, the amygdala may be important for the integration of cognitive and emotional information. Figure labels represent different cortical areas with the exception of Hipp (hippocampus) and Amyg, which represent subcortical areas. Figure reproduced from Young et al. (1994) with permission from Freund Publishing House Ltd. Analysis of connectivity: Neural systems in the cerebral cortex, Reviews in the Neurosciences; copyright (1994).

It is also instructive to consider the connectivity of the hypothalamus (Risold et al., 1997), as it has been long recognized for its importance in emotional behaviours (Swanson, 2000, 2003). In particular, via its descending connections that innervate brainstem motor systems, this structure is thought to play a key role in the implementation of goal-directed behaviors. Hypothalamic signals also can be conveyed to the cortex, mostly by way of the thalamus. Critically, prefrontal cortical territories project directly to the hypothalamus. Thus, the hypothalamus appears to be organized in such a way that it can generate both relatively reflexive behaviors and behaviors that are voluntarily triggered by inputs from the cerebral cortex (Swanson, 2000). Overall, this structure appears to be connected with all levels of the nervous system, including the neocortex (Swanson, 2000), enabling important hypothalamic regulatory signals to have widespread effects on the brain.

It is also important to consider the role of the ascending systems. For instance, the basal nucleus of Maynert is a major part of the so-called magnocellular basal forebrain system (Heimer and Van Hoesen, 2006). The projections from this system reach all parts of the cortical mantle (Heimer and Van Hoesen, 2006), and are involved in cortical plasticity in sensory cortex in the context of classical conditioning (Weinberger, 1995), in addition to arousal and attention mechanisms (see citations in (Sarter and Bruno, 2000; Heimer and Van Hoesen, 2006)). In particular, basal forebrain corticopetal cholinergic projections appear to be crucial for diverse attentional functions, including sustained, selective, and divided attention (Sarter and Bruno, 1999; Sarter et al., 1999; Sarter and Bruno, 2000). Of importance in the present context, the basal forebrain receives both cortical and amygdala inputs (for citations, see (Sarter and Bruno, 2000)). Notably, recent anatomical evidence suggests the existence of specific topographically organized prefrontal-basal forebrain-prefrontal loops (Zaborszky et al., 1999; Zaborszky, 2002; Zaborszky et al., 2005), so that specific prefrontal cortical targets of the basal forebrain connect back to sites from which the corticopetal fibers originate. Such loops provide a direct substrate for cognitive-emotional integration, for example by allowing amygdala signals to be broadcast widely, including to frontoparietal regions known to be important for the control of attention. More generally, the overall anatomical arrangement of the basal forebrain may involve multiple functional-anatomical macrosystems (Alheid and Heimer, 1988; Zahm, 2006) with wide-ranging effects on brain computations and important clinical implications (Alheid and Heimer, 1988; Sarter and Bruno, 1999). In summary, the picture that emerges from anatomical connectivity data suggests a remarkable potential for integration of information.

Figure 8: Potential relationship between anatomical sites, neural computations and behaviors. Brain areas (for example, A2), which are connected to form networks (ellipses), are involved in multiple neural computations (for example, NC2, NC3 and NC4) and specific computations (for example, NC4) are carried out by several areas (for example, A2 and A3). Therefore, the structure–function mapping is both one-to-many and many-to-one; in other words, many-to-many. Multiple neural computations underlie behavior. Each behavior has both affective and cognitive components, indicated by the affective and cognitive axes. Note that the axes are not orthogonal, indicating that the dimensions are not independent from each other. Brain areas with a high degree of connectivity (hubs) may be especially important for regulating the flow and interaction of information between regions. Reprinted by permission from Macmillan Publishers Ltd: Nature Neuroscience (Pessoa, 2008), copyright (2008). See (Mesulam, 1990) for a related scheme.

Conclusion: from interactions to integration

Historically, emotion and cognition have been viewed as separate entities. One factor that may have contributed to this separation in the past century is methodological. For instance, data arising from single-unit or lesion studies usually allow the researcher to only derive conclusions concerning the specific areas being targeted. Research in the past two decades suggests, however, that such a view is likely deficient and that, in order to understand how complex behaviors are carried out in the brain, an understanding of the interactions between the two may be indispensable. Indeed, some studies have suggested that it may be important to go beyond understanding interactions, some of which are suggested to be mutually antagonistic, to understanding how cognition and emotion are effectively integrated in the brain. As stated recently, at some point of processing functional specialization is lost, and emotion and cognition conjointly and equally contribute to the control of thought and behavior (Gray et al., 2002). While these statements were offered as a summary of specific findings concerning working memory performance following mood induction (see above), they may aptly characterize a vast array of real-world situations. In other words, whereas many behaviors may be reasonably well characterized in terms of cognitive-emotional interactions such that emotion and cognition are partly separable, in many situations, true integration of emotion and cognition may also take place ( Figure 8). The latter further blurs the distinction between cognition and emotion. See Duncan and Barrett (2007) for a similar view.


  • Adolphs R, Cahill L, Schul R, Babinsky R (1997) Impaired declarative memory for emotional material following bilateral amygdala damage in humans. Learn Mem 4:291-300.
  • Alheid GF, Heimer L (1988) New perspectives in basal forebrain organization of special relevance for neuropsychiatric disorders: the striatopallidal, amygdaloid, and corticopetal components of substantia innominata. Neuroscience 27:1-39.
  • Amaral DG, Price JL, Pitkanen A, Carmichael ST (1992) Anatomical organization of the primate amygdaloid complex. In: The amygdala: neurobiological aspects of emotion, memory, and mental dysfunction (Aggleton J, ed), pp 1-66. New York: Wiley-Liss.
  • Anderson AK (2005) Affective influences on the attentional dynamics supporting awareness. J Exp Psychol Gen 134:258-281.
  • Anderson AK, Phelps EA (2001) Lesions of the human amygdala impair enhanced perception of emotionally salient events. Nature 411:305-309.
  • Anderson AK, Christoff K, Panitz D, De Rosa E., Gabrieli JD (2003) Neural correlates of the automatic processing of threat facial signals. Journal of Neuroscience 23:5627-5633.
  • Arnold MB (1960) Emotion and personality. New York: Columbia University Press.
  • Aron AR, Robbins TW, Poldrack RA (2004) Inhibition and the right inferior frontal cortex. Trends Cogn Sci 8:170-177.
  • Barbas H (1995) Anatomic basis of cognitive-emotional interactions in the primate prefrontal cortex. Neuroscience and Biobehavioral Reviews 19:449-510.
  • Bargh JA (1997) The automaticity of everyday life. In: Advances in social cognition (Wyer Jr. RS, ed), pp 1-61. Mahwah, NJ: Erlbaum.
  • Bishop SJ (2007) Neurocognitive mechanisms of anxiety: an integrative account. Trends Cogn Sci 11:307-316.
  • Bishop SJ, Duncan J, Lawrence AD (2004) State anxiety modulation of the amygdala response to unattended threat-related stimuli. J Neurosci 24:10364-10368.
  • Bishop SJ, Jenkins R, Lawrence AD (2007) Neural processing of fearful faces: effects of anxiety are gated by perceptual capacity limitations. Cereb Cortex 17:1595-1603.
  • Bornstein R. (1989). Exposure and affect: Overview and meta-analysis of research,1968-1987. Psychological Bulletin 106: 265-289.
  • Bradley MM, Greenwald MK, Petry MC, Lang PJ (1992) Remembering pictures: pleasure and arousal in memory. J Exp Psychol Learn Mem Cogn 18:379-390.
  • Cahill L, Haier RJ, Fallon J, Alkire MT, Tang C, Keator D, Wu J, McGaugh JL (1996) Amygdala activity at encoding correlated with long-term, free recall of emotional information. Proc Natl Acad Sci U S A 93:8016-8021.
  • Damasio AR (1994) Descartes' error: Emotion, reason, and the human brain. New York: G.P. Putnam.
  • Damasio AR (1999) The feeling of what happens: body and emotion in the making of consciousness. New York: Harcourt Brace.
  • Dolan R (2003) Emotion, cognition, and behavior. Science 298:1191-1194.
  • Duncan S, Barrett LF (2007) Affect is a form of cognition: A neurobiological analysis. Cognition and Emotion 21:1184-1211.
  • Eastwood JD, Smilek D, Merikle PM (2001) Differential attentional guidance by unattended faces expressing positive and negative emotion. Percept Psychophys 63:1004-1013.
  • Ekman P (1992) An argument for basic emotions. Cognition and Emotion 6:169-200.
  • Etkin A, Klemenhagen KC, Dudman JT, Rogan MT, Hen R, Kandel ER, Hirsch J (2004) Individual differences in trait anxiety predict the response of the basolateral amygdala to unconsciously processed fearful faces. Neuron 44:1043-1055.
  • Fazio R, Sanbonmatsu D, Powell M, Kardes F (1986) On the automatic activation of attitudes. Journal of Personality and Social Psychology 50:229-238.
  • Funayama ES, Grillon C, Davis M, Phelps EA (2001) A double dissociation in the affective modulation of startle in humans: effects of unilateral temporal lobectomy. J Cogn Neurosci 13:721-729.
  • Fuster JM, Alexander GE (1971) Neuron activity related to short-term memory. Science 173:652-654.
  • Gazzaniga, MS, Ivry, RB, Mangun, GR (2008). Cognitive neuroscience (3rd edition). W. W. Norton & Company.
  • Goldstein M, Brendel G, Tuescher O, Pan H, Epstein J, Beutel M, Yang Y, Thomas K, Levy K, Silverman M, Clarkin J, Posner M, Kernberg O, Stern E, Silbersweig D (2007) Neural substrates of the interaction of emotional stimulus processing and motor inhibitory control: an emotional linguistic go/no-go fMRI study. Neuroimage 36:1026-1040.
  • Gray JR, Braver TS, Raichle ME (2002) Integration of emotion and cognition in the lateral prefrontal cortex. Proceedings of the National Academy of Sciences USA 99:4115-4120.
  • Haidt J (2003) The moral emotions. In: Handbook of Affective Sciences (Davidson RJ, Scherer KR, Goldsmith HH, eds), pp 852-870. Oxford: Oxford University Press.
  • Heimer L, Van Hoesen GW (2006) The limbic lobe and its output channels: implications for emotional functions and adaptive behavior. Neurosci Biobehav Rev 30:126-147.
  • Hilgetag CC, Burns GA, O'Neill MA, Scannell JW, Young MP (2000) Anatomical connectivity defines the organization of clusters of cortical areas in the macaque monkey and the cat. Philos Trans R Soc Lond B Biol Sci 355:91-110.
  • Hsu SM, Pessoa L (2007) Dissociable effects of bottom-up and top-down factors on the processing of unattended fearful faces. Neuropsychologia 45:3075-3086.
  • Hugdahl K, Ohman A (1977) Effects of instruction on acquisition and extinction of electrodermal responses to fear-relevant stimuli. J Exp Psychol [Hum Learn] 3:608-618.
  • Kubota K, Niki H (1971) Prefrontal cortical unit activity and delayed alternation performance in monkeys. Journal of Neurophysiology 34:337-347.
  • Kunst-Wilson WR, Zajonc RB (1980) Affective discrimination of stimuli that cannot be recognized. Science 207: 557-558.
  • Lazarus RS (1984) On the primacy of cognition. American Psychologist 39:124-129.
  • LeDoux JE (1996) The emotional brain. New York: Simon & Schuster.
  • Leventhal H, Scherer KR (1987) The relationship of emotion to cognition: A functional approach to a semantic controversy. Cognition & Emotion 1:3-28.
  • Lim SL, Padmala S, Pessoa L (2008) Affective learning modulates spatial competition during low-load attentional conditions. Neuropsychologia.
  • McGaugh JL (2002) Memory consolidation and the amygdala: a systems perspective. Trends Neurosci 25:456.
  • McGaugh JL (2004) The amygdala modulates the consolidation of memories of emotionally arousing experiences. Annu Rev Neurosci 27:1-28.
  • Merikle PM, Smilek D, Eastwood JD (2001) Perception without awareness: perspectives from cognitive psychology. Cognition 79:115-134.
  • Mesulam M-M (2002) The human frontal lobes: Transcending the default mode through contingent encoding. In: Principles of frontal lobe function (Stuss DT, Knight RT, eds), pp 8-30. New York: Oxford University Press.
  • Mesulam MM (1990) Large-scale neurocognitive networks and distributed processing for attention, language, and memory. Annals of Neurology 28:597-613.
  • Moll J, Zahn R, de Oliveira-Souza R, Krueger F, Grafman J (2005) The neural basis of human moral cognition. Nat Rev Neurosci 6:799-809.
  • Morris JS, Ohman A, Dolan RJ (1998) Conscious and unconscious emotional learning in the human amygdala. Nature 393:467-470.
  • Ochsner KN, Gross JJ (2005) The cognitive control of emotion. Trends Cogn Sci 9:242-249.
  • Ochsner KN, Gross JJ (2008) Cognitive emotion regulation. Curr Dir Psych Sci 17:153-158.
  • Ohman A (2002) Automaticity and the amygdala: nonconscious responses to emotional faces. Current Directions in Psychological Science 11:62-66.
  • Ohman A, Mineka S (2001) Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. Psychol Rev 108:483-522.
  • Ohman A, Flykt A, Esteves F (2001) Emotion drives attention: detecting the snake in the grass. Journal of Experimental Psychology: General 130:466-478.
  • Olsson A, Phelps EA (2004) Learned fear of "unseen" faces after Pavlovian, observational, and instructed fear. Psychol Sci 15:822-828.
  • Olsson A, Phelps EA (2007) Social learning of fear. Nat Neurosci 10:1095-1102.
  • Packard MG, Cahill L, McGaugh JL (1994) Amygdala modulation of hippocampal-dependent and caudate nucleus-dependent memory processes. Proc Natl Acad Sci U S A 91:8477-8481.
  • Padmala S, Pessoa L (2008) Affective learning enhances visual detection and responses in primary visual cortex. J Neurosci 28:6202-6210.
  • Perlstein WM, Elbert T, Stenger VA (2002) Dissociation in human prefrontal cortex of affective influences on working memory-related activity. Proc Natl Acad Sci U S A 99:1736-1741.
  • Pessoa L (2005) To what extent are emotional visual stimuli processed without attention and awareness? Curr Opin Neurobiol 15:188-196.
  • Pessoa L (2008) On the relationship between emotion and cognition. Nat Rev Neurosci 9:148-158.
  • Pessoa L, Kastner S, Ungerleider LG (2002a) Attentional control of the processing of neutral and emotional stimuli. Cognitive Brain Research 15:31-45.
  • Pessoa L, Padmala S, Morland T (2005) Fate of unattended fearful faces in the amygdala is determined by both attentional resources and cognitive modulation. NeuroImage 28:249-255.
  • Pessoa L, McKenna M, Gutierrez E, Ungerleider LG (2002b) Neural processing of emotional faces requires attention. Proceedings of the National Academy of Sciences USA 99:11458-11463.
  • Pessoa L, Japee S, Sturman D, Ungerleider LG (2006) Target visibility and visual awareness modulate amygdala responses to fearful faces. Cerebral Cortex 16:366-375.
  • Phelps EA (2004) Human emotion and memory: interactions of the amygdala and hippocampal complex. Curr Opin Neurobiol 14:198-202.
  • Phelps EA (2006) Emotion and cognition: insights from studies of the human amygdala. Annu Rev Psychol 57:27-53.
  • Phelps EA, Ling S, Carrasco M (2006) Emotion facilitates perception and potentiates the perceptual benefits of attention. Psychol Sci 17:292-299.
  • Phelps EA, O'Connor KJ, Gatenby JC, Gore JC, Grillon C, Davis M (2001) Activation of the left amygdala to a cognitive representation of fear. Nature Neuroscience 4:437-441.
  • Risold PY, Thompson RH, Swanson LW (1997) The structural organization of connections between hypothalamus and cerebral cortex. Brain Res Brain Res Rev 24:197-254.
  • Rolls ET (2005) Emotion explained. Oxford: Oxford University Press.
  • Rubia K, Smith AB, Brammer MJ, Taylor E (2003) Right inferior prefrontal cortex mediates response inhibition while mesial prefrontal cortex is responsible for error detection. Neuroimage 20:351-358.
  • Sarter M, Bruno JP (1999) Abnormal regulation of corticopetal cholinergic neurons and impaired information processing in neuropsychiatric disorders. Trends Neurosci 22:67-74.
  • Sarter M, Bruno JP (2000) Cortical cholinergic inputs mediating arousal, attentional processing and dreaming: differential afferent regulation of the basal forebrain by telencephalic and brainstem afferents. Neuroscience 95:933-952.
  • Sarter M, Bruno JP, Turchi J (1999) Basal forebrain afferent projections modulating cortical acetylcholine, attention, and implications for neuropsychiatric disorders. Ann N Y Acad Sci 877:368-382.
  • Sergerie K, Lepage M, Armony JL (2006) A process-specific functional dissociation of the amygdala in emotional memory. J Cogn Neurosci 18:1359-1367.
  • Sergerie K, Lepage M, Armony JL (2007) Influence of emotional expression on memory recognition bias: a functional magnetic resonance imaging study. Biol Psychiatry 62:1126-1133.
  • Sporns O (2006) Small-world connectivity, motif composition, and complexity of fractal neuronal connections. Biosystems 85:55-64.
  • Sporns O, Zwi JD (2004) The small world of the cerebral cortex. Neuroinformatics 2:145-162.
  • Sporns O, Tononi G, Edelman GM (2000) Theoretical neuroanatomy: relating anatomical and functional connectivity in graphs and cortical connection matrices. Cereb Cortex 10:127-141.
  • Sporns O, Chialvo DR, Kaiser M, Hilgetag CC (2004) Organization, development and function of complex brain networks. Trends Cogn Sci 8:418-425.
  • Stephan KE, Hilgetag CC, Burns GA, O'Neill MA, Young MP, Kotter R (2000) Computational analysis of functional connectivity between areas of primate cerebral cortex. Philos Trans R Soc Lond B Biol Sci 355:111-126.
  • Storbeck J: The discussion in this paragraph draws on the accompanying review to this article by J. Storbeck.
  • Storbeck J, Robinson MD, McCourt ME (2006) Semantic processing precedes affect retrieval: The neurological case for cognitive primacy in visual processing. Review of general psychology 10:41-55.
  • Swanson LW (2000) Cerebral hemisphere regulation of motivated behavior. Brain Res 886:113-164.
  • Swanson LW (2003) Brain architecture: Understanding the basic plan. New York: Oxford University Press.
  • Vuilleumier P (2005) How brains beware: neural mechanisms of emotional attention. Trends Cogn Sci 9:585-594.
  • Vuilleumier P, Schwartz S (2001) Emotional facial expressions capture attention. Neurology 56:153-158.
  • Vuilleumier P, Armony JL, Driver J, Dolan RJ (2001) Effects of attention and emotion on face processing in the human brain: An event-related fMRI study. Neuron 30:829-841.
  • Vuilleumier P, Richardson MP, Armony JL, Driver J, Dolan RJ (2004) Distant influences of amygdala lesion on visual cortical activation during emotional face processing. Nat Neurosci 7:1271-1278.
  • Weinberger NM (1995) Dynamic regulation of receptive fields and maps in the adult sensory cortex. Annu Rev Neurosci 18:129-158.
  • Whalen PJ, Rauch SL, Etcoff NL, McInerney SC, Lee MB, Jenike MA (1998) Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. Journal of Neuroscience 18:411-418.
  • Whalen PJ, Kagan J, Cook RG, Davis FC, Kim H, Polis S, McLaren DG, Somerville LH, McLean AA, Maxwell JS, Johnstone T (2004) Human amygdala responsivity to masked fearful eye whites. Science 306:2061.
  • Wiens S (2006) Subliminal emotion perception in brain imaging: findings, issues, and recommendations. Prog Brain Res 156:105-121.
  • Young MP, Scannell JW, Burns GAPC, Blakemore C (1994) Analysis of connectivity: Neural systems in the cerebral cortex. Reviews in the Neurosciences 5:227-249.
  • Zaborszky L (2002) The modular organization of brain systems. Basal forebrain: the last frontier. Prog Brain Res 136:359-372.
  • Zaborszky L, Pang K, Somogyi J, Nadasdy Z, Kallo I (1999) The basal forebrain corticopetal system revisited. Ann N Y Acad Sci 877:339-367.
  • Zaborszky L, Buhl DL, Pobalashingham S, Bjaalie JG, Nadasdy Z (2005) Three-dimensional chemoarchitecture of the basal forebrain: spatially specific association of cholinergic and calcium binding protein-containing neurons. Neuroscience 136:697-713.
  • Zahm DS (2006) The evolving theory of basal forebrain functional-anatomical 'macrosystems'. Neurosci Biobehav Rev 30:148-172.
  • Zajonc RB (1984) On the primacy of affect. American Psychologist 39:117-123.

Recommended reading

  • Bishop, S.J. Neurocognitive mechanisms of anxiety: an integrative account. Trends Cogn Sci 11, 307-16 (2007).
  • Damasio, A.R. Descartes' error: Emotion, reason, and the human brain (G.P. Putnam, New York, 1994).
  • Damasio, A.R. The feeling of what happens: body and emotion in the making of consciousness (Harcourt Brace, New York, 1999).
  • Dolan, R. Emotion, cognition, and behavior. Science 298, 1191-1194 (2003).
  • Duncan, S. & Barrett, L.F. Affect is a form of cognition: A neurobiological analysis. Cognition and Emotion 21, 1184-1211 (2007).
  • LeDoux, J.E. The emotional brain (Simon & Schuster, New York, 1996).
  • Lewis, M.D. Bridging emotion theory and neurobiology through dynamic systems modeling. Behav Brain Sci 28, 169-94; discussion 194-245 2005).
  • Pessoa, L. On the relationship between emotion and cognition. Nat Rev Neurosci 9, 148-58 (2008).
  • Phelps, E.A. Emotion and cognition: insights from studies of the human amygdala. Annu Rev Psychol 57, 27-53 (2006).
  • Sander, D., Grandjean, D. & Scherer, K.R. A systems approach to appraisal mechanisms in emotion. Neural Netw 18, 317-52 (2005).
  • Vuilleumier, P. How brains beware: neural mechanisms of emotional attention. Trends Cogn Sci 9, 585-94 (2005).

External links

See also

Cognition, Emotion

Personal tools

Focal areas