我们的网站为什么显示成这样?

可能因为您的浏览器不支持样式,您可以更新您的浏览器到最新版本,以获取对此功能的支持,访问下面的网站,获取关于浏览器的信息:

|本期目录/Table of Contents|

 基于视听双通道的音乐情绪冲突效应及优势通道研究(PDF)

《心理学探新》[ISSN:1003-5184/CN:36-1228/B]

期数:
 2022年01期
页码:
 36-45
栏目:
 
出版日期:
 2022-02-25

文章信息/Info

Title:
 Emotional Conflict Effect and Dominant Modality Based on Audio-Visual Modality
文章编号:
1003-5184(2022)01-0036-10
作者:
 周 欣12郑莹灿3肖子伦1郑茂平4
 (1.西南大学心理学部,重庆 400715; 2.川北医学院精神卫生学院,南充 637100; 3.陆军军医大学医学心理系,军人发展心理学教研室,重庆 400000; 4.西南大学音乐学院,重庆 400715)
Author(s):
 Zhou Xin12Zheng Yincan3Xiao Zilun1Zheng Maoping4
 (1.Faculty of Psychology,Southwest University,Chongqing 400715; 2.School of Mental Health,North Sichuan Medical College,Nanchong 637100; 3.Developmental Psychology for Armyman,Department of Medical Psychology,Army Medical University,Chongqing 400000; 4.School of Music,Southwest University,Chongqing 400715)
关键词:
 音乐情绪 视听双通道 情绪冲突效应 听觉优势
Keywords:
 musical emotions audio-visual emotional conflict effect auditory dominance
分类号:
 B842.5
DOI:
 -
文献标识码:
 A
摘要:
 为探讨基于视听双通道的音乐情绪冲突效应、冲突情境下的优势加工通道和音乐经验对结果的影响,本研究采用音乐表演视频为材料,比较音乐组和非音乐组被试在一致型和不一致型视听双通道下的情绪评定速度、准确性及强度。结果发现:(1)一致型条件下的情绪评定更准确且更强烈;(2)不一致型条件下,被试更多以听觉通道的情绪线索为依据进行情绪类型评定;(3)非音乐组被试比音乐组被试更依赖视觉通道的情绪线索。结果表明:通道间情绪信息的不一致阻碍了音乐情绪加工; 听觉通道是音乐情绪冲突情境下的优势加工通道; 音乐经验降低了情绪冲突效应对音乐组被试的干扰。
Abstract:
 The aim of the current study was to investigate emotional conflict effect and dominant sensory and the influence of musical training experience based on audio-visual modality.Participants were divided into two groups,one comprising musician who had been musically trained for more than 5 years,and the other non-musicians with no musical expertise.The original musical performance video was used as congruous audio-visual(AV)material.The video which integrated the sound and picture from different segments and represents different emotional types was used as incongruous AV material.Participants were instructed to identify the type and the intensity of emotion recognition,as well as emotion felt.The reaction time(RT),accuracy(ACC),and intensity of every assessment were recorded and analyzed.Results:1)congruous condition has higher intensity and accuracy in than incongruous condition.2)There was a higher accuracy when answer with auditory emotion type than with visual emotion type.3)musician participants had higher accuracy when answer with auditory emotion type,while non-musician participants showed higher accuracy when answer with visual emotion type.Which illustrated that,the incongruity of emotional information between sensory modalities hindered the processing of musical emotion in AV modality.Auditory was the dominant modality of musical emotion processing under the emotional conflict condition.Musical expertise reduced the interference of emotional conflict effect on musician participants.

参考文献/References

 蔡岳建,潘孝富,庄钟春晓.(2007).音乐的速度与调式对大学生情绪影响的实证研究.心理科学,30(1),196-198.
侯建成,董奇.(2010).音乐认知能力的发展及其大脑可塑性研究.星海音乐学院学报,(3),79-84.
黄希庭.(2007).心理学导论(第2版)(普通高等教育十一五国家级规划教材).人民教育出版社.
李冬冬,程真波,戴瑞娜,汪芬,黄宇霞.(2012).情绪音乐库的初步编制与评定.中国心理卫生杂志,26(7),552-556.
李萍,张明明,李帅霞,张火垠,罗文波.(2019).面孔表情和声音情绪信息整合加工的脑机制.心理科学进展,27(7),1205-1214.
文小辉,刘强,孙弘进,张庆林,尹秦清,郝明洁,牟海蓉.(2009).多感官线索整合的理论模型.心理科学进展,17(4),59-66.
张亮,孙向红,张侃.(2009).情绪信息的多通道整合.心理科学进展,17(6),1133-1138.
周欣,郑莹灿,郑茂平.(2020).基于视听双通道的音乐情绪加工机制及情绪类型和音乐经验的影响. 心理科学,43(1),39-45.
Ammirante,P.,& Thompson,W.F.(2012).Continuation tapping to triggered melodies:Motor resonance effects of melodic motion.Experimental Brain Research,216(1),51-60.
Chapados,C.,& Levitin,D.J.(2008).Cross-modal interactions in the experience of musical performances:Physiological correlates.Cognition,108(3),639-651.
Chen,X.H.,Pan,Z.H.,Wang,P.,Yang,X.H.,Liu,P.,You,X.Q.,& Yuan,J.J.(2016).The integration of facial and vocal cues during emotional change perception:EEG markers.Social Cognitive and Affective Neuroscience,11(7),1152-1161.
Davidson,J.W.(2012).Bodily movement and facial actions in expressive musical performance by solo and duo instrumentalists:Two distinctive case studies.Psychology of Music,40(5),595-633.
de Gelder,B.,& Vroomen,J.(2000).The perception of emotions by ear and by eye.Cognition & Emotion,14(14),289-311.
Doi,H.,& Shinohara,K.(2015).Unconscious presentation of fearful face modulates electrophysiological responses to emotional prosody.Cerebral Cortex,25(3),817-832.
Eerola,T.,Peltola,H.R.,& Vuoskoski,J.K.(2015).Attitudes toward sad music are related to both preferential and contextual strategies.Psychomusicology Music Mind & Brain,25(2),116-123.
Egner,T.,& Hirsch,J.(2005).The neural correlates and functional integration of cognitive control in a stroop task.NeuroImage,24(2),539-547.
Etkin,A.,Egner,T.,Peraza,D.M.,Kandel,E.R.,& Hirsch,J.(2006).Resolving emotional conflict:A role for the rostral anterior cingulate cortex in modulating activity in the amygdala.Neuron,51(6),871-882.
Haas,B.W.,Omura,K.,Constable,R.T.,& Canli,T.(2006).Interference produced by emotional conflict associated with anterior cingulate activation.Cognitive Affective & Behavioral Neuroscience,6(2),152-156.
Jessen,S.,& Kotz,S.A.(2011).The temporal dynamics of processingemotions from vocal,facial,and bodily expressions.NeuroImage,58(2),665-674.
Juslin,P.N.,& Sloboda,J.A.(2010).The past,present,and future of music and emotion research.In P.N.Juslin & J.A.Sloboda(Eds.),Handbook of music and emotion:Theory,research,applications(pp.933-955).New York:Oxford University Press.
Kantor-Martynuska,Bigand,J.,& Emmanuel.(2013).Individual differences in granularity of the affective responses to music.Polish Psychological Bulletin,44(4),399-408.
Karin,P.,Frances,C.,Carol,S.,& Pollick,F.E.(2011).The music of your emotions:Neural substrates involved in detection of emotional correspondence between auditory and visual music actions.Plos One,6(4),e19165.
Klasen,M.,Kreifelts,B.,Chen,Y.H.,Seubert,J.,& Mathiak,K.(2014).Neural processing of emotion in multimodal settings.Frontiers in Human Neuroscience,8(8),822.
Krahé,C.,Hahn,U.,& Whitney,K.(2015).Is seeing(musical)believing?the eye versus the ear in emotional responses to music.Psychology of Music,43(1),140-148.
Kret,M.E.,Roelofs,K.,Stekelenburg,J.J.,& de Gelder,B.(2013).Emotional signals from faces,bodies and scenes influence observers’ face expressions,fixations and pupil-size.Frontiers in Human Neuroscience,7(810),810.
Lange,E.B.,Fünderich,J.,& Grimm,H.(2022).Multisensory integration of musical emotion perception in singing.Psychological Research.
Law,L.N.C.,& Zentner,M.(2012).Assessing musical abilities objectively:Construction and validation of the profile of music perception skills.Plos One,7(12),e52508.
Livingstone,S.R.,& Russo,F.A.(2018).The Ryerson audio-visual database of emotional speech and song(RAVDESS):A dynamic multimodal set of facial and vocal expressions in North American English.PLoS ONE,13(5),e0196391.
Livingstone,S.R.,Thompson,W.F.,Wanderley,M.M.,& Palmer,C.(2015).Common cues to emotion in the dynamic facial expressions of speech and song.The Quarterly Journal of Experimental Psychology,68(5),952-970.
Liu,P.,Rigoulot,S.,& Pell,M.D.(2015).Culture modulates the brain response to human expressions of emotion:Electrophysiological evidence.Neuropsychologia,67,1-13.
Lundqvist,L.O.,Carlsson,F.,Hilmersson,P.,& Juslin,P.N.(2009).Emotional responses to music:Experience,expression,and physiology.Psychology of Music,37(1),61-90.
Misselhorn,J.,Friese,U.,& Engel,A.K.(2019).Frontal and parietal alpha oscillations reflect attentional modulation of cross-modal matching.Scientific Reports,9(1),5030.
Mitchell,H.F.,& Macdonald,R.A.R.(2012).Listeners as spectators?audio-visual integration improves music performer identification.Psychology of Music,42(1),112-127.
Mondloch,C.J.(2012).Sad or fearful?the influence of body posture on adults’ and children’s perception of facial displays of emotion.Journal of Experimental Child Psychology,111(2),180-196.
Müller,V.I.,Habel,U.,Derntl,B.,Schneider,F.,& Zilles,K.(2011).Incongruence effects in crossmodal emotion integration.NeuroImage,54,2257-2266.
Paulmann,S.,& Pell,M.D.(2011).Is there an advantage for recognizing multi-modal emotional stimuli?Motivation and Emotion,35(2),192-201.
Paulmann,S.,Jessen,S.,& Kotz,S.A.(2009).Investigating the multimodal nature of human communication.Journal of Psychophysiology,23(2),63-76.
Petrini,K.,Mcaleer,P.,& Pollick,F.(2010).Audiovisual integration of emotional signals from music improvisation does not depend on temporal correspondence.Brain Research,1323(8),139-148.
Piwek,L.,Pollick,F.,& Petrini,K.(2015).Audiovisual integration of emotional signals from others’ social interactions.Frontiers in Psychology,9,611.
Platz,F.,& Kopiez,R.(2012).When the eye listens:A meta-analysis of how audio-visual presentation enhances the appreciation of music performance.Music Perception,30,71-83.
Proverbio,A.M.,Massetti,G.,Rizzi,E.,& Zani,A.(2016).Skilled musicians are not subject to the McGurk effect.Scientific Reports,6,30423.
Rigoulot,S.,& Pell,M.D.(2012).Seeing emotion with your ears:Emotional prosody implicitly guides visual attention to faces.Plos One,7(1),e30740.
Rigoulot,S.,& Pell,M.D.(2014).Emotion in the voice influences the way we scan emotional faces.Speech Communication,65(7),36-49.
Schubert,E.(2007).Locus of emotion:The effect of task order and age on emotion perceived and emotion felt in response to music.Journal of Music Therapy,44(4),344-368.
Shoda,H.,& Adachi,M.(2016)Expressivity,affective nuance,and presentation modality in a performer-to-audience communication.Psychomusicology:Music,Mind,and Brain,26(2),167-178.
Stock,J.V.D.,Peretz,I.,Grèzes,J.,& Gelder,B.D.(2009).Instrumental music influences recognition of emotional body language.Brain Topography,21(3),216-220.
Strelnikov,K.,Foxton,J.,Marx,M.,& Barone,P.(2015).Brain prediction of auditory emphasis by facial expressions during audiovisual continuous speech.Brain Topography,28(3),1-12.
Thompson,W.F.,Russo,F.A.,& Livingstone,S.R.(2010).Facial expressions of singers influence perceived pitch relations.Psychonomic Bulletin & Review,17(3),317-322.
Vuoskoski,J.K.,Gatti,E.,Spence,C.,& Clarke,E.F.(2016).Do visual cues intensify the emotional responses evoked by musical performance?a psychophysiological investigation.Psychomusicology Music Mind & Brain,26(2),179-188.
Vuoskoski,J.K.,Thompson,M.R.,Clarke,E.F.,& Spence,C.(2014).Crossmodal interactions in the perception of expressivity in musical performance.Attention,Perception,& Psychophysics,76(2),591-604.
Weijkamp,J.,& Sadakata,M.(2017).Attention to affective audio-visual information:Comparison between musicians and non-musicians.Psychology of Music,45(2),204-215.
W?llner,C.(2012).Is empathy related to the perception of emotional expression in music?a multimodal time-series analysis.Psychology of Aesthetics Creativity & the Arts,6(3),214-223.
Zinchenko,A.,Kanske,P.,Obermeier,C.,Schr?ger,E.,& Kotz,S.A.(2015).Emotion and goal-directed behavior:ERP evidence on cognitive and emotional conitict.Social Cognitive and Affective Neuroscience,10(11),1577-1587.
Zinchenko,A.,&Kanske,P.,Obermeier,C.,Schr?ger,E.,Villringer,A.,& Kotz,S.A.(2018).Modulation of cognitive and emotional control in age-related mild-to-moderate hearing loss.Front.Neurol,9,783.
Zinchenko,A.,Kotz,S.A.,Schr?ger,E.,& Kanske,P.(2020).Moving towards dynamics:Emotional modulation of cognitive and emotional control.International Journal of Psychophysiology,147(2020),193-220.

备注/Memo

备注/Memo:
 基金项目:中央高校基本科研业务费科研项目(SWU1709123),重庆市社会科学规划基金项目(2019YBYS149)。
通讯作者:郑茂平,E-mail:zmpshxy@swu.edu.cn。
更新日期/Last Update:  1900-01-01