以行為及腦造影證據探討英文字音及字形相似效果對中英雙語使用者之短期記憶的影響

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：18

、訪客IP：3.145.50.83

姓名

黎引真(Yin-chen Li) 查詢紙本館藏

畢業系所

認知與神經科學研究所

論文名稱

以行為及腦造影證據探討英文字音及字形相似效果對中英雙語使用者之短期記憶的影響
(Behavioral and fMRI investigations on the effects of phonological and visual similarity of English words on short-term memory in unbalanced Chinese-English bilinguals)

相關論文

★ The influence of experience on the SNARC effect -the mapping between sequential information and spatial representation	★ 中文名詞動詞的具體效果的神經相關活動
★ 字形和語意對短期記憶的影響: 從行為及腦造影實驗而來的證據	★ 中文字音與字形相似度對語言短期記憶之影響
★ 非語音訊息對中英雙語使用者的語言短期記憶的貢獻	★ 中文短期記憶之字形表徵研究
★ The temporal dynamics of the code-switching between alphabetic and logographic languages in unbalancedChinese-English bilinguals	★ The acquisition of Chinese literacy as a second language correlates with statistical learning of implicit transitional probability
★ The behavioral and neural correlates of orthographic lexicon and orthographic buffer in Chinese writing	★ How the Brain Deals with the Asymmetry between Chinese Subject and Object Relative Clauses: Support for a Dynamic Processing Theory
★ EXPLORATION OF THE NEURAL CORRELATES OF SYNTACTIC PROCESSING IN CHINESE USING FUNCTIONAL MAGNETIC RESONANCE IMAGING AND EVENT-RELATED POTENTIALS	★ 視知覺相關能力以及統計學習能力對中文識字學習的影響：來自以中文為母語或外語學習者的證據
★ Correlation of statistical learning of different implicit transitional probabilities with Chinese literacy acquisition in non-native adult learners	★ 字形相似性、字義相似性以及視覺相似性對於中文工作記憶的影響
★ The Characteristics and Neurophysiological Correlates of Componential Visual Statistical Learning	★ 金錢酬賞之來源與其分配對公平性感知的影響

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

過去研究拼音語言讀者的文獻顯示，言語的訊息主要以語音表徵維持在短期記憶內，而非視覺表徵。相對的，中文讀者的短期記憶則同時展現來自語音和字形表徵的貢獻。為了探討雙語使用者的短期記憶是受其母語特性或受刺激材料影響，此研究分別檢視英文母語者和中英雙語使用者的英文字音、字形相似效果。另外，此研究也透過功能磁振造影，比較英文短期記憶中語音和視覺表徵相關的神經機制，在此兩種語言使用者之間的異同。
此研究包含兩個實驗。實驗一由兩個使用探針序列回憶作業 (probed serial recall task) 的行為實驗組成。行為實驗結果顯示，英文母語者的英文短期記憶只受到字音相似度干擾、而不被字形相似度影響；另一方面，中英雙語使用者的英文短期記憶則同時受到字音和字形相似度影響。另外，雙語使用者的英文能力似乎也會調節字形相似效果的強度。實驗二是功能核磁共振腦造影 (fMRI) 實驗，使用類似前一實驗的探針序列再認派典 (probed serial recognition paradigm)。腦造影結果大致於言語短期記憶作業時呈現左側化的額顳頂葉活化網絡，且在字音相似效果下呈現左側化的額頂葉活化網絡。另一方面，視覺相似效果的活化則在英文讀者和中英雙語使用者分別呈現右側及雙側額頂葉網絡。大致上，與字音和字形相似效果相關的腦部活化在英文母語者較側化，而在中英雙語使用者顯得較平均雙側化。
本研究結果指出，雙語使用者的言語短期記憶表徵，同時受到其母語的特性及第二語言的能力影響，並且行為觀察到的字形相似效果可能與雙側化的額頂葉活化有關。

摘要(英)

Previous findings from readers of alphabetic languages demonstrate that verbal information in short-term memory (STM) is mainly retained by phonological but not visual representation. In contrast, our previous findings from Chinese readers demonstrate the contribution from both phonological and orthographic representation. To investigate whether bilinguals’ STM is delineated by characteristics of the native language or by the to-be-remembered materials, the effects of phonological and visual similarity of English words in native English speakers and in Chinese-English bilinguals were examined. The neural substrates underlying the phonological and visual representations of English words during STM tasks are also compared between native English speakers and Chinese-English bilinguals.
Two experiments were conducted in this study. Experiment 1 consisted of two behavioral experiments using a probed serial recall task. The results of the behavioral experiments showed that English speakers’ STM was only hindered by phonological but not visual similarity of English materials, while the STM of Chinese-English bilinguals was affected by both phonological and visual similarity. Furthermore, bilinguals’ proficiency in English seemed to modulate the effect of visual similarity. Experiment 2 was an fMRI experiment employing a similar task with the probed serial recognition paradigm. The neuroimaging results generally showed a left lateralized fronto-temporo-parietal network of verbal STM and a left lateralized fronto-parietal network of the phonological similarity effect (PSE). On the other hand, the results showed a right lateralized and bilateralized fronto-parietal network of the visual similarity effect (VSE) in native English readers and Chinese-English bilinguals, respectively. In general, the activations associated with the PSE and the VSE were more lateralized in the native English participants while being more bilateralized in the Chinese-English participants.
The present findings suggest that the representation underlying bilingual verbal STM is jointly determined by features of the first language and proficiency of the second language, and that the behaviorally observable VSE might be associated with the bilateralized fronto-parietal activations.

關鍵字(中)

★ 言語短期記憶
★ 探針序列回憶派典
★ 字形相似度
★ 雙語
★ fMRI

關鍵字(英)

★ verbal short-term memory
★ the probed serial recall paradigm
★ orthographic similarity
★ bilingualism
★ fMRI

論文目次

Chinese Abstract i
English Abstract ii
Acknowledgements iv
Table of Contents vi
List of Figures x
List of Tables xii
List of Abbreviations xiii
CHAPTER 1: Introduction 1
1.1 Overview of the Short-term Memory / Working Memory Model 1
1.2 Verbal STM of Monolinguals 4
1.2.1 Evidence of phonological contribution: the phonological similarity effect. 4
1.2.2 Evidence of visual/orthographic contribution: the visual similarity effect. 7
1.3 Neural Substrates Underlying Verbal STM 11
1.4 Cognitive Processes of Bilinguals 14
1.4.1 L1 literacy experience affecting L2 related cognitive functions. 14
1.4.2 Cerebral lateralization. 19
1.5 Current Study 20
CHAPTER 2: Experiment 1 – Behavioral Investigations on the Visual Similarity Effect of English Verbal Short-Term Memory in Chinese-English Bilinguals 25
Experiment 1a: Probed Serial Recall Task using Pair-Wise Comparisons of Phonological & Visual Similarity 25
2.1 Method 25
2.1.1 Participants. 25
2.1.2 Design and materials. 26
2.1.3 Procedure. 29
2.2 Results 32
2.2.1 Reaction time and accuracy of naming. 32
2.2.2 Accuracy of the verbal STM task. 33
2.3 Discussion 37
Experiment 1b: Probed Serial Recall Task using List-Wise Comparisons of Phonological & Visual Similarity 40
2.4 Method 40
2.4.1 Participants. 40
2.4.2 Design and materials. 41
2.4.3 Procedure. 43
2.5 Results 44
2.5.1 Reaction time and accuracy of naming. 44
2.5.2 Accuracy of the verbal STM task. 46
2.5.3 RAN performance vs. PSE and VSE in Chinese participants. 50
2.5.4 Subjective difficulty and dissimilarity ratings. 52
2.6 Discussion 56
2.6.1 PSE and VSE in Chinese and English participants 56
2.6.2 RAN vs. VSE in Chinese participants 57
2.6.3 Bridging behavioral and neuroimaging experiments. 58
CHAPTER 3: Experiment 2 – FMRI Investigations on Neural Substrates underlying the Phonological & Visual Representations of English Verbal Short-Term Memory: English vs. Chinese Readers 60
3.1 Method 60
3.1.1 Participants. 60
3.1.2 Design and materials. 61
3.1.3 Procedure. 64
3.1.4 Image acquisition. 66
3.1.5 Imaging preprocessing. 67
3.1.6 1st level GLM modeling and 2nd level contrasts. 68
3.1.7 Lateralization index. 69
3.1.8 Region of interest analysis. 70
3.2 Results 71
3.2.1 Behavioral results. 71
3.2.2 Imaging results. 73
3.3 Discussion 88
CHAPTER 4: General Discussion 92
References 100
Appendix 111

參考文獻

Abutalebi, J., Cappa, S. F., & Perani, D. (2005). What Can Functional Neuroimaging Tell Us About the Bilingual Brain? In J. F. Kroll & A. M. B. DeGroot (Eds.), Handbook of Bilingualism: Psycholinguistic Approaches (pp. 497–512). Oxford University Press, Inc.
Baddeley, A. D. (1966a). Short-term memory for word sequences as a function of acoustic, semantic and formal similarity. The Quarterly journal of experimental psychology, 18(4), 362–5. doi:10.1080/14640746608400055
Baddeley, A. D. (1966b). The influence of acoustic and semantic similarity on long-term memory for word sequences. The Quarterly journal of experimental psychology, 18(4), 302–9. doi:10.1080/14640746608400047
Baddeley, A. D. (1996). Exploring the Central Executive. The Quarterly Journal of Experimental Psychology Section A, 49(1), 5–28. doi:10.1080/713755608
Baddeley, A. D. (1998). Recent developments in working memory. Current opinion in neurobiology, 8(2), 234–8.
Baddeley, A. D. (2000a). The episodic buffer: a new component of working memory? Trends in cognitive sciences, 4(11), 417–423.
Baddeley, A. D. (2000b). Short-Term and Working Memory. In E. Tulving & F. I. M. Craik (Eds.), The Oxford Handbook of Memory (pp. 77–92). Oxford University Press.
Baddeley, A. D. (2012). Working memory: theories, models, and controversies. Annual review of psychology, 63, 1–29. doi:10.1146/annurev-psych-120710-100422
Baddeley, A. D., & Hitch, G. J. (1974). Working Memory. In G. A. Bower (Ed.), The Psychology of Learning and Motivation: Advances in Research and Theory (pp. 47–89). New York: Academic.
Baddeley, A. D., Thomson, N., & Buchanan, M. (1975). Word length and the structure of short-term memory. Journal of Verbal Learning and Verbal Behavior, 14(6), 575–589. doi:10.1016/S0022-5371(75)80045-4
Brett, M., Anton, J.-L., Valabregue, R., & Poline, J.-B. (2002). Regions of Interest analysis using the MarsBaR Toolbox for SPM99. NeuroImage, 16(2).
Brysbaert, M., & New, B. (2009). SubtlexUS: American Word Frequencies. Retrieved August 23, 2011, from http://subtlexus.lexique.org/
Chang, T.-T., & Lee, J. R. (2009). Familiarity and Age of Acquisition Ratings for English Words by Taiwanese College Students. Bulletin of Educational Psychology, 41(2), 441–452.
Chein, J. M., & Fiez, J. A. (2001). Dissociation of verbal working memory system components using a delayed serial recall task. Cerebral cortex, 11(11), 1003–14.
Conrad, R. (1964). Acoustic confusions in immediate memory. British Journal of Psychology, 55(1), 75–84. doi:10.1111/j.2044-8295.1964.tb00899.x
Conrad, R., & Hull, A. J. (1964). Information, acoustic confusion and memory span. British Journal of Psychology, 55(4), 429–432. doi:10.1111/j.2044-8295.1964.tb00928.x
Della Sala, S., Gray, C., Baddeley, A., Allamano, N., & Wilson, L. (1999). Pattern span: a tool for unwelding visuo–spatial memory. Neuropsychologia, 37(10), 1189–1199. doi:10.1016/S0028-3932(98)00159-6
Fiez, J. A., Raife, E. A., Balota, D. A., Schwarz, J. P., Raichle, M. E., & Petersen, S. E. (1996). A positron emission tomography study of the short-term maintenance of verbal information. The Journal of neuroscience : the official journal of the Society for Neuroscience, 16(2), 808–22.
Gazzaniga, M. S., Ivry, R. B., & Mangun, G. R. (2009a). Language. In Cognitive Neuroscience: The Biology of the Mind (3rd ed., pp. 388–444). W. W. Norton, Incorporated.
Gazzaniga, M. S., Ivry, R. B., & Mangun, G. R. (2009b). Hemispheric Specialization. In Cognitive Neuroscience: The Biology of the Mind (3rd ed., pp. 445–490). W. W. Norton, Incorporated.
Gollan, T. H., Weissberger, G. H., Runnqvist, E., Montoya, R. I., & Cera, C. M. (2011). Self-ratings of spoken language dominance: A Multilingual Naming Test (MINT) and preliminary norms for young and aging Spanish–English bilinguals. Bilingualism: Language and Cognition, 15(03), 594–615. doi:10.1017/S1366728911000332
Grabner, G., Janke, A. L., Budge, M. M., Smith, D., Pruessner, J., & Collins, D. L. (2006). Symmetric atlasing and model based segmentation: an application to the hippocampus in older adults. Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention, 9(Pt 2), 58–66.
Hamada, M., & Koda, K. (2008). Influence of First Language Orthographic Experience on Second Language Decoding and Word Learning. Language Learning, 58(1), 1–31. doi:10.1111/j.1467-9922.2007.00433.x
Hamada, M., & Koda, K. (2011). The role of the phonological loop in English word learning: a comparison of Chinese ESL learners and native speakers. Journal of psycholinguistic research, 40(2), 75–92. doi:10.1007/s10936-010-9156-9
Henson, R. N., Burgess, N., & Frith, C. D. (2000). Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study. Neuropsychologia, 38(4), 426–40.
Hitch, G. J., Woodin, M. E., & Baker, S. (1989). Visual and phonological components of working memory in children. Memory & cognition, 17(2), 175–185.
Hoosain, R. J. (1992). Differential Cerebral Lateralization of Chinese-English Bilingual Functions? Advances in Psychology: Cognitive Processing in Bilinguals, 83, 561–571. doi:10.1016/S0166-4115(08)61517-4
Hoosain, R. J., & Shiu, L. P. (1989). Cerebral lateralization of Chinese-English bilingual functions. Neuropsychologia, 27(5), 705–12.
Hue, C. W., & Erickson, J. R. (1988). Short-term memory for Chinese characters and radicals. Memory & cognition, 16(3), 196–205.
Hull, R. J., & Vaid, J. (2007). Bilingual language lateralization: a meta-analytic tale of two hemispheres. Neuropsychologia, 45(9), 1987–2008. doi:10.1016/j.neuropsychologia.2007.03.002
Jones, D. M., & Macken, W. J. (1993). Irrelevant tones produce an irrelevant speech effect: Implications for phonological coding in working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 369–369.
Koda, K. (1989). Effects of L1 Orthographic Representation on L2 Phonological Coding Strategies. Journal of psycholinguistic research, 18(2), 201–222. doi:10.1007/BF01067782
Lai, C.-Y. (2008). Phonological and orthographic similarity affects verbal short-term memory for Chinese characters (Master’s thesis). National Central University, Taiwan.
Levenshtein, V. I. (1966). Binary codes capable of correcting deletions, insertions. Soviet Physics Doklady, 10, 707–710.
Lin, E. Y.-C. (2010). The investigation of orthographic representations of verbal short-term memory for Chinese characters (Master’s thesis). National Central University, Taiwan.
Logie, R. H., Della Sala, S., Wynn, V., & Baddeley, A. D. (2000). Visual similarity effects in immediate verbal serial recall. The Quarterly journal of experimental psychology. A, Human experimental psychology, 53(3), 626–46. doi:10.1080/713755916
Majerus, S., Bastin, C., Poncelet, M., Van der Linden, M., Salmon, E., Collette, F., & Maquet, P. (2007). Short-term memory and the left intraparietal sulcus: focus of attention? Further evidence from a face short-term memory paradigm. NeuroImage, 35(1), 353–67. doi:10.1016/j.neuroimage.2006.12.008
Majerus, S., D’Argembeau, A., Martinez Perez, T., Belayachi, S., Van der Linden, M., Collette, F., … Maquet, P. (2010). The commonality of neural networks for verbal and visual short-term memory. Journal of cognitive neuroscience, 22(11), 2570–93. doi:10.1162/jocn.2009.21378
Majerus, S., Poncelet, M., Van der Linden, M., Albouy, G., Salmon, E., Sterpenich, V., … Maquet, P. (2006). The left intraparietal sulcus and verbal short-term memory: focus of attention or serial order? NeuroImage, 32(2), 880–91. doi:10.1016/j.neuroimage.2006.03.048
Martin, R. C., Wu, D., Freedman, M., Jackson, E. F., & Lesch, M. (2003). An event-related fMRI investigation of phonological versus semantic short-term memory. Journal of Neurolinguistics, 16(4-5), 341–360. doi:10.1016/S0911-6044(03)00025-3
McDermott, K. B., Petersen, S. E., Watson, J. M., & Ojemann, J. G. (2003). A procedure for identifying regions preferentially activated by attention to semantic and phonological relations using functional magnetic resonance imaging. Neuropsychologia, 41(3), 293–303.
Mueller, S. T., Seymour, T. L., Kieras, D. E., & Meyer, D. E. (2003). Theoretical implications of articulatory duration, phonological similarity, and phonological complexity in verbal working memory. Journal of experimental psychology. Learning, memory, and cognition, 29(6), 1353–80. doi:10.1037/0278-7393.29.6.1353
Murray, D. J. (1968). Articulation and acoustic confusability in short-term memory. Journal of Experimental Psychology, 78(4, Pt.1), 679–684. doi:10.1037/h0026641
Norton, E. S., & Wolf, M. (2012). Rapid automatized naming (RAN) and reading fluency: implications for understanding and treatment of reading disabilities. Annual review of psychology, 63, 427–52. doi:10.1146/annurev-psych-120710-100431
Paradis, M. (1990). Language lateralization in bilinguals: enough already! Brain and language, 39(4), 576–86.
Paulesu, E., Frith, C. D., & Frackowiak, R. S. (1993). The neural correlates of the verbal component of working memory. Nature, 362(6418), 342–5. doi:10.1038/362342a0
Peereman, R., & Content, A. (n.d.). Orthography-phonology mapping in English and French. Retrieved January 31, 2013, from http://homepages.ulb.ac.be/~acontent/OPMapping.html
Peters, F., Collette, F., Degueldre, C., Sterpenich, V., Majerus, S., & Salmon, E. (2009). The neural correlates of verbal short-term memory in Alzheimer’s disease: an fMRI study. Brain, 132(Pt 7), 1833–46. doi:10.1093/brain/awp075
Ravizza, S. M., Behrmann, M., & Fiez, J. a. (2005). Right parietal contributions to verbal working memory: spatial or executive? Neuropsychologia, 43(14), 2057–67. doi:10.1016/j.neuropsychologia.2005.03.014
Ravizza, S. M., Delgado, M. R., Chein, J. M., Becker, J. T., & Fiez, J. A. (2004). Functional dissociations within the inferior parietal cortex in verbal working memory. NeuroImage, 22(2), 562–73. doi:10.1016/j.neuroimage.2004.01.039
Repovš, G., & Baddeley, A. D. (2006). The multi-component model of working memory: explorations in experimental cognitive psychology. Neuroscience, 139(1), 5–21. doi:10.1016/j.neuroscience.2005.12.061
Saito, S., Logie, R. H., Morita, A., & Law, A. (2008). Visual and phonological similarity effects in verbal immediate serial recall: A test with kanji materials. Journal of Memory and Language, 59(1), 1–17. doi:10.1016/j.jml.2008.01.004
Salmon, E., Van der Linden, M., Collette, F., Delfiore, G., Maquet, P., Degueldre, C., … Franck, G. (1996). Regional brain activity during working memory tasks. Brain, 119(5), 1617–1625. doi:10.1093/brain/119.5.1617
Sumiyoshi, C., Matsuo, K., Kato, C., Ozawa, F., Takehara, Y., Isoda, H., … Nakai, T. (2003). Orthography effect on brain activities in the working memory process for phonologically ambiguous syllables: a functional magnetic resonance imaging study using Japanese speakers. Neuroscience letters, 336(1), 50–4.
Todd, J. J., & Marois, R. (2004). Capacity limit of visual short-term memory in human posterior parietal cortex. Nature, 428(6984), 751–4. doi:10.1038/nature02466
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., … Joliot, M. (2002). Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage, 15(1), 273–89. doi:10.1006/nimg.2001.0978
Wang, M., Koda, K., & Perfetti, C. A. (2003). Alphabetic and nonalphabetic L1 effects in English word identification: a comparison of Korean and Chinese English L2 learners. Cognition, 87(2), 129–149. doi:10.1016/s0010-0277(02)00232-9
Wang, P. P., & Bellugi, U. (1994). Evidence from two genetic syndromes for a dissociation between verbal and visual-spatial short-term memory. Journal of clinical and experimental neuropsychology, 16(2), 317–22. doi:10.1080/01688639408402641
Wilke, M., & Lidzba, K. (2007). LI-tool: a new toolbox to assess lateralization in functional MR-data. Journal of neuroscience methods, 163(1), 128–36. doi:10.1016/j.jneumeth.2007.01.026
Wilke, M., & Schmithorst, V. J. (2006). A combined bootstrap/histogram analysis approach for computing a lateralization index from neuroimaging data. NeuroImage, 33(2), 522–30. doi:10.1016/j.neuroimage.2006.07.010
Wolf, M., & Denckla, M. (2005). RAN/RAS: Rapid Automatized Naming and Rapid Alternating Stimulus Tests. Austin, TX: Pro-Ed.
Yarkoni, T., Balota, D., & Yap, M. (2008). Moving beyond Coltheart’s N: a new measure of orthographic similarity. Psychonomic bulletin & review, 15(5), 971–9. doi:10.3758/PBR.15.5.971
Yik, W. F. (1978). The effect of visual and acoustic similarity on short-term memory for Chinese words. The Quarterly journal of experimental psychology, 30(3), 487–94. doi:10.1080/00335557843000070

指導教授

吳嫻(Denise Hsien Wu)

審核日期

2013-7-29

推文