Different Semantic Processing of Chinese Character and Japanese Kanji in Bilingual Brain

Zhenglong Lin1, Wentao Zhang1, Xiujun Li2, Hongzan Sun3, Qiyong Guo3, Geqi Qi*4, Jinglong Wu5,6 and Xintao Zhang*1 1Department of Sports Medicine and Rehabilitation, China 2School of Computer Science and Technology, China 3Department of Radiology, China 4Department of Psychology, China 5Key Laboratory of Biomimetic Robots and System, Beijing Institute of Technology, China 6Cognitive Neuroscience Laboratory, Graduate School of Natural Science and Technology, Japan


Introduction
One of the most important questions concerning language processing in the bilingual brain is whether the two languages share the same neural structure for comprehension [1][2][3]. Previous studies have collected data predominantly from subjects whose first (L1) and second (L2) languages both use alphabetic scripts. According to some of these studies, lexical and semantic storage of the two languages are largely localized in the same brain regions [1,[4][5][6].
When the L1 and L2 have remarkably different configurations, for example one is alphabetic and the other is logographic, previous findings showed that processing of the L2 is greatly shaped by the L1, although the two kinds of script were reported to elicit different activation patterns in native readers [12][13][14][15][16]. These studies suggest that neural network involved in semantic processing of visual word can be different across writing systems [17]. This leads us to ask whether languages with the same writing system utilize the same neural network for semantic processing. Chinese-Japanese or Japanese-Chinese Bilinguals are outstanding examples of those who have L1 and L2 presented with the same writing system -logogram.
The Japanese and Chinese languages both use an extremely sophisticated writing system that uses kanji ideograms [18,19].
Also, the number of kanji characters that are used is overwhelmingly larger in Chinese than in Japanese, and about 70-80% of the characters used in both languages are used to express the same meaning. Although Previous Functional Resonance Magnetic Imaging (FMRI) studies on alphabetic language have shown effect of orthographic depth between L1 and L2 on language processing network [20,21]. In contrast to grapheme-to-phoneme mapping alphabets, logographic characters used in Chinese and Japanese languages map grapheme to a meaningful unit-morpheme or a word [17]. Thus, in principle, we could read Chinese characters/ kanjis directly for meaning without pronunciation. Based on these premises, we want to know whether bilinguals in Chinese and Japanese utilize the same lexico-semantic route for both languages, without involving neural network for phonological processing. So far, only one study has directly compared processing of L1 and L2, both of which use logographic script [22].
In that study, the authors investigated brain activation associated with Japanese and Chinese sentence reading in native Japanese speakers literate in Mandarin and native Chinese speakers literate in Japanese using functional magnetic resonance imaging. The results showed that both languages share the same processing network, while at the same time utilizing regions, which are dedicated to processing of one language but not the other. The goal of the present study is to compare the activation patterns during semantic processing in bilinguals of logographic language, using Chinese and Japanese words. Word reading is different from sentence reading, since the latter follows a more complicated syntax rules that bring the word components together into a context. For example, despite their common use of ideograms, Chinese characters and Japanese kanji are regarded very differently in sentences. A Japanese sentence is usually consisted of both kanji (morphograms) and kana (phonograms) and therefore it is a complex mixed system of phonograms and morphograms [23].
On the other hand, Chinese readers can convert character into corresponding sounds, or they can primarily read and understand the meaning of sentences written in character without first converting characters into sounds, a process like sight reading in English [24,25].
To exclude the complex processing of sentence reading, the current study specifically compared Chinese and Japanese word processing in bilinguals while they decided whether two pairs of Chinese characters or Japanese kanjis were similar in meaning or not.
Our purpose is to identify the networks involved in semantic processing of Chinese characters and Japanese kanjis, to test if words of both the languages use the same network without involving phonological processing. Furthermore, we want to quantify the differences of semantic processing in the two languages if there are any. This would indicate whether the two groups of bilinguals use the same strategy for semantic processing of logographic characters.

Subjects
Twenty-six healthy college students participated in this FMRI study. All participants were right-handed. None of the participants displayed any signs or had any previous history of medical or neurological diseases. Written informed consent was obtained from each participant in accordance with the guidelines approved by Ethics Committees of the Shengjing Hospital of the China Medical University and Okayama University. The group of Chinese-Japanese bilingual participants consisted of 13 native Chinese (7 males and 6 females, aged 23.3±0.9 years), and they had learned Japanese for a period of 4.1±0.8 years. The group of Japanese-Chinese bilingual participants consisted of 13 native Japanese (7 males and 6 females, aged 22±2.2 years), and they had learned Chinese for a period of 3.7±2.1 years. At the time of the experiment, all Japanese-Chinese bilinguals were studying in China and were using Chinese daily.
The Chinese-Japanese bilinguals' proficiency in grammar and vocabulary in Japanese was assessed with the level 1 Japanese language proficiency test, which was administered by Japan

Experimental Design
Chinese characters and Japanese kanjis were separately used in two FMRI experiments, both of which were consisted of (a) semantic (b) phonological and (c) size judgment tasks. During each trial, a pair of two-word Chinese characters/Japanese kanji was presented with the fixation point in-between. The participants were asked to judge whether the pairs of Chinese characters/Japanese kanji (a) had the same meaning, (b) rhyme or (c) were the same size and respond with two different buttons to indicate yes or no respectively ( Figure 1 & Table 1). A block design was adopted, and each session contained 6 experimental blocks (36s), interleaved by rest conditions (24s). The blocks were evenly divided into the 3 experimental tasks (semantic, phonological and size judgment), and randomly distributed within a session. At the start of each block, a cue was presented for 4s to prompt what task was to be completed in the next series of trials. The stimuli were presented for 2.5s, each followed by 1.5s of fixation point. Such trails were

Figure 1:
A block design was adopted, and each session contained 6 experimental blocks (36s), interleaved by rest conditions (24s). The blocks were evenly divided into the 3 experimental tasks (semantic, phonological and size judgment), and randomly distributed within a session. At the start of each block, a cue was presented for 4s to prompt what task was to be completed in the next series of trials. The stimuli were presented for 2.5s, each followed by 1.5s of fixation point. Such trails were repeated 8 times in each experimental block.

FMRI Data Analysis
The parameter from this normalization process was then applied to each functional image. Finally, the normalized functional images were filtered using a Gaussian kernel of 8 mm Full Width at Half Maximum (FWHM) in the x, y, and z axes. The parameters from this normalization process were then applied to the functional images, which were resampled to a final resolution of 2 × 2 × 2 mm 3 .

Individual Analysis: A General Linear Model (GLM) was fitted
to the FMRI data for each subject [26]. The Blood-Oxygen-Level Random Effects Group Analysis: We evaluated the linear contrasts in each subject and obtained the contrast images that were used for the random-effect group analysis. In the group analysis, we performed a full-factorial analysis for each contrast.
The height threshold for SPM[t] was set at 3.93 (equivalent to P<0.001 uncorrected). The statistical threshold for the spatial extent test on the clusters was set at P<0.05 and corrected for multiple comparisons over the search volume. Coordinates in MNI space were transformed into Talairach spae and the brain regions were anatomically defined and labeled using Automated Anatomical Labeling (AAL) software package [27]. We conducted both whole brain and Region-of-Interest (ROI) analyses. In the whole brain analysis, the search volume was the whole brain. In this analysis, we compared the semantic judgment task of each language with the fixation condition to identify the activation maps of the regions involved in semantic processing (  Figure 3 & Table 3). The percent signal changes were then compared using repeated-measures ANOVA in SPSS 13.0 (SPSS Inc., Tokyo, IL).

Behavioral Results
The subjects responded more slowly and less accurately when they performed semantic and phonological tasks in their L2.
However, no such difference between languages was observed in performance during size judgment tasks. A two-way ANOVA analysis was performed to examine the influence of language and subject group on response time and accuracy during semantic judgment

Imaging Results
Whole Brain Results: Whole brain activations during Chinese character and Japanese kanji semantic judgment tasks are shown in Figure 2 and Table 2 Japanese speakers, on the other hand, showed more extensive brain activation during Chinese character semantic task compared to Japanese kanji semantic task. Consistent with previous studies, the overall activation patterns associated with Chinese character and Japanese kanji in both subject groups are bilateral, suggesting a right hemispheric advantage for processing these words.  Table 1 (p<0.05, corrected at cluster level).    Chinese-Japanese bilinguals showed stronger activation to Japanese kanji than Chinese character in these three regions: LIFGor (p<0.05), LIFG-tr (0.0001) and RMGF (p<0.05).

Discussion
The current study investigated brain activations during Chinese character and Japanese kanji processing in two groups of bilinguals, namely a Chinese-Japanese bilingual group and a Japanese-Chinese bilingual group. Consistent with our hypothesis, the results showed a largely common neural network for semantic processing of Chinese words and Japanese words in the brain of all bilinguals.
However, there were also some differences between the activation patterns of the two bilingual groups, possibly due to different neural strategies adapted by the two groups. Regardless of writing systems, recognizing words universally requires mapping of the graphic forms to their corresponding pronunciations and meanings.
However, different writing systems emphasize on different part of the language decoding process [17], which in turn is reflected on the corresponding activation patterns in the brain.
For example, shallow orthographic writings such as Italian more actively engage a dorsal pathway as a reflection of the computation of assembled phonology from individual graphemes, whereas deeper orthographies such as English engage a ventral pathway along which computation of addressed phonology takes place Chinese writing has even deeper orthography that does not map grapheme to phoneme, but instead maps logographic character to a meaningful unit [28]. And visually, Chinese characters differ drastically from other writings with their nonlinear square packed configurations. It has been suggested that such visual complexity demands for holistic spatial processing, thus engaging both left and right hemisphere for decoding [29]. This stands in contrast to left hemisphere dominance of alphabetic writing processing.

Bilateral brain activation was expected and demonstrated
during the semantic processing of Chinese words at typical language areas (Figure 1). The most extensive activation was observed in the bilateral occipital lobe and along the ventral visual stream. These regions have been reported to decode pictorial features and orthography of Chinese characters [30]. As mentioned previously, Japanese kanjis are essentially Chinese characters used to write Japanese. Thus, most kanjis used in modern Japanese still retain their Chinese meaning, physical resemblance with some of their modern traditional Chinese characters counterparts. Kanji contrasts with the other part of the Japanese writing system--kana and utilizes a differential processing route in the brain [31,17].
While kana depends on the dorsal stream from the occipital to the inferior parietal area, Kanji processing relies on the ventral stream from the occipital to the temporal cortex [31,32,17].
During semantic judgment task of Japanese words, both Chinese and Japanese bilingual groups showed strong activations in the ventral processing stream (Figure 2 & Table 2). This is consistent with previous findings from imaging studies of kanji processing [33,34].
Our results may suggest that semantic decoding of kanji depends heavily on visual orthographic retrieval and lexical-semantic system through the ventral route, regardless of the bilingual groups. Other notable activation was observed in supplementary motor cortex, indicating preparatory processing during the semantic judgment task [34,35]. The activation patterns for Japanese word semantic processing in the two groups of bilinguals were like that of Chinese word semantic processing in the Chinese bilingual group, suggesting a common neural mechanism working behind these phenomena.
As discussed in the previous sections, our overall results show that Chinese and Japanese bilingual groups adapted different strategies while completing sematic judgment tasks in two languages. For the Chinese word semantic judgment task, Chinese bilingual group relied on ventral route, mapping graphic form of characters to lexical/semantic information; Japanese bilingual group, on the other hand, additionally recruited language regions in the frontal and parietal lobe for orthographic and phonological information retrieval to assist the determination of semantic judgment.
It is consistent with previous findings, which indicated that more extensive activation is elicited by less proficient language of bilinguals [36]. Developmental studies of Chinese word processing reported that there is a reduced reliance on phonological information with increased reading skills [37,38]. This tendency may help explain the weak involvement of frontal language areas in the Chinese bilinguals during semantic judgment of their native language. Regarding the Japanese word semantic task, both Chinese and Japanese bilingual groups relied on ventral route, more heavily on regions in occipital lobe, suggesting visuospatial and orthographic processing is essential for semantic retrieval of kanji words in all subjects. However, when we further investigated language areas with ROI analysis, we found that the Chinese bilingual group showed significantly larger BOLD signal change for Japanese words compared to Chinese words in several brain regions ( Figure 3).  Furthermore, semantic processing left inferior frontal gyrus (pars orbitalis and pars triangularis also showed stronger BOLD signal change for Japanese words than Chinese words [39]. These findings suggest that Japanese word semantic judgment task leads to higher demand for resources involved in orthographic and sematic processing in the brain of Chinese bilinguals. This is consistent with previous findings showing less proficient second language elicits higher level of activations in language areas [36].

Conclusion
To summarize, our findings showed that both Chinese-Japanese and Japanese-Chinese bilinguals partially relied on occipital and temporal network for Chinese and Japanese words, which suggest emphasis on orthography-to-semantic mapping during semantic processing of logographic scripts. However, unlike Chinese bilinguals, Japanese bilinguals showed more neural demand in frontal language areas, which may reflect a reliance on orthographic and phonological information for semantic processing of Chinese words. Further research is needed to account for the influence of one logographic processing on the other in the bilingual brain and better understand of how more than one language is comprehended in the brain.