LexSIC
A quick vocabulary test for dialect proficiency in Sicilian
Abstract
It has been increasingly acknowledged that regional languages and dialects bear similarities with heritage languages, and that some heritage speakers are bilectal with two closely related minority languages or dialects. However, assessing the knowledge of non-standard varieties proves difficult due to the lack of assessment materials. Our contribution documents the creation and validation of LexSIC, a yes/no vocabulary task, a placement test for speakers with receptive and/or productive skills in Sicilian. The materials are freely available. The vocabulary items were validated in a survey with 100 speakers of Italian, who had varying levels of proficiency in Sicilian, including bilectal heritage speakers in Germany. We have relied on Classical Test Theory (CTT) and Item Response Theory (IRT) in validating test items and we demonstrate and discuss correlations with self-reported measures of proficiency, language use, age and education. A comparison of vocabulary proficiency in bilectals with Italian and Sicilian proficiency further shows that the two are highly correlated, which underlines a cumulative enhancement of vocabulary proficiency in bilectals. We discuss the challenges in creating assessment materials in minority languages and dialects.
Keywords
Sicilian, bilectalism, heritage speakers, vocabulary, assessmentReferences
Alderson, J. Charles. 2005. Diagnosing foreign language proficiency: The interface
between learning and assessment. London: Continuum.
Alderson, J. Charles & Ari Huhta. 2005. The development of a suite of computer-based diagnosis tests based on the Common European Framework. Language Testing 22(3): 301–320. https://doi.org/10.1191/0265532205lt310oa
Amenta, Simona, Badan, Linda, & Marc Brysbaert. 2021. LexITA: A Quick and Reliable Assessment Tool for Italian L2 Receptive Vocabulary Size. Applied Linguistics 42(2): 292–314. https://doi.org/10.1093/applin/amaa020
Anderson, Richard C. & Peter Freebody. 1983. Reading comprehension and the assessment and acquisition of word knowledge. In B. Hutton (ed.), Advances in Reading/Language Research, Vol. 2, 231–256. Greenwich, Connecticut: JAI Press.
Andriani, Luigi, Casalicchio, Jan, Ciconte, Francesco M., D'Alessandro, Roberta, Frasson, Alberto, Van Osch, Brechje, Sorgini, Luana, & Silvia Terenghi. 2022. Documenting Italo-Romance minority languages in the Americas. Problems and tentative solutions. In: A. Nevins & M. Cole (eds.), Contemporary research in minority and diaspora languages of Europe, 9–56. Berlin: Language Science Press.
Bachman, Lyle. 2004. Statistical analyses for language assessment. Cambridge University Press.
Bates, Elizabeth & Judith C. Goodman. 1999. On the emergence of grammar from the lexicon. In B. Macwhinney (ed.), The emergence of language, 29– 79. Mahwah, NJ: Erlbaum.
Beglar, David. 2010. A Rasch-based validation of the Vocabulary Size Test. Language Testing 27(1): 101–118. https://doi.org/10.1177/0265532209340194
Benmamoun, Elabbas, Montrul, Silvina, & Maria Polinsky. 2013. Heritage languages and their speakers: Opportunities and challenges for linguistics. Theoretical Linguistics 39(3-4): 129-181. https://doi.org/10.1515/tl-2013-0009
Berruto, Gaetano. 1987. Sociolinguistica dell’italiano contemporaneo. Roma: La Nuova Italia Scientifica. New updated edition in 2012.
Berruto, Gaetano. 1989. Main topics and findings in Italian sociolinguistics. International Journal of the Sociology of Language 76: 7–30. https://doi.org/10.1515/ijsl.1989.76.7
Berruto, Gaetano. 2018. The languages and dialects of Italy. In W. Ayres-Bennett & J. Carruthers (eds.), Manual of Romance Sociolinguistics, 494–525. Boston, Berlin: De Gruyter. https://doi.org/10.1515/9783110365955-019
Besler, Alexandra, Ferin, Maria, Venagli, Ilaria, & Tanja Kupisch. in prep. On the relation between attitudes and dialect maintenance (Sicilian and Venetan) in Italy, Ms. University of Konstanz.
Bialystok, Ellen, Craik, Fergus I. M., Klein, Raymond, & Mythili Viswanathan. 2004. Bilingualism, aging, and cognitive control: evidence from the Simon task. Psychology and Aging 19: 290–303. https://doi.org/10.1037/0882-7974.19.2.290
Brysbaert, Marc. 2013. Lextale_FR A fast, free, and efficient test to measure language proficiency in French. Psychologica Belgica, 53(1): 23–37. https://doi.org/10.5334/pb-53-1-23
Coluccia, Rosario. 1994. Il volgare nel Mezzogiorno. In L. Serianni & P. Trifone (eds), Storia della lingua italiana. III: Le altre lingue, 373-405. Turin: Einaudi.
Council of Europe. 1992. The European Charter for Regional or Minority Languages. www.coe.int/en/web/european-charter- regional-or-minority-languages/text-of-the-charter.
Cruschina, Silvio. 2020. The classification of Sicilian dialects: Language change and contact. L’Italia Dialettale 81: 79–103.
De Mauro, Tullio. 2005. Storia linguistica dell’Italia unita, 9. ed. Roma: GLF Editori Laterza.
De Renzo, Francesco. 2008. Per un’analisi della situazione sociolinguistica dell’Italia contemporanea. Italiano, dialetti e altre lingue. Italica 85(1): 44-62.
Eberhard, David M., Simons, Gary F., & Charles D. Fennig (eds.). 2022. Ethnologue: Languages of the World. Twenty-fifth edition. SIL International. http://www.ethnologue.com
Ferguson, Charles A. 1964. Diglossia. In D. Hymes (ed.), Language in Culture and Society, 425–439. New York: Harper & Row.
Garraffa, Maria, Beveridge, Madeleine, & Antonella Sorace. 2015. Linguistic and cognitive skills in Sardinian-Italian bilingual children. Frontiers in Psychology 6(1898): 1–15. https://doi.org/10.3389/fpsyg.2015.01898
Garraffa, Maria, Obregon¸ Mateo, & Antonella Sorace. 2017. Linguistic and cognitive effects of bilingualism with regional minority languages: a study of Sardinian-Italian adult speakers. Frontiers in Psychology 8(1907): 1-11. https://doi.org/10.3389/fpsyg.2017.01907
Gathercole, Susan E. & Alan D. Baddeley. 1989. Evaluation of the role of phonological STM in the development of vocabulary in children: A longitudinal study. Journal of Memory and Language 28: 200–213. https://doi.org/10.1016/0749-596X(89)90044-2
Grassi, Corrado, Sobrero, Alberto A., & Tullio Telmon. 1997. Fondamenti di dialettologia italiana. Rome: Laterza.
Green, Rita. 2013. Statistical analyses for language testers. London: Palgrave Macmillan.
Gyllstad, Henrik. 2013. Looking at L2 vocabulary knowledge dimensions from an assessment perspective – Challenges and potential solutions. In C. Bardel, B. Laufer, & C. Lindqvist (eds.), L2 Vocabulary Acquisition, Knowledge and Use: New Perspectives on Assessment and Corpus Analysis, 11-28. Eurosla Monographs Series, 2. EUROSLA.
Gyllstad, Henrik, Vilkaitė, Laura, & Norbert Schmitt. 2015. Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates. ITL International Journal of Applied Linguistics 166(2): 278–306. https://doi.org/10.1075/itl.166.2.04gyl
Gyllstad, Henrik, McLean, Stuart, & Jeffrey Stewart. 2021. Using confidence intervals to determine adequate item sample sizes for vocabulary tests: An essential but overlooked practice. Language Testing 38(4): 558–579. https://doi.org/10.1177/0265532220979562
Haller, Hermann W. 1993. Una lingua perduta e ritrovata. L’italiano degli italo-americani. Firenze: La Nuova Italia.
Haller, Hermann W. 1997. The dialects abroad. In M. Maiden und M. Parry (eds.), The Dialects of Italy, 401–411. London: Routledge.
Haller, Hermann W. 2014. Evolving linguistic identities among the Italian-American youth: Perceptions from linguistic autobiographies. Forum Italicum 48(2): 238–252. https://doi.org/10.1177/0014585814529230
Hilton, Heather. 2008. The link between vocabulary knowledge and spoken L2 fluency. The Language Learning Journal 36: 153–166. https://doi.org/10.1080/09571730802389983
ISTAT. 2007. La lingua italiana, i dialetti e le lingue straniere. Anno 2006, online, portal-lem.com/images/it/Italie/Lingue_e_dialetti_e_lingue_straniere_in_Italia.pdf.
ISTAT. 2012. L’uso della lingua italiana, dei dialetti e di altre lingue in Italia, published online 27th October 2014, http://www.istat.it/archivio/136496.
Izura, Christina, Cuetos, Fernando, & Marc Brysbaert. 2014. Lextale-Esp: A test to rapidly and efficiently assess the Spanish vocabulary size. Psicológica 35(1): 49–66.
Jeon, Eun H. & Junko Yamashita. 2014. L2 reading comprehension and its correlates: A Meta-analysis. Language Learning 64: 160–212. https://doi.org/10.1111/lang.1203
Laufer, Batia & Geke C. Ravenhorst-Kalovski. 2010. Lexical threshold revisited: Lexical text coverage, learners’ vocabulary size and reading comprehension. Reading in a Foreign Language, 22(1): 15–30.
Leiner, Dominik J. 2014. SoSci Survey (Version 2.4.00-i). [Computer software]
Lenth R (2023). emmeans: Estimated Marginal Means, aka Least-Squares Means. R package version 1.8.4-1, <https://CRAN.R-project.org/package=emmeans>.
Leivada, Evelina, Papadopoulou, Elena, Kambanaros, Maria & Kleanthes Grohman. 2017. The Influence of Bilectalism and Non-standardization on the Perception of Native Grammatical Variants. Frontiers in Psychology 8: 205.
Lemhöfer, Kristin & Mirjam Broersma. 2012. Introducing LexTALE: A quick and valid lexical test for advanced learners of English. Behavior Research Methods 44: 325–43. https://doi.org/10.3758/s13428-011-0146-0
Linacre, John Michael. 2002. What do infit and outfit, mean-square and standardized mean. Rasch Measurement Transactions 16(2): 878.
Loporcaro, Michele. 2009. Profilo linguistico dei dialetti italiani. Bari: Editori Laterza.
Matranga, Vito & Roberto Sottile. 2013. La variazione dialettale nello spazio geografico. In G. Ruffino (ed.), Lingue e culture in Sicilia, 215–274. Palermo: Centro di studi filologici e linguistici siciliani.
McLean, Stuart, Kramer, Brandon, & Jeffrey Stewart. 2015. An empirical examination of the effect of guessing on vocabulary size test scores. Vocabulary Learning and Instruction 4(1): 26–35.
Meara, Paul. 1996. The dimensions of lexical competence. In G. Brown, K. Malmkjær, & J. Williams (eds.), Performance and competence in second language acquisition, 33–55. Cambridge: Cambridge University Press.
Meara, Paul & Barbara Buxton. 1987. An alternative to multiple choice vocabulary tests. Language Testing 4: 142-154.
Montrul, Silvina. 2008. Incomplete Acquisition in Bilingualism. Re-examining the Age Factor. Amsterdam: John Benjamins. https://doi.org/10.1075/sibil.39
Montrul, Silvina. 2016. The Acquisition of Heritage Languages. Cambridge, UK: Cambridge University Press. https://doi.org/10.1017/CBO9781139030502
Moseley, Christopher. 2010. Atlas of the worlds’ languages in danger. Unesco Publishing.
Nation, Paul. 1993. Vocabulary size, growth, and use. In R. Schreuder & B. Weltens (eds.), The bilingual Lexicon, 115–134. Amsterdam: John Benjamins.
Parry, Mair. 2010. Matters of choice: Language preferences in Italy today. The Italianist 30(2): 61-77.
Pellegrini, Giovan Battista. 1977. Carta dei dialetti d’Italia (Profilo dei dialetti italiani 0). Pisa: Pacini.
Polinsky, Maria. 2018. Heritage Languages and their Speakers. Cambridge: Cambridge University Press.
R Core Team. 2022. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
Rubino, Antonia. 2014. Trilingual Talk in Sicilian-Australian Migrant Families: Playing Out Identities Through Language Alternation. London: Palgrave Macmillan.
Ruffino, Giovanni. 1991. Dialetto e dialetti di Sicilia. Palermo: CUSL.
Ruffino, Giovanni. 2001. Profili linguistici delle regioni. Sicilia. Bari: Laterza.
Ruffino, Giovanni. 2006. L’indialetto ha la faccia scura. Giudizi e pregiudizi linguistici dei bambini italiani. Palermo: Sellerio.
Salmela, Rosa, Lehtonen, Minna, Garusi, Stefano, & Raymond Bertram. 2021. Lexize: A test to quickly assess vocabulary knowledge in Finnish. Scandinavian Journal of Psychology 62(6): 775–894. https://doi.org/10.1111/sjop.12768
Schmid, Marc. 2014. Italienische Migration nach Deutschland. Soziohistorischer Hintergrund und Situation im Bildungssystem. Wiesbaden: Springer VS.
Schmitt, Norbert. 2014. Size and depth of vocabulary knowledge: What the research shows. Language Learning 64: 913–951. https://doi.org/10.1111/lang.12077
Stæhr, Lars S. 2008. Vocabulary size and the skills of listening, reading and writing. The Language Learning Journal 36: 139–152. https://doi.org/10.1080/09571730802389975
Tosi, Arturo. 2001. Language and Society in a Changing Italy. Clevedon: Multilingual Matters.
Zhang, Songshan & Xian Zhang. 2020. The relationship between vocabulary knowledge and L2 reading/listening comprehension: A meta-analysis. Language Teaching Research 26(4): 696–725. https://doi.org/10.1177/1362168820913998
Published
Downloads
Copyright (c) 2023 Tanja Kupisch, Sebastiano Arona, Alexandra Besler, Silvio Cruschina, Maria Ferin, Henrik Gyllstad, Ilaria Venagli
This work is licensed under a Creative Commons Attribution 4.0 International License.
