Fundamentals of formal properties of nonmanuals: A quantitative approach
This project aims to establish a quantitative typology of nonmanuals in five sign languages to explore universal linguistic features and their differences in expression across modalities.
Projectdetails
Introduction
Sign languages, in addition to using the hands, also use positions and movements of other articulators: the body, the head, the mouth, the eyebrows, the eyes, and the eyelids, to convey lexical, grammatical, and prosodic information. This linguistic use of the nonmanual articulators is known as nonmanuals.
Hypothesis
Contrary to current assumptions in the field of sign linguistics, this project proposes the hypothesis that all sign languages use the same basic universal building blocks (nonmanual movements). However, each language is different in how it combines these building blocks both sequentially and simultaneously.
Differences Among Languages
Languages also differ in the following aspects of nonmanuals:
- Regularity
- Frequency
- Alignment properties
Methodology
In order to test this hypothesis, the project will investigate formal properties of nonmanuals in five geographically, historically, and socially diverse sign languages. The methodology includes:
- Using data from published naturalistic corpora of the sign languages
- Employing Computer Vision for extracting measurements of the movement of nonmanual articulators
- Applying a statistical technique of Functional Data Analysis for a quantitative comparison of dynamic nonmanual contours
This will result in the first quantitative formal typology of nonmanuals grounded in naturalistic corpus data.
Methodological Development
The novel methodology proposed in this project requires testing, adjustment, and development, which constitutes an important component of the project. The developed methodological pipeline will be a secondary output enabling large-scale reliable quantitative research on nonmanuals in the future.
Cross-Modal Comparison
Finally, the established typology of formal properties of nonmanuals in the five sign languages will serve as a basis for a cross-modal comparison between nonmanuals and prosody/intonation in spoken languages. This comparison aims to separate truly universal features of the human linguistic capacity from the effects of the visual versus auditory modalities.
Financiële details & Tijdlijn
Financiële details
Subsidiebedrag | € 1.500.000 |
Totale projectbegroting | € 1.500.000 |
Tijdlijn
Startdatum | 1-1-2023 |
Einddatum | 31-12-2027 |
Subsidiejaar | 2023 |
Partners & Locaties
Projectpartners
- UNIVERSITETET I BERGENpenvoerder
Land(en)
Vergelijkbare projecten binnen European Research Council
Project | Regeling | Bedrag | Jaar | Actie |
---|---|---|---|---|
Naming the world: Semantic associations and form-meaning mappings in the mental lexicon across sign languagesThe SemaSign project aims to uncover form-meaning correspondences in sign languages using computational methods and datasets to enhance understanding of mental lexicons and improve sign language resources. | ERC Starting... | € 1.490.840 | 2024 | Details |
How Hands Help Us HearHearingHands aims to explore the impact of gesture-speech coupling on audiovisual communication across languages and populations, enhancing our understanding of multimodal interaction. | ERC Starting... | € 1.499.988 | 2022 | Details |
Gates to LanguageThe GALA project investigates the biological mechanisms of language acquisition in humans and nonhuman species to uncover why only humans can learn language. | ERC Starting... | € 1.490.057 | 2024 | Details |
A Foundation for Empirical Multimodality ResearchFOUNDATIONS develops a novel methodology for empirical research on multimodality by creating large, annotated corpora and using AI to analyze human communication across diverse cultural artifacts. | ERC Consolid... | € 1.999.974 | 2024 | Details |
Theory of ToneThe project aims to classify tonal systems into four categories and identify their diachronic changes by analyzing a balanced sample of 150-200 tonal languages worldwide. | ERC Advanced... | € 2.418.010 | 2023 | Details |
Naming the world: Semantic associations and form-meaning mappings in the mental lexicon across sign languages
The SemaSign project aims to uncover form-meaning correspondences in sign languages using computational methods and datasets to enhance understanding of mental lexicons and improve sign language resources.
How Hands Help Us Hear
HearingHands aims to explore the impact of gesture-speech coupling on audiovisual communication across languages and populations, enhancing our understanding of multimodal interaction.
Gates to Language
The GALA project investigates the biological mechanisms of language acquisition in humans and nonhuman species to uncover why only humans can learn language.
A Foundation for Empirical Multimodality Research
FOUNDATIONS develops a novel methodology for empirical research on multimodality by creating large, annotated corpora and using AI to analyze human communication across diverse cultural artifacts.
Theory of Tone
The project aims to classify tonal systems into four categories and identify their diachronic changes by analyzing a balanced sample of 150-200 tonal languages worldwide.
Vergelijkbare projecten uit andere regelingen
Project | Regeling | Bedrag | Jaar | Actie |
---|---|---|---|---|
Pas ChatGPT aan voor DierentalenDit project onderzoekt de haalbaarheid van technologie die dierentalen vertaalt naar menselijke talen om de communicatie tussen mensen en dieren te verbeteren. | Mkb-innovati... | € 20.000 | 2023 | Details |
Pas ChatGPT aan voor Dierentalen
Dit project onderzoekt de haalbaarheid van technologie die dierentalen vertaalt naar menselijke talen om de communicatie tussen mensen en dieren te verbeteren.