Categories
All Lab News Publication

“ToneCL:Contrastive Learning for Few-Shot Syllable-Level Tone Classification” published in Association for Computational Linguistics

We are pleased to share a new publication by Qisheng and Youngah, titled ToneCL: Contrastive Learning for Few-Shot Syllable-Level Tone Classification, published in the Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers).

In this study, Qisheng and Youngah introduce ToneCL, a lightweight contrastive learning framework designed for few-shot syllable-level tone classification. Contrastive learning allows a model to learn useful speech representations from large amounts of unlabeled audio before being fine-tuned with only a small number of labeled examples. This approach is particularly valuable for low-resource languages, where annotated speech data are often scarce and expensive to collect.

To evaluate the framework, the authors simulated low-resource conditions using Mandarin and Vietnamese speech data, limiting training data to only tens of labeled examples per tone category. ToneCL consistently outperformed comparison methods, achieving 91.6% accuracy on a six-speaker Mandarin dataset with just ten labeled examples per tone. The study also demonstrated strong cross-lingual transfer, showing that pretraining on Vietnamese speech can effectively support tone classification in Mandarin. An ablation analysis further revealed that frequency band rejection was the most important augmentation technique contributing to the model’s performance.

In addition to the publication, Qisheng presented “ToneCL: Contrastive Learning for Few-Shot Syllable-Level Tone Classification” as an oral presentation at the AACL-IJCNLP 2026 main conference. The talk was part of the Machine Translation and Phonology session, held on Saturday, November 7. The presentation provided an opportunity to share the study’s findings with the wider computational linguistics community as part of a conference program.

Liao, Q., & Do, Y. (2006). ToneCL: Contrastive learning for few-shot syllable-level tone classification. In Y. Zhang, R. Xu, A. Purwarianti, T. Rong, & J. Suzuki (Eds.), Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 1513–1525). Association for Computational Linguistics. open_in_new URL

Categories
Lab News

Presenting at LabPhon19 @ Seoul

Our lab members recently presented in the recent LabPhon19 conference, held from June 27th to 29th, 2024, in Seoul, South Korea. The conference theme was “Where speech sounds meet the architecture of the grammar and beyond.” We presented findings from three distinct areas of investigation: phonetic substance in language learning, tonal representation in Hakka dialects, and the influence of naturalness bias on phonological variation.

Poster Presentations

  • Phonetic substance in alternation learning: This study by Ivy and Youngah investigated how learners acquire grammatical and sound patterns in different domains. The results suggest that while both domains involve structural complexity and naturalness as learning biases, these biases play a stronger role in phonological learning, particularly when the target pattern is complex and unnatural.
  • Syllable-based or Word-based? Representation of tones undergoing merger in Hakka: Ming and Jon explored how native speakers of Wangmudu Hakka represent tones in their minds. Their findings suggest that for tones undergoing merger, speakers rely on word-level representations rather than syllable-level or generalized sandhi rules.
  • The acquisition, contact, and transmission of phonological variation: Xiaoyu, Samuel, Thomas, Bingzi, Frank, Stephen, Wayne and Youngah examined how biases influence phonological variation learning in different language learning contexts. Their results suggest that a bias towards phonetically natural patterns guides learning in acquisition and contact situations, but not necessarily during language transmission.

Corpus Workshop Presentation

  • Attention-LSTM Autoencoder for Phonotactics Learning from Raw Audio Input: Frank and Youngah presented a study on how a neural network model can learn phonotactic knowledge from raw audio data. Their model, designed to mimic early stages of infant language learning, successfully captured the influence of surrounding sounds on the pronunciation of stops following a sibilant fricative in English.
Frank, Xiaoyu, Ivy, Youngah, Jon and Ming enjoying a meal in Seoul.