CantoneseLLM

This talk addresses the critical challenge faced by leading Large Language Models (LLMs) when processing the highly dynamic, slang-infused, and diverse linguistic landscape of Hong Kong Cantonese. Despite being a highly utilized language, Cantonese remains a “low-resource” language in the global AI training ecosystem, leading to significant failure and reduced performance for general-purpose LLMs (like those from major tech companies).

We will present CantoneseLLM, an LLM developed by Votee specifically trained to tackle this complexity. CantoneseLLM is designed to handle the massive target distribution increase caused by intense Cantonese slang input, which typically causes external models to fail.

The presentation will cover:

1. The Cantonese Data Crisis: Why traditional LLM training fails when faced with localized Hong Kong language nuances.
2. Community Empowerment: The role of the “hon9kon0ize” community (a dedicated Cantonese AI group) in curating and pushing forward high-quality, local datasets necessary for training specialized models.
3. The Specialized Solution: An in-depth look at Votee’s CantoneseLLM—how it was built, its unique training methodologies for low-resource languages, and its performance benchmarks.
4. Comparative Analysis with the “HK Canto Eval” Benchmark:

To measure what truly matters, the hon9kon9ize community and Votee co-developed the “HK Canto Eval” benchmark. We will first present how leading SOTA models like Ernie 4.5 perform on this culturally-specific suite. We then demonstrate how CantoneseLLM achieves highly comparable results on these demanding local tasks, proving a specialized model can match global giants when tested on true linguistic and cultural fluency.

This session serves as a crucial case study, showcasing how dedicated, localized effort can successfully tackle the low-resource language problem and boost the Cantonese AI community.