Common Voice
Developer(s)Mozilla Foundation
Initial releaseJune 19, 2017; 6 years ago (2017-06-19)
Repositorygithub.com/common-voice/common-voice
Available inMultilingual (List of languages)
LicenseCreative Commons CC0
Websitecommonvoice.mozilla.org

Common Voice is a crowdsourcing project started by Mozilla to create a free database for speech recognition software. The project is supported by volunteers who record sample sentences with a microphone and review recordings of other users. The transcribed sentences will be collected in a voice database available under the public domain license CC0. This license ensures that developers can use the database for voice-to-text applications without restrictions or costs.

Aims

Common Voice aims to provide diverse voice samples. According to Mozilla's Katharina Borchert, many existing projects took datasets from public radio or otherwise had datasets that underrepresented both women and people with pronounced accents.[1]

History

At the beginning of 2022, Bengali.AI partnered with Common Voice to launch "Bangla Speech Recognition" project that aims to make machines understand Bangla language. 2000 hours of voice was collected with aim for higher than 10,000 hours.[2]

Voice database

The first dataset was released in November 2017. More than 20,000 users worldwide had recorded 500 hours of English sentences.[3]

In February 2019, the first batch of languages was released for use. This included 18 languages: English, French, German and Mandarin Chinese, but also less prevalent languages as Welsh and Kabyle. In total, this included almost 1,400 hours of recorded voice data from more than 42,000 contributors.[4]

As of July 2020 the database has amassed 7,226 hours of voice recordings in 54 languages, 5,591 hours of which has been verified by volunteers.[5]

In May 2021, following the work to add Kinyarwanda, they received a grant to add Kiswahili.[6]

In September 2022, it was announced that the Twi language of Ghana was the 100th language to be added to the Mozilla Common Voice database.[7]

As of October 2022, Mozilla Common Voice officially collects voice data for the following languages:[8]

See also

References

  1. ^ "Why do we gender AI? Voice tech firms move to be more inclusive". The Guardian. 11 January 2020. Archived from the original on 19 December 2022. Retrieved 19 April 2020.
  2. ^ "Bengali.AI: Democratising AI research in Bangla". The Business Standard. 2022-12-23. Archived from the original on 2022-12-24. Retrieved 2022-12-25.
  3. ^ "Announcing the Initial Release of Mozilla's Open Source Speech Recognition Model and Voice Dataset". blog mozilla.org. November 29, 2017. Archived from the original on November 29, 2017. Retrieved November 19, 2019.
  4. ^ "Mozilla updates Common Voice dataset with 1,400 hours of speech across 18 languages". VentureBeat. February 28, 2019. Archived from the original on March 4, 2019. Retrieved November 19, 2019.
  5. ^ "Mozilla Common Voice updates will help train the 'Hey Firefox' wakeword for voice-based web browsing". VentureBeat. 1 July 2020. Archived from the original on March 10, 2021. Retrieved 1 April 2021.
  6. ^ "Mozilla Common Voice Receives $3.4 Million Investment to Democratize and Diversify Voice Tech in East Africa". Mozilla Foundation. 2021-05-25. Archived from the original on 2022-12-19. Retrieved 2021-06-03.
  7. ^ Onukwue, Alexander (23 September 2022). "Ghana's most popular language is now on Mozilla Common Voice". Quartz. Archived from the original on 2 December 2022. Retrieved 3 October 2022.
  8. ^ "Languages". commonvoice.mozilla.org. Archived from the original on 24 December 2022. Retrieved 4 October 2022.