OpenVoice: Jagoran Kirkira a Fasahar Kwaikwayon Murya

TL;DR. OpenVoice from MIT, Tsinghua and MyShell: production-grade voice cloning with tone, accent and emotion control — and the trade-offs worth knowing.

Points clés

Gabatarwa. Yayin da [OpenAI ⧉][02] ta yanke shawarar taƙaita damar yin amfani da nata kayan aikin kwafin murya saboda yiwuwar amfani da shi ta hanyar da ba ta dace ba, OpenVoice yana ba da mafita mai aminci.
Kan Gaba na OpenVoice wajen Ƙirƙira. OpenVoice ya banbanta kansa ta hanyar gaggawa wajen kwafin murya, inda kawai yake buƙatar ɗan gajeren sautin murya don kwafe muryar mai magana daidai a cikin harsuna da yawa.
Sauri da Daidaito: Nasara ta Fuska Biyu. Tsarin ginin (architecture) OpenVoice yana ba shi damar tsere wa masu fafatawa da shi a cikin sauri da kuma daidaito, yana haɗa magana sau 12 mafi sauri fiye da ainihin lokaci (real-time) akan kwayar GPU guda ɗaya ba…
Kwafin Murya na Zero-Shot Cross-Lingual. Ɗaya daga cikin fitattun siffofin OpenVoice ita ce ikon samun nasarar kwafin murya tsakanin harsuna daban-daban na zero-shot ba tare da buƙatar bayanai masu yawa na kowane harshe ba.

OpenVoice ⧉ wata fasahar kwafin murya ce mai cike da sabbin abubuwa wacce MIT ⧉, Jami'ar Tsinghua ⧉, da kuma MyShell ⧉, wani kamfanin AI na kasar Canada suka samar. Tana ba da damar haɗa murya cikin sauri da daidaito tare da cikakken iko akan halayen murya. MyShell ta taka muhimmiyar rawa wajen haɓaka OpenVoice, wanda aka yi amfani da shi sau miliyoyi a matsayin tsarin baya (backend) na kwafin murya don dandalinsu. Ya yi fice saboda saurinsa, daidaitonsa, da kuma ikon dacewa da yanayi.

OpenVoice yana ba da fa'idodi masu mahimmanci fiye da kayan aikin da ke akwai. Yana ba da damar sarrafa salon murya mai sauƙi bayan sauti da timbre. Hakanan yana da damar zero-shot cross-lingual ba tare da buƙatar bayanai masu yawa na kowane harshe ba. Kasancewar OpenVoice a matsayin open-source ya sa ya zama mai kima a sassa daban-daban, gami da accessibility (sauƙin shiga), nishaɗi, da sabis na abokan ciniki. Yana ba da tabbacin ci gaba mai dorewa, wanda ke ƙarfafa matsayinsa na jagora a cikin samar da muryoyin roba.

Gabatarwa

Yayin da OpenAI ⧉ ta yanke shawarar taƙaita damar yin amfani da nata kayan aikin kwafin murya saboda yiwuwar amfani da shi ta hanyar da ba ta dace ba, OpenVoice yana ba da mafita mai aminci. Tare da ingantaccen tsarin sarrafawa da zaɓuɓɓukan daidaitawa (fine-tuning), OpenVoice yana ba masu amfani damar samar da muryoyin gaskiya masu sauƙin daidaitawa yayin da yake ba da fifiko ga la'akari da ɗabi'a. Wannan labarin zai yi bayani dalla-dalla kan siffofin farko na OpenVoice, aikace-aikacensa a zahiri, da kuma makomar fasahar kwafin murya.

.class="m-10 w-100"

Kan Gaba na OpenVoice wajen Ƙirƙira

OpenVoice ya banbanta kansa ta hanyar gaggawa wajen kwafin murya, inda kawai yake buƙatar ɗan gajeren sautin murya don kwafe muryar mai magana daidai a cikin harsuna da yawa. Tsarin ginin (architecture) yana da sassa biyu: samfurin mai magana na asali (base speaker model) da kuma mai sauya launin sauti (tone colour converter). Wannan yana ba da damar sarrafa salon murya daidai, gami da sautin motsin rai, lafazi, rhythm, da intonation. Hakanan yana kiyaye keɓaɓɓen halayen muryar mai magana. Wannan sassauci yana ba masu ƙirƙira da masana fasaha iko don samar da muryoyin da ke da tabbaci da zurfin motsin rai.

.class="m-10 w-100"

Sauri da Daidaito: Nasara ta Fuska Biyu

Tsarin ginin (architecture) OpenVoice yana ba shi damar tsere wa masu fafatawa da shi a cikin sauri da kuma daidaito, yana haɗa magana sau 12 mafi sauri fiye da ainihin lokaci (real-time) akan kwayar GPU guda ɗaya ba tare da rage ingancin muryar da aka kofa ba. Wannan saurin aiki yana samun goyon bayan daidaito na musamman.

OpenVoice ya yi fice wajen kama keɓaɓɓun launukan sautin murya da kuma nuances na harshe na muryar da ake amfani da ita. Wannan ya sa ya zama babban mafita a cikin fasahar kwafin murya.

.class="m-10 w-100"

Kwafin Murya na Zero-Shot Cross-Lingual

Ɗaya daga cikin fitattun siffofin OpenVoice ita ce ikon samun nasarar kwafin murya tsakanin harsuna daban-daban na zero-shot ba tare da buƙatar bayanai masu yawa na kowane harshe ba. OpenVoice yana amfani da tsarin phoneme na duniya (universal phoneme system) da kuma wakilci mara dogaro da harshe (language-neutral representation) a cikin mai sauya launin sautinsa. Yana iya kwafe muryoyi a cikin sabbin harsuna waɗanda ba su cikin bayanan horarwarsa ba. Wannan babban ci gaba ne akan hanyoyin da aka yi amfani da su a baya.

.class="m-10 w-100"

Sarrafa Daki-daki: Ƙirƙirar Muryoyi da Daidaito

Ikon daidaita ma'aunin murya (parameters) dalla-dalla ya sa OpenVoice ya zama na daban, yana ba masu amfani ikon sarrafawa mara misaltuwa akan tsarin samar da magana. Keɓance murya da bayyana ra'ayi suna da mahimmanci a fannoni kamar nishaɗi, ilimi, da sabis na abokan ciniki. Waɗannan fannonin suna buƙatar isar da magana mai cike da ma'ana don inganta haɗin gwiwar masu amfani da fahimtarsu.

.class="m-10 w-100"

Aikace-aikace a Zahiri Masu Dogaro

OpenVoice ya riga ya nuna ikon yin aiki a zahiri, bayan da aka yi amfani da shi sau dubun-dubatar miliyoyi a matsayin tsarin baya (backend) na kwafin murya don MyShell.ai tsakanin Mayu da Oktoba 2023. Wannan babban amfani yana nuna ƙarfin OpenVoice da shirye-shiryensa don ƙaddamarwa a cikin manyan mahallan samar da kasuwanci.

.class="m-10 w-100"

Sabbin Abubuwa ta Hanyar Haɗin Gwiwar Open-Source

Samfurin open-source na OpenVoice ba kawai yana samar da damar yin amfani da fasahar kwafin murya ta zamani ga kowa ba, har ma yana haɓaka yanayin haɗin gwiwa don ci gaba mai dorewa. Ta hanyar gayyatar gudunmawa daga al'ummar fasaha ta duniya, OpenVoice yana tabbatar da sauye-sauye na musamman na ikonsa, yana magance buƙatun da ke tasowa da kuma faɗaɗa aikace-aikacensa. An samar da lambar tushe (source code) da nauyin samfurin (model weights) ga jama'a don sauƙaƙe ƙarin bincike da haɓakawa.

.class="m-10 w-100"

Kwatancen Bincike tare da Kayan Aikin Kwafin Murya na OpenAI

Yayin da Kayan Aikin Kwafin Murya na OpenAI ke wakiltar babban ci gaba a cikin haɗin murya, OpenVoice ya fi shi ta hanyar ba da ƙarin sassauci da iko. Kwatanta kai tsaye tsakanin hanyoyin kwafin murya na iya zama ƙalubale. Wannan saboda mafita daban-daban suna amfani da bayanan bayanai (datasets) daban-daban, ma'aunin kimantawa, da fannonin da aka mayar da hankali kansu. OpenVoice ya yi fice a cikin kwafin murya don keɓaɓɓun ikonsa. Yana iya yin zero-shot cross-lingual kwafin murya kuma yana da babban sassauci wajen sarrafa salon murya. Wannan haɗin siffofin ya sa OpenVoice ya kasance mai sauƙin daidaitawa da ƙarfi, wanda ke sa shi zama kayan aiki na musamman don sake haifar da murya.

.class="m-10 w-100"

Aikace-aikace Masu Daban-daban a Sassa Daban-daban

Aikace-aikacen OpenVoice sun bazu zuwa sassa daban-daban. Yana ba da tabbacin kawo sauyi ga accessibility (sauƙin shiga) ta hanyar samar wa mutanen da ke da matsalar gani damar yin amfani da hanyar kewaya murya ta halitta. A cikin nishaɗi, yana ba da damar ƙirƙirar muryoyi daban-daban don abubuwan dijital. Sabis na abokan ciniki na iya yin amfani da OpenVoice don haɓaka tsarin ba da amsa ta murya (interactive voice response), yana ba masu amfani ƙarin ƙwarewa na musamman da ban sha'awa.

.class="m-10 w-100"

La'akari da AI Mai Kyau da Alhaki

Kamar kowace fasaha mai ƙarfi, yana da mahimmanci a yi la'akari da tasirin ɗabi'a da yuwuwar yin amfani da kwafin murya ta hanyar da ba ta dace ba.

Masu haɓaka OpenVoice sun jajirce wajen aiwatar da ayyukan AI masu kyau da alhaki:

Samun izini daga mutanen da ake kofa muryoyinsu
Amfani da watermarking don gano abubuwan da aka samar
Ilmantar da masu amfani akan ingantaccen amfani da fasahar.
Bincike mai gudana da haɗin gwiwa tare da masana ɗabi'a da masu tsara manufofi zai zama mahimmanci don magance ƙalubalen da ke tasowa a cikin wannan fanni.

.class="m-10 w-100"

Hangowa na Ci gaba na Gaba

Yayin da OpenVoice ke ci gaba, tsarin aikinsa yana mayar da hankali kan:

Tace samfurinsa don ɗaukar ƙarin salon murya da lafazi.
Ci gaba da damar haɗin gwiwar harsuna daban-daban (cross-lingual synthesis).
Inganta saurin inference.

Haɓaka open-source yana tabbatar da cewa OpenVoice ya kasance mai cike da sabbin abubuwa. Gudunmawar al'umma da ci gaban fasaha za su ci gaba da kiyaye shi a kan gaba wajen kwafin murya.

.class="m-10 w-100"

Kammalawa

OpenVoice yana ba da tabbacin wani muhimmin lokaci a cikin juyin halittar fasahar kwafin murya. OpenVoice yana haɗa haɗin murya mai sauri da daidaito tare da ikon sarrafawa mara misaltuwa akan siffofin murya. Yana aiki mafi kyau fiye da kayan aikin da ke akwai kuma yana kafa sabbin ma'auni na masana'antu. A matsayinsa na aikin open-source mai amfani a zahiri, OpenVoice ya sadaukar da kansa don ingantawa akai-akai. Fasaha ce mai mahimmanci wacce za ta tsara yadda ake samar da magana ta roba a nan gaba, tare da amfani a fannoni da aikace-aikace da yawa.

Hujjoji

MyShell. (2023). OpenVoice: Jagoran Kirkira a Fasahar Kwaikwayon Murya. An dawo da shi daga https://research.myshell.ai/open-voice
Qin, Z., Zhao, W., Yu, X., & Sun, X. (2023). OpenVoice: Versatile Instant Voice Cloning. arXiv preprint arXiv:2312.01479. An dawo da shi daga https://arxiv.org/abs/2312.01479

An duba na ƙarshe a 2026-06-23.

Bita ta ƙarshe 2026-07-16.

Sake buga wannan labari

OpenVoice: Jagoran Kirkira a Fasahar Kwaikwayon Murya — Sebastien Rousseau

OpenVoice from MIT, Tsinghua and MyShell: production-grade voice cloning with tone, accent and emotion control — and the trade-offs worth knowing.

An lasisin wannan labari a karkashin Creative Commons Attribution 4.0 International. Sake bugawa na bukatar nuna asalin URL na asali.

OpenVoice: Jagoran Kirkira a Fasahar Kwaikwayon Murya — Sebastien Rousseau

OpenVoice from MIT, Tsinghua and MyShell: production-grade voice cloning with tone, accent and emotion control — and the trade-offs worth knowing.

Originally published at https://sebastienrousseau.com/ha/2024-04-01-openvoice-leading-innovation-in-voice-cloning-technology/ by Sebastien Rousseau.
Licensed under CC-BY-4.0.

SEBASTIEN ROUSSEAU FOUNDER · ENGINEER