Nvidia PersonaPlex 7B paApple Silicon: Yakazara-Duplex Kutaura-kune-Kutaura muSwift

Kuzivisa iyo New Frontier yeVoice AI

Mamiriro ehungwaru hwekugadzira ari kusimuka kubva mugore kuenda kumucheto, uye Apple Silicon iri kutungamira kuchaja. Kune vanogadzira, kugona kumhanyisa mamodheru ane simba munharaunda kunovhura nyika nyowani yemikana yekupindura, yakavanzika, uye isina-inoshanda-inoshanda maapplication. Pinda Nvidia's PersonaPlex 7B, yemhando-ye-iyo-yemhando yemhando yakagadzirirwa yakasikwa, inoratidzira kutaura AI. Kana iyi modhi ine simba ikapetwa nehunyanzvi hweinjini yeM-series Mac uye yakakwenenzverwa yeSwift kuitiswa, mhedzisiro ibudiriro mune-chaiyo-nguva, yakazara-duplex kutaura-kune-kutaura kutaurirana.

Chii chinonzi Full-Duplex Speech-to-Speech?

Usati wanyura mumashiripiti ehunyanzvi, zvakakosha kuti unzwisise "full-duplex" chikamu. Kusiyana nevabatsiri vezwi vakapfava izvo zvinoda kuti udzvanye bhatani uye kumirira mhinduro, kupindirana kwakazara-duplex kunotevedzera kutaurirana kwemunhu. Inobvumira kutaura uye kuteerera panguva imwe chete, kugonesa kukanganisa, kumbomira, uye nhaurirano yechokwadi yekumashure-uye-mberi. Izvi zvinoreva kuti AI inogona kugadzirisa zvauri kutaura uchiri kutaura uye kugadzira mhinduro inotanga nguva yaunopedza — kana kutopindira zvinyoro nyoro kana ukambomira. Kuzadzikisa izvi pamudziyo wepano, usingatumire audio kune sevha iri kure, ndiyo nzira tsvene yekugadzira zvisina musono uye zvinonzwisisika zvevashandisi.

Kushandisa Apple Silicon's Unified Architecture

Kiyi yekuita kuti izvi zvigoneke palaptop kana desktop ndiyo yakasarudzika yezvivakwa zveApple Silicon. Iwo M-akatevedzana machipisi anosanganisa iyo CPU, GPU, uye ine simba Neural Injini (NE) pane imwechete chidimbu chesilicon. Iyi yakabatana ndangariro yekuvaka yakanakira muchina wekudzidza mabasa. Mahombe modhi sePersonaPlex 7B anogona kutakurwa akananga mundangariro yakagovaniswa, ichibvumira iyo CPU kubata iyo logic yekushandisa muSwift, iyo GPU yekumhanyisa mamwe macomputer, uye Neural Injini kubvarura nepakati pepakati tensor mashandiro emuenzaniso nekushanda kwakanyanya. Iyi synergy inobvisa zvipingamupinyi zvekufambisa data pakati pezvikamu zvakasiyana, zvichiita kuti nguva chaiyo yekufungidzira kwete kungogoneka, asi yakatsetseka uye ine simba.

• Zvakavanzika nekumhanya: Zvese zvinogadziriswa zvinoitika munharaunda pachigadzirwa. Hurukuro dzako dzakasimba hadzimbotumirwa kumakore, zvichiita kuti dhata rako rive nekuvanzika kwese uchibatsirwa kubva pedyo-zero latency.
• Mashandiro EOffline: Zvishandiso zvakavakwa ne stack iyi zvinoshanda chero kupi, pasina chinongedzo cheindaneti, zvichiita kuti zvivimbike zvisingaite.
• Native Performance: Kushandisa Swift uye masisitimu echinyakare seCore ML inobvumira kusanganisa kwakadzama neMacOS, zvichikonzera bhotoro-yakapfava iyo inonzwa chikamu cheiyo inoshanda sisitimu pachayo.

Kuvaka Pipeline neSwift

Kugadzira iyi yakazara-duplex pombi muSwift inosanganisira kuronga akati wandei. Chekutanga, iyo AVFoundation framework inotora odhiyo yekuisa kubva kumakrofoni. Iri redhiyo rwizi rwunobva rwashandurwa kuita mavara uchishandisa yemuno yekuziva mataurirwo modhi, senge Apple's on-device Speech framework. Iwo mameseji anobuda anopihwa muNvidia PersonaPlex 7B modhi, iyo yakagadziridzwa kuti imhanye kuburikidza neCore ML kana imwe Swift-inoenderana inference injini seMLX. Iyo modhi inogadzira ine kufunga, mamiriro-anoziva mameseji mhinduro. Chekupedzisira, chinyorwa ichi chinoshandurwa zvakare kuita kutaura kwakafanana nehupenyu uchishandisa injini yenzvimbo yemavara-ku-kutaura (TTS). Dambudziko rechokwadi riri mukutarisira zvikamu izvi panguva imwe chete kuti uwane iyo yakazara-duplex mhedzisiro - basa iro Swift yemazuva ano concurrency modhi ine async/await inokunda.

"Kugona kumhanyisa modhi yeiyi caliber munharaunda paApple Silicon inoshandura zvakanyanya mafungire atinoita nezvekubatanidza AI mukufamba kwedu kwezuva nezuva. Inofambisa AI kubva kune yakabatana sevhisi kuenda kune yemuno, inogara-inowanikwa chishandiso." -Mugadziri Mukuru paMewayz

Zvinoreva kumapuratifomu SeMewayz

Kune modular bhizinesi inoshanda sisitimu seMewayz, iyi tekinoroji inosvetuka inoshandura. Fungidzira vakangwara inzwi vamiririri mukati mebhizinesi rako software iyo inogona kukubatsira kunyora maemail, kugadzirisa yakaoma nguva yeprojekiti, kana kuongorora data-zvese kuburikidza nekutaura kwechisikigo, pasina kumbokanganisa data rekambani. Mewayz module inofambiswa neveko PersonaPlex 7B inogona kupa:

Kuvanzika kusati kwamboonekwa kwekubata ruzivo rwebhizinesi rakavanzika,-chaiyo-nguva yekubatsirana yekubatsira inonzwa sekunge uine nyanzvi yaunoshanda nayo mukamuri, uye anoteerera zvakanyanya vatengi rutsigiro bots akabatanidzwa zvakananga munzvimbo yekambani yeMewayz. Tekinoroji iyi inobvumira Mewayz kusundidzira miganhu yezvingaitwe nebhizinesi OS, ichipfuura zviri nyore-inoenderana nemirairo kuenda kune yechokwadi kutaurirana uye masisitimu akangwara anowedzera kugona kwevanhu zvakachengeteka uye nemazvo.

Kusanganiswa kweNvidia's PersonaPlex 7B, iro simba reApple Silicon, uye kunaka kweSwift kunopfuura kungoita demo rehunyanzvi; ipurani yeramangwana rekudyidzana kwevanhu nekombuta. Inovimbisa nyika iyo michina yedu inotinzwisisa kwete sevatungamiriri vanopa maodha, asi sevadyidzani munhaurirano.

Mibvunzo Inowanzo bvunzwa

Kusuma Murondedzero Itsva weIzwi AI

Mamiriro ehungwaru hwekugadzira ari kusimuka kubva mugore kuenda kumucheto, uye Apple Silicon iri kutungamira kuchaja. Kune vanogadzira, kugona kumhanyisa mamodheru ane simba munharaunda kunovhura nyika nyowani yemikana yekupindura, yakavanzika, uye isina-inoshanda-inoshanda maapplication. Pinda Nvidia's PersonaPlex 7B, yemhando-ye-iyo-yemhando yemhando yakagadzirirwa yakasikwa, inoratidzira kutaura AI. Kana iyi modhi ine simba ikapetwa nehunyanzvi hweinjini yeM-series Mac uye yakakwenenzverwa yeSwift kuitiswa, mhedzisiro ibudiriro mune-chaiyo-nguva, yakazara-duplex kutaura-kune-kutaura kutaurirana.

Chii chinonzi Full-Duplex Speech-to-Speech?

Usati wanyura mumashiripiti ehunyanzvi, zvakakosha kuti unzwisise "full-duplex" chikamu. Kusiyana nevabatsiri vezwi vakapfava izvo zvinoda kuti udzvanye bhatani uye kumirira mhinduro, kupindirana kwakazara-duplex kunotevedzera kutaurirana kwemunhu. Inobvumira kutaura uye kuteerera panguva imwe chete, kugonesa kukanganisa, kumbomira, uye nhaurirano yechokwadi yekumashure-uye-mberi. Izvi zvinoreva kuti AI inogona kugadzirisa zvauri kutaura uchiri kutaura uye kugadzira mhinduro inotanga nguva yaunopedza — kana kutopindira zvinyoro nyoro kana ukambomira. Kuzadzikisa izvi pamudziyo wepano, usingatumire audio kune sevha iri kure, ndiyo nzira tsvene yekugadzira zvisina musono uye zvinonzwisisika zvevashandisi.

Kushandisa Apple Silicon's Unified Architecture

Kiyi yekuita kuti izvi zvigoneke palaptop kana desktop ndiyo yakasarudzika yezvivakwa zveApple Silicon. Iwo M-akatevedzana machipisi anosanganisa iyo CPU, GPU, uye ine simba Neural Injini (NE) pane imwechete chidimbu chesilicon. Iyi yakabatana ndangariro yekuvaka yakanakira muchina wekudzidza mabasa. Mahombe modhi sePersonaPlex 7B anogona kutakurwa akananga mundangariro yakagovaniswa, ichibvumira iyo CPU kubata iyo logic yekushandisa muSwift, iyo GPU yekumhanyisa mamwe macomputer, uye Neural Injini kubvarura nepakati pepakati tensor mashandiro emuenzaniso nekushanda kwakanyanya. Iyi synergy inobvisa zvipingamupinyi zvekufambisa data pakati pezvikamu zvakasiyana, zvichiita kuti nguva chaiyo yekufungidzira kwete kungogoneka, asi yakatsetseka uye ine simba.

Kuvaka Pipeline neSwift

Kugadzira iyi yakazara-duplex pombi muSwift inosanganisira kuronga akati wandei. Chekutanga, iyo AVFoundation chimiro inotora odhiyo yekuisa kubva kumakrofoni. Iri redhiyo rwizi rwunobva rwashandurwa kuita mavara uchishandisa yemuno yekuziva mataurirwo modhi, senge Apple's on-device Speech framework. Iwo mameseji anobuda anopihwa muNvidia PersonaPlex 7B modhi, iyo yakagadziridzwa kuti imhanye kuburikidza neCore ML kana imwe Swift-inoenderana inference injini seMLX. Iyo modhi inogadzira ine kufunga, mamiriro-anoziva mameseji mhinduro. Chekupedzisira, chinyorwa ichi chinoshandurwa zvakare kuita kutaura kwakafanana nehupenyu uchishandisa injini yenzvimbo yemavara-ku-kutaura (TTS). Dambudziko rechokwadi riri mukutarisira zvikamu izvi panguva imwe chete kuti uwane iyo yakazara-duplex mhedzisiro-basa iro Swift's yemazuva ano concurrency modhi ine async/kumirira inokunda.

Zvinoreva kumapuratifomu SeMewayz

Kune modular bhizinesi inoshanda sisitimu seMewayz, iyi tekinoroji inosvetuka inoshandura. Fungidzira vakangwara inzwi vamiririri mukati mebhizinesi rako software iyo inogona kukubatsira kunyora maemail, kugadzirisa yakaoma nguva yeprojekiti, kana kuongorora data-zvese kuburikidza nekutaura kwechisikigo, pasina kumbokanganisa data rekambani. Mewayz module inofambiswa neveko PersonaPlex 7B inogona kupa: