Yethula i-HN: RunAnywhere (YC W26) - I-AI esheshayo Inference ku-Apple Silicon

Siyakwamukela Kukusasa Le-AI ekudivayisi

Umjaho wokuqagela nge-AI osheshayo, osebenza kahle kakhudlwana uyashisa, futhi uyasuka efwini uye emadeskini ethu—kanye nasemathangeni ethu. Konjiniyela namabhizinisi akha izinhlelo zokusebenza ezinikwe amandla yi-AI, izindleko eziphezulu nokubambezeleka kwezimo ze-GPU ezisekelwe emafini ziyizingqinamba ezibalulekile. Faka i-RunAnywhere, isiqalisi esiyisiqalo esivela kunqwaba ye-Y Combinator W26 ene-turbocharging AI inference ocezwini lwezingxenyekazi zekhompuyutha eziyizigidi esezinazo kakade: I-Apple Silicon. Umgomo wabo ulula kodwa unamandla: ukuvula amandla aphelele, angasetshenzisiwe ama-chips ochungechunge lwe-M kuma-Mac, okwenza ukuthuthukiswa kwe-AI yendawo kanye nokusetshenziswa kusheshe kakhulu futhi kungabizi kakhulu.

Le mpumelelo iyisibonelo esihle kakhulu sohlobo lokuqamba okusha esikulwelayo ngaphakathi kwe-ecosystem ye-Mewayz. Sikholelwa ukuthi ikusasa lebhizinisi lilele kumathuluzi ajwayelekile, asebenzisanayo anika amaqembu amandla okwakha ukugeleza komsebenzi okunamandla ngaphandle kokukhiyelwa kumthengisi oyedwa. Ubuchwepheshe be-RunAnywhere buhambisana kahle nalo mbono, bunikeza isendlalelo esiyisisekelo esingase sinikeze amandla isizukulwane esisha sezinhlelo zokusebenza ze-AI ezikudivayisi ngaphakathi kwe-OS yebhizinisi eliyimojuli.

Kungani Inkomba ye-AI ekudivayisi iyisiguquli segeyimu

Ngokwesiko, ukusebenzisa amamodeli e-AI ayinkimbinkimbi kwakudinga ukuthumela idatha kumaseva anamandla akude emafini. Nakuba isebenza kahle, le ndlela iza nezihibe ezikhona: ukubambezeleka ngenkathi ulinde impendulo, izindleko zokusebenza eziqhubekayo ezilingana nokusetshenziswa, kanye nokukhathazeka kobumfihlo bedatha okungenzeka. I-Apple Silicon Macs, nesakhiwo sawo senkumbulo esihlanganisiwe kanye nezinjini ezinamandla ze-Neural, zethula enye indlela ephoqelelayo. Kodwa-ke, abathuthukisi bazabalaze ukusebenzisa ngokugcwele le hardware, ngokuvamile belungiselela ukusebenza okuphansi. I-RunAnywhere ixazulula lokhu ngokunikeza isendlalelo sesofthiwe esiyinkimbinkimbi esenza amamodeli asebenze ngokwemvelo ku-hardware ye-Apple, ekhulisa isivinini nokusebenza kahle.

Kumabhizinisi asebenzisa inkundla efana ne-Mewayz ukuze ahlanganise ukuphathwa kwephrojekthi yawo, i-CRM, namathuluzi okuxhumana, lokhu kusho ukuthi izifinyezo ezixhaswe yi-AI, ukuhlaziya idatha, nemininingwane yamakhasimende kungenzeka ngokushesha nangokuvikelekile emshinini wendawo wesisebenzi. Yehlisa ukuthembela kuma-API angaphandle futhi igcina idatha ebucayi ngaphansi kolawulo lwenkampani.

Indlela Ukugijima Noma Kuphi Kuvula Ngayo Ukusebenza Okuphakeme

I-RunAnywhere ayikona nje ukugoqa okulula kwezinhlaka ezikhona. Ithimba lingene lajula ekwakhiweni kwama-chips e-Apple ukuze lidale umdidiyeli nesikhathi sokusebenza esiqeda izingqinamba zokusebenza. Isosi yabo eyimfihlo ibandakanya indlela enezinhlangothi eziningi:

• I-Kernel Fusion Ethuthukisiwe: Ukuhlanganisa imisebenzi eminingi ibe yi-kernel eyodwa, ethuthukisiwe ukuze kuncishiswe ukunyakaza kwenkumbulo futhi kukhuliswe ukusebenza kahle kwekhompyutha ku-GPU ne-Neural Engine.
• I-Intelligent Memory Management: Ukusebenzisa inkumbulo ehlanganisiwe ye-Apple Silicon ngokugcwele, kwehlisa kakhulu i-overhead ngokuvamile ehlotshaniswa nokuhambisa idatha phakathi kwe-CPU ne-GPU.
• Ukuthuthukiswa Kwezingxenyekazi Zekhompyutha: Ukuhlanganisa izibalo kuma-cores athile (CPU, GPU, NE) we-chip ngayinye ye-M-series, iqinisekisa ukuthi umthwalo ofanele uya engxenyeni efanele ye-chip ngesikhathi esifanele.

Umphumela uwukuzizwisa okungenazihibe konjiniyela. Bangathatha amamodeli ajwayelekile futhi, ngoshintsho oluncane lwekhodi, bawasebenzise 2-5x ngokushesha kunezixazululo zangaphambilini. Lokhu kukhuphula ukusebenza kwenza kube nokwenzeka ukusebenzisa amamodeli amakhulu, athuthuke kakhulu endaweni, okuvula amathuba amasha okucubungula umsindo wesikhathi sangempela nevidiyo, ukukhiqiza amakhodi ayinkimbinkimbi, nokuningi.

Ukuhlanganisa i-RunNomaphi ku-Modular Business OS

Ifilosofi esekelwe ku-Mewayz ukuthi amathuluzi angcono kakhulu kufanele asebenze ndawonye ngaphandle komthungo ukuze adale isistimu yokusebenza enamandla nevumelana nezimo zebhizinisi lakho. I-RunAnywhere "imojula" ebaluleke kakhulu kulo mbono. Cabanga ngeqembu lokumaketha okuqukethwe lisebenzisa i-Mewayz: umlobi angasebenzisa umsizi we-AI, onikwe amandla endaweni yi-RunAnywhere, ukuze akhiqize ikhophi esalungiswa ngaphandle kwanoma ikuphi ukunensa. Ngesikhathi esifanayo, ithimba labadayisi lingaba nokuhlanganiswa kwe-CRM esebenzisa i-AI ekudivayisi ukuze ihlaziye imibhalo yekholi futhi iphakamise izinyathelo ezilandelayo ngesikhathi sangempela, konke ngaphandle kokushaya iseva yangaphandle.

"Ngokuhambisa okucatshangwayo kwe-AI kusuka efwini kuya onqenqemeni, asigcini nje ngokuthuthukisa isivinini; sinika amandla isigaba esisha sezinhlelo zokusebenza eziyimfihlo, eziphendulayo, nezingabizi kakhulu. Lolu wushintsho olubalulekile konjiniyela namabhizinisi ngokufanayo."

Le ndlela yokuqala yendawo ihambisana ngokuphelele nokuzibophezela kwe-Mewayz ebukhosini bedatha kanye nobumfihlo bomsebenzisi. Amabhizinisi angakha ukugeleza komsebenzi okuhlakaniphile azi ukuthi idatha yawo yobunikazi ihlala ivikelekile kumadivayisi awo, kuyilapho esazuza emandleni amamodeli e-AI athuthukisiwe.

Umgwaqo Osengaphambili Wokuthuthukiswa Kwe-AI Yasendaweni

Ukwethulwa kwe-RunAnywhere kuphawula ingqopha-mlando ebalulekile embusweni wentando yeningi we-AI. Ngokwenza i-Apple Silicon ibe inkundla yesigaba sokuqala sokuchazwa kwe-AI, banika amandla uhla olubanzi lwabathuthukisi nezinkampani ukuze bakhe futhi basebenzise izici ezihlakaniphile. Njengoba umtapo wolwazi wamamodeli asekelwayo ukhula futhi ukulungiselelwa kuya kuba okuthuthuke kakhulu, singalindela ukubona ukuqhuma kwezinhlelo zokusebenza ezisungulayo ezisheshayo, eziyimfihlo kakhulu, nezingabizi kakhulu ukuzisebenza.

Emphakathini we-Mewayz, lokhu kusho ukuthi amathuluzi owasebenzisayo ukuqhuba ibhizinisi lakho asezohlakanipha kakhulu futhi aphendule ngokwengeziwe. Ukuhlanganiswa kobuchwepheshe obufana ne-RunAnywhere ngqo ku-OS yethu eyimojula kuzovumela amaqembu ukuthi enze ukugeleza komsebenzi okuhlotshiswe ngempela nokukhalipha, okuvula indlela yekusasa lomsebenzi elisebenza kahle kakhulu neliqondakalayo. Isikhathi sokungakhuni, i-AI ekudivayisi sesifikile.