Generative AI yanga isiri chinhu chipfupi chechamupupuri chetekinoroji. Mamodheru akaita seGPT-4 atora nyika nedutu nekugona kwavo surreal kugadzira zvinyorwa zvinotevedzera kutaura kwevanhu, kunyora zvinyorwa, kodhi, uye kunyange kuuya nemhinduro dzekugadzira kune mamwe mabasa akaomarara. Isu tiri kugara tichiswedera kune ramangwana rinobatsirwa neAI, iro apo vabatsiri vedu vedhijitari vanozonzwisisa uye kupindura kune zvatinoda. Zvakakwana kuita chero munhu mutendi, handiti?  Zvakanaka, zvinenge ... asi kwete chaizvo.  Munoona, pasi pekupenya kweGPT's glitzy goho uye kutsetseka kwayo kwegirama chidziviso chakakosha, icho chinopengesa vazhinji vedu tekinoroji:   Iyi inoratidzika kunge iri nyore (asi ichishungurudza) nyaya inoratidza gaka repakati mune zvazvino AI masisitimu. Kunyangwe nekukwanisa kugadzira ndima dzinokatyamadza kubva kumabhiriyoni emadatapoints, kana wapihwa basa rechokwadi - chimwe chinhu chaasati amboona kana kudzidziswa pa - GPT-maitiro emhando yakarova madziro ekuzvarwa. generative AI inotamburira kubata ruzivo rutsva, kunyanya mune imwe-pfuti yekudzidza mamiriro.  Izvi zvinopenda mufananidzo wezvandinodaidza kuti   : zvisinei kuti ane simba sei, zvisinei kuti masystem 'akangwara' eAI seGPT anoita senge GPT, anodonha kana zvichidikanwa kuti zvigadzirise nekukurumidza kubva pane imwechete kana diki diki. mienzaniso isingaonekwi. "One-Shot Generalization Paradox"  Ngatiburitse gangaidzo iri zvishoma tonyura   chekuseri kwayo. Asi usazvinetse, isu hatizochengeta uhwu hungwaru - tichadzika mumatope ehunyanzvi toongorora kuti chii chaizvo chinomisa maAI edu azvino-gen kuti aenderane nekushanduka kwemashiripiti uko vanhu vanako pavanosangana nevasingazive. muchikonzero  Iwo Mashiripiti uye Mechanism yeGenerative Models… Kusvikira Vatyoka  Iko kupenya kwepakati kwemamodhi seGPT-4 kunogara pane yakaomesesa   , iyo inozivikanwa nekupa simba zvese kubva kumhando dzemitauro kuenda kumabasa echiono. Ikozvino, ini handidi kukurovera pasi nejagoni kutanga kwechimedu ichi (tichangotanga), asi mamwe matekinoroji anoda kuvhurwa kuti anzwisise kuti kupi uye nei mitswe inotanga kuratidza. Transformer architecture  Kutanga, GPT ndeyemhuri yemhando   , dzakadzidziswa kufanotaura izwi rinotevera kana tokeni mune chero chinyorwa chakapihwa. Vanova sei vakanaka kudaro? Muchikamu chikuru, imhaka   akavakirwa   , iyo inobvumira mamodheru aya kusefa mukati mehuwandu hwezvinyorwa uye zvakanyanya "kutarisa" pazvikamu zvakakosha zvemutsara uchitarisawo mazwi ese kutevedzana. Iyi nzira yepasirese yekutarisisa yakakurumidza kuve musimboti wekutora chirevo chechirevo muzvikamu zvakakura zvezvinyorwa. dzakatevedzana yemagadzirirwo ekuzvitarisisa muTransformer  Asi heino crux yekanganisika: Generative AI inotsamira   pane iyi data yekudzidzisa. Izvo zvakasarudzika pakuziva mapatani uye hukama hwehuwandu pakati petokens mune data yayakamboonekwa, asi zvakare inotsamira pane iyo data. Pakaburitswa modhi, GPT-4 yakanga   yanyatsodzidza kufunga kana kukudziridza kunzwisisa kwenyika. Asi, ishamwari dzekusimudzira dzayakanhonga mumabhiriyoni emienzaniso yezvinyorwa inowanikwa online (mumabhuku, Wikipedia, Reddit tambo, mapepa ezvidzidzo… unozvipa zita). zvakanyanya isati  Saka, nepo GPT inganzwa senge inoona zvese, ichigadzira zvinoenderana uye dzimwe nguva zvinyorwa zvine hungwaru, zvairi   kuita kutamba mutambo unonakidza we probabilistic pateni-kufananidza. Meaning? Kana chimwe chinhu chitsva chikauya (senge bepa idzva resainzi pane quantum mechanics kana imwe niche indasitiri-chaiyo jargon), inonetsekana zvakaoma kuti iite zvine musoro pazviri. kunyatso  Izvo ... hazviverengeki.  Mira. Asi Sei Zvisingagoni Kungofanana Nevanhu?  Zvino, pano ndipo apo vanhu vakasiyana zvakanyanya kubva kumichina. Fungidzira kuti uri kuverenga nezve pfungwa inodarika hunyanzvi hwako kekutanga. Pamwe iwe uri tekinoroji yekutanga muvambi anofamba-famba pasi rose remakanika engineering. Chokwadi, haugone kubatanidza madotsi pakuverenga kwekutanga - asi mushure mekutarisa pamienzaniso mishoma kana madhayagiramu, mamwe mwenje wemwenje unodzima.   Uye zvino, tarisa uye tarisa, iwe unozviwana (kana kuti yakawanda yacho). Aha, iyi inodzora hurongwa! Izvi zvinobatana nazvo!  Iyi nuance inonzi   - kugona kukurumidza kutora mapatani kana kunzwisisa ruzivo rutsva rwakavakirwa pamienzaniso mishoma. Uye chimwe chinhu icho vanhu vakanaka pachiri. Isu tinotora chidimbu chidiki cheruzivo uye nekuchenjera mepu kune yakakura madingindira, zvimiro, kana analogies atinoziva kare. Mune mamwe mazwi, isu hatidi miriyoni mienzaniso kana yakakura corpus ye data yapfuura kuti tive ne epiphany. one-shot generalization  Mukupesana kukuru, mamodheru ekugadzira   yenyika zvachose. Ivo vanongofamba-famba nemunzvimbo yenhamba uye vanofanotaura zvichienderana nekuti ndeapi mazwi kana zvimiro zvinonyanya kuitika. Saka kana vakumbirwa kubata chimwe chinhu chakazara - izwi nyowani resainzi, dzidziso nyowani haina kumboburitswa online - vanomhanya nemusoro kumadziro. Zvichitaurwa zviri nyore,   , uye vanoshaya maumbirwo echokwadi ekuti vasvetuke munzvimbo yavasina kujaira. haana nzwisiso yomuzvarirwo havasati vambosangana nazvo  Zvakanaka, izvo zvinonzwisisika. Rega ndijekese izvi zvakare.  Generative AI modhi dzinodzidza   pakati peiyo iripo data mapoinzi. Zvichireva, vanova nyanzvi mukuzadza   pakati pezvibodzwa zvavanenge vatoona uye mapatani avanoziva, asi vanonetsekana   , kureva, kusvetuka uye kuita fungidziro zvichibva pane imwe pfungwa kana data rekudzidzisa risipo. Semuyenzaniso, GPT-4 inogona kubata "nguva dzose" zvivakwa zvemitauro mumutauro wemazuva ese zvakanakisa nekuti kune mamirioni emienzaniso iripo. Asi, kanda muchikumbiro cheari kubuda, hyper-specialized mazano - toti, iwo chaiwo ekufambira mberi kwemazuva ano mune   mufizikisi - uye boom: gibberish yakakwana. Sei? GPT haina chero nhamba yereferensi yenzvimbo yakadai, mazwi matsva. Zvakatodzidzisa fungidziro dzekuti, kunyangwe zvichigoneka mukutsetsenura, kurega     . nekududzira mikaha neextrapolation solitonic fiber lasers kupindirana kwechokwadi kwekururama kwemazwi  Iyo Technical Core yeDambudziko  Zvakanaka, kana iwe uine pfungwa dzehunyanzvi, ngatinyure zvakadzama mukuti nei kudzikisira uku kwakasindimara, uye chii chiri kuitika pasi pehodhi panguva imwe chete yekuedza kudzidza.  Imwe nyaya yepakati neiyo imwe-pfuti generalization ndeyeruzivo rwunomiririrwa nemuenzaniso mukati panguva   . Mamodheru eGPT ane maitiro akanaka kana achishanda mukati memiganhu - chiitiko chinowanzotsanangurwa sekudzidza   . Mukati memiganho yemisoro yakaona yakakura yakakwana mienzaniso yekudzidziswa, kunyangwe GPT-4 inogona kuburitsa zvinokatyamadza zvinobuda. Izvi zvinodaro nekuti chimiro cheiyo modhi chinoibvumira   - muchimiro   - iyo inobata hukama pakati pemazwi uye pfungwa. yekudzidzira kwayo yekuzvitarisira mukugovera kuvharidzira ruzivo kuburikidza nedense vector inomiririra chekumisikidza kwakamisikidzwa  Asi pano ndipo panochinja zvinhu. Kana iyo modhi ikapihwa basa nemamiriro ezvinhu anoda kunze-kwe-kugovera generalization, zvichireva kusangana nepfungwa yayasati yambodzidziswa pairi, sisitimu hairevi zvinhu nenzira iyo vanhu vanoita. Funga nezvazvo seizvi: aya mamodheru ari ega   , achitsamira pane manhamba "gut manzwiro." Ivo havana yakavakirwa-mukati kugona kugadzira kana kufunga "pamusoro pe data." mapatani michina  Semuenzaniso, funga kuti GPT inodzidza sei mitemo yegirama. Zvakafanana nemunhu akagara pasi kuti abate nemusoro zviuru zvenzira dzinoshandiswa mazwi mumitsara yeChirungu. Mushure mekutarisa zvakakwana, sisitimu inovaka mepu yemukati inoziva, "Ah, mushure mekunge chidzidzo chauya chiito, pamwe chinhu, uye kukanda muchinyorwa kana chirevo sezvinodiwa." Asi kana ikaunzwa nemutauro mutsva kana zvimiro zvezvirevo zvitsva, kugona uku kunotadza nekuti kunongogumira pakuziva chete hukama (kana   kujeka) hwawakatoona. husina  Izvi, zvinosuruvarisa, zvine miganhu. Tora basa parichazoda kuburitsa zvinyorwa zvinopindirana nezvechinyorwa chisina kuburitswa, taura zvinokatyamadza zvakawanikwa mune isingazivikanwe nyaya yefizikisi senge   . Iyo modhi haina   kunodiwa kududzira zvakare ruzivo rwechikuru kuti upe mukana mutsva. Muhuropi hwedu hwevanhu, tinogara tine zviratidziro zvepamusoro-soro (mazano, dzidziso, analogies!) izvo zvinotipa kushanduka. GPT, zvisinei, haidaro! Inoburitsa mibairo inoenderana   , kwete kusvetuka kwekugadzira. quantum-gravity duality kuumbwa nezvinogoneka kufungidzira  Zvakafanana nekutyaira uine mepu yakagara yakarongerwa nzira chete kubva muzana rapfuura: hazvikubatsire kufamba uchivakwa kana kuburikidza nekumonyoroka uye kutendeuka kwakaonekwa mumwedzi mitanhatu yapfuura.  Kuwana Unyanzvi - Sei Izvi Zvichiitika Pasi PeHood  Imwe nhanho yekunzwisisa iyo inogumira ndeye kuziva basa re   . dense vs sparse zvinomiririra  Ndinorevei neizvi?  Traditional transformer modhi inoshanda ne   . Chiratidzo chega chega mumutsara chinomiririrwa nemavhejita ane mativi epamusoro, uye mavekita aya anotora hukama hwakasiyana-siyana huri pakati pemazwi - zviumbwa zvemaumbirwo, zvirevo zvemataurirwo, zvimiro zvechimiro, zvichingodaro. Asi nekuti zviratidziro izvi zvakakora,   kuti zvitsigire. abstraction nenzira inotungamira kune inoshanduka uye inogadzirisa generalization. dense vector embeddings hazvina kupatsanurwa zvakakwana  Dense embeddings inoganhurirwa neiyo   panguva yekudzidziswa kwemuenzaniso. Iyi tradeoff yakakosha: nekugadzirisa chinhu chimwe (general statistical kugona), modhi inopira chimwe chinhu (kugona kufunga mumamiriro ezvinhu akazara). Fungidzira iwe unogara uchigadzirisa maitiro ako epfungwa kuti   nenyika yawakamboona; iyo tradeoff ndeyekuti zvisingafungidzike zviitiko zvinokurasa zvachose.   anonetsekana nemakesi madiki-diki nekuti anokunda pakudzokorora "avhareji mamiriro" uye kuomesa pamberi pezvisizvo kumitemo yakadzidzwa. bias-variance tradeoff anyatsoenderana Mamodheru akaomarara-asi-akaomarara  Iyo inogona kuve yakakosha mhinduro pano ndeye   - matekiniki ekugadzira mativi   pamatanho akasiyana ekududzira. Sparse network inotaura nekutora ruzivo nenzira inochinjika uye yakajairika, senge nzira iyo vanhu vanotarisa nayo pazvinhu zvikuru, zvakakosha mukufembera mhedzisiro pane kutarisisa pamusoro pezvidiki. mashoma anomiririra anopatsanura akasiyana maficha  Saka rimwe dambudziko ne-one-shot generalization nderekuti zvemazuva ano network zvimiro hazvisimbise mabasa ekusagadzikana akadaro - anotsamira zvakanyanya pane dense, inofambiswa nedata. Saka nei, kana vakakumbirwa kuti vagadzirise zvinhu zvitsva uye zvakasarudzika zvine mamiriro mashoma, vanokundikana.  Chii Chaigona Kugadzirisa Izvi?  Sezvineiwo, isu hatina zvachose kunze kwemazano. Vatsvagiri veAI (ini ndakasanganisirwa!) vatanga kudzidzisa nezve nzira dzinoverengeka dzekuvandudza kugona kweAI-yekupfura generalization. Dzimwe dzenzira dzinonakidza dzinotenderedza   zvivakwa. Aya mavakirwo akasiyana zvakanyanya neanhasi mamodheru, achigonesa kudzidza-ku-kudzidza kugona uko sisitimu inoshandura maparamita ayo kuti aenderane nemhando itsva dzedata nekukurumidza - zvakanyanya kuenderana nehunhu-sehunhu. meta-yekudzidza    , semuenzaniso, modhi inozvigadzirisa kuti idzidze mabasa matsva nemienzaniso mishoma yekudzidzisa.   inoshanda zvakafanana   mukati mezviitiko zvakawanda, zvakafanana nekurangarira kwatinoita zvidzidzo zvakakosha kubva munguva yakapfuura uye nekuzvishandisa zvakare nekunzwisisa patinosangana neatsva, mamiriro akafanana. MuModel-Agnostic Meta-Learning (MAML) Memory-Augmented Neural Networks (MANNs) nekuchengeta zvakadzidzwa  Kubatanidza   mumienzaniso yakadzama yekudzidza ndiyo imwe nzira inovimbisa. Mamodheru akashongedzerwa nezvikamu zvekufananidzira anogona 'kufunga' kuburikidza nekufunga, pane kungovimba nenhamba. Minda yakaita seNeuro   inopa mahybrids ekubatanidza mamodheru uye mitemo-yakavakirwa masisitimu inobvumira maAI kutevedzera epamusoro-kurongeka kufunga, kunyanya mune abstract kufunga mamiriro. kugona kufunga kwekufananidzira -Symbolic AI  Nzira Inoenda Mberi?  Saka zvese izvi zvinorevei kune ramangwana reAI? Chokwadi, GPT-4 inonzwa semashiripiti kana ichitipa kudyidzana kwakanaka kwevatengi kana kupindura mibvunzo yakajairika, asi isu tinofanirwa kugadzira mamodheru asiri einjini dzekudzidzira nemusoro. Takananga kunguva yemberi uko   ,   , uye   zvinosangana kugadzira vadzidzi vanochinja. kudzidza kwekufambisa kudzidza-meta neuro-symbolic architectures  Iyo One-Shot Generalization Paradox haisi apocalyptic kufa-kuguma kweAI. Icho chipingamupinyi chinoita kuti tifunge patsva fungidziro huru pamusoro pehungwaru uye kuchinjika. Sezvo dhata rega risingagadzirise izvi - modhi dzinoda kugona   ,   , uye   , kwete kungoziva nemusoro. kudzidza kubva kune zvipfupi kugadzira analogies rangarira zvakakosha maficha  Mamodheru edu emangwana anozoda kuve vanhu vakawanda kupfuura muchina kana zvasvika pakuziva synthesis. Uye sevatsvagiri, vanogadzira, uye vanogadzira padanho rekucheka, tichiri mukutanga innings yekutsanangura zvazvinoreva kuti AI idzidze - yega - munyika inoshanduka, inonyorwa.  Iri harisi dambudziko rehunyanzvi. Ihwo huzivi.

The is an opinion piece based on the author’s POV and does not necessarily reflect the views of HackerNoon.

Read My Stories

Software Engineer

Odhiyo iyi inogadzirwa mumutauro wekutanga wenyaya!

Iyo One-Shot Generalization Paradox: Nei Generative AI Inetsekana Neruzivo Rutsva

About Author

MACOMMENTS

HONGA TAGS

NYAYA IYI YAKAPIWA MUNA

Related Stories

Forget Pepe and dogwifhat — Snek Is the Memecoin You've Been Waiting For

On the Position of Large Factories

Empowering Senior Professionals: Interview with Startups of the Year 2024 Nominee, SNATIKA

Meet SNATIKA, Winner of HackerNoon's Startups of The Year 2024 in Training And Consulting

Forget Pepe and dogwifhat — Snek Is the Memecoin You've Been Waiting For

On the Position of Large Factories

Empowering Senior Professionals: Interview with Startups of the Year 2024 Nominee, SNATIKA

Meet SNATIKA, Winner of HackerNoon's Startups of The Year 2024 in Training And Consulting

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps