{"id":686,"date":"2025-01-29T07:35:31","date_gmt":"2025-01-29T07:35:31","guid":{"rendered":"https:\/\/janusai.pro\/?p=686"},"modified":"2025-01-29T07:37:05","modified_gmt":"2025-01-29T07:37:05","slug":"i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive","status":"publish","type":"post","link":"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/","title":{"rendered":"Tislasin DeepSeek-R1:n p\u00e4\u00e4ttelykykytiedon Qwen2:een, ja tulokset olivat todella r\u00e4j\u00e4hdysm\u00e4isi\u00e4!!!!"},"content":{"rendered":"<div style=\"margin-top: 0px; margin-bottom: 0px;\" class=\"sharethis-inline-share-buttons\" ><\/div>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Sis\u00e4llysluettelo<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Sis\u00e4llysluettelon vaihtaminen\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A0_What_is_knowledge_distillation\" >\u2160. Mit\u00e4 on tiedon tislaus?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#IICore_concepts\" >II.Keskeiset k\u00e4sitteet<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#21_Template_design\" >2.1 Mallin suunnittelu<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#22_Reasoning_trajectory_The_%E2%80%9Cthinking_chain%E2%80%9D_of_the_models_solution\" >2.2 P\u00e4\u00e4ttelypolku: Mallin ratkaisun \"ajatteluketju\".<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#23_Rejection_sampling_Filtering_good_data_from_%E2%80%9Ctrial_and_error\" >2.3 N\u00e4ytteenotto hylk\u00e4\u00e4misest\u00e4: Hyvien tietojen suodattaminen \"kokeilemalla ja erehtym\u00e4ll\u00e4<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A2Generation_of_distilled_data\" >\u2162.Tislattujen tietojen tuottaminen<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Data_sources\" >Tietol\u00e4hteet:<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Distillation_data_generation_process\" >Tislaustietojen tuottamisprosessi:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A3Distillation_process\" >\u2163.Tislausprosessi<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Teacher_and_student_roles\" >Opettajan ja oppilaan roolit:<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Training_steps\" >Koulutuksen vaiheet:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A4_Example_demonstration\" >\u2164. Esimerkkiesittely<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/janusai.pro\/fi\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A5_Summary\" >\u2165. Yhteenveto<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A0_What_is_knowledge_distillation\"><\/span><strong>\u2160. <\/strong>Mit\u00e4 on tiedon tislaus?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Tiedon tislaus on mallin tiivist\u00e4mistekniikka, jota k\u00e4ytet\u00e4\u00e4n tiedon siirt\u00e4miseen suuresta, monimutkaisesta mallista (opettajan malli) pieneen malliin (oppilaan malli). <\/p>\n\n\n\n<p>Keskeinen periaate on, ett\u00e4 opettajamalli opettaa opiskelijamallia ennustamalla tuloksia (kuten todenn\u00e4k\u00f6isyysjakaumia tai p\u00e4\u00e4ttelyprosesseja), ja opiskelijamalli parantaa suoritustaan oppimalla n\u00e4ist\u00e4 ennusteista. <\/p>\n\n\n\n<p>Menetelm\u00e4 soveltuu erityisen hyvin resurssirajoitteisiin laitteisiin, kuten matkapuhelimiin tai sulautettuihin laitteisiin.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"IICore_concepts\"><\/span>II.Keskeiset k\u00e4sitteet<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"21_Template_design\"><\/span>2.1 Mallin suunnittelu<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Malli: Strukturoitu muoto, jota k\u00e4ytet\u00e4\u00e4n mallin tuotoksen standardointiin. Esimerkiksi\n<ul class=\"wp-block-list\">\n<li>: Merkitsee p\u00e4\u00e4ttelyprosessin alkua.<\/li>\n\n\n\n<li>: Merkitsee p\u00e4\u00e4ttelyprosessin p\u00e4\u00e4ttymist\u00e4.<\/li>\n\n\n\n<li>: Merkitsee lopullisen vastauksen alkua.<\/li>\n\n\n\n<li>: Merkitsee lopullisen vastauksen loppua.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Toiminto:\n<ul class=\"wp-block-list\">\n<li>Selkeys: Se kertoo mallille, ett\u00e4 \"ajatteluprosessi jatkuu t\u00e4st\u00e4, ja vastaus jatkuu t\u00e4st\u00e4\".<\/li>\n\n\n\n<li>Johdonmukaisuus: Varmistaa, ett\u00e4 kaikki tuotokset noudattavat samaa rakennetta, mik\u00e4 helpottaa my\u00f6hemp\u00e4\u00e4 k\u00e4sittely\u00e4 ja analysointia.<\/li>\n\n\n\n<li>Luettavuus: Ihmiset voivat helposti erottaa p\u00e4\u00e4ttelyprosessin ja vastauksen toisistaan, mik\u00e4 parantaa k\u00e4ytt\u00e4j\u00e4kokemusta.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"22_Reasoning_trajectory_The_%E2%80%9Cthinking_chain%E2%80%9D_of_the_models_solution\"><\/span>2.2 P\u00e4\u00e4ttelypolku: Mallin ratkaisun \"ajatteluketju\".<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>P\u00e4\u00e4ttelypolku: Mallin tuottamat yksityiskohtaiset vaiheet, kun malli ratkaisee ongelmaa, osoittavat mallin loogisen ketjun.<\/li>\n\n\n\n<li>Esimerkki:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"759\" height=\"290\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d.png\" alt=\"\" class=\"wp-image-689\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d.png 759w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d-300x115.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d-18x7.png 18w\" sizes=\"auto, (max-width: 759px) 100vw, 759px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"23_Rejection_sampling_Filtering_good_data_from_%E2%80%9Ctrial_and_error\"><\/span>2.3 N\u00e4ytteenotto hylk\u00e4\u00e4misest\u00e4: Hyvien tietojen suodattaminen \"kokeilemalla ja erehtym\u00e4ll\u00e4<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>N\u00e4ytteenotto hylk\u00e4\u00e4misest\u00e4: Luo useita ehdokkaiden vastauksia ja s\u00e4ilyt\u00e4 hyv\u00e4t vastaukset, kuten kirjoittaessasi luonnoksen ja kopioidessasi sitten oikean vastauksen tentiss\u00e4.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A2Generation_of_distilled_data\"><\/span>\u2162.Tislattujen tietojen tuottaminen<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Ensimm\u00e4inen askel tiedon tislauksessa on tuottaa korkealaatuista \"opetusdataa\", josta pienet mallit voivat oppia.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Data_sources\"><\/span><strong>Tietol\u00e4hteet<\/strong>:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>80%:n tuottamista p\u00e4\u00e4ttelytiedoista. <a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-R1\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">DeepSeek-R1<\/a><\/li>\n\n\n\n<li>20% DeepSeek-V3:n yleisist\u00e4 teht\u00e4v\u00e4tiedoista.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Distillation_data_generation_process\"><\/span><strong>Tislaustietojen tuottamisprosessi<\/strong>:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>S\u00e4\u00e4nt\u00f6jen suodatus<\/strong>: tarkistaa automaattisesti vastauksen oikeellisuuden (esim. onko matemaattinen vastaus kaavan mukainen).<\/li>\n\n\n\n<li><strong>Luettavuuden tarkistus<\/strong>: eliminoi sekakieliset (esim. kiinan ja englannin sekakieliset) tai pitk\u00e4t kappaleet.<\/li>\n\n\n\n<li><strong>Malliohjattu sukupolvi<\/strong>: edellytt\u00e4\u00e4, ett\u00e4 DeepSeek-R1 tuottaa mallin mukaisia p\u00e4\u00e4ttelyratoja.<\/li>\n\n\n\n<li><strong>N\u00e4ytteenoton hylk\u00e4\u00e4misen suodatus<\/strong>:<\/li>\n\n\n\n<li><strong>Tietojen integrointi<\/strong>: Lopulta luotiin 800 000 korkealaatuista n\u00e4ytett\u00e4, joista noin 600 000 sis\u00e4lsi p\u00e4\u00e4ttelytietoja ja noin 200 000 yleisi\u00e4 tietoja.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A3Distillation_process\"><\/span>\u2163.Tislausprosessi<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Teacher_and_student_roles\"><\/span>Opettajan ja oppilaan roolit:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>DeepSeek-R1 opettajamallina;<\/li>\n\n\n\n<li>Qwen-sarjan mallit opiskelijamallina.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Training_steps\"><\/span>Koulutuksen vaiheet:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Ensiksi tietojen sy\u00f6tt\u00f6: sinun on sy\u00f6tett\u00e4v\u00e4 kysymysosa 800 000 n\u00e4ytteest\u00e4 Qwen-malliin ja pyydett\u00e4v\u00e4 sit\u00e4 luomaan t\u00e4ydellinen p\u00e4\u00e4ttelypolku (ajatteluprosessi + vastaus) mallin mukaisesti. T\u00e4m\u00e4 on hyvin t\u00e4rke\u00e4 vaihe<\/p>\n\n\n\n<p>Seuraavaksi tappion laskeminen: verrataan oppilaan mallin tuottamaa tulosta opettajan mallin p\u00e4\u00e4ttelypolkuun ja yhdenmukaistetaan tekstisekvenssi valvotun hienos\u00e4\u00e4d\u00f6n (SFT) avulla. Jos et ole varma, mit\u00e4 SFT on, toivon, ett\u00e4 haet t\u00e4t\u00e4 hakusanaa saadaksesi lis\u00e4tietoja.<\/p>\n\n\n\n<p>T\u00e4ydellinen parametrien p\u00e4ivitys opiskelijan suurempaan malliin: Optimoi Qwen-mallin parametrit backpropagationin avulla opettajamallin tuotoksen l\u00e4hent\u00e4miseksi.<\/p>\n\n\n\n<p>Koulutusprosessin toistaminen useaan kertaan varmistaa, ett\u00e4 tieto siirtyy riitt\u00e4v\u00e4sti. N\u00e4in saavutetaan alkuper\u00e4inen koulutustavoite. Annamme esimerkin, jolla havainnollistamme t\u00e4m\u00e4n, ja toivomme, ett\u00e4 ymm\u00e4rr\u00e4tte.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A4_Example_demonstration\"><\/span>\u2164. Esimerkkiesittely<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Artikkelissa havainnollistetaan tislausvaikutusta tietyn yht\u00e4l\u00f6nratkaisuteht\u00e4v\u00e4n avulla (ratkaise yht\u00e4l\u00f6):<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Opettajamallin vakiotulos:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"771\" height=\"328\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352.png\" alt=\"\" class=\"wp-image-690\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352.png 771w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352-300x128.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352-768x327.png 768w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352-18x8.png 18w\" sizes=\"auto, (max-width: 771px) 100vw, 771px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Qwen-7B:n tuotos ennen tislausta:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"766\" height=\"178\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb.png\" alt=\"\" class=\"wp-image-688\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb.png 766w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb-300x70.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb-18x4.png 18w\" sizes=\"auto, (max-width: 766px) 100vw, 766px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Qwen-7B:n tuotos tislauksen j\u00e4lkeen:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"759\" height=\"260\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c.png\" alt=\"\" class=\"wp-image-687\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c.png 759w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c-300x103.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c-18x6.png 18w\" sizes=\"auto, (max-width: 759px) 100vw, 759px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Optimoitu ratkaisu: Vastaus on sama kuin opettajan malli.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A5_Summary\"><\/span>\u2165. Yhteenveto<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Tiet\u00e4myksen tislauksen avulla DeepSeek-R1:n p\u00e4\u00e4ttelykyky siirret\u00e4\u00e4n tehokkaasti Qwen-sarjan pieniin malleihin. T\u00e4ss\u00e4 prosessissa keskityt\u00e4\u00e4n mallinnettuun ulostuloon ja hylk\u00e4\u00e4v\u00e4\u00e4n otantaan. Strukturoidun datan tuottamisen ja tarkennetun harjoittelun avulla pienet mallit voivat suorittaa monimutkaisia p\u00e4\u00e4ttelyteht\u00e4vi\u00e4 my\u00f6s resurssirajoitteisissa skenaarioissa. T\u00e4m\u00e4 tekniikka tarjoaa t\u00e4rke\u00e4n viitekehyksen teko\u00e4lymallien kevyelle k\u00e4ytt\u00f6\u00f6notolle.<\/p>","protected":false},"excerpt":{"rendered":"<p>\u2160. Mit\u00e4 on tiedon tislaus? Tiedon tislaus on mallin tiivist\u00e4mistekniikka, jota k\u00e4ytet\u00e4\u00e4n tiedon siirt\u00e4miseen suuresta, monimutkaisesta mallista (opettajan malli) pieneen malliin (oppilaan malli). Keskeinen periaate on, ett\u00e4 opettajamalli opettaa opiskelijamallia ennustamalla tuloksia (kuten todenn\u00e4k\u00f6isyysjakaumia tai p\u00e4\u00e4ttelyprosesseja), ja...<\/p>","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kadence_starter_templates_imported_post":false,"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-686","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/posts\/686","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/comments?post=686"}],"version-history":[{"count":2,"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/posts\/686\/revisions"}],"predecessor-version":[{"id":692,"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/posts\/686\/revisions\/692"}],"wp:attachment":[{"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/media?parent=686"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/categories?post=686"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/janusai.pro\/fi\/wp-json\/wp\/v2\/tags?post=686"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}