{"id":686,"date":"2025-01-29T07:35:31","date_gmt":"2025-01-29T07:35:31","guid":{"rendered":"https:\/\/janusai.pro\/?p=686"},"modified":"2025-01-29T07:37:05","modified_gmt":"2025-01-29T07:37:05","slug":"i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive","status":"publish","type":"post","link":"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/","title":{"rendered":"DeepSeek-R1 \u00e9rvel\u00e9si k\u00e9pess\u00e9g\u00e9nek tud\u00e1s\u00e1t Qwen2-be desztill\u00e1ltam, \u00e9s az eredm\u00e9nyek val\u00f3ban robban\u00e1sszer\u0171ek voltak!!!"},"content":{"rendered":"<div style=\"margin-top: 0px; margin-bottom: 0px;\" class=\"sharethis-inline-share-buttons\" ><\/div>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_72 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Tartalomjegyz\u00e9k<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Tartalomjegyz\u00e9k\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A0_What_is_knowledge_distillation\" title=\"\u2160. Mi a tud\u00e1s desztill\u00e1ci\u00f3ja?\">\u2160. Mi a tud\u00e1s desztill\u00e1ci\u00f3ja?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#IICore_concepts\" title=\"II.Alapfogalmak\">II.Alapfogalmak<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#21_Template_design\" title=\"2.1 Sablonok kialak\u00edt\u00e1sa\">2.1 Sablonok kialak\u00edt\u00e1sa<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#22_Reasoning_trajectory_The_%E2%80%9Cthinking_chain%E2%80%9D_of_the_models_solution\" title=\"2.2 \u00c9rvel\u00e9si p\u00e1lya: A modell megold\u00e1s\u00e1nak &quot;gondolkod\u00e1si l\u00e1nca&quot;\">2.2 \u00c9rvel\u00e9si p\u00e1lya: A modell megold\u00e1s\u00e1nak \"gondolkod\u00e1si l\u00e1nca\"<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#23_Rejection_sampling_Filtering_good_data_from_%E2%80%9Ctrial_and_error\" title=\"2.3 Visszautas\u00edtott mintav\u00e9tel: A j\u00f3 adatok kisz\u0171r\u00e9se a &quot;pr\u00f3ba \u00e9s hiba&quot; m\u00f3dszerb\u0151l\">2.3 Visszautas\u00edtott mintav\u00e9tel: A j\u00f3 adatok kisz\u0171r\u00e9se a \"pr\u00f3ba \u00e9s hiba\" m\u00f3dszerb\u0151l<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A2Generation_of_distilled_data\" title=\"\u2162.A desztill\u00e1lt adatok el\u0151\u00e1ll\u00edt\u00e1sa\">\u2162.A desztill\u00e1lt adatok el\u0151\u00e1ll\u00edt\u00e1sa<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Data_sources\" title=\"Adatforr\u00e1sok:\">Adatforr\u00e1sok:<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Distillation_data_generation_process\" title=\"A desztill\u00e1ci\u00f3s adatok el\u0151\u00e1ll\u00edt\u00e1s\u00e1nak folyamata:\">A desztill\u00e1ci\u00f3s adatok el\u0151\u00e1ll\u00edt\u00e1s\u00e1nak folyamata:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A3Distillation_process\" title=\"\u2163.Desztill\u00e1ci\u00f3s elj\u00e1r\u00e1s\">\u2163.Desztill\u00e1ci\u00f3s elj\u00e1r\u00e1s<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Teacher_and_student_roles\" title=\"Tan\u00e1r \u00e9s di\u00e1k szerepek:\">Tan\u00e1r \u00e9s di\u00e1k szerepek:<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#Training_steps\" title=\"K\u00e9pz\u00e9si l\u00e9p\u00e9sek:\">K\u00e9pz\u00e9si l\u00e9p\u00e9sek:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A4_Example_demonstration\" title=\"\u2164. P\u00e9lda bemutat\u00e1s\u00e1ra\">\u2164. P\u00e9lda bemutat\u00e1s\u00e1ra<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/janusai.pro\/hu\/i-distilled-deepseek-r1s-reasoning-ability-knowledge-into-qwen2-and-the-results-were-really-explosive\/#%E2%85%A5_Summary\" title=\"\u2165. \u00d6sszefoglal\u00f3\">\u2165. \u00d6sszefoglal\u00f3<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A0_What_is_knowledge_distillation\"><\/span><strong>\u2160. <\/strong>Mi a tud\u00e1s desztill\u00e1l\u00e1sa?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>A tud\u00e1sdesztill\u00e1ci\u00f3 egy olyan modellt\u00f6m\u00f6r\u00edt\u00e9si technika, amelyet arra haszn\u00e1lnak, hogy a tud\u00e1st egy nagy, \u00f6sszetett modellb\u0151l (a tan\u00e1ri modellb\u0151l) egy kis modellbe (a tanul\u00f3i modellbe) vigy\u00e9k \u00e1t. <\/p>\n\n\n\n<p>Az alapelv az, hogy a tan\u00edt\u00f3 modell az eredm\u00e9nyek (p\u00e9ld\u00e1ul val\u00f3sz\u00edn\u0171s\u00e9gi eloszl\u00e1sok vagy k\u00f6vetkeztet\u00e9si folyamatok) el\u0151rejelz\u00e9s\u00e9vel tan\u00edtja a tanul\u00f3 modellt, a tanul\u00f3 modell pedig ezen el\u0151rejelz\u00e9sekb\u0151l tanulva jav\u00edtja teljes\u00edtm\u00e9ny\u00e9t. <\/p>\n\n\n\n<p>Ez a m\u00f3dszer k\u00fcl\u00f6n\u00f6sen alkalmas er\u0151forr\u00e1s-korl\u00e1tozott eszk\u00f6z\u00f6k, p\u00e9ld\u00e1ul mobiltelefonok vagy be\u00e1gyazott eszk\u00f6z\u00f6k eset\u00e9ben.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"IICore_concepts\"><\/span>II.Alapfogalmak<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"21_Template_design\"><\/span>2.1 Sablonok kialak\u00edt\u00e1sa<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Sablon: A modell kimenet\u00e9nek szabv\u00e1nyos\u00edt\u00e1s\u00e1ra haszn\u00e1lt struktur\u00e1lt form\u00e1tum. P\u00e9ld\u00e1ul\n<ul class=\"wp-block-list\">\n<li>: Az \u00e9rvel\u00e9si folyamat kezdet\u00e9t jelzi.<\/li>\n\n\n\n<li>: Az \u00e9rvel\u00e9si folyamat v\u00e9g\u00e9t jelzi.<\/li>\n\n\n\n<li>: A v\u00e9gs\u0151 v\u00e1lasz kezdet\u00e9t jel\u00f6li.<\/li>\n\n\n\n<li>: A v\u00e9gs\u0151 v\u00e1lasz v\u00e9g\u00e9t jel\u00f6li.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Funkci\u00f3:\n<ul class=\"wp-block-list\">\n<li>Tisztas\u00e1g: Ez a modellnek azt \u00fczeni, hogy \"a gondolkod\u00e1si folyamat itt kezd\u0151dik, a v\u00e1lasz pedig ott\".<\/li>\n\n\n\n<li>K\u00f6vetkezetess\u00e9g: Biztos\u00edtja, hogy minden kimenet ugyanazt a strukt\u00far\u00e1t k\u00f6vesse, megk\u00f6nny\u00edtve a k\u00e9s\u0151bbi feldolgoz\u00e1st \u00e9s elemz\u00e9st.<\/li>\n\n\n\n<li>Olvashat\u00f3s\u00e1g: Az emberek k\u00f6nnyen meg tudj\u00e1k k\u00fcl\u00f6nb\u00f6ztetni az \u00e9rvel\u00e9si folyamatot \u00e9s a v\u00e1laszt, ami jav\u00edtja a felhaszn\u00e1l\u00f3i \u00e9lm\u00e9nyt.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"22_Reasoning_trajectory_The_%E2%80%9Cthinking_chain%E2%80%9D_of_the_models_solution\"><\/span>2.2 \u00c9rvel\u00e9si p\u00e1lya: A modell megold\u00e1s\u00e1nak \"gondolkod\u00e1si l\u00e1nca\"<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u00c9rvel\u00e9si p\u00e1lya: A modell \u00e1ltal egy probl\u00e9ma megold\u00e1sa sor\u00e1n gener\u00e1lt r\u00e9szletes l\u00e9p\u00e9sek mutatj\u00e1k a modell logikai l\u00e1nc\u00e1t.<\/li>\n\n\n\n<li>P\u00e9lda:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"759\" height=\"290\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d.png\" alt=\"\" class=\"wp-image-689\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d.png 759w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d-300x115.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/b8eff676-f9d7-436c-9ee7-1e423242825d-18x7.png 18w\" sizes=\"auto, (max-width: 759px) 100vw, 759px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"23_Rejection_sampling_Filtering_good_data_from_%E2%80%9Ctrial_and_error\"><\/span>2.3 Visszautas\u00edtott mintav\u00e9tel: A j\u00f3 adatok kisz\u0171r\u00e9se a \"pr\u00f3ba \u00e9s hiba\" m\u00f3dszerb\u0151l<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Visszautas\u00edtott mintav\u00e9tel: T\u00f6bb jel\u00f6lt v\u00e1lasz\u00e1nak gener\u00e1l\u00e1sa \u00e9s a j\u00f3 v\u00e1laszok megtart\u00e1sa, hasonl\u00f3an ahhoz, mint amikor egy vizsg\u00e1n egy v\u00e1zlatot \u00edrunk, majd a helyes v\u00e1laszt lem\u00e1soljuk.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A2Generation_of_distilled_data\"><\/span>\u2162.A desztill\u00e1lt adatok el\u0151\u00e1ll\u00edt\u00e1sa<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>A tud\u00e1s lep\u00e1rl\u00e1s\u00e1nak els\u0151 l\u00e9p\u00e9se, hogy j\u00f3 min\u0151s\u00e9g\u0171 \"tan\u00edt\u00e1si adatokat\" hozzon l\u00e9tre, amelyekb\u0151l a kis modellek tanulhatnak.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Data_sources\"><\/span><strong>Adatforr\u00e1sok<\/strong>:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>80% az \u00e9rvel\u00e9si adatokb\u00f3l, amelyeket a <a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-R1\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">DeepSeek-R1<\/a><\/li>\n\n\n\n<li>20% a DeepSeek-V3 \u00e1ltal\u00e1nos feladatadatokb\u00f3l.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Distillation_data_generation_process\"><\/span><strong>A desztill\u00e1ci\u00f3s adatok el\u0151\u00e1ll\u00edt\u00e1s\u00e1nak folyamata<\/strong>:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Szab\u00e1lysz\u0171r\u00e9s<\/strong>: automatikusan ellen\u0151rzi a v\u00e1lasz helyess\u00e9g\u00e9t (pl. hogy a matematikai v\u00e1lasz megfelel-e a k\u00e9pletnek).<\/li>\n\n\n\n<li><strong>Olvashat\u00f3s\u00e1gi ellen\u0151rz\u00e9s<\/strong>: kik\u00fcsz\u00f6b\u00f6li a vegyes nyelveket (pl. k\u00ednai \u00e9s angol vegyesen) vagy a hossz\u00fa bekezd\u00e9seket.<\/li>\n\n\n\n<li><strong>Sablonvez\u00e9relt gener\u00e1l\u00e1s<\/strong>: a DeepSeek-R1-nek a sablon szerinti k\u00f6vetkeztet\u00e9si p\u00e1ly\u00e1k kimenet\u00e9hez sz\u00fcks\u00e9ges.<\/li>\n\n\n\n<li><strong>Visszautas\u00edt\u00e1s mintav\u00e9telez\u00e9s sz\u0171r\u00e9se<\/strong>:<\/li>\n\n\n\n<li><strong>Adatintegr\u00e1ci\u00f3<\/strong>: 800 000 kiv\u00e1l\u00f3 min\u0151s\u00e9g\u0171 minta ker\u00fclt v\u00e9g\u00fcl gener\u00e1l\u00e1sra, ebb\u0151l k\u00f6r\u00fclbel\u00fcl 600 000 k\u00f6vetkeztet\u00e9si adat \u00e9s k\u00f6r\u00fclbel\u00fcl 200 000 \u00e1ltal\u00e1nos adat.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A3Distillation_process\"><\/span>\u2163.Desztill\u00e1ci\u00f3s elj\u00e1r\u00e1s<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Teacher_and_student_roles\"><\/span>Tan\u00e1r \u00e9s di\u00e1k szerepek:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>DeepSeek-R1 mint tan\u00e1ri modell;<\/li>\n\n\n\n<li>Qwen sorozat\u00fa modellek, mint a di\u00e1kmodell.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Training_steps\"><\/span>K\u00e9pz\u00e9si l\u00e9p\u00e9sek:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>El\u0151sz\u00f6r is, adatbevitel: a 800 000 minta k\u00e9rd\u00e9ses r\u00e9sz\u00e9t be kell vinni a Qwen modellbe, \u00e9s meg kell k\u00e9rni, hogy gener\u00e1ljon egy teljes k\u00f6vetkeztet\u00e9si p\u00e1ly\u00e1t (gondolkod\u00e1si folyamat + v\u00e1lasz) a sablon szerint. Ez egy nagyon fontos l\u00e9p\u00e9s<\/p>\n\n\n\n<p>Ezut\u00e1n vesztes\u00e9gsz\u00e1m\u00edt\u00e1s: a tanul\u00f3modell \u00e1ltal gener\u00e1lt kimenet \u00f6sszehasonl\u00edt\u00e1sa a tan\u00e1ri modell k\u00f6vetkeztet\u00e9si p\u00e1ly\u00e1j\u00e1val, \u00e9s a sz\u00f6vegsorozat \u00f6sszehangol\u00e1sa fel\u00fcgyelt finomhangol\u00e1ssal (SFT). Ha nem tudja, mi az SFT, rem\u00e9lem, r\u00e1keres erre a kulcssz\u00f3ra, hogy t\u00f6bbet tudjon meg.<\/p>\n\n\n\n<p>A hallgat\u00f3 nagyobb modellj\u00e9nek teljes param\u00e9terfriss\u00edt\u00e9se: A Qwen modell param\u00e9tereinek optimaliz\u00e1l\u00e1sa backpropag\u00e1ci\u00f3val a tan\u00e1ri modell kimenet\u00e9nek k\u00f6zel\u00edt\u00e9se \u00e9rdek\u00e9ben.<\/p>\n\n\n\n<p>A k\u00e9pz\u00e9si folyamat t\u00f6bbsz\u00f6ri megism\u00e9tl\u00e9se biztos\u00edtja, hogy a tud\u00e1s kell\u0151 m\u00e9rt\u00e9kben \u00e1tad\u00e1sra ker\u00fclj\u00f6n. Ez\u00e1ltal megval\u00f3sul az eredeti k\u00e9pz\u00e9si c\u00e9l. Egy p\u00e9ld\u00e1val szeml\u00e9ltetj\u00fck ezt, \u00e9s rem\u00e9lj\u00fck, hogy meg\u00e9rti.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A4_Example_demonstration\"><\/span>\u2164. P\u00e9lda bemutat\u00e1s\u00e1ra<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>A cikk a desztill\u00e1ci\u00f3s hat\u00e1st egy konkr\u00e9t egyenletmegold\u00e1si feladaton (oldj meg egy egyenletet) kereszt\u00fcl mutatja be:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A tan\u00e1ri modell standard kimenete:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"771\" height=\"328\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352.png\" alt=\"\" class=\"wp-image-690\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352.png 771w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352-300x128.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352-768x327.png 768w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/3a53b6a8-36d2-4251-ab0f-8646d7646352-18x8.png 18w\" sizes=\"auto, (max-width: 771px) 100vw, 771px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Qwen-7B kimenete desztill\u00e1ci\u00f3 el\u0151tt:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"766\" height=\"178\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb.png\" alt=\"\" class=\"wp-image-688\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb.png 766w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb-300x70.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/51c44a52-01a0-474a-8d47-5483613286fb-18x4.png 18w\" sizes=\"auto, (max-width: 766px) 100vw, 766px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Qwen-7B kimenet desztill\u00e1ci\u00f3 ut\u00e1n:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"759\" height=\"260\" src=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c.png\" alt=\"\" class=\"wp-image-687\" srcset=\"https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c.png 759w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c-300x103.png 300w, https:\/\/janusai.pro\/wp-content\/uploads\/2025\/01\/61c7fb80-d903-4339-971c-9613b5ac199c-18x6.png 18w\" sizes=\"auto, (max-width: 759px) 100vw, 759px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Optimaliz\u00e1lt megold\u00e1s: Struktur\u00e1lt k\u00f6vetkeztet\u00e9si folyamat gener\u00e1l\u00f3dik, \u00e9s a v\u00e1lasz megegyezik a tan\u00e1ri modellel.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"%E2%85%A5_Summary\"><\/span>\u2165. \u00d6sszefoglal\u00f3<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>A tud\u00e1s lep\u00e1rl\u00e1s\u00e1val a DeepSeek-R1 k\u00f6vetkeztet\u00e9si k\u00e9pess\u00e9ge hat\u00e9konyan \u00e1tker\u00fcl a Qwen kis modellek sorozat\u00e1ba. Ez a folyamat a sablonos kimenetre \u00e9s a selejtes mintav\u00e9telre \u00f6sszpontos\u00edt. A struktur\u00e1lt adatgener\u00e1l\u00e1s \u00e9s a kifinomult k\u00e9pz\u00e9s r\u00e9v\u00e9n a kis modellek er\u0151forr\u00e1s-korl\u00e1tozott forgat\u00f3k\u00f6nyvekben is k\u00e9pesek komplex k\u00f6vetkeztet\u00e9si feladatok elv\u00e9gz\u00e9s\u00e9re. Ez a technol\u00f3gia fontos hivatkoz\u00e1si alapot ny\u00fajt a mesters\u00e9ges intelligencia modellek k\u00f6nny\u00edtett telep\u00edt\u00e9s\u00e9hez.<\/p>","protected":false},"excerpt":{"rendered":"<p>\u2160. Mi a tud\u00e1s desztill\u00e1ci\u00f3ja? A tud\u00e1sdesztill\u00e1ci\u00f3 egy olyan modellt\u00f6m\u00f6r\u00edt\u00e9si technika, amelyet arra haszn\u00e1lnak, hogy a tud\u00e1st egy nagy, \u00f6sszetett modellb\u0151l (a tan\u00e1ri modellb\u0151l) egy kis modellbe (a tanul\u00f3i modellbe) adj\u00e1k \u00e1t. Az alapelv az, hogy a tan\u00edt\u00f3 modell az eredm\u00e9nyek (p\u00e9ld\u00e1ul val\u00f3sz\u00edn\u0171s\u00e9gi eloszl\u00e1sok vagy k\u00f6vetkeztet\u00e9si folyamatok) el\u0151rejelz\u00e9s\u00e9vel tan\u00edtja a tanul\u00f3 modellt, \u00e9s a...<\/p>","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kadence_starter_templates_imported_post":false,"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-686","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/posts\/686","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/comments?post=686"}],"version-history":[{"count":2,"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/posts\/686\/revisions"}],"predecessor-version":[{"id":692,"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/posts\/686\/revisions\/692"}],"wp:attachment":[{"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/media?parent=686"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/categories?post=686"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/janusai.pro\/hu\/wp-json\/wp\/v2\/tags?post=686"}],"curies":[{"name":"munkaf\u00fczet","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}