{"id":7380,"date":"2024-04-26T15:47:03","date_gmt":"2024-04-26T15:47:03","guid":{"rendered":"https:\/\/tup.kxe.temporary.site\/microsoft-unveils-a-new-small-language-model\/"},"modified":"2024-04-26T15:47:03","modified_gmt":"2024-04-26T15:47:03","slug":"microsoft-unveils-a-new-small-language-model","status":"publish","type":"post","link":"https:\/\/okdesign.ca\/fr\/microsoft-unveils-a-new-small-language-model\/","title":{"rendered":"Microsoft unveils a new small language model"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p>Phi-3-Mini is the first in a family of small language models Microsoft plans to release over the coming weeks. Phi-3-Small and Phi-3-Medium are in the works. In contrast to large language models like OpenAI\u2019s ChatGPT and Google\u2019s Gemini, small language models are trained on much smaller datasets and are said to be much more affordable for users.<\/p>\n<blockquote class=\"wp-block-quote\">\n<p>We are excited to introduce Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the\u00a0most capable and cost-effective small language models (SLMs)\u00a0available, outperforming models of the same size and next size up across a variety of language, reasoning, coding and math benchmarks.<\/p>\n<p><cite><a rel=\"nofollow noopener\" href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/introducing-phi-3-redefining-whats-possible-with-slms\/\" target=\"_blank\">Misha Bilenko Corporate Vice President, Microsoft GenAI<\/a><\/cite><\/p><\/blockquote>\n<p><strong>What are they for? <\/strong>For one thing, the reduced size of this language model may make it suitable to run locally, for example as an app on a smartphone. Something the size of ChatGPT lives in the cloud and requires an internet connection for access.<\/p>\n<p>While ChatGPT is said to have <a rel=\"nofollow noopener\" href=\"https:\/\/arstechnica.com\/information-technology\/2024\/04\/microsofts-phi-3-shows-the-surprising-power-of-small-locally-run-ai-language-models\/\" target=\"_blank\">over a trillion parameters<\/a>, Phi-3-Mini has only 3.8 billion. Sanjeev Bora, who works with genAI in the healthcare space, <a rel=\"nofollow noopener\" href=\"https:\/\/www.linkedin.com\/pulse\/understanding-parameters-genai-models-design-use-cases-sanjeev-bora-de1uc\/\" target=\"_blank\">writes<\/a>: \u201cThe number of parameters in a model usually dictates its size and complexity. Larger models with more parameters are generally more capable but come at the cost of increased computational requirements. The choice of size often depends on the specific problem being addressed.\u201d<\/p>\n<p><!-- \/1038259\/MT_Post-text --><\/p>\n<p>Phi-3-Mini was trained on a relatively small dataset of 3.3 trillion tokens \u2014 instances of human language expressed numerically. But that\u2019s still a lot of tokens.<\/p>\n<p><strong>Why we care.<\/strong> While it is generally reported, and confirmed by Microsoft, that these SLMs will be much more affordable than the big LLMs, it\u2019s hard to find exact details on the pricing. Nevertheless, taking the promise at face-value, one can imagine a democratization of genAI, making it available to very small businesses and sole proprietors.<\/p>\n<p>We need to see what these models can do in practice, but it\u2019s plausible that use cases like writing a marketing newsletter, coming up with email subject lines or drafting social media posts just don\u2019t require the gigantic power of a LLM. <\/p>\n<hr\/>\n<hr\/>\n<p><em><strong>Dig deeper: <a rel=\"nofollow\" href=\"https:\/\/martech.org\/how-a-non-profit-farmers-market-is-leveraging-ai\/\">How a non-profit farmers\u00a0<strong>market<\/strong>\u00a0is leveraging AI<\/a><\/strong><\/em><\/p>\n<p><!-- START INLINE FORM --><\/p>\n<p><!-- END INLINE FORM -->\n<\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/martech.org\/microsoft-unveils-a-new-small-language-model\/\">Source link <\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>Phi-3-Mini is the first in a family of small language models Microsoft plans to release over the coming weeks. Phi-3-Small and Phi-3-Medium are in the works. In contrast to large language models like OpenAI\u2019s ChatGPT and Google\u2019s Gemini, small language models are trained on much smaller datasets and are said to be much more affordable [&hellip;]<\/p>","protected":false},"author":3,"featured_media":7381,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-7380","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-agency"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.8 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Microsoft unveils a new small language model - OK Design<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/okdesign.ca\/fr\/microsoft-unveils-a-new-small-language-model\/\" \/>\n<meta property=\"og:locale\" content=\"fr_CA\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Microsoft unveils a new small language model\" \/>\n<meta property=\"og:description\" content=\"Phi-3-Mini is the first in a family of small language models Microsoft plans to release over the coming weeks. Phi-3-Small and Phi-3-Medium are in the works. In contrast to large language models like OpenAI\u2019s ChatGPT and Google\u2019s Gemini, small language models are trained on much smaller datasets and are said to be much more affordable [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/okdesign.ca\/fr\/microsoft-unveils-a-new-small-language-model\/\" \/>\n<meta property=\"og:site_name\" content=\"OK Design\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/okdesign.ca\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-26T15:47:03+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"OK Design\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"OK Design\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimation du temps de lecture\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/\"},\"author\":{\"name\":\"OK Design\",\"@id\":\"https:\/\/okdesign.ca\/en\/#\/schema\/person\/a8cdeff6d4fdb205ceabe60a22c77a75\"},\"headline\":\"Microsoft unveils a new small language model\",\"datePublished\":\"2024-04-26T15:47:03+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/\"},\"wordCount\":379,\"publisher\":{\"@id\":\"https:\/\/okdesign.ca\/en\/#organization\"},\"image\":{\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1\",\"articleSection\":[\"Agency\"],\"inLanguage\":\"fr-CA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/\",\"url\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/\",\"name\":\"Microsoft unveils a new small language model - OK Design\",\"isPartOf\":{\"@id\":\"https:\/\/okdesign.ca\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1\",\"datePublished\":\"2024-04-26T15:47:03+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#breadcrumb\"},\"inLanguage\":\"fr-CA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1\",\"width\":1920,\"height\":1080},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/okdesign.ca\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Microsoft unveils a new small language model\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/okdesign.ca\/en\/#website\",\"url\":\"https:\/\/okdesign.ca\/en\/\",\"name\":\"OK Design - Conception Graphiques et Sites Web\",\"description\":\"Conception graphique et sites Web\",\"publisher\":{\"@id\":\"https:\/\/okdesign.ca\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/okdesign.ca\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-CA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/okdesign.ca\/en\/#organization\",\"name\":\"OK Web Design\",\"url\":\"https:\/\/okdesign.ca\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\/\/okdesign.ca\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2020\/09\/OKDesign-W.png?fit=7001%2C1376&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2020\/09\/OKDesign-W.png?fit=7001%2C1376&ssl=1\",\"width\":7001,\"height\":1376,\"caption\":\"OK Web Design\"},\"image\":{\"@id\":\"https:\/\/okdesign.ca\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/okdesign.ca\",\"https:\/\/www.instagram.com\/okdesignca\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/okdesign.ca\/en\/#\/schema\/person\/a8cdeff6d4fdb205ceabe60a22c77a75\",\"name\":\"OK Design\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/414d6a655f4d2b769d207dd5f01fd608ffbb3f6a8992a451bdb6d00e62dac102?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/414d6a655f4d2b769d207dd5f01fd608ffbb3f6a8992a451bdb6d00e62dac102?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/414d6a655f4d2b769d207dd5f01fd608ffbb3f6a8992a451bdb6d00e62dac102?s=96&d=mm&r=g\",\"caption\":\"OK Design\"},\"sameAs\":[\"https:\/\/tup.kxe.temporary.site\"],\"url\":\"https:\/\/okdesign.ca\/fr\/author\/okdesign\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Microsoft unveils a new small language model - OK Design","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/okdesign.ca\/fr\/microsoft-unveils-a-new-small-language-model\/","og_locale":"fr_CA","og_type":"article","og_title":"Microsoft unveils a new small language model","og_description":"Phi-3-Mini is the first in a family of small language models Microsoft plans to release over the coming weeks. Phi-3-Small and Phi-3-Medium are in the works. In contrast to large language models like OpenAI\u2019s ChatGPT and Google\u2019s Gemini, small language models are trained on much smaller datasets and are said to be much more affordable [&hellip;]","og_url":"https:\/\/okdesign.ca\/fr\/microsoft-unveils-a-new-small-language-model\/","og_site_name":"OK Design","article_publisher":"https:\/\/www.facebook.com\/okdesign.ca","article_published_time":"2024-04-26T15:47:03+00:00","og_image":[{"width":1920,"height":1080,"url":"https:\/\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg","type":"image\/jpeg"}],"author":"OK Design","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"OK Design","Estimation du temps de lecture":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#article","isPartOf":{"@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/"},"author":{"name":"OK Design","@id":"https:\/\/okdesign.ca\/en\/#\/schema\/person\/a8cdeff6d4fdb205ceabe60a22c77a75"},"headline":"Microsoft unveils a new small language model","datePublished":"2024-04-26T15:47:03+00:00","mainEntityOfPage":{"@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/"},"wordCount":379,"publisher":{"@id":"https:\/\/okdesign.ca\/en\/#organization"},"image":{"@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1","articleSection":["Agency"],"inLanguage":"fr-CA"},{"@type":"WebPage","@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/","url":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/","name":"Microsoft unveils a new small language model - OK Design","isPartOf":{"@id":"https:\/\/okdesign.ca\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage"},"image":{"@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1","datePublished":"2024-04-26T15:47:03+00:00","breadcrumb":{"@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#breadcrumb"},"inLanguage":"fr-CA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/"]}]},{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#primaryimage","url":"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1","contentUrl":"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1","width":1920,"height":1080},{"@type":"BreadcrumbList","@id":"https:\/\/okdesign.ca\/microsoft-unveils-a-new-small-language-model\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/okdesign.ca\/"},{"@type":"ListItem","position":2,"name":"Microsoft unveils a new small language model"}]},{"@type":"WebSite","@id":"https:\/\/okdesign.ca\/en\/#website","url":"https:\/\/okdesign.ca\/en\/","name":"OK Design - Conception Graphiques et Sites Web","description":"Conception graphique et sites Web","publisher":{"@id":"https:\/\/okdesign.ca\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/okdesign.ca\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-CA"},{"@type":"Organization","@id":"https:\/\/okdesign.ca\/en\/#organization","name":"OK Web Design","url":"https:\/\/okdesign.ca\/en\/","logo":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/okdesign.ca\/en\/#\/schema\/logo\/image\/","url":"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2020\/09\/OKDesign-W.png?fit=7001%2C1376&ssl=1","contentUrl":"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2020\/09\/OKDesign-W.png?fit=7001%2C1376&ssl=1","width":7001,"height":1376,"caption":"OK Web Design"},"image":{"@id":"https:\/\/okdesign.ca\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/okdesign.ca","https:\/\/www.instagram.com\/okdesignca\/"]},{"@type":"Person","@id":"https:\/\/okdesign.ca\/en\/#\/schema\/person\/a8cdeff6d4fdb205ceabe60a22c77a75","name":"OK Design","image":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/secure.gravatar.com\/avatar\/414d6a655f4d2b769d207dd5f01fd608ffbb3f6a8992a451bdb6d00e62dac102?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/414d6a655f4d2b769d207dd5f01fd608ffbb3f6a8992a451bdb6d00e62dac102?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/414d6a655f4d2b769d207dd5f01fd608ffbb3f6a8992a451bdb6d00e62dac102?s=96&d=mm&r=g","caption":"OK Design"},"sameAs":["https:\/\/tup.kxe.temporary.site"],"url":"https:\/\/okdesign.ca\/fr\/author\/okdesign\/"}]}},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/okdesign.ca\/wp-content\/uploads\/2024\/04\/Small-robot.jpg?fit=1920%2C1080&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/posts\/7380","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/comments?post=7380"}],"version-history":[{"count":0,"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/posts\/7380\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/media\/7381"}],"wp:attachment":[{"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/media?parent=7380"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/categories?post=7380"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/okdesign.ca\/fr\/wp-json\/wp\/v2\/tags?post=7380"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}