{"id":12162,"date":"2025-08-10T02:16:17","date_gmt":"2025-08-09T17:16:17","guid":{"rendered":"https:\/\/aireviewirush.com\/?p=12162"},"modified":"2025-08-10T02:16:17","modified_gmt":"2025-08-09T17:16:17","slug":"an-ai-nerd-knob-each-community-engineer-ought-to-know","status":"publish","type":"post","link":"https:\/\/aireviewirush.com\/?p=12162","title":{"rendered":"An AI &#8216;Nerd Knob&#8217; Each Community Engineer Ought to Know"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p>Alright, my buddies, I\u2019m again with one other put up primarily based on my learnings and exploration of AI and the way it\u2019ll match into our work as community engineers. In immediately\u2019s put up, I need to share the primary (of what&#8217;s going to possible be many) \u201cnerd knobs\u201d that I believe all of us ought to concentrate on and the way they may affect our use of AI and AI instruments. I can already sense the joy within the room. In any case, there\u2019s not a lot a community engineer likes greater than <em>tweaking a nerd knob<\/em> within the community to fine-tune efficiency. And that\u2019s precisely what we\u2019ll be doing right here. Wonderful-tuning our AI instruments to assist us be simpler.<\/p>\n<p>First up, the requisite disclaimer or two.<\/p>\n<ol>\n<li><strong>There are SO MANY nerd knobs in AI.<\/strong> (Shocker, I do know.) So, when you all like this sort of weblog put up, I\u2019d be pleased to return in different posts the place we have a look at different \u201cknobs\u201d and settings in AI and the way they work. Properly, I\u2019d be pleased to return as soon as I perceive them, not less than. \ud83d\ude42<\/li>\n<li><strong>Altering <em>any of the settings<\/em> in your AI instruments can have dramatic results on outcomes.<\/strong> This contains growing the useful resource consumption of the AI mannequin, in addition to growing hallucinations and lowering the accuracy of the knowledge that comes again out of your prompts. Contemplate yourselves warned. As with all issues AI, go forth and discover and experiment. However accomplish that in a protected, lab surroundings.<\/li>\n<\/ol>\n<p>For immediately\u2019s experiment, I\u2019m as soon as once more utilizing LMStudio operating regionally on my laptop computer reasonably than a public or cloud-hosted AI mannequin. For extra particulars on why I like LMStudio, take a look at my final weblog, <a href=\"https:\/\/blogs.cisco.com\/learning\/creating-a-netai-playground-for-agentic-ai-experimentation\" target=\"_blank\" rel=\"noopener\">Making a NetAI Playground for Agentic AI Experimentation<\/a>.<\/p>\n<p>Sufficient of the setup, let\u2019s get into it!<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_53 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title \" >Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\" role=\"button\"><label for=\"item-6a32ba75b25e4\" ><span class=\"\"><span style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input aria-label=\"Toggle\" aria-label=\"item-6a32ba75b25e4\"  type=\"checkbox\" id=\"item-6a32ba75b25e4\"><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/aireviewirush.com\/?p=12162\/#The_affect_of_working_reminiscence_measurement_aokaya_%E2%80%9Ccontext%E2%80%9D\" title=\"The affect of working reminiscence measurement, a.okay.a. \u201ccontext\u201d\">The affect of working reminiscence measurement, a.okay.a. \u201ccontext\u201d<\/a><ul class='ez-toc-list-level-3'><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/aireviewirush.com\/?p=12162\/#Time_to_show_the_knob\" title=\"Time to show the knob!\">Time to show the knob!<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/aireviewirush.com\/?p=12162\/#All_tales_should_finish%E2%80%A6\" title=\"All tales should finish\u2026\">All tales should finish\u2026<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/aireviewirush.com\/?p=12162\/#Be_taught_with_Cisco\" title=\"Be taught with Cisco\">Be taught with Cisco<\/a><ul class='ez-toc-list-level-3'><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/aireviewirush.com\/?p=12162\/#X%E2%80%AF%E2%80%AFThreads_Fb%E2%80%AF%E2%80%AFLinkedIn%E2%80%AF%E2%80%AFInstagram%E2%80%AF%E2%80%AFYouTube\" title=\"X\u202f|\u202fThreads\u00a0|\u00a0Fb\u202f|\u202fLinkedIn\u202f|\u202fInstagram\u202f|\u202fYouTube\">X\u202f|\u202fThreads\u00a0|\u00a0Fb\u202f|\u202fLinkedIn\u202f|\u202fInstagram\u202f|\u202fYouTube<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"The_affect_of_working_reminiscence_measurement_aokaya_%E2%80%9Ccontext%E2%80%9D\"><\/span><strong>The affect of working reminiscence measurement, a.okay.a. \u201ccontext\u201d<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Let me set a scene for you.<\/p>\n<p>You\u2019re in the midst of troubleshooting a community concern. Somebody reported, or observed, instability at some extent in your community, and also you\u2019ve been assigned the joyful activity of attending to the underside of it. You captured some logs and related debug info, and the time has come to undergo all of it to determine what it means. However you\u2019ve additionally been utilizing AI instruments to be extra productive, 10x your work, impress your boss, you realize <em>all of the issues<\/em> which might be occurring proper now.<\/p>\n<p>So, you determine to see if AI may help you&#8217;re employed by the info sooner and get to the basis of the difficulty.<\/p>\n<p>You fireplace up your native AI assistant. (Sure, native\u2014as a result of <em>who is aware of<\/em> what\u2019s within the debug messages? Greatest to maintain all of it protected in your laptop computer.)<\/p>\n<p>You inform it what you\u2019re as much as, and paste within the log messages.<\/p>\n<figure id=\"attachment_476324\" aria-describedby=\"caption-attachment-476324\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"lazy lazy-hidden size-full wp-image-476324\" data-lazy-type=\"image\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-01.png\" alt=\"Asking an AI assistant to help debug a network issue.\" width=\"800\" height=\"608\" srcset=\"\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-476324\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-01.png\" alt=\"Asking an AI assistant to help debug a network issue.\" width=\"800\" height=\"608\" srcset=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-01-300x228.png 300w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-01-768x584.png 768w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-01.png 800w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><\/noscript><figcaption id=\"caption-attachment-476324\" class=\"wp-caption-text\">Asking AI to help with troubleshooting<\/figcaption><\/figure>\n<p>After getting 120 or so strains of logs into the chat, you hit enter, kick up your ft, attain to your Arnold Palmer for a refreshing drink, and look forward to the AI magic to occur. However earlier than you&#8217;ll be able to take a sip of <em>that iced tea and lemonade goodness<\/em>, you see this has instantly popped up on the display:<\/p>\n<figure id=\"attachment_476325\" aria-describedby=\"caption-attachment-476325\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"lazy lazy-hidden size-full wp-image-476325\" data-lazy-type=\"image\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-02.png\" alt=\"AI Failure! Context length issue\" width=\"800\" height=\"272\" srcset=\"\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-476325\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-02.png\" alt=\"AI Failure! Context length issue\" width=\"800\" height=\"272\" srcset=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/IL20250731203321-ai-knobs-context-02-300x102.png 300w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/IL20250731203313-ai-knobs-context-02-768x261.png 768w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/IL20250731203259-ai-knobs-context-02-2048x696.png 2048w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/IL20250731203303-ai-knobs-context-02-1536x522.png 1536w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/IL20250731203308-ai-knobs-context-02-1024x348.png 1024w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-02.png 800w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><\/noscript><figcaption id=\"caption-attachment-476325\" class=\"wp-caption-text\">AI Failure! \u201cThe AI has nothing to say\u201d<\/figcaption><\/figure>\n<p>Oh my.<\/p>\n<p><em>\u201cThe AI has nothing to say.\u201d<\/em>!?! How might that be?<\/p>\n<p>Did you discover a query so tough that AI can\u2019t deal with it?<\/p>\n<p>No, that\u2019s not the issue. Try the useful error message that LMStudio has kicked again:<\/p>\n<p style=\"padding-left: 40px;\"><em>\u201cMaking an attempt to maintain the primary 4994 tokens when context the overflows. Nonetheless, <strong>the mannequin is loaded with context size of solely 4096 tokens, which isn&#8217;t sufficient<\/strong>. Attempt to load the mannequin with a bigger context size, or present shorter enter.\u201d<\/em><\/p>\n<p>And we\u2019ve gotten to the basis of this completely scripted storyline and demonstration. Each AI software on the market has a restrict to how a lot \u201cworking reminiscence\u201d it has. The technical time period for this working reminiscence is \u201ccontext size<em>.\u201d <\/em>When you attempt to ship extra knowledge to an AI software than can match into the context size, you\u2019ll hit this error, or one thing prefer it.<\/p>\n<p>The error message signifies that the mannequin was \u201cloaded with context size of solely 4096 tokens.\u201d What&#8217;s a \u201ctoken,\u201d you marvel? Answering that might be a subject of a completely totally different weblog put up, however for now, simply know that \u201ctokens\u201d are the unit of measurement for the context size. And the very first thing that&#8217;s accomplished whenever you ship a immediate to an AI software is that the immediate is transformed into \u201ctokens\u201d.<\/p>\n<p>So what will we do? Properly, the message offers us two potential choices: we will enhance the context size of the mannequin, or we will present shorter enter. Typically it isn\u2019t a giant deal to supply shorter enter. However different instances, like after we are coping with massive log recordsdata, that choice isn\u2019t sensible\u2014all the knowledge is essential.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Time_to_show_the_knob\"><\/span><strong>Time to show the knob!<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>It&#8217;s that first choice, to load the mannequin with a bigger context size, that&#8217;s our nerd knob. Let\u2019s flip it.<\/p>\n<p>From inside LMStudio, head over to \u201cMy Fashions\u201d and click on to open up the configuration settings interface for the mannequin.<\/p>\n<figure id=\"attachment_476327\" aria-describedby=\"caption-attachment-476327\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"lazy lazy-hidden size-full wp-image-476327\" data-lazy-type=\"image\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-03.png\" alt=\"Accessing Model Settings\" width=\"800\" height=\"198\" srcset=\"\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-476327\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-03.png\" alt=\"Accessing Model Settings\" width=\"800\" height=\"198\" srcset=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-03-300x74.png 300w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-03-768x190.png 768w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-03.png 800w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><\/noscript><figcaption id=\"caption-attachment-476327\" class=\"wp-caption-text\">Accessing Mannequin Settings<\/figcaption><\/figure>\n<p>You\u2019ll get an opportunity to view all of the knobs that AI fashions have. And as I discussed, there are loads of them.<\/p>\n<figure id=\"attachment_476328\" aria-describedby=\"caption-attachment-476328\" style=\"width: 500px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"lazy lazy-hidden size-full wp-image-476328\" data-lazy-type=\"image\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-04.png\" alt=\"Default configuration settings\" width=\"500\" height=\"538\" srcset=\"\" sizes=\"auto, (max-width: 500px) 100vw, 500px\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-476328\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-04.png\" alt=\"Default configuration settings\" width=\"500\" height=\"538\" srcset=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-04-279x300.png 279w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-04.png 500w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\"\/><\/noscript><figcaption id=\"caption-attachment-476328\" class=\"wp-caption-text\">Default configuration settings<\/figcaption><\/figure>\n<p>However the one we care about proper now&#8217;s the Context Size. We will see that the default size for this mannequin is 4096 tokens. However it helps as much as 8192 tokens. Let\u2019s max it out!<\/p>\n<figure id=\"attachment_476329\" aria-describedby=\"caption-attachment-476329\" style=\"width: 500px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"lazy lazy-hidden size-full wp-image-476329\" data-lazy-type=\"image\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-05.png\" alt=\"Maxing out the Context Length\" width=\"500\" height=\"200\" srcset=\"\" sizes=\"auto, (max-width: 500px) 100vw, 500px\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-476329\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-05.png\" alt=\"Maxing out the Context Length\" width=\"500\" height=\"200\" srcset=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-05-300x120.png 300w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-05.png 500w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\"\/><\/noscript><figcaption id=\"caption-attachment-476329\" class=\"wp-caption-text\">Maxing out the Context Size<\/figcaption><\/figure>\n<p>LMStudio supplies a useful warning and possible motive for why the mannequin doesn\u2019t default to the max. The context size takes reminiscence and assets. And elevating it to \u201ca excessive worth\u201d can affect efficiency and utilization. So if this mannequin had a max size of 40,960 tokens (the Qwen3 mannequin I exploit generally has that prime of a max), you may not need to simply max it out straight away. As an alternative, enhance it by a bit at a time to seek out the candy spot: a context size sufficiently big for the job, however not outsized.<\/p>\n<p>As community engineers, we&#8217;re used to fine-tuning knobs for timers, body sizes, and so many different issues. That is proper up our alley!<\/p>\n<p>When you\u2019ve up to date your context size, you\u2019ll must \u201cEject\u201d and \u201cReload\u201d the mannequin for the setting to take impact. However as soon as that\u2019s accomplished, it\u2019s time to benefit from the change we\u2019ve made!<\/p>\n<figure id=\"attachment_476335\" aria-describedby=\"caption-attachment-476335\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"lazy lazy-hidden size-full wp-image-476335\" data-lazy-type=\"image\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-06.png\" alt=\"The extra context length allows the AI to analyze the data\" width=\"800\" height=\"1666\" srcset=\"\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-476335\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-06.png\" alt=\"The extra context length allows the AI to analyze the data\" width=\"800\" height=\"1666\" srcset=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-06-144x300.png 144w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-06-492x1024.png 492w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-06-768x1599.png 768w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-06-738x1536.png 738w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-06.png 800w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><\/noscript><figcaption id=\"caption-attachment-476335\" class=\"wp-caption-text\">AI absolutely analyzes the logs<\/figcaption><\/figure>\n<p>And have a look at that, with the bigger context window, the AI assistant was capable of undergo the logs and provides us a pleasant write-up about what they present.<\/p>\n<p>I notably just like the shade it threw my means: <em>\u201c\u2026take into account looking for help from \u2026 a certified community engineer.\u201d <\/em>Properly performed, AI. Properly performed.<\/p>\n<p>However bruised ego apart, we will proceed the AI assisted troubleshooting with one thing like this.<\/p>\n<figure id=\"attachment_476336\" aria-describedby=\"caption-attachment-476336\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"lazy lazy-hidden size-full wp-image-476336\" data-lazy-type=\"image\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-07.png\" alt=\"AI helps put a timeline of the problem together\" width=\"800\" height=\"1246\" srcset=\"\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-476336\" src=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-07.png\" alt=\"AI helps put a timeline of the problem together\" width=\"800\" height=\"1246\" srcset=\"https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-07-193x300.png 193w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-07-657x1024.png 657w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-07-768x1196.png 768w, https:\/\/storage.googleapis.com\/blogs-images-new\/ciscoblogs\/1\/2025\/07\/ai-knobs-context-07.png 800w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><\/noscript><figcaption id=\"caption-attachment-476336\" class=\"wp-caption-text\">The AI Assistant places a timeline collectively<\/figcaption><\/figure>\n<p>And we\u2019re off to the races. We\u2019ve been capable of leverage our AI assistant to:<\/p>\n<ol>\n<li>Course of a big quantity of log and debug knowledge to establish potential points<\/li>\n<li>Develop a timeline of the issue (that shall be tremendous helpful within the assist desk ticket and root trigger evaluation paperwork)<\/li>\n<li>Determine some subsequent steps we will do in our troubleshooting efforts.<\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"All_tales_should_finish%E2%80%A6\"><\/span><strong>All tales should finish\u2026<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>And so you might have it, our first AI Nerd Knob\u2014Context Size. Let\u2019s evaluate what we realized:<\/p>\n<ol>\n<li>AI fashions have a \u201cworking reminiscence\u201d that&#8217;s known as \u201ccontext size.\u201d<\/li>\n<li>Context Size is measured in \u201ctokens.\u201d<\/li>\n<li>Oftentimes instances an AI mannequin will assist a better context size than the default setting.<\/li>\n<li>Growing the context size would require extra assets, so make modifications slowly, don\u2019t simply max it out utterly.<\/li>\n<\/ol>\n<p>Now, relying on what AI software you\u2019re utilizing, you might NOT be capable to regulate the context size. When you\u2019re utilizing a public AI like ChatGPT, Gemini, or Claude, the context size will rely upon the subscription and fashions you might have entry to. Nonetheless, there most undoubtedly IS a context size that can issue into how a lot \u201cworking reminiscence\u201d the AI software has. And being conscious of that truth, and its affect on how you should use AI, is essential. Even when the knob in query is behind a lock and key. \ud83d\ude42<\/p>\n<p>When you loved this look beneath the hood of AI and wish to study extra choices, please let me know within the feedback: Do you might have a favourite \u201cknob\u201d you want to show? Share it with all of us. Till subsequent time!<\/p>\n<p><em>PS\u2026 When you\u2019d prefer to be taught extra about utilizing LMStudio, my buddy <a href=\"https:\/\/blogs.cisco.com\/author\/jasonbelk\" target=\"_blank\" rel=\"noopener\">Jason Belk<\/a> put a free tutorial collectively known as <a href=\"https:\/\/u.cisco.com\/tutorials\/run-your-own-llm-locally-for-free-with-ease-26602\" target=\"_blank\" rel=\"noopener\">Run Your Personal LLM Regionally For Free and with Ease<\/a> that may get you began in a short time. Test it out!<\/em><\/p>\n<p style=\"text-align: center;\"><iframe class=\"lazy lazy-hidden\" loading=\"lazy\" title=\"How To Run a Large Language Model (LLM) Locally and with Ease! | Snack Minute Ep. 182\" width=\"640\" height=\"360\" data-lazy-type=\"iframe\" data-src=\"https:\/\/www.youtube-nocookie.com\/embed\/RfdeQmlT_fw?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen=\"\"><\/iframe><noscript><iframe loading=\"lazy\" title=\"How To Run a Large Language Model (LLM) Locally and with Ease! | Snack Minute Ep. 182\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube-nocookie.com\/embed\/RfdeQmlT_fw?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen=\"\"><\/iframe><\/noscript><\/p>\n<p>\u00a0<\/p>\n<p style=\"text-align: center;\" data-ttstextid=\"75\">Join\u00a0<a href=\"https:\/\/u.cisco.com\/?utm_campaign=ciscou&amp;utm_source=blog-cisco&amp;utm_medium=cu-static-blog-footer\" target=\"_blank\" rel=\"noopener\">Cisco U.<\/a>\u00a0| Be a part of the\u202f\u00a0<a href=\"https:\/\/learningnetwork.cisco.com\/s\/?ccid=learning&amp;dtid=blog&amp;oid=blog-cisco-footer\" target=\"_blank\" rel=\"noopener\">Cisco Studying Community<\/a>\u202fimmediately totally free.<\/p>\n<blockquote data-ttstextid=\"76\">\n<h2 style=\"text-align: center;\" data-ttstextid=\"77\"><span class=\"ez-toc-section\" id=\"Be_taught_with_Cisco\"><\/span><strong>Be taught with Cisco<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3 style=\"text-align: center;\" data-ttstextid=\"78\"><span class=\"ez-toc-section\" id=\"X%E2%80%AF%E2%80%AFThreads_Fb%E2%80%AF%E2%80%AFLinkedIn%E2%80%AF%E2%80%AFInstagram%E2%80%AF%E2%80%AFYouTube\"><\/span><strong><a href=\"https:\/\/twitter.com\/LearningatCisco\" target=\"_blank\" rel=\"noopener\">X<\/a>\u202f|\u202f<a href=\"https:\/\/www.threads.net\/@learningatcisco\" target=\"_blank\" rel=\"noopener\">Threads<\/a>\u00a0|\u00a0<a href=\"https:\/\/www.facebook.com\/learningatcisco\" target=\"_blank\" rel=\"noopener\">Fb<\/a>\u202f|\u202f<a href=\"https:\/\/www.linkedin.com\/showcase\/cisco_training_and_certification\" target=\"_blank\" rel=\"noopener\">LinkedIn<\/a>\u202f|\u202f<a href=\"https:\/\/www.instagram.com\/learningatcisco\/\" target=\"_blank\" rel=\"noopener\">Instagram<\/a><\/strong><strong>\u202f|\u202f<a href=\"https:\/\/www.youtube.com\/@CiscoUtube\" target=\"_blank\" rel=\"noopener\">YouTube<\/a><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/blockquote>\n<p style=\"text-align: center;\" data-ttstextid=\"79\">Use\u202f\u00a0<strong>#CiscoU\u00a0<\/strong>and\u00a0<strong>#CiscoCert<\/strong>\u202fto affix the dialog.<\/p>\n<p data-ttstextid=\"79\">Learn subsequent:<\/p>\n<blockquote class=\"wp-embedded-content\" data-secret=\"Tae1KFnedT\">\n<p><a href=\"https:\/\/blogs.cisco.com\/learning\/creating-a-netai-playground-for-agentic-ai-experimentation\" target=\"_blank\" rel=\"noopener\">Making a NetAI Playground for Agentic AI Experimentation<\/a><\/p>\n<\/blockquote>\n<p><iframe loading=\"lazy\" class=\"lazy lazy-hidden wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"\u201cCreating a NetAI Playground for Agentic AI Experimentation\u201d \u2014 Cisco Blogs\" data-lazy-type=\"iframe\" data-src=\"https:\/\/blogs.cisco.com\/learning\/creating-a-netai-playground-for-agentic-ai-experimentation\/embed#?secret=IhNnOcoeW4#?secret=Tae1KFnedT\" data-secret=\"Tae1KFnedT\" width=\"600\" height=\"338\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><noscript><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"\u201cCreating a NetAI Playground for Agentic AI Experimentation\u201d \u2014 Cisco Blogs\" src=\"https:\/\/blogs.cisco.com\/learning\/creating-a-netai-playground-for-agentic-ai-experimentation\/embed#?secret=IhNnOcoeW4#?secret=Tae1KFnedT\" data-secret=\"Tae1KFnedT\" width=\"600\" height=\"338\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><\/noscript><\/p>\n<blockquote class=\"wp-embedded-content\" data-secret=\"YfZpMITLpi\">\n<p><a href=\"https:\/\/blogs.cisco.com\/learning\/let-the-agent-heal-the-network\" target=\"_blank\" rel=\"noopener\">Take an AI Break and Let the Agent Heal the Community<\/a><\/p>\n<\/blockquote>\n<p><iframe loading=\"lazy\" class=\"lazy lazy-hidden wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"\u201cTake an AI Break and Let the Agent Heal the Network\u201d \u2014 Cisco Blogs\" data-lazy-type=\"iframe\" data-src=\"https:\/\/blogs.cisco.com\/learning\/let-the-agent-heal-the-network\/embed#?secret=JFqTnl3jyL#?secret=YfZpMITLpi\" data-secret=\"YfZpMITLpi\" width=\"600\" height=\"338\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><noscript><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"\u201cTake an AI Break and Let the Agent Heal the Network\u201d \u2014 Cisco Blogs\" src=\"https:\/\/blogs.cisco.com\/learning\/let-the-agent-heal-the-network\/embed#?secret=JFqTnl3jyL#?secret=YfZpMITLpi\" data-secret=\"YfZpMITLpi\" width=\"600\" height=\"338\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><\/noscript><\/p>\n<p>Share:<\/p>\n<p>\n  \t<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><script async defer src=\"https:\/\/platform.instagram.com\/en_US\/embeds.js\"><\/script><br \/>\n<br \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Alright, my buddies, I\u2019m again with one other put up primarily based on my learnings and exploration of AI and the way it\u2019ll match into our work as community engineers. In immediately\u2019s put up, I need to share the primary (of what&#8217;s going to possible be many) \u201cnerd knobs\u201d that I believe all of us [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":12164,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":["post-12162","post","type-post","status-publish","format-standard","has-post-thumbnail","category-cloud-computing"],"_links":{"self":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/12162","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=12162"}],"version-history":[{"count":1,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/12162\/revisions"}],"predecessor-version":[{"id":12163,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/12162\/revisions\/12163"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/media\/12164"}],"wp:attachment":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=12162"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=12162"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=12162"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}