{"id":4512,"date":"2025-03-22T02:16:08","date_gmt":"2025-03-21T17:16:08","guid":{"rendered":"https:\/\/aireviewirush.com\/?p=4512"},"modified":"2025-03-22T02:16:09","modified_gmt":"2025-03-21T17:16:09","slug":"hacking-our-option-to-higher-group-conferences","status":"publish","type":"post","link":"https:\/\/aireviewirush.com\/?p=4512","title":{"rendered":"Hacking our option to higher group conferences"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div id=\"\"><img decoding=\"async\" src=\"\/images\/summarizer-header.png\" alt=\"Summarization header image\" width=\"75%\"\/><\/p>\n<p><em>Since this weblog was initially printed, I\u2019ve additionally launched the Distill CLI. You possibly can learn the observe up <a href=\"http:\/\/www.allthingsdistributed.com\/2024\/06\/introducing-distill-cli.html\" target=\"_blank\" rel=\"noopener\">weblog put up<\/a> or tinker with the <a href=\"https:\/\/github.com\/awslabs\/distill-cli\" target=\"_blank\" rel=\"noopener\">code on GitHub<\/a>.<\/em><\/p>\n<hr\/>\n<p>As somebody who takes loads of notes, I\u2019m at all times looking out for instruments and techniques that may assist me to refine my very own note-taking course of (such because the Cornell Technique). And whereas I typically want pen and paper (as a result of it\u2019s proven to assist with retention and synthesis), there\u2019s no denying that expertise might help to reinforce our built-up talents. That is very true in conditions corresponding to conferences, the place actively collaborating and taking notes on the identical time will be in battle with each other. The distraction of trying right down to jot down notes or tapping away on the keyboard could make it arduous to remain engaged within the dialog, because it forces us to make fast selections about what particulars are necessary, and there\u2019s at all times the chance of lacking necessary particulars whereas attempting to seize earlier ones. To not point out, when confronted with back-to-back-to-back conferences, the problem of summarizing and extracting necessary particulars from pages of notes is compounding \u2013 and when thought-about at a gaggle degree, there&#8217;s <a href=\"https:\/\/hbr.org\/2017\/07\/stop-the-meeting-madness\" target=\"_blank\" rel=\"noopener\">important particular person and group time waste<\/a> in fashionable enterprise with a majority of these administrative overhead.<\/p>\n<p>Confronted with these issues each day, my group \u2013 a small tiger group I wish to name OCTO (Workplace of the CTO) \u2013 noticed a chance to make use of AI to enhance our group conferences. They&#8217;ve developed a easy, and simple proof of idea for ourselves, that makes use of AWS providers like Lambda, Transcribe, and Bedrock to transcribe and summarize our digital group conferences. It permits us to assemble notes from our conferences, however keep centered on the dialog itself, because the granular particulars of the dialogue are robotically captured (it even creates a listing of to-dos). And as we speak, we\u2019re open sourcing the software, which our group calls \u201cDistill\u201d, within the hopes that others would possibly discover this handy as effectively: <a href=\"https:\/\/github.com\/aws-samples\/amazon-bedrock-audio-summarizer\" target=\"_blank\" rel=\"noopener\">https:\/\/github.com\/aws-samples\/amazon-bedrock-audio-summarizer<\/a>.<\/p>\n<p>On this put up, I\u2019ll stroll you thru the high-level structure of our challenge, the way it works, and provide you with a preview of how I\u2019ve been working alongside <a href=\"https:\/\/aws.amazon.com\/q\/\" target=\"_blank\" rel=\"noopener\">Amazon Q Developer<\/a> to show Distill right into a Rust CLI.<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_53 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title \" >Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\" role=\"button\"><label for=\"item-69e697517ebbf\" ><span class=\"\"><span style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input aria-label=\"Toggle\" aria-label=\"item-69e697517ebbf\"  type=\"checkbox\" id=\"item-69e697517ebbf\"><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/aireviewirush.com\/?p=4512\/#The_anatomy_of_a_easy_audio_summarization_app\" title=\"The anatomy of a easy audio summarization app \">The anatomy of a easy audio summarization app <\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/aireviewirush.com\/?p=4512\/#Utilizing_Distill\" title=\"Utilizing Distill \">Utilizing Distill <\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/aireviewirush.com\/?p=4512\/#There%E2%80%99s_worth_in_chipping_away_at_on_a_regular_basis_issues\" title=\"There\u2019s worth in chipping away at on a regular basis issues \">There\u2019s worth in chipping away at on a regular basis issues <\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/aireviewirush.com\/?p=4512\/#Constructing_a_Rust_CLI_from_scratch\" title=\"Constructing a Rust CLI from scratch \">Constructing a Rust CLI from scratch <\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/aireviewirush.com\/?p=4512\/#Coming_quicklymldr\" title=\"Coming quickly&amp;mldr; \">Coming quickly&amp;mldr; <\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/aireviewirush.com\/?p=4512\/#Beneficial_posts\" title=\"Beneficial posts \">Beneficial posts <\/a><\/li><\/ul><\/nav><\/div>\n<h2 id=\"the-anatomy-of-a-simple-audio-summarization-app\"><span class=\"ez-toc-section\" id=\"The_anatomy_of_a_easy_audio_summarization_app\"><\/span>The anatomy of a easy audio summarization app <a href=\"#the-anatomy-of-a-simple-audio-summarization-app\"\/><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The app itself is easy \u2014 and that is intentional. I subscribe to the concept methods needs to be made so simple as doable, however no easier. First, we add an audio file of our assembly to an S3 bucket. Then an S3 set off notifies a Lambda operate, which initiates the transcription course of. An Occasion Bridge rule is used to robotically invoke a second Lambda operate when any Transcribe job starting with <code>summarizer-<\/code> has a newly up to date standing of <code>COMPLETED<\/code>. As soon as the transcription is full, this Lambda operate takes the transcript and sends it with an instruction immediate to Bedrock to create a abstract. In our case, we\u2019re utilizing Claude 3 Sonnet for inference, however you possibly can adapt the code to make use of any mannequin out there to you in Bedrock. When inference is full, the abstract of our assembly \u2014 together with high-level takeaways and any to-dos \u2014 is saved again in our S3 bucket.<\/p>\n<p><img decoding=\"async\" src=\"\/images\/summarizer-architecture.png\" alt=\"Distill architecture diagram\" loading=\"lazy\"\/><\/p>\n<p>I\u2019ve spoken many occasions in regards to the significance of treating infrastructure as code, and as such, we\u2019ve used the AWS CDK to handle this challenge\u2019s infrastructure. The CDK provides us a dependable, constant option to deploy assets, and be certain that infrastructure is sharable to anybody. Past that, it additionally gave us a great way to quickly iterate on our concepts.<\/p>\n<h2 id=\"using-distill\"><span class=\"ez-toc-section\" id=\"Utilizing_Distill\"><\/span>Utilizing Distill <a href=\"#using-distill\"\/><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>In case you do that (and I hope that you&#8217;ll), the setup is fast. Clone the <a href=\"https:\/\/github.com\/aws-samples\/amazon-bedrock-audio-summarizer\" target=\"_blank\" rel=\"noopener\">repo<\/a>, and observe the steps within the README to deploy the app infrastructure to your account utilizing the CDK. After that, there are two methods to make use of the software:<\/p>\n<ol>\n<li>Drop an audio file straight into the <code>supply<\/code> folder of the S3 bucket created for you, wait a couple of minutes, then view the ends in the <code>processed<\/code> folder.<\/li>\n<li>Use the Jupyter pocket book we put collectively to step by means of the method of importing audio, monitoring the transcription, and retrieving the audio abstract.<\/li>\n<\/ol>\n<p>Right here\u2019s an instance output (minimally sanitized) from a latest OCTO group assembly that solely a part of the group was in a position to attend:<\/p>\n<blockquote>\n<p>Here&#8217;s a abstract of the dialog in readable paragraphs:<\/p>\n<p>The group mentioned potential content material concepts and approaches for upcoming occasions like VivaTech, and re:Invent. There have been strategies round keynotes versus having fireplace chats or panel discussions. The significance of crafting thought-provoking upcoming occasions was emphasised.<\/p>\n<p>Recapping Werner\u2019s latest Asia tour, the group mirrored on the highlights like partaking with native college college students, builders, startups, and underserved communities. Indonesia\u2019s initiatives round incapacity inclusion have been praised. Helpful suggestions was shared on logistics, balancing work with downtime, and optimum occasion codecs for Werner. The group plans to analyze turning these learnings into an inner publication.<\/p>\n<p>Different matters lined included upcoming advisory conferences, which Jeff could attend nearly, and the evolving position of the fashionable CTO with elevated deal with social affect and world views.<\/p>\n<p>Key motion objects:<\/p>\n<ul>\n<li>Reschedule group assembly to subsequent week<\/li>\n<li>Lisa to flow into upcoming advisory assembly agenda when out there<\/li>\n<li>Roger to draft potential panel questions for VivaTech<\/li>\n<li>Discover recording\/streaming choices for VivaTech panel<\/li>\n<li>Decide content material possession between groups for summarizing Asia tour highlights<\/li>\n<\/ul>\n<\/blockquote>\n<p>What\u2019s extra, the group has created a Slack webhook that robotically posts these summaries to a group channel, in order that those that couldn\u2019t attend can make amends for what was mentioned and rapidly assessment motion objects.<\/p>\n<p>Bear in mind, AI will not be good. A number of the summaries we get again, the above included, have errors that want handbook adjustment. However that\u2019s okay, as a result of it nonetheless hastens our processes. It\u2019s merely a reminder that we should nonetheless be discerning and concerned within the course of. Vital pondering is as necessary now because it has ever been.<\/p>\n<h2 id=\"theres-value-in-chipping-away-at-everyday-problems\"><span class=\"ez-toc-section\" id=\"There%E2%80%99s_worth_in_chipping_away_at_on_a_regular_basis_issues\"><\/span>There\u2019s worth in chipping away at on a regular basis issues <a href=\"#theres-value-in-chipping-away-at-everyday-problems\"\/><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>This is only one instance of a easy app that may be constructed rapidly, deployed within the cloud, and result in organizational efficiencies. Relying on which research you have a look at, round 30% of company staff say that they don\u2019t full their motion objects as a result of they will\u2019t bear in mind key info from conferences. We are able to begin to chip away at stats like that by having tailor-made notes delivered to you instantly after a gathering, or an assistant that robotically creates work objects from a gathering and assigns them to the suitable particular person. It\u2019s not at all times about fixing the \u201clarge\u201d downside in a single swoop with expertise. Generally it\u2019s about chipping away at on a regular basis issues. Discovering easy options that turn out to be the muse for incremental and significant innovation.<\/p>\n<p>I\u2019m notably considering the place this goes subsequent. We now stay in a world the place an AI powered bot can sit in your calls and may act in actual time. Taking notes, answering questions, monitoring duties, eradicating PII, even trying issues up that will have in any other case been distracting and slowing down the decision whereas one particular person tried to seek out the information. By sharing our easy app, the intention isn\u2019t to point out off \u201cone thing shiny and new\u201d, it\u2019s to point out you that if we are able to construct it, so are you able to. And I\u2019m curious to see how the open-source group will use it. How they\u2019ll lengthen it. What they\u2019ll create on high of it. And that is what I discover actually thrilling \u2014 the potential for easy AI-based instruments to assist us in increasingly more methods. Not as replacements for human ingenuity, however aides that make us higher.<\/p>\n<p>To that finish, engaged on this challenge with my group has impressed me to take alone pet challenge: turning this software right into a Rust CLI.<\/p>\n<h2 id=\"building-a-rust-cli-from-scratch\"><span class=\"ez-toc-section\" id=\"Constructing_a_Rust_CLI_from_scratch\"><\/span>Constructing a Rust CLI from scratch <a href=\"#building-a-rust-cli-from-scratch\"\/><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>I blame <a href=\"https:\/\/brooker.co.za\/blog\/\" target=\"_blank\" rel=\"noopener\">Marc Brooker<\/a> and <a href=\"https:\/\/shufflesharding.com\/\" target=\"_blank\" rel=\"noopener\">Colm MacC\u00e1rthaigh<\/a> for turning me right into a Rust fanatic. I&#8217;m a methods programmer at coronary heart, and that coronary heart began to beat lots quicker the extra acquainted I bought with the language. And it turned much more necessary to me after coming throughout <a href=\"https:\/\/greenlab.di.uminho.pt\/wp-content\/uploads\/2017\/09\/paperSLE.pdf\" target=\"_blank\" rel=\"noopener\">Rui Pereira\u2019s fantastic analysis<\/a> on the vitality, time, and reminiscence consumption of various programming languages, once I realized it\u2019s great potential to assist us construct extra sustainably within the cloud.<\/p>\n<p>Throughout our experiments with Distill, we needed to see what impact transferring a operate from Python to Rust would appear like. With the CDK, it was straightforward to make a fast change to our stack that permit us transfer a Lambda operate to the AL2023 runtime, then deploy a Rust-based model of the code. In case you\u2019re curious, the operate averaged chilly begins that have been 12x quicker (34ms vs 410ms) and used 73% much less reminiscence (21MB vs 79MB) than its Python variant. Impressed, I made a decision to actually get my fingers soiled. I used to be going to show this challenge right into a command line utility, and put a few of what I\u2019ve realized in Ken Youens-Clark\u2019s \u201c<a href=\"https:\/\/www.amazon.com\/Command-Line-Rust-Project-Based-Primer-Writing\/dp\/1098109430\" target=\"_blank\" rel=\"noopener\">Command Line Rust<\/a>\u201d into observe.<\/p>\n<p>I\u2019ve at all times liked working from the command line. Each <code>grep<\/code>, <code>cat<\/code>, and <code>curl<\/code> into that little black field jogs my memory loads of driving an outdated automotive. It could be just a little bit tougher to show, it would make some noises and complain, however you are feeling a connection to the machine. And being energetic with the code, very similar to taking notes, helps issues stick.<\/p>\n<p>Not being a Rust guru, I made a decision to place Q to the check. I nonetheless have loads of questions in regards to the language, idioms, the possession mannequin, and customary libraries I\u2019d seen in pattern code, like Tokio. If I\u2019m being trustworthy, studying the right way to interpret what the compiler is objecting to might be the toughest half for me of programming in Rust. With Q open in my IDE, it was straightforward to fireside off \u201csilly\u201d questions with out stigma, and utilizing the references it offered meant that I didn\u2019t need to dig by means of troves of documentation.<\/p>\n<p><img decoding=\"async\" src=\"\/images\/summarizer-tokio.png\" alt=\"Summary of Tokio\" loading=\"lazy\"\/><\/p>\n<p>Because the CLI began to take form, Q performed a extra important position, offering deeper insights that knowledgeable coding and design selections. As an example, I used to be curious whether or not utilizing slice references would introduce inefficiencies with massive lists of things. Q promptly defined that whereas slices of arrays could possibly be extra environment friendly than creating new arrays, there\u2019s a risk of efficiency impacts at scale. It felt like a dialog \u2013 I may bounce concepts off of Q, freely ask observe up questions, and obtain instant, non-judgmental responses.<\/p>\n<p><img decoding=\"async\" src=\"\/images\/summarizer-slices.png\" alt=\"Advice from Q on slices in Rust\" loading=\"lazy\"\/><\/p>\n<p>The very last thing I\u2019ll point out is the function to ship code on to Q. I\u2019ve been experimenting with code refactoring and optimization, and it has helped me construct a greater understanding of Rust, and pushed me to assume extra critically in regards to the code I\u2019ve written. It goes to point out simply how necessary it&#8217;s to create instruments that meet builders the place they\u2019re already comfy \u2014 in my case, the IDE.<\/p>\n<p><img decoding=\"async\" src=\"\/images\/summarizer-send-to-q.png\" alt=\"Send code to Q\" loading=\"lazy\"\/><\/p>\n<h2 id=\"coming-soon\"><span class=\"ez-toc-section\" id=\"Coming_quicklymldr\"><\/span>Coming quickly&amp;mldr; <a href=\"#coming-soon\"\/><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Within the subsequent few weeks, the plan is to share my code for my Rust CLI. I want a little bit of time to shine this off, and have people with a bit extra expertise assessment it, however right here\u2019s a sneak peek:<\/p>\n<p><img decoding=\"async\" src=\"\/images\/summarizer-cli.png\" alt=\"Sneak peak of the Rust CLI\" loading=\"lazy\"\/><\/p>\n<p>As at all times, now go construct! And get your fingers soiled whereas doing it.<\/p>\n<h2 id=\"recommended-posts\"><span class=\"ez-toc-section\" id=\"Beneficial_posts\"><\/span>Beneficial posts <a href=\"#recommended-posts\"\/><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"<p>Since this weblog was initially printed, I\u2019ve additionally launched the Distill CLI. You possibly can learn the observe up weblog put up or tinker with the code on GitHub. As somebody who takes loads of notes, I\u2019m at all times looking out for instruments and techniques that may assist me to refine my very own [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":4514,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":{"0":"post-4512","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-cloud-computing"},"_links":{"self":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/4512","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4512"}],"version-history":[{"count":1,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/4512\/revisions"}],"predecessor-version":[{"id":4513,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/4512\/revisions\/4513"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/media\/4514"}],"wp:attachment":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4512"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4512"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4512"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}