{"id":1636,"date":"2025-10-24T12:39:38","date_gmt":"2025-10-24T12:39:38","guid":{"rendered":"https:\/\/pacific.ai\/staging\/3667\/?p=1636"},"modified":"2026-04-03T16:52:25","modified_gmt":"2026-04-03T16:52:25","slug":"responsible-llm-deployment-in-practice-at-brook-health","status":"publish","type":"post","link":"https:\/\/pacific.ai\/staging\/3667\/responsible-llm-deployment-in-practice-at-brook-health\/","title":{"rendered":"Responsible LLM Deployment in Practice at Brook Health"},"content":{"rendered":"<div id=\"bsf_rt_marker\"><\/div>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Responsible LLM Deployment in Practice at Brook Health\" width=\"580\" height=\"326\" src=\"https:\/\/www.youtube.com\/embed\/Kubip8mIHYI?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n<p>As healthcare organizations embrace large language models (LLMs), the need for robust governance and systematic evaluation becomes mission critical. This session describes Brook AI\u2019s journey to becoming a world-class AI governance organization \u2013 highlighting the processes, architectures, and tools that made it possible.<\/p>\n<p>Brook AI delivers remote patient care, blending clinical teams with AI for continuous, always-on patient support. To evolve from early trials to an enterprise-ready foundation for generative AI deployment, Brook partnered with Pacific AI to implement a comprehensive governance framework aligned with NIST AI RMF, ISO 42001, CHAI, state laws, and federal regulations. This included policy rollouts, stakeholder training, automated governance tooling, and a full architecture and security review of Brook\u2019s multi-agent LLM-based platform.<\/p>\n<p>Brook also embedded LLM-based agent testing directly into its development lifecycle and CI\/CD pipelines. Together, the teams created a rigorous benchmark suite covering key aspects of responsible AI in healthcare: fairness, accountability, transparency, explainability, robustness, safety, privacy, and accessibility. The suite was reviewed by healthcare professionals and applied to real-world scenarios mirroring clinician\u2013patient conversations. It also enables comparative evaluations of Brook\u2019s domain-specific agentic AI configurations against general-purpose LLMs such as ChatGPT, and incorporates automated daily evaluations with LLM-as-a-judge plus continuous monitoring for drift and safety incidents in production.<\/p>\n<p>Attendees will leave with a clear blueprint for integrating AI governance into clinical GenAI applications \u2013 demonstrating that safety, compliance, and innovation can co-exist at scale.<\/p>","protected":false},"excerpt":{"rendered":"<p>As healthcare organizations embrace large language models (LLMs), the need for robust governance and systematic evaluation becomes mission critical. This session describes Brook AI\u2019s journey to becoming a world-class AI governance organization \u2013 highlighting the processes, architectures, and tools that made it possible. Brook AI delivers remote patient care, blending clinical teams with AI for [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2577,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"nf_dc_page":"","content-type":"","inline_featured_image":false,"footnotes":""},"categories":[119,10],"tags":[],"class_list":["post-1636","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-case-studies","category-video"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Responsible LLM Deployment in Practice at Brook Health - Pacific AI<\/title>\n<meta name=\"description\" content=\"Webinar on responsible LLM deployment in healthcare with Brook AI and Pacific AI showing how governance, testing, and compliance enable safe innovation.\" \/>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Responsible LLM Deployment in Practice at Brook Health - Pacific AI\" \/>\n<meta property=\"og:description\" content=\"Webinar on responsible LLM deployment in healthcare with Brook AI and Pacific AI showing how governance, testing, and compliance enable safe innovation.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/\" \/>\n<meta property=\"og:site_name\" content=\"Pacific AI\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/people\/Pacific-AI\/61566807347567\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-10-24T12:39:38+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-03T16:52:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/pacific.ai\/wp-content\/uploads\/2025\/10\/resp_llm_2.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"550\" \/>\n\t<meta property=\"og:image:height\" content=\"440\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"David Talby\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Talby\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/\"},\"author\":{\"name\":\"David Talby\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#\\\/schema\\\/person\\\/8a2b4d5d75c8752d83ae6bb1d44e0186\"},\"headline\":\"Responsible LLM Deployment in Practice at Brook Health\",\"datePublished\":\"2025-10-24T12:39:38+00:00\",\"dateModified\":\"2026-04-03T16:52:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/\"},\"wordCount\":249,\"publisher\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/10\\\/resp_3.webp\",\"articleSection\":[\"Case studies\",\"Video\"],\"inLanguage\":\"en\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/\",\"url\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/\",\"name\":\"Responsible LLM Deployment in Practice at Brook Health - Pacific AI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/10\\\/resp_3.webp\",\"datePublished\":\"2025-10-24T12:39:38+00:00\",\"dateModified\":\"2026-04-03T16:52:25+00:00\",\"description\":\"Webinar on responsible LLM deployment in healthcare with Brook AI and Pacific AI showing how governance, testing, and compliance enable safe innovation.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/#breadcrumb\"},\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/#primaryimage\",\"url\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/10\\\/resp_3.webp\",\"contentUrl\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/10\\\/resp_3.webp\",\"width\":550,\"height\":440},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/responsible-llm-deployment-in-practice-at-brook-health\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/pacific.ai\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Responsible LLM Deployment in Practice at Brook Health\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#website\",\"url\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/\",\"name\":\"Pacific AI\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#organization\",\"name\":\"Pacific AI\",\"url\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/site_logo.svg\",\"contentUrl\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/site_logo.svg\",\"width\":182,\"height\":41,\"caption\":\"Pacific AI\"},\"image\":{\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/people\\\/Pacific-AI\\\/61566807347567\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/pacific-ai\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/#\\\/schema\\\/person\\\/8a2b4d5d75c8752d83ae6bb1d44e0186\",\"name\":\"David Talby\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/03\\\/David_portret-96x96.webp\",\"url\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/03\\\/David_portret-96x96.webp\",\"contentUrl\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/wp-content\\\/uploads\\\/2025\\\/03\\\/David_portret-96x96.webp\",\"caption\":\"David Talby\"},\"description\":\"David Talby is a CTO at Pacific AI, helping healthcare &amp; life science companies put AI to good use. David is the creator of Spark NLP \u2013 the world\u2019s most widely used natural language processing library in the enterprise. He has extensive experience building and running web-scale software platforms and teams \u2013 in startups, for Microsoft\u2019s Bing in the US and Europe, and to scale Amazon\u2019s financial systems in Seattle and the UK. David holds a PhD in computer science and master\u2019s degrees in both computer science and business administration.\",\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/in\\\/davidtalby\\\/\"],\"url\":\"https:\\\/\\\/pacific.ai\\\/staging\\\/3667\\\/author\\\/david\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Responsible LLM Deployment in Practice at Brook Health - Pacific AI","description":"Webinar on responsible LLM deployment in healthcare with Brook AI and Pacific AI showing how governance, testing, and compliance enable safe innovation.","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"Responsible LLM Deployment in Practice at Brook Health - Pacific AI","og_description":"Webinar on responsible LLM deployment in healthcare with Brook AI and Pacific AI showing how governance, testing, and compliance enable safe innovation.","og_url":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/","og_site_name":"Pacific AI","article_publisher":"https:\/\/www.facebook.com\/people\/Pacific-AI\/61566807347567\/","article_published_time":"2025-10-24T12:39:38+00:00","article_modified_time":"2026-04-03T16:52:25+00:00","og_image":[{"width":550,"height":440,"url":"https:\/\/pacific.ai\/wp-content\/uploads\/2025\/10\/resp_llm_2.webp","type":"image\/webp"}],"author":"David Talby","twitter_card":"summary_large_image","twitter_misc":{"Written by":"David Talby","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/#article","isPartOf":{"@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/"},"author":{"name":"David Talby","@id":"https:\/\/pacific.ai\/staging\/3667\/#\/schema\/person\/8a2b4d5d75c8752d83ae6bb1d44e0186"},"headline":"Responsible LLM Deployment in Practice at Brook Health","datePublished":"2025-10-24T12:39:38+00:00","dateModified":"2026-04-03T16:52:25+00:00","mainEntityOfPage":{"@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/"},"wordCount":249,"publisher":{"@id":"https:\/\/pacific.ai\/staging\/3667\/#organization"},"image":{"@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/#primaryimage"},"thumbnailUrl":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/10\/resp_3.webp","articleSection":["Case studies","Video"],"inLanguage":"en"},{"@type":"WebPage","@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/","url":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/","name":"Responsible LLM Deployment in Practice at Brook Health - Pacific AI","isPartOf":{"@id":"https:\/\/pacific.ai\/staging\/3667\/#website"},"primaryImageOfPage":{"@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/#primaryimage"},"image":{"@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/#primaryimage"},"thumbnailUrl":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/10\/resp_3.webp","datePublished":"2025-10-24T12:39:38+00:00","dateModified":"2026-04-03T16:52:25+00:00","description":"Webinar on responsible LLM deployment in healthcare with Brook AI and Pacific AI showing how governance, testing, and compliance enable safe innovation.","breadcrumb":{"@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/#breadcrumb"},"inLanguage":"en","potentialAction":[{"@type":"ReadAction","target":["https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/"]}]},{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/#primaryimage","url":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/10\/resp_3.webp","contentUrl":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/10\/resp_3.webp","width":550,"height":440},{"@type":"BreadcrumbList","@id":"https:\/\/pacific.ai\/responsible-llm-deployment-in-practice-at-brook-health\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/pacific.ai\/"},{"@type":"ListItem","position":2,"name":"Responsible LLM Deployment in Practice at Brook Health"}]},{"@type":"WebSite","@id":"https:\/\/pacific.ai\/staging\/3667\/#website","url":"https:\/\/pacific.ai\/staging\/3667\/","name":"Pacific AI","description":"","publisher":{"@id":"https:\/\/pacific.ai\/staging\/3667\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/pacific.ai\/staging\/3667\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en"},{"@type":"Organization","@id":"https:\/\/pacific.ai\/staging\/3667\/#organization","name":"Pacific AI","url":"https:\/\/pacific.ai\/staging\/3667\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/pacific.ai\/staging\/3667\/#\/schema\/logo\/image\/","url":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/06\/site_logo.svg","contentUrl":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/06\/site_logo.svg","width":182,"height":41,"caption":"Pacific AI"},"image":{"@id":"https:\/\/pacific.ai\/staging\/3667\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/people\/Pacific-AI\/61566807347567\/","https:\/\/www.linkedin.com\/company\/pacific-ai\/"]},{"@type":"Person","@id":"https:\/\/pacific.ai\/staging\/3667\/#\/schema\/person\/8a2b4d5d75c8752d83ae6bb1d44e0186","name":"David Talby","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/03\/David_portret-96x96.webp","url":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/03\/David_portret-96x96.webp","contentUrl":"https:\/\/pacific.ai\/staging\/3667\/wp-content\/uploads\/2025\/03\/David_portret-96x96.webp","caption":"David Talby"},"description":"David Talby is a CTO at Pacific AI, helping healthcare &amp; life science companies put AI to good use. David is the creator of Spark NLP \u2013 the world\u2019s most widely used natural language processing library in the enterprise. He has extensive experience building and running web-scale software platforms and teams \u2013 in startups, for Microsoft\u2019s Bing in the US and Europe, and to scale Amazon\u2019s financial systems in Seattle and the UK. David holds a PhD in computer science and master\u2019s degrees in both computer science and business administration.","sameAs":["https:\/\/www.linkedin.com\/in\/davidtalby\/"],"url":"https:\/\/pacific.ai\/staging\/3667\/author\/david\/"}]}},"_links":{"self":[{"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/posts\/1636","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/comments?post=1636"}],"version-history":[{"count":6,"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/posts\/1636\/revisions"}],"predecessor-version":[{"id":2455,"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/posts\/1636\/revisions\/2455"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/media\/2577"}],"wp:attachment":[{"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/media?parent=1636"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/categories?post=1636"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pacific.ai\/staging\/3667\/wp-json\/wp\/v2\/tags?post=1636"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}