By now we've all started
to experience the power of generative AI with large
language models like GPT. Using a single prompt,
you can create content from existing data. In fact, by giving the model
access to more specific information in your
prompts, it can generate more relevant content and
responses in a fraction of the time it would take
for you to do it yourself. These services provide a lot
of productivity advantages, but can you harness them
while still retaining control over your organization's data? Today I will show you how your
organization can safely use generative AI with a closer
look at Bing Chat Enterprise and its built-in
commercial data protection. It uses GPT-4, included
already as part of the service, and because it's included
with your Microsoft 365 Business subscription, it's available for small organizations up
to the largest enterprises. Let's start by looking at
what Bing Chat Enterprise is and is not, along with some
of the fundamental differences to public services like Chat
GPT that you might be familiar with, and how Bing Chat
Enterprise protects your data. The consumer Bing Chat service
is an AI-powered chat bot. One of the core things that
differentiates Bing Chat is that it's grounded in
up-to-date public web data. There is no knowledge cutoff based on when the model was trained. I'll prompt Bing Chat with
something tied to an event from the last couple of months. Where is Lionel Messi
playing football these days? As you can see, Bing's public search index grounds to the large language
model with up-to-the-minute results using knowledge from the internet. Notice how distinct to the
Bing experience the responses followed by source citations
that you can always review to spot hallucinations
in the model's output. Let's try something else by asking it to write a poem about
Lionel Messi's career. Here you can see a poem generated
based on the information and context available to it,
and it knew when I typed his, I was referring to Lionel Messi, so it's not constrained
by a lack of knowledge. The underlying tech platform
is constantly optimized for search relevance to ground
the large language model, and the experience is
continuously evolving. For example, beyond text
outputs, Bing Chat also provides access to other large language
models like DALL-E for more visual content generation
with its Bing Image Creator. Now, what I've shown you
up until this point is the consumer Bing Chat experience and Bing Chat Enterprise builds on this. It is still a web-based experience, but with some key differentiations. Most importantly, Bing Chat
Enterprise addresses legitimate concerns as to where your
prompts and responses are stored and how this information
might be used in the future. First, you can get to the
experience in three ways. You can access it from Bing.com, the Microsoft Edge sidebar,
and from Windows Copilot. Let's try the experience out on Bing.com. Notice it is an
authenticated web experience. Access to the service is
controlled using the same Microsoft Entra ID system used to
provide secure access to Microsoft 365 for your
work or school accounts. I'm signed in here with
my Entra ID work account. On my other desktop, I have my notes with specs
for an unreleased product. Let's say I want to write
a value prop for it, so I'll copy all of the text. Now, I'll prompt use this
information to write me a short value proposition on
the Contoso Thunderbolt eBike and paste in everything
from the clipboard, and you'll see that Bing
Chat Enterprise knows how to write a value prop,
generating a response based on the information that I provided. Next, I'll ask Bing Chat
Enterprise to compare specs of the top three eBikes
in the market in 2023, and after, introducing each eBike, it provides a detailed tabular
summary of key features and components for each eBike
along with the citations. And if we fast forward in
time to when the value prop is finished as a multi-page PDF file, then I can use the Edge sidebar
to parse all the information in this PDF to generate social
posts for our product launch. While Bing Chat Enterprise works on that, let me show you the rest of this PDF file on the left and what it's parsing through. Without doing this, I would
have needed to copy and paste each of these sections
in the PDF one by one, and now I don't have to. After a few seconds, it's saved
me a lot of time and written me some great draft social
posts to quickly get started. Now, let's review what we just saw. First, I allowed the model to
compare the confidential specs of our unreleased product with information on competitive offerings publicly
available on the internet, and even started preparing
for our social campaign. And I can feel confident in doing this because the conversation
history is not retained and there is no risk
of the data being used to train the underlying
large language model. I'll close this browser
tab with a PDF and then hit the new topic button in
this window with my spec and initial value prop, and
when I do, behind the scenes, the temporary information
stored and processed in the Bing Chat service is deleted,
including all memory of the PDF. It's gone. As a point of reference, let's go back to the Bing
Chat consumer experience. Whereas you can see on the
left under recent activity my chat history was recorded,
whereas with Bing Chat Enterprise on the right,
we've started a new session and there is no recent activity displayed. Because Microsoft purges this information and it's not stored anywhere, it also means that from
Microsoft 365 admins, there is no reporting or
auditing of that data available. That said, you do have a few controls as a Microsoft 365 admin. Using the licensing controls
at the user or group level, you can configure the on-off
state of the Bing Chat Enterprise service for
anyone in your tenant. For the Edge sidebar,
as we used with our PDF, there are controls to enable or disable whether Edge can use browser context. As a user, and if your policy permits it, you can control this in
your Edge browser settings. Under app and notification
settings in Bing Chat, you can choose to allow
access to any webpage or PDF. And for
administrators, these settings are also available in group policy or, as you can see here in the
Intune settings catalog, and you'll find them under
Microsoft Edge settings. So that's what the core
Bing Chat Enterprise service experience is and how it works. A question we get a lot is
how it compares with Microsoft 365 Copilot and there are
three main differences. First, Microsoft 365 Copilot operates entirely inside your tenant boundary. Your data never leaves that boundary. Second, Microsoft 365 Copilot
can access and orchestrate your work data, including
your emails, documents, and meetings, via the Microsoft Graph. It automatically retrieves this
information and presents it to the large language model to generate a relevant grounded response. Lastly, those experiences are tailored to the specific Microsoft
365 apps you're using. In contrast, Bing Chat Enterprise
is a separate service from Microsoft 365 that operates
outside that tenant boundary. Its main information source
is the public internet. It has no access to your
internal company data. As demonstrated, you can
safely augment your prompts by pasting in organizational
data, and the service can combine this with
knowledge from the web. All data is processed in the
Bing Chat Enterprise service and is presented to the
underlying large language model to generate a response, which
includes a system prompt to help frame responses based
on responsible AI practices. Again, chat data is only
temporarily held during your open session and purged with
each new chat session. So that was an overview
of Bing Chat Enterprise and how it can safely
let your organization reap the benefits of generative AI today. If you're considering
Microsoft 365 Copilot, while you prepare your environment, Bing Chat Enterprise gives
you an immediate and safe solution for you to take
advantage of generative AI and for Microsoft 365 business users, it is at no additional cost. To learn more, check out aka.ms/BCEdocs. Subscribe to Microsoft
Mechanics for the latest in tech updates, and
thank you for watching.
