Salesforce Introduces Agentforce Testing Center: First-of-Its-Kind AI Agent Lifecycle Management Tooling for Testing Autonomous AI Agents at Scale
November 20 2024 - 12:26PM
Business Wire
Agentforce Testing Center enables teams to test
Agentforce using synthetically generated data, ensuring accurate
responses and actions — with complete monitoring of usage and
feedback
New Data Cloud Sandboxes and Digital Wallet
enhancements enable teams to test the entire AI and data lifecycle
in secure test environments while transparently managing and
optimizing costs
Salesforce (NYSE: CRM), the world’s #1 AI CRM, today announced
agentic lifecycle management tools to automate Agentforce testing,
prototype agents in secure Sandbox environments, and transparently
manage usage at scale.
AI agents are a new paradigm in software. They are intelligent
systems that can reason and act on behalf of customers and
employees. But to realize their full potential, agents need to be
tested and configured without disrupting live production
environments. This new toolchain — the first of its kind in the
industry — will enable teams to test, deploy, and monitor AI agents
with Agentforce at scale, with confidence, enabling every
enterprise to become “agent-first.”
“Agentforce is helping businesses create a limitless workforce.
To deliver this value fast, CIOs need new tools for testing and
monitoring agentic systems,” said Adam Evans, EVP and GM for
Salesforce AI Platform. “Salesforce introduced the concept of
Application Lifecycle Management back in 2006 with Force.com. This
new category of Agentic Lifecycle Management requires unique tools,
and Salesforce is meeting the moment again with Agentforce Testing
Center, which will help companies roll out trusted AI agents with
no-code tools for testing, deploying, and monitoring in a secure,
repeatable way.”
Innovation in action: Other vendors lack the necessary
capabilities for customers to run the appropriate tests on their AI
before deploying, which can lead to hallucinations, inaccurate
results, and substandard customer experiences. Agentforce Testing
Center — built on the enterprise-grade Salesforce Platform and
integrated with Data Cloud — enables every organization to easily
test and monitor AI agents so that they can deploy with
confidence.
New capabilities include:
- AI-generated tests for Agentforce: Teams building with
Agentforce need to accurately test all of the different ways a
customer may pose a question or interact with an agent. In addition
to Agent Builder, which features a Plan Tracer for investigating
the reasoning process of an agent, the new Agentforce Testing
Center enables teams to test topic and action selection at scale.
Using natural language instructions, Testing Center can
auto-generate hundreds of synthetic interactions — such as requests
a customer may make when engaging with Agentforce Service Agent —
then test them in parallel to see how frequently they result in the
right outcome. Teams can then use the test data to refine
instructions so the expected topic is more frequently selected,
improving the end customer experience.
- Sandboxes for Agentforce and Data Cloud: Teams looking
to test Agentforce need to do so in safe, isolated environments.
Generally available today, Salesforce Sandboxes — mirror images of
your production org’s data and configurations — now support both
Data Cloud and Agentforce. By replicating the org’s data and
metadata into a risk-free environment, development teams can
rapidly assemble their unstructured data foundation and rigorously
prototype Agentforce without fear of disrupting the business. Now
teams can perform UAT (User Acceptance Testing) with an initial set
of users to ensure that Agentforce performs the tasks that it’s
intended to accomplish, then migrate those changes to production
using familiar tools such as Change Sets, DevOps Center, and the
Salesforce CLI that now support Data Cloud and Agentforce.
- Monitoring and observability for Agentforce: With the
general availability of Data Cloud Sandboxes, the full Einstein
Trust Layer can be tested in a secure, pre-production environment,
enabling rapid configuration of Agentforce agents and Prompt
Templates. With the Einstein Trust Layer’s audit trail and feedback
store in sandboxes, teams can build a closed loop for AI testing —
iterating on prompts and actions based on user feedback. And once
Agentforce is live in production, new capabilities for granular
insights into adoption and accuracy become available through
Agentforce Analytics and Utterance Analysis — new observability
solutions built natively on Data Cloud for continuous iteration
while moving through the Agentforce lifecycle.
- Transparent usage monitoring in Digital Wallet: Data
Cloud Sandbox and Agentforce usage is metered in Digital Wallet,
providing customers with complete visibility into their consumption
across the AI development lifecycle. New enhancements provide
granular insights into what features consume credits, so that teams
can uncover new trends around usage as they scale. And because
Digital Wallet is integrated into the Salesforce Platform, teams
can create automations to alert admins if, for example, usage
exceeds a particular threshold.
Customer and analyst perspectives:
“With nearly 3 million members, PenFed is committed to building
relationships that go beyond transactions,” said Shree Reddy, CIO,
PenFed. “Through the power of Data Cloud on the Salesforce
Platform, we’re equipping our member service representatives with a
complete, personalized view of each member’s journey. With the
ability to properly test prior to deployment with Data Cloud
Sandboxes, this enables us to provide faster, more accurate support
and recommendations that truly reflect our commitment to their
financial well-being. At PenFed, we’re here to support every
member’s unique goals with care and understanding, helping them
achieve their financial dreams.”
“To help engender trust in AI, every business investing in an
agent strategy will need to think through how they pressure test an
autonomous AI agent that can reason, retrieve data, and use tools.
Salesforce is instilling confidence by using AI to test hundreds of
variations of an agent's interaction in parallel. With these
enhancements and support for Agentforce and Data Cloud in familiar
testing environments, this Testing Center will help Salesforce
customers manage the unique needs of testing AI agents,” said Keith
Kirkpatrick, Research Director, The Futurum Group.
Availability:
- Agentforce Testing Center is in a closed pilot today, and will
be generally available for use in sandboxes in early December.
- Sandbox support for Agentforce and Data Cloud is generally
available today.
- Agentforce Analytics and Utterance Analysis are generally
available today.
- DevOps Center, Salesforce CLI, and Change Sets support for
Agentforce and Data Cloud are generally available today.
Learn more:
- Get started for free with Salesforce Foundations
- Explore how to test agents in Agentforce Testing Center
- Explore Agentforce and Data Cloud customer stories
- Estimate your ROI with Agentforce
- Read about how Data Cloud powers Agentforce
- Learn more about testing and deployment on the Salesforce
Platform
- Join the new Agentblazer and Datablazer communities
About Salesforce
Salesforce helps organizations of any size reimagine their
business for the world of AI. With Agentforce, Salesforce's trusted
platform, organizations can bring humans together with agents to
drive customer success—powered by AI, data, and action. Visit
www.salesforce.com for more information.
View source
version on businesswire.com: https://www.businesswire.com/news/home/20241120646715/en/
Carolyn Guss pr@salesforce.com
Salesforce (NYSE:CRM)
Historical Stock Chart
From Oct 2024 to Nov 2024
Salesforce (NYSE:CRM)
Historical Stock Chart
From Nov 2023 to Nov 2024