Ant Group Unveils Cloud-based Cryptographic Computing Platform
July 05 2024 - 5:26AM
Business Wire
- From the SecretFlow Cloud platform, Ant also offers a suite
of Cryptographic Computing Solutions for Large Language
Models
Ant Group today unveiled SecretFlow Cloud, its cloud-based
cryptographic computing platform, and a suite of cryptographic
computing solutions tailored for large language models (LLMs) at
the World Artificial Intelligence Conference in Shanghai.
Leveraging integrated software-hardware cryptographic computing
technologies, these solutions enable the secure circulation of
encrypted data throughout the hosting and inference processes of
LLMs, safeguarding the integrity of LLM assets and data security
while significantly enhancing data privacy protection. Providers
can now encrypt and deploy their LLMs onto cloud environments
effortlessly with a single click through its encrypted hosting
service, safeguarding their valuable assets from compromise and
theft. Meanwhile, the encrypted inference service ensures efficient
data security and the protection of trade secrets during
interactions with LLMs.
These solutions allow GPUs to perform computing tasks within
trusted execution environments, notably reducing the cost and
performance disparity between encrypted LLM inference and plaintext
operations, providing a more cost-effective approach. The platform
also integrates additional technologies such as memory and disk
encryption, ensuring end-to-end encryption and secure cross-domain
model hosting management. Additionally, a user-friendly remote
attestation system allows for smooth verification through web
interfaces, minimizing friction for users.
SecretFlow Cloud currently supports both public and private
cloud deployments, and is compatible with commonly-used LLMs in the
global market. For instance, in a public cloud setup, users can
seamlessly build a new professional LLM on SecretFlow Cloud or
migrate an existing LLM to the platform, with its secure LLM
inference services ready in as few as 10 minutes with just a click.
Moreover, users can purchase cryptographic computing resources on
demand to meet their needs.
"Data is the most critical element in the application of LLMs,
and cryptographic computing technology significantly enhances the
utility of data in cross-domain scenarios," noted Dr. Lenx Wei,
Vice President and Chief Technology Security Officer at Ant Group.
"As LLMs evolve toward specialized professional domains and become
essential productivity tools, cryptographic computing will play a
vital role, particularly in fully unlocking the value of
high-quality, domain-specific data sets."
According to Dr. Wei, while companies often deploy LLMs in
private environments to address data security challenges, such
methods can incur higher operational costs and compromise both
service efficiency and quality, ultimately constraining the
potential of LLMs. The cryptographic computing solutions offered by
SecretFlow Cloud can effectively resolve these issues.
Looking forward, SecretFlow Cloud aims to further develop its
cryptographic computing solutions to ensure data security
throughout the full lifecycle of professional LLMs, including their
creation, deployment, and service delivery.
Ant Group has been exploring privacy-preserving computing
technologies since 2016 and released SecretFlow in 2022 as an
open-source privacy-preserving computing framework that features an
array of advanced technologies, including multiparty computation,
federated learning, Trusted Execution Environments, Homomorphic
Encryption, and Differential Privacy. Positioned at the forefront
of cryptographic computing, SecretFlow Cloud represents a new
generation of privacy-preserving computing technology, poised to
overcome pain points in security, cost, and accessibility in data
circulation. It offers a solution for instantly harnessing data
value, akin to turning on a tap. To date, its technologies have
been adopted in industries such as insurance, rural finance,
healthcare, public services, and marketing.
About Ant Group
Ant Group aims to build the infrastructure and platforms to
support the digital transformation of the service industry. Through
continuous innovation, we strive to provide all consumers and small
and micro businesses equal access to digital financial and other
daily life services that are convenient, sustainable and
inclusive.
For more information, please visit our website at
www.antgroup.com or follow us on Twitter @AntGroup.
View source
version on businesswire.com: https://www.businesswire.com/news/home/20240705154761/en/
Media Inquiries Vick Li Wei Ant Group
Vick.lw@antgroup.com