29.09.2023
142

Cloudflare has Introduced New Tools for Deploying and Running AI Services

Yuliia Zablotska
Author at ApiX-Drive
Reading time: ~1 min

Cloudflare, which provides CDN services, DDoS protection, DNS servers, and secure access to resources, presented its Cloudflare AI platform, which comes with a collection of different products and applications for creating, deploying and running AI models. Its main purpose is to enable users to develop full-fledged and ready-to-scale applications based on artificial intelligence on the Cloudflare network. Key advantages: no need for your own servers and direct infrastructure management; high speed and availability of deployment of AI models.

New tools include:

  • Workers AI – this service allows you to determine which GPUs from Cloudflare partners are physically closest to the user, provides you with access to them to run AI models, and allows you to pay only when you use them.
  • Vectorize is a database where you can store vector embeddings—mathematical representations of data that were created by Workers AI models.
  • AI Gateway – the application provides analytics that help the user better understand and manage the financial costs of launching AI services.

In addition to creating and launching new artificial intelligence models, plugins for the well-known ChatGPT can be developed on the Cloudflare AI platform. Cloudflare CEO Matthew Prince emphasized that not only does it allow you to train custom AI models and create new extensions for them, but it also successfully solves the financial challenges associated with deploying AI workloads and also ensures reliable protection of customer data. According to him, the company was pushed to release a new suite of AI products by users who wanted a simple, intuitive and cost-effective solution for managing AI.