Cloudflare Unveils Data Platform for Seamless Data Ingestion and Querying

The era of cumbersome data infrastructure is coming to an end, thanks to Cloudflare’s latest innovation: the Cloudflare Data Platform. This move reflects broader industry trends towards more streamlined and cost-effective data management solutions. By integrating Cloudflare Pipelines, R2 Data Catalog, and R2 SQL, the platform provides a comprehensive toolkit for ingesting, storing, and querying analytical data tables.

At the heart of the Data Platform lies Cloudflare Pipelines, a powerful tool for receiving events, transforming them with SQL queries, and ingesting them into R2 Data Catalog or as files on R2. This process enables seamless data structuring and writing into object storage, making it easier to query events with Iceberg. With Pipelines, users can shift left, pushing validation, schematization, and processing to the ingestion layer, resulting in faster and more accurate queries.

The R2 Data Catalog, launched in April 2025, has been a game-changer for managing Iceberg metadata. Its latest update introduces compaction support, a periodic maintenance operation that rewrites small files into larger ones, reducing metadata overhead and increasing query performance. This feature is a significant step forward in optimizing data storage and querying capabilities.

R2 SQL, the newest addition to the Data Platform, is a distributed SQL engine designed to perform petabyte-scale queries over data in R2. By tightly integrating with R2 Data Catalog and R2, R2 SQL provides a fully serverless experience for users, allowing them to focus on their SQL without worrying about the underlying engine. With its initial focus on filter queries, R2 SQL is poised to expand its capabilities to cover more SQL features, such as complex aggregations.

The Cloudflare Data Platform is a significant development in the data management landscape, offering a usage-based pricing model that makes it more accessible to businesses of all sizes. By providing a complete solution for ingesting, storing, and querying analytical data tables, Cloudflare is empowering companies to unlock the full potential of their data. As the platform continues to evolve, with upcoming features like integration with Logpush and user-defined functions via Workers, it’s clear that the future of data management is becoming increasingly streamlined and efficient.

Source: Official Link