Browsing: Apache

In this post, we show you how to implement real-time data ingestion from multiple Kafka topics to Apache Hudi tables…

Spark 4.1 highlights at a glanceSpark Declarative Pipelines (SDP): A new declarative framework where you define datasets and queries, and…

In recent years, we’ve witnessed a significant shift in how enterprises manage and analyze their ever-growing data lakes. At the…

Apache Spark Connect, introduced in Spark 3.4, enhances the Spark ecosystem by offering a client-server architecture that separates the Spark…

Apache Iceberg is an open table format that helps combine the benefits of using both data warehouse and data lake…

Hundreds of thousands of customers build artificial intelligence and machine learning (AI/ML) and analytics applications on AWS, frequently transforming data…

Amazon EMR runtime for Apache Spark offers a high-performance runtime environment while maintaining API compatibility with open source Apache Spark…

The Amazon EMR runtime for Apache Spark is a performance-optimized runtime for Apache Spark that is 100% API compatible with…

This post shows how Amazon EMR 7.12 can make your Apache Spark and Iceberg workloads up to 4.5x faster performance.…

Amazon SageMaker Unified Studio introduces support for running interactive Apache Spark sessions with your corporate identities through trusted identity propagation.…