Tag: apache-iceberg
All the articles with the tag “apache-iceberg”.
-
Data This Week #35
10 min readWhy sorted Parquet files don't give DataFusion an ordered scan, point-in-time leak-free graphs on Iceberg, rank-space Hilbert clustering in DuckDB, Netflix's ontology-driven observability, Uber's dependency analysis, Apache Polaris disaster recovery, Redshift data sharing and Iceberg writes, JEV classification, duckxlsx, and debugging data mismatches.
-
Data This Week #33
6 min readMicrosoft backs Apache Ossie with a Power BI converter and DAX integration, Cloudflare launches Basin with zero egress fees, Aurora PostgreSQL queries Iceberg natively via DuckDB, Snowflake open-sources pg_lake, streaming deletes vs. Iceberg compaction, Supabase acquires Turso, and the community debates dbt 2 maturity.
-
Data This Week #32
7 min readServing APIs off S3 Tables, Spark Declarative Pipelines, serverless Postgres CDC on Fargate, Iceberg 1.12 preview, Postgres search internals, data contracts with Bitol, Notion CRDTs, DuckDB-Wasm on OPFS, and community debate on AI and data modeling.
-
Data This Week #31
5 min readPandas vs. single-machine engines, Delta Lake 4.3 selective data replacement, PlanetScale's Neki, PyIceberg with Apache Polaris, Shopify's gisting, Sony LIV's real-time analytics, and a community debate on dbt development standards.
-
Data This Week #27
6 min readSafely migrating Iceberg catalogs without moving data, DuckDB's MySQL engine stress-tested at 500 GB, the end of the Hive Metastore era, hands-on S3 Tables evaluation, why dbt tests don't equal data trust, and an ontology+LLM approach to legacy data modernization.
-
Data This Week #26
4 min readAmazon MSK delivers Kafka data directly to Iceberg streaming tables, Iceberg v3 introduces native row-level lineage for CDC, Spotify builds a custom indexing layer for online point queries on the data lake, and a Rust terminal database GUI called Rainfrog.
-
Data This Week #25
6 min readS3 Tables compaction myths debunked, DuckDB's vectorized execution internals, Snowflake's managed Iceberg at scale, NOT EXISTS rewritten as anti-joins, partition affinity over Redis, AWS Glue view automation, and Supabase Pipelines in public alpha.
-
Data This Week #24
5 min readDatabricks bakes native AI and semantic primitives into Spark 4.2, Netflix rebuilds LLM serving with vLLM on Triton, multi-cloud lakehouse architecture on AWS for agentic AI, Kubernetes internals deep dive, and Debezium's log-based CDC architecture.