Tag: dbt
All the articles with the tag “dbt”.
-
Data This Week #35
10 min readWhy sorted Parquet files don't give DataFusion an ordered scan, point-in-time leak-free graphs on Iceberg, rank-space Hilbert clustering in DuckDB, Netflix's ontology-driven observability, Uber's dependency analysis, Apache Polaris disaster recovery, Redshift data sharing and Iceberg writes, JEV classification, duckxlsx, and debugging data mismatches.
-
Data This Week #33
6 min readMicrosoft backs Apache Ossie with a Power BI converter and DAX integration, Cloudflare launches Basin with zero egress fees, Aurora PostgreSQL queries Iceberg natively via DuckDB, Snowflake open-sources pg_lake, streaming deletes vs. Iceberg compaction, Supabase acquires Turso, and the community debates dbt 2 maturity.
-
Data This Week #31
5 min readPandas vs. single-machine engines, Delta Lake 4.3 selective data replacement, PlanetScale's Neki, PyIceberg with Apache Polaris, Shopify's gisting, Sony LIV's real-time analytics, and a community debate on dbt development standards.
-
Data This Week #28
5 min readInstacart's Postgres-native search replacing Elasticsearch and FAISS, Netflix migrating batch workloads to Kueue on Kubernetes, AWS Dogwood for AI agent governance, distributed DuckDB with Quack, Debezium for CDC-driven event architecture, and the community debate on dbt Cloud pricing.
-
Data This Week #27
6 min readSafely migrating Iceberg catalogs without moving data, DuckDB's MySQL engine stress-tested at 500 GB, the end of the Hive Metastore era, hands-on S3 Tables evaluation, why dbt tests don't equal data trust, and an ontology+LLM approach to legacy data modernization.
-
Data This Week #23
5 min readApache OSSIE enters ASF incubation to standardize semantic layers, HubSpot scales to 20B vectors with Qdrant, cloud-native financial search with Iceberg and Turbopuffer, Lakekeeper's Generic Table API for multi-format lakehouses, and versioning Power BI with Git.
-
Data This Week #22
5 min readAWS S3 Annotations for business context, Cloudflare's Town Lake lakehouse and Skipper AI agent, Databricks LTAP rethinking database storage, Iceberg native views in Hive, Snowflake pipeline scaling pitfalls, and CRED's zero-data-loss RDS Blue/Green deployments at scale.
-
Data This Week #21
4 min readPostgres 19 pg_plan_advice for query plan control, Flink's Hadoop-free native S3 filesystem, incremental model pitfalls in dbt, Trino's summer SQL standard upgrades, PgBouncer's pooling mechanics, Razorpay's CDP architecture, and pgEdge ColdFront for Iceberg tiering.