Archive - The Data Platform Journal

How to Build a Data Platform: Now on YouTube!

My colleague Mike has taken my “How to Build a Data Platform“ guide and is now making a video series!

May 27 •

April 2024

Failed attempts to replace SQL: a history lesson.

Never break the cycle?

Apr 4, 2024 •

February 2024

Issue #33: Podcast, Practical Data Modelling, and Reviewing Databases in 2023

Plus: Automated dbt Test Generation, BigQuery Design Deep Dive and Data Exploration in Stream Processing

Feb 6, 2024 •

January 2024

Issue #32: Reviewing 2023 and Not-So-Bold 2024 Predictions

Plus: Make a Massive Impact on the Bottom Line with Analytics, Understanding Data Lakehouses, Idempotence Explained, Spatiotemporal Data Analysis…

Jan 4, 2024 •

December 2023

Issue #31: Microsoft Fabric is Generally Available - Should You Adopt It?

Also: Text to SQL LLMs and Knowledge Graphs vs. Semantic Layers, The State of Streaming, Why You Need a Data Catalog to Build Data Products and…

Dec 12, 2023 •

October 2023

Issue #30: How Self-Service Analytics Impact Data Platforms

Hi all, this week we have:

Oct 31, 2023 •

Issue #29: How Data Platform Foundations Impact AI and ML Applications

Plus Current 2023 Conference Retrospectives, Apache Paimon: the Streaming Lakehouse and dbt Tests are expensive

Oct 18, 2023 •

How to Build a Data Platform: People & Teams

Roles required, Effective Delivery, Team Design, Communication and Scaling Data Teams.

Oct 11, 2023 •

Issue #28: Fancy Data Stack and Data Contract Retrospectives

Plus: SRE Insights, Elementary for dbt, Principles of Data layers in Data Platform, and Data - The Land DevOps Forgot

Oct 4, 2023 •

September 2023

How to Build a Data Platform: Data Governance

Why is Data Governance important?, "Agile" Data Governance, Ownership Over Tooling and Do I Need a Data Catalog

Sep 28, 2023

Issue #27: What Should We "Shift Left" On?

Plus: The State of Databases Today, Serverless is Still Not Designed for Data, Why Prices are Still Going Up, Apache Kafka as System of Record and Why…

Sep 19, 2023 •

How to Build a Data Platform: Security

Trade-offs, Defence in Depth, Security Monitoring and Security at Scale

Sep 14, 2023 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts