Practitioner writing on data engineering, AI infrastructure, and the systems that make intelligence work at scale. Real-time CDC, Iceberg, Snowflake, AI governance and agents for data work.https://dataaichronicles.com/https://medium.com/dataaichronicles/the-quietest-process-in-airflow-what-the-triggerer-did-for-200-parallel-dataproc-jobs-2075b8b5ae33https://medium.com/dataaichronicles/the-quietest-process-in-airflow-what-the-triggerer-did-for-200-parallel-dataproc-jobs-2075b8b5ae33How Airflow's triggerer and deferrable operators let a single scheduler supervise 200 concurrent Dataproc jobs without burning worker slots.Tue, 06 Oct 2026 00:00:00 GMThttps://medium.com/dataaichronicles/connecting-atlan-to-snowflakes-ontology-tags-lineage-and-semantic-views-across-the-boundary-5d3df9a7399dhttps://medium.com/dataaichronicles/connecting-atlan-to-snowflakes-ontology-tags-lineage-and-semantic-views-across-the-boundary-5d3df9a7399dKeeping tags, lineage and semantic views consistent when governance lives in Atlan and the definitions live in Snowflake.Tue, 29 Sep 2026 00:00:00 GMThttps://medium.com/dataaichronicles/the-semantic-layer-semantic-views-dbt-metrics-and-business-definitions-71b54fe640cfhttps://medium.com/dataaichronicles/the-semantic-layer-semantic-views-dbt-metrics-and-business-definitions-71b54fe640cfWhere business definitions should live, and how Snowflake semantic views and dbt metrics divide the work.Tue, 15 Sep 2026 00:00:00 GMThttps://www.artie.com/blogs/data-engineering-innovators-spotlight-ved-prakashhttps://www.artie.com/blogs/data-engineering-innovators-spotlight-ved-prakashAn interview with Artie on real-time CDC with Project Siphon, proactive cost governance for Snowflake Cortex, and where AI will change data engineering next.Sun, 19 Apr 2026 00:00:00 GMThttps://dataaichronicles.com/chronicles/how-a-gen-ai-model-reaches-production/https://dataaichronicles.com/chronicles/how-a-gen-ai-model-reaches-production/From raw data to millions of conversations. Seven stages, from data collection and pre-training through alignment, evaluation, infrastructure, deployment and monitoring.Sun, 08 Mar 2026 00:00:00 GMT