Why you Need a Persistent Layer 1. All history, all of the time, instead of some history some of the time Including a persistent layer in your architecture is a paradigm shift in how you see the data warehouse. In the popular Kimball methodology, without the persistent layer, the data warehouse layer was responsible for…
The persistent layer contains as set of persistent tables that record the full history of changes to the data of the table/query that is the source of the Persistent table. The source could a source table/file, a source query, another staging table or a view/materialized view in the transform layer. In a persistent table there…
This post is the first in a series of detailed cases studies discussing the ETL strategies that can be used when a Persistent staging layer is included in your Data Warehouse. It’s intended as a reference for developers using Dimodelo Data Warehouse Studio, our Data Warehouse Automation tool to quickly build a Data Warehouse. It’s…
Dimodelo Solutions is proud to announce the release of version 2.15 of Dimodelo Data Warehouse Studio, its data warehouse automation tool for the Microsoft data platform. In this release we have added support for the Microsoft APS platform and SQL Server 2017. We have also redesigned our data management architecture from the ground up, introducing…
In this episode, I had the pleasure of speaking with Chris Webb, a well respected independent consultant based in the UK. He specialises in Analysis Services, MDX, Power Pivot, DAX, Power Query and Power BI in general. He is a widely read blogger having authored more than a 1000 posts over the last 10 years. …
At Dimodelo, we have been hard at work, redesigning the Data Warehouse data management architecture that Dimodelo Data Warehouse Studio (our Data Warehouse Automation tool) generates. Working with our clients we have introduced a Persistent Layer into the data warehouse architecture. “What is a Persistent Layer?” I hear you ask. The persistent layer contains as…
In this episode, it is my pleasure to speak with Mark Tabladillo, Lead Data Scientist for Microsoft Services — Data and Artificial Intelligence (Chief Technology Office). He works as part of a global team with Fortune 500 companies, global leading institutions, and high-tech startups toward digital transformation using advanced analytics. Mark is passionate about educating…
In this episode I speak with James Rowland-Jones (JRJ), Principal Program Manager for Microsoft. He is passionate about delivering highly scalable solutions that are creative, simple and elegant in their design. James specializes in scale out data solutions such as Azure SQL Data Warehouse, Microsoft Analytics Platform System and Hadoop. JRJ is a keen advocate…
Talking Analytics Platform Services with Ashley Furniture’s Data Architect Phil Haddad, and Microsoft’s Principal Program Manager in the Azure SQL Data Warehouse team, Matt Usher. In this podcast we discuss: Refractoring an exising data warehouse Automating data warehouse development in an enterprise environment with 700 applications Migrating to Azure Data Warehouse from PDW/APS The role Microsoft Partners…
In this episode, it is my pleasure to speak with James Serra, Data Platform Solution Architect and Data Warehouse Evangelist at Microsoft. He is a thought leader in data warehousing and data management with over 25 years of experience in data modeling, data governance, and development methodologies. James is also a popular and prolific blogger…
