Data Warehouse Automation – the next big thing
Jet Reports have written an interesting article on Data Warehouse Automation. It appears this concept is gaining recognition. TDWI has also recognized the value of Data Warehouse Automation, as one of the emerging trends for 2015 and beyond.
I’ve also written an introduction article on the who, what, where, when and why of Data Warehouse Automation.
In summary, Data Warehouse Automation describe the automation of the following:
- Simplified capture of the Data Warehouse Design.
- Automated Build (i.e. Generate Code)
- Automated Deployment of code to the Server
- Automated Batch execution of the ETL code on the Server.
- Automated Monitoring and Reporting of the Batch execution.
Generally this is achieved through a Data Warehouse Automation tool, or manually creating a set of scripts to generate the code and scripts to automate the Build, Deploy Run process.
What are the benefits ?
- It’s fast. Dramatically reduce your development time.
- It’s flexible. Respond to changing business requirements quickly and easily.
- Stay focused. On what really matters. Concentrate on reporting and analytics instead of stuck in ETL code.
- Quality.Data Warehouse Automation tools produce tested, high performance, complete and readable code. At least Dimodelo Data Warehouse Studio does!
- Consistency and Continuity. It produces consistent code, naming standards etc. Developers come and go, but so long as they keep using the same tool, its easy for one developer to understand the work of another.
