Data Engineering Blog

Genuine News about the Data Ecosystem.
Topics: #dataengineering #bigdata #python #opensource #etl

What Data Warehouse Automation tools are on the market

The 5 top most searched Data Warehouse Automation tools on the market compared with GoogleTrends is telling you that WhereScape is first before TimeXtender and BiReady (new Attunity Compose) over the last year. See the picture in full size or go directly to GoogleTrend comparison and change to your own needs. Although the analysis is not representative, it still gives some insights and a good overview to size and presumably usage compared to each other, worldwide.

Why automate? What does Data Warehouse Automation for us?

This article is for you if you considering to use Data Warehouse Automation (DWA) and asking yourself why you should use Data Warehouse Automation tools what does it do for you. After I explained in my previous blog Why Data Warehouse Automation is not more popular, you will find the why and what of Data Warehouse Automation in this second post of the series. Why automate your Data Warehouse? Every industry has used automation to increase productivity, reduce manual effort, improve quality and consistency, and speed delivery.

Why Data Warehouse Automation is not more popular

I was working with a Data Warehouse Automation (DWA) tool for a little more than a year, and I have to say I loved it. As a BI developer you could focus on the challenges you had in dimensional modelling, what granularity should you have the fact tables and going crazy with the business requirements and everything fast, consistent and tested! But why is Data Warehouse Automation not used more often and more popular?

Data Warehouse Automation (DWA) – Series

Very long time ago, 1986, 31 years ago to be precise, IBM in Europe created the very first architecture of a data warehouse. And it seems to be a masterpiece as it didn’t change much since. Though how can we improve or bring some innovation into Data Warehouse business in times everyone is talking about big data, data lakes, Internet of Things (IoT), predictive analytics, Data Vault, etc.? No matter how we want to improve the architecture, it has to be automated as much as possible.

Saying Goodbye to WordPress, a Homecoming

A brief of history When I began my journey with websites, I started as many of us with HTML, CSS, HTML & MySQL running on an Apache Webserver. Those days I prepared all recurring code inside to include PHP files and had content either as HTML itself or dynamically pulled from the MySQL database. And how that looked you see in the featured image of this post 😉. Later, I moved to WordPress to make the page more modern, chose a cool template, adding templates and automatise a lot.

Email, and the way we (should) communicate at work

The first example of email can be found on computers at MIT in a program called MAILBOX, all the way back in 1965. Besides its advantages of sharing fast and in a direct way, there are several studies stating that average office workers receiving 110 messages a day. Given the fact that every interruption takes 20 minutes to get back, this is a major distraction and also adds to the overall stress.