SSIS Data Flow Plus!

In my previous blog post I talked about BIML, and how it might revolutionise my approach to creating ETL processes.  It’s pretty cool, and very powerful, but there is a bit of a learning curve, so I decided to look for a different way to achieve the same thing, but that …

BIML, where have you been all my life?

I’ve used the BIDS Helper Visual Studio add-on for years now, and I’ve seen and heard of BIML, but it’s one of those things I’ve never needed to look into any further than that.  Until I discovered that it’s something that would’ve saved me hours of tedious SSIS work! What …

Azure SQL to Azure Data Warehouse ETL

I’ve recently needed to move data from our transactional database (an Azure SQL database), into an Azure SQL Data Warehouse. A definite case of “harder than it needed to be”… What’s an Azure Data Warehouse? I’ll assume if you’ve read this far, you know what a SQL database is. But …

PowerShell script to update Azure firewall rule

I’ve recently moved house, and as a result had to change my broadband plan from cable to ADSL (sad face). This also means I’ve gone from having a fixed IP address to a dynamically assigned one. Usually this wouldn’t be a problem, except when it comes to connecting to the several Azure …

SQL Server 2016 & Azure Query Store

I hadn’t been following the news much regarding SQL Server 2016, so when I did some reading the other day I was quite pleasantly surprised by some of the new features announced (not to mention that it looks like SSMS will finally be getting some much needed love). 🙂 We’ve …

Red Gate Azure backup failures

We use Red Gate Cloud Services to backup our Azure database, as well as some storage accounts to Amazon EC2 storage, etc.  It all works really well 99% of the time, but after a few failures in a short time period I opened a ticket with Red Gate. The errors …

Head in the clouds

Wow – 2 years and 4 days with no posts.  What a slacker… Anyway… I’ve been busy doing a few things in that time.  The most relevant probably being that I moved on from Trade Me near the end of 2014, and now work for Timely.  This is a small company …