Posted on April 17, 2010, 3:01 pm, by Rhys, under
MySQL,
SSIS.
Getting data out of MySQL with SSIS is a snap. Putting data into MySQL has been a different matter. I’ve always done this in the past with a hodgepodge of ODBC, Linked Servers, OPENQUERY and the Script Task. All of these work well but they’re just not as convenient as loading files with the OLED [...]
Posted on April 10, 2010, 11:57 am, by Rhys, under
SSIS.
Whilst doing some maintenance on an SSIS package I encountered the below error when attempting to edit an Execute Process Task.
Posted on February 20, 2010, 7:55 pm, by Rhys, under
SSIS.
A few weeks ago I blogged about my attempts to make dynamic output files in ssis. The idea here was to make an ssis package, producing a text file output, that would cope with complete changes to the data source. If you wanted to add a column all you needed to do was change the [...]
Posted on February 6, 2010, 3:35 pm, by Rhys, under
SSIS.
I like making my SSIS packages as dynamic as possible. Once that package has been deployed into production I want to avoid opening it up in BIDS if possible. I’ve blogged previously about using Stored Procedures in Execute SQL Tasks but this only gives us flexibility in terms of the where clause. We have no [...]
Posted on January 19, 2010, 10:04 pm, by Rhys, under
SSIS.
I’ve been having a bit of a debate with some colleagues today about the Execute SQL Procedure Task in SSIS. Is it ok to enter raw SQL queries into this task or should everything be enclosed within a Stored Procedure? My view… For me, any day of the week, it should always be a proc. [...]
Posted on December 26, 2009, 6:59 pm, by Rhys, under
Powershell,
SSIS.
SSIS and Powershell are two of my current loves in technology, so of course, I was excited to see someone has made a Powershell Script Task. I’ve been meaning to try this out for months. Unfortunately it looks like the project isn’t currently active, but I thought I’d still give it a whirl, and post [...]
Posted on December 6, 2009, 7:40 pm, by Rhys, under
SSIS.
I’m currently building a lot of SSIS packages that are primarily date driven. Many of these involve periods of 100 days, to several years, so I wanted to automate the testing of these packages. I’d previously automated the testing of stored procedures over date ranges but wanted a solution for testing the system as a [...]
Posted on November 21, 2009, 8:45 pm, by Rhys, under
SSIS.
Sadly, as people don’t make sense, we have to make compromises in our systems and processes. I recently had a requirement, in an SSIS package, to be able to identify which days were Bank Holidays and take a different course of action, e.g. not run the main process. Here’s an illustration of the approach I [...]
Posted on October 22, 2009, 1:34 pm, by Rhys, under
SSIS.
Here’s a quick VB.Net snippet that allows you to write messages to the Windows Event Log from your packages. Nothing to configure here, just change the log message to something appropriate. Obviously, in order to work, the package would have to be run under an account that has permission to write to the event log. [...]
Posted on October 15, 2009, 10:06 pm, by Rhys, under
SSIS.
When creating SSIS packages it’s a common requirement to be able to archive the processed files. Here’s VB.Net code snippet, with a quick walkthrough, that does exactly that. The script uses two variables, inFiles and archiveFiles. The variable inFiles contains the folder we want to move files from, and archiveFiles is the destination. Configure your [...]