Home > SQL Server, Utilities > The SSIS Balanced Data Distributor is released

The SSIS Balanced Data Distributor is released

Those of you who have seen my data loading presentation at SQLBits and PASS may remember that I recommend explicitly multi threading data loads to achieve higher load speeds.

This job has now become a lot easier from SSIS with the release of the Balanced Data Distributor (BDD). it is available here:

http://www.microsoft.com/downloads/en/details.aspx?FamilyID=ea0a1544-5ee4-4ad4-9d76-296d0632f162&displaylang=en

For max scale, you will still want to do some manual form of threading, but the BDD should help you achieve better scale for many common scenarios.

Advertisements
  1. Marcel
    May 27, 2011 at 14:25

    Nice Thomas, but still not dynamically. Do you have an idea how to start SSIS packages dynamic by data source streams? For example: I have a source extract that deliveres 3 month of data. Based on that I want to start a parametrized package 3 times and each of it handles 1 month. But it has to be dynamically.
    My only idea was a script task with multithreading…

    • Thomas Kejser
      May 29, 2011 at 13:00

      Hi Marcel

      I still prefer to start multiple instances of DTEXEC, each pulling work off a queue. This also allows easy scale out. But with the new component, you can do more with each process, which should boost scale.

      I have not found a way to dynamically control the number of destinationsnto break tbe TDs and TCP/IP scale barrier. perhaps an idea for another custom component?

  2. Len Wyatt
    May 31, 2011 at 19:00

    For more information on the Balanced Data Distributor, look here: http://blogs.msdn.com/b/sqlperf/archive/2011/05/25/the-balanced-data-distributor-for-ssis.aspx

  3. June 6, 2011 at 16:54

    Nice. However, I do agree with you Thomas, that I also prefer to run multible packages (either via dtexec or from a master package), which runs from a queue. But if there is only one source file, then this component could be useful.

  4. Carla Sabotta
    August 2, 2011 at 23:01

    For a demo of the Balanced Data Distributor, go to http://technet.microsoft.com/en-us/sqlserver/hh369962 .

  1. June 8, 2011 at 13:15
  2. June 8, 2011 at 13:21

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s