Comments on: Merging CSV Files with Powershell http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330 making DBAs everywhere curse! Sat, 04 Feb 2012 06:02:22 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Rhys http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-1784 Rhys Wed, 21 Dec 2011 21:42:31 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-1784 Hi Steve, Probably easy enough to test for this. Does the file contain headers or is it completely empty? Cheers, Rhys Hi Steve,

Probably easy enough to test for this. Does the file contain headers or is it completely empty?

Cheers,

Rhys

]]> By: Steve http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-1783 Steve Wed, 21 Dec 2011 21:22:36 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-1783 Very nice script. It's a real time saver. I did run into one issue, though. My source script puts data in the files, but sometimes there is no data. When the merge script runs it fails if a source file content is null. Very nice script. It’s a real time saver.

I did run into one issue, though. My source script puts data in the files, but sometimes there is no data. When the merge script runs it fails if a source file content is null.

]]> By: Rhys http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-1646 Rhys Thu, 24 Nov 2011 17:48:10 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-1646 Hi again James, Think we've found a bug here. Output from a ps session... csv file contain 3 lines each... <pre> PS C:\Users\campbellr\test> ls Directory: C:\Users\campbellr\test Mode LastWriteTime Length Name ---- ------------- ------ ---- -a--- 24/11/2011 17:16 61 1.csv -a--- 24/11/2011 17:16 61 2.csv -a--- 24/11/2011 17:17 61 3.csv -a--- 24/11/2011 17:43 61 4.csv PS C:\Users\campbellr\test> cat *.csv col1,col1,col1,col1 col1,col1,col1,col1 col1,col1,col1,col1 col2,col2,col2,col2 col2,col2,col2,col2 col2,col2,col2,col2 col3,col3,col3,col3 col3,col3,col3,col3 col3,col3,col3,col3 col4,col4,col4,col4 col4,col4,col4,col4 col4,col4,col4,col4 PS C:\Users\campbellr\test> cat *.csv > all.csv PS C:\Users\campbellr\test> cat *.csv col1,col1,col1,col1 col1,col1,col1,col1 col1,col1,col1,col1 col2,col2,col2,col2 col2,col2,col2,col2 col2,col2,col2,col2 col3,col3,col3,col3 col3,col3,col3,col3 col3,col3,col3,col3 col4,col4,col4,col4 col4,col4,col4,col4 col4,col4,col4,col4 col1,col1,col1,col1 col1,col1,col1,col1 col1,col1,col1,col1 col2,col2,col2,col2 col2,col2,col2,col2 col2,col2,col2,col2 col3,col3,col3,col3 col3,col3,col3,col3 col3,col3,col3,col3 col4,col4,col4,col4 col4,col4,col4,col4 col4,col4,col4,col4 </pre> The first cat shows the file contents as expected. The line with > carried on filling up all.csv until you ctrl + c it. The next cat command outputs the contents of the files onto the screen ad infinitum. Hi again James,

Think we’ve found a bug here. Output from a ps session…

csv file contain 3 lines each…

PS C:\Users\campbellr\test> ls

    Directory: C:\Users\campbellr\test

Mode                LastWriteTime     Length Name
----                -------------     ------ ----
-a---        24/11/2011     17:16         61 1.csv
-a---        24/11/2011     17:16         61 2.csv
-a---        24/11/2011     17:17         61 3.csv
-a---        24/11/2011     17:43         61 4.csv

PS C:\Users\campbellr\test> cat *.csv
col1,col1,col1,col1
col1,col1,col1,col1
col1,col1,col1,col1
col2,col2,col2,col2
col2,col2,col2,col2
col2,col2,col2,col2
col3,col3,col3,col3
col3,col3,col3,col3
col3,col3,col3,col3
col4,col4,col4,col4
col4,col4,col4,col4
col4,col4,col4,col4
PS C:\Users\campbellr\test> cat *.csv > all.csv
PS C:\Users\campbellr\test> cat *.csv
col1,col1,col1,col1
col1,col1,col1,col1
col1,col1,col1,col1
col2,col2,col2,col2
col2,col2,col2,col2
col2,col2,col2,col2
col3,col3,col3,col3
col3,col3,col3,col3
col3,col3,col3,col3
col4,col4,col4,col4
col4,col4,col4,col4
col4,col4,col4,col4
col1,col1,col1,col1
col1,col1,col1,col1
col1,col1,col1,col1
col2,col2,col2,col2
col2,col2,col2,col2
col2,col2,col2,col2
col3,col3,col3,col3
col3,col3,col3,col3
col3,col3,col3,col3
col4,col4,col4,col4
col4,col4,col4,col4
col4,col4,col4,col4

The first cat shows the file contents as expected. The line with > carried on filling up all.csv until you ctrl + c it. The next cat command outputs the contents of the files onto the screen ad infinitum.

]]> By: Rhys http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-1645 Rhys Thu, 24 Nov 2011 17:30:16 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-1645 Hi James, Cool idea but that goes into an infinite loop filling up the csv file until you stop it. Not the behavior I'd expect. Cheers, Rhys Hi James,

Cool idea but that goes into an infinite loop filling up the csv file until you stop it. Not the behavior I’d expect.

Cheers,

Rhys

]]> By: James http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-1644 James Thu, 24 Nov 2011 13:24:58 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-1644 how about this simple concatenate: cd ./dir cat *.csv > all.csv how about this simple concatenate:

cd ./dir
cat *.csv > all.csv

]]> By: John Nash http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-200 John Nash Mon, 21 Jun 2010 20:18:00 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-200 Thanks for the tip, it worked very well. Thanks for the tip, it worked very well.

]]> By: Rhys http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-146 Rhys Mon, 01 Mar 2010 21:29:27 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-146 Thanks Chris. I get the same error when trying this now. Perhaps a version issue. Anyway, I've updated the script. Cheers, Rhys Thanks Chris. I get the same error when trying this now. Perhaps a version issue. Anyway, I’ve updated the script.

Cheers,

Rhys

]]> By: Chris http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330/comment-page-1#comment-145 Chris Mon, 01 Mar 2010 18:48:04 +0000 http://www.youdidwhatwithtsql.com/merging-csv-files-with-powershell/330#comment-145 Hi, I got the following error running the script: Method invocation failed because [System.Management.Automation.PSObject] doesn't contain a method named 'op_Addition'. I found through another blog that "$content = null" needs to be changed to "content = @()." Thanks! Hi, I got the following error running the script:

Method invocation failed because [System.Management.Automation.PSObject] doesn’t contain a method named ‘op_Addition’.

I found through another blog that “$content = null” needs to be changed to “content = @().”

Thanks!

]]>