By Steve Radich on 8/15/2016 12:54 AM

 I was loading a data set into Redshift for some experiments and was able to get this..

An error occurred when executing the SQL command:

copy dbo.Loans_test from 's3://removed/removed/loans_full.txt'

credentials 'aws_access_key_id=Removed;aws_secret_acces...

 

[Amazon](500310) Invalid operation: A fatal error occurred. The database will be restarted.;

1 statement failed.

 

Execution time: 7.07s

Read More »

By Steve Radich on 8/13/2016 12:30 AM

I ran into an interesting problem where I ran robocopy to copy hundreds of GB of files to a remote location for a test lab, the vpn dropped several times, copies retried - due to bandwidth limitations it was stopped, etc. All things that can explain why this happened.

 

After getting to the point robocopy said the directories matched with no errors we had problems with several of the files.

Read More »