Large CSV Fails in DTS 
Author Message
 Large CSV Fails in DTS
Hi,

I am running a DTS package in VB 6 to import data into a temp file from
a CSV file. If my file size is about 500 KB, no problem. When my file
size is above 1.4M, the DTS package fails. Would anybody have some
suggestions why this would happen? Thank you.

Susan



Fri, 04 Apr 2003 03:00:00 GMT
 Large CSV Fails in DTS


Quote:
> Hi,

> I am running a DTS package in VB 6 to import data into a temp file from
> a CSV file. If my file size is about 500 KB, no problem. When my file
> size is above 1.4M, the DTS package fails. Would anybody have some
> suggestions why this would happen? Thank you.

> Susan

What's the error?
Is there sufficient disk space?


Fri, 04 Apr 2003 03:00:00 GMT
 Large CSV Fails in DTS

Yes, there's sufficient space, because I'm writing to a network drive. Each
time it fails, it seems to fail at a different point, as my error log (where
I put rejected records) is a different size each time. My VB app just hangs.
I press CTL ALT DEL and I get a 'not responding' message for my VB app. Then
I do End Task. It doesn't even write an error to my DTSlog file as it seems
to hang in the DTS process of importing the records. I tried stepping through
the process and I just get a "copy data from Assets to Temp Assets step
failed " message back from DTS.

Susan

Quote:



> > Hi,

> > I am running a DTS package in VB 6 to import data into a temp file from
> > a CSV file. If my file size is about 500 KB, no problem. When my file
> > size is above 1.4M, the DTS package fails. Would anybody have some
> > suggestions why this would happen? Thank you.

> > Susan

> What's the error?
> Is there sufficient disk space?



Sun, 06 Apr 2003 03:00:00 GMT
 Large CSV Fails in DTS

I don't believe it's the DTS package that is failing. When I run it from EM, it
works fine. It's actually VB's connection to the executing process that seems to
loose touch. Once I execute the Dts package, because it takes so long, VB or
Windows must think that the app is not responding and hangs. Is there anyway to
put some code in to let whatever know that the app is still processing. Do
events? Thanks.

Susan

Quote:

> Yes, there's sufficient space, because I'm writing to a network drive. Each
> time it fails, it seems to fail at a different point, as my error log (where
> I put rejected records) is a different size each time. My VB app just hangs.
> I press CTL ALT DEL and I get a 'not responding' message for my VB app. Then
> I do End Task. It doesn't even write an error to my DTSlog file as it seems
> to hang in the DTS process of importing the records. I tried stepping through
> the process and I just get a "copy data from Assets to Temp Assets step
> failed " message back from DTS.

> Susan




> > > Hi,

> > > I am running a DTS package in VB 6 to import data into a temp file from
> > > a CSV file. If my file size is about 500 KB, no problem. When my file
> > > size is above 1.4M, the DTS package fails. Would anybody have some
> > > suggestions why this would happen? Thank you.

> > > Susan

> > What's the error?
> > Is there sufficient disk space?



Mon, 07 Apr 2003 03:00:00 GMT
 Large CSV Fails in DTS
could you post some code here?  In particular, can you step through to find
the offending line?

Quote:

> I don't believe it's the DTS package that is failing. When I run it from
EM, it
> works fine. It's actually VB's connection to the executing process that
seems to
> loose touch. Once I execute the Dts package, because it takes so long, VB
or
> Windows must think that the app is not responding and hangs. Is there
anyway to
> put some code in to let whatever know that the app is still processing. Do
> events? Thanks.

> Susan


> > Yes, there's sufficient space, because I'm writing to a network drive.
Each
> > time it fails, it seems to fail at a different point, as my error log
(where
> > I put rejected records) is a different size each time. My VB app just
hangs.
> > I press CTL ALT DEL and I get a 'not responding' message for my VB app.
Then
> > I do End Task. It doesn't even write an error to my DTSlog file as it
seems
> > to hang in the DTS process of importing the records. I tried stepping
through
> > the process and I just get a "copy data from Assets to Temp Assets step
> > failed " message back from DTS.

> > Susan




> > > > Hi,

> > > > I am running a DTS package in VB 6 to import data into a temp file
from
> > > > a CSV file. If my file size is about 500 KB, no problem. When my
file
> > > > size is above 1.4M, the DTS package fails. Would anybody have some
> > > > suggestions why this would happen? Thank you.

> > > > Susan

> > > What's the error?
> > > Is there sufficient disk space?



Mon, 07 Apr 2003 03:00:00 GMT
 Large CSV Fails in DTS


Quote:
>I don't believe it's the DTS package that is failing. When I run it from EM, it
>works fine. It's actually VB's connection to the executing process that seems to
>loose touch. Once I execute the Dts package, because it takes so long, VB or
>Windows must think that the app is not responding and hangs. Is there anyway to
>put some code in to let whatever know that the app is still processing. Do
>events? Thanks.

>Susan

I think your best bet would indeed be to us the event handlers.

http://support.microsoft.com/support/kb/articles/q221/1/93.asp

You can ensure you get regular OnProgress events by setting the
ProgressRowCount Property of the DataPump.

Seems rather strange all the same.
--
Darren Green
SQL/DTS - http://www.swynk.com/friends/green/



Mon, 07 Apr 2003 03:00:00 GMT
 
 [ 6 post ] 

 Relevant Pages 

1. DTS fails to transfer large varchar columns

2. 2 identical csv files, 1 is 2 bytes larger than other, 1 won't import

3. Why can I not create large CSV files

4. Importing large amount of CSV's into Oracle 8

5. Insert Trigger failing to fire during Import of csv file

6. CSV import fails in SQL7?

7. Single record csv import failing

8. DTS Package call another, when child fails, parent fails

9. Importing unicode CSV file via DTS

10. Export to CSV from DTS or SP?

11. SQL 7.0 DTS Import of CSV files

12. Creating a DTS CSV File Source/Destination Connection


 
Powered by phpBB® Forum Software