convert fixed width Flat file to db2 tables using SQL DTS 2000 
Author Message
 convert fixed width Flat file to db2 tables using SQL DTS 2000
hi,
i am trying to migrate data from fixed width flat file
dumped from the cobol prg into Db2 UDB tables with some
transformations. i plan to use DTS for the same. The
problem is the enormous volume of data in the order of
16GB. My question is can DTS handle this bulk data
quantity and the transformations, are there any different
approaches to this problem. Any suggestions or help would
be highly appreciated

Cheers
Siddharth



Mon, 15 Aug 2005 22:48:15 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000

Hi Siddharth.

I'm not really sure I've understand what parts (flat file, DB2, SQL Server)
will be used and what parts will be retired. It might be helpful if you
could clarify.

If the data is *always* going to come from the flat file and move to SQL
Server, another option would be to use bcp. If the data will always move
from flat file to DB2, you could use a DB2 linked server to
query/manipulate data in SQL Server; or could use DTS. At this time, I'm
unable to find any maximum on DTS.

Sincerely,

Rita Nikas, MCSE MCDBA
Product Support Services
Microsoft Corporation

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
| Subject: convert fixed width Flat file to db2 tables using SQL DTS 2000
| Date: Thu, 27 Feb 2003 06:48:15 -0800
|
| hi,
| i am trying to migrate data from fixed width flat file
| dumped from the cobol prg into Db2 UDB tables with some
| transformations. i plan to use DTS for the same. The
| problem is the enormous volume of data in the order of
| 16GB. My question is can DTS handle this bulk data
| quantity and the transformations, are there any different
| approaches to this problem. Any suggestions or help would
| be highly appreciated
|
| Cheers
| Siddharth
|



Tue, 16 Aug 2005 06:08:16 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
hi rita,

thanx for your inputs, as regards the clarification,

We are in the process of migrating the mainframe data
dumped into fixed width flat file by a COBOL program and
move the data by transforming it(business logic/rules) and
putting it into IMB DB2 database which is the backend
database. The application for which the data is migrated
is using .NET technology and altogether a new application.

My question is whether we could use DTS to tranform and
pump data from fixed width flat file into DB2. SQL server
is to be used only for transformation and not for the
purpose of storage. Can DTS be a suitable or viable option
for transforming and pumping data from fixed width flat
file to db2 tables. Also can it process huge volumes of
data ( just over 16 GB) , are there any performance
issues, . I hope i have clarified enough :)

i dont think bcp utility allow transformation to the
sequential fixed flat file before pumping data into db2
tables.

Thanx again in advance

Cheers

Siddharth

Quote:
>-----Original Message-----
>Hi Siddharth.

>I'm not really sure I've understand what parts (flat

file, DB2, SQL Server)
Quote:
>will be used and what parts will be retired. It might be
helpful if you
>could clarify.

>If the data is *always* going to come from the flat file
and move to SQL
>Server, another option would be to use bcp. If the data
will always move
>from flat file to DB2, you could use a DB2 linked server
to
>query/manipulate data in SQL Server; or could use DTS. At
this time, I'm
>unable to find any maximum on DTS.

>Sincerely,

>Rita Nikas, MCSE MCDBA
>Product Support Services
>Microsoft Corporation

>This posting is provided "AS IS" with no warranties, and
confers no rights.

>--------------------
>| Subject: convert fixed width Flat file to db2 tables
using SQL DTS 2000
>| Date: Thu, 27 Feb 2003 06:48:15 -0800
>|
>| hi,
>| i am trying to migrate data from fixed width flat file
>| dumped from the cobol prg into Db2 UDB tables with some
>| transformations. i plan to use DTS for the same. The
>| problem is the enormous volume of data in the order of
>| 16GB. My question is can DTS handle this bulk data
>| quantity and the transformations, are there any
different
>| approaches to this problem. Any suggestions or help
would
>| be highly appreciated
>|
>| Cheers
>| Siddharth
>|

>.



Tue, 16 Aug 2005 07:06:28 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
Hi Siddharth.

Thanks for the reply.

As best I can tell, you *should* be able to use DTS from a flat text file
to DB2, as long as you're using an appropriate OLE DB provider for DB2 or
driver. The "DTS Driver Support for Heterogeneous Data Types" topic in SQL
Server 2000 Books Online outlines some drivers that are supported, too.

And, I've not found any limits to the file size that can be imported using
DTS. So, I'd recommend you give it a try and let us know how things go....

Sincerely,

Rita Nikas, MCSE MCDBA
Product Support Services
Microsoft Corporation

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
| Subject: RE: convert fixed width Flat file to db2 tables using SQL DTS
2000
| Date: Thu, 27 Feb 2003 15:06:28 -0800
|
| hi rita,
|
| thanx for your inputs, as regards the clarification,
|
| We are in the process of migrating the mainframe data
| dumped into fixed width flat file by a COBOL program and
| move the data by transforming it(business logic/rules) and
| putting it into IMB DB2 database which is the backend
| database. The application for which the data is migrated
| is using .NET technology and altogether a new application.
|
| My question is whether we could use DTS to tranform and
| pump data from fixed width flat file into DB2. SQL server
| is to be used only for transformation and not for the
| purpose of storage. Can DTS be a suitable or viable option
| for transforming and pumping data from fixed width flat
| file to db2 tables. Also can it process huge volumes of
| data ( just over 16 GB) , are there any performance
| issues, . I hope i have clarified enough :)
|
| i dont think bcp utility allow transformation to the
| sequential fixed flat file before pumping data into db2
| tables.
|
| Thanx again in advance
|
| Cheers
|
| Siddharth
|
|

Quote:
| >-----Original Message-----
| >Hi Siddharth.
| >
| >I'm not really sure I've understand what parts (flat
| file, DB2, SQL Server)
| >will be used and what parts will be retired. It might be
| helpful if you
| >could clarify.
| >
| >If the data is *always* going to come from the flat file
| and move to SQL
| >Server, another option would be to use bcp. If the data
| will always move
| >from flat file to DB2, you could use a DB2 linked server
| to
| >query/manipulate data in SQL Server; or could use DTS. At
| this time, I'm
| >unable to find any maximum on DTS.
| >
| >Sincerely,
| >
| >Rita Nikas, MCSE MCDBA
| >Product Support Services
| >Microsoft Corporation
| >
| >This posting is provided "AS IS" with no warranties, and
| confers no rights.
| >
| >
| >--------------------
| >| Subject: convert fixed width Flat file to db2 tables
| using SQL DTS 2000
| >| Date: Thu, 27 Feb 2003 06:48:15 -0800
| >|
| >| hi,
| >| i am trying to migrate data from fixed width flat file
| >| dumped from the cobol prg into Db2 UDB tables with some
| >| transformations. i plan to use DTS for the same. The
| >| problem is the enormous volume of data in the order of
| >| 16GB. My question is can DTS handle this bulk data
| >| quantity and the transformations, are there any
| different
| >| approaches to this problem. Any suggestions or help
| would
| >| be highly appreciated
| >|
| >| Cheers
| >| Siddharth
| >|
| >
| >.
| >
|



Tue, 16 Aug 2005 08:42:49 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
hi rita,
thanx for ur prompt reply...as per ur assurances as well
my previous encounters with DTS, it seems to be feasible,
but the large volumes of data is much of concern, the flat
file width is of 300K characters and the volume is 100K
records, the sheer volume gives shivers to the strategy
and the implementation as there is no second chance
involved in the data migration, if u could come up with
some figures or give a green signal that
"is" possible rather than "should" be possible, it would
be a great help

Cheers
Siddharth

Quote:
>-----Original Message-----
>Hi Siddharth.

>Thanks for the reply.

>As best I can tell, you *should* be able to use DTS from
a flat text file
>to DB2, as long as you're using an appropriate OLE DB

provider for DB2 or
Quote:
>driver. The "DTS Driver Support for Heterogeneous Data

Types" topic in SQL
Quote:
>Server 2000 Books Online outlines some drivers that are
supported, too.

>And, I've not found any limits to the file size that can
be imported using
>DTS. So, I'd recommend you give it a try and let us know
how things go....

>Sincerely,

>Rita Nikas, MCSE MCDBA
>Product Support Services
>Microsoft Corporation

>This posting is provided "AS IS" with no warranties, and
confers no rights.

>--------------------
>| Subject: RE: convert fixed width Flat file to db2

tables using SQL DTS

- Show quoted text -

Quote:
>2000
>| Date: Thu, 27 Feb 2003 15:06:28 -0800
>|
>| hi rita,
>|
>| thanx for your inputs, as regards the clarification,
>|
>| We are in the process of migrating the mainframe data
>| dumped into fixed width flat file by a COBOL program
and
>| move the data by transforming it(business logic/rules)
and
>| putting it into IMB DB2 database which is the backend
>| database. The application for which the data is
migrated
>| is using .NET technology and altogether a new
application.
>|
>| My question is whether we could use DTS to tranform and
>| pump data from fixed width flat file into DB2. SQL
server
>| is to be used only for transformation and not for the
>| purpose of storage. Can DTS be a suitable or viable
option
>| for transforming and pumping data from fixed width flat
>| file to db2 tables. Also can it process huge volumes of
>| data ( just over 16 GB) , are there any performance
>| issues, . I hope i have clarified enough :)
>|
>| i dont think bcp utility allow transformation to the
>| sequential fixed flat file before pumping data into db2
>| tables.
>|
>| Thanx again in advance
>|
>| Cheers
>|
>| Siddharth
>|
>|
>| >-----Original Message-----
>| >Hi Siddharth.
>| >
>| >I'm not really sure I've understand what parts (flat
>| file, DB2, SQL Server)
>| >will be used and what parts will be retired. It might
be
>| helpful if you
>| >could clarify.
>| >
>| >If the data is *always* going to come from the flat
file
>| and move to SQL
>| >Server, another option would be to use bcp. If the
data
>| will always move
>| >from flat file to DB2, you could use a DB2 linked
server
>| to
>| >query/manipulate data in SQL Server; or could use DTS.
At
>| this time, I'm
>| >unable to find any maximum on DTS.
>| >
>| >Sincerely,
>| >
>| >Rita Nikas, MCSE MCDBA
>| >Product Support Services
>| >Microsoft Corporation
>| >
>| >This posting is provided "AS IS" with no warranties,
and
>| confers no rights.
>| >
>| >
>| >--------------------
>| >| Subject: convert fixed width Flat file to db2 tables
>| using SQL DTS 2000
>| >| Date: Thu, 27 Feb 2003 06:48:15 -0800
>| >|
>| >| hi,
>| >| i am trying to migrate data from fixed width flat
file
>| >| dumped from the cobol prg into Db2 UDB tables with
some
>| >| transformations. i plan to use DTS for the same. The
>| >| problem is the enormous volume of data in the order
of
>| >| 16GB. My question is can DTS handle this bulk data
>| >| quantity and the transformations, are there any
>| different
>| >| approaches to this problem. Any suggestions or help
>| would
>| >| be highly appreciated
>| >|
>| >| Cheers
>| >| Siddharth
>| >|
>| >
>| >.
>| >
>|

>.



Wed, 17 Aug 2005 04:09:40 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
Hi Siddharth.

I'm doing some checking to see if this type of information exists or not.
Hope to have more information early next week...

Sincerely,

Rita Nikas, MCSE MCDBA
Product Support Services
Microsoft Corporation

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
| Subject: RE: convert fixed width Flat file to db2 tables using SQL DTS
2000
| Date: Fri, 28 Feb 2003 12:09:40 -0800
|
| hi rita,
| thanx for ur prompt reply...as per ur assurances as well
| my previous encounters with DTS, it seems to be feasible,
| but the large volumes of data is much of concern, the flat
| file width is of 300K characters and the volume is 100K
| records, the sheer volume gives shivers to the strategy
| and the implementation as there is no second chance
| involved in the data migration, if u could come up with
| some figures or give a green signal that
| "is" possible rather than "should" be possible, it would
| be a great help
|
| Cheers
| Siddharth
|

Quote:
| >-----Original Message-----
| >Hi Siddharth.
| >
| >Thanks for the reply.
| >
| >As best I can tell, you *should* be able to use DTS from
| a flat text file
| >to DB2, as long as you're using an appropriate OLE DB
| provider for DB2 or
| >driver. The "DTS Driver Support for Heterogeneous Data
| Types" topic in SQL
| >Server 2000 Books Online outlines some drivers that are
| supported, too.
| >
| >And, I've not found any limits to the file size that can
| be imported using
| >DTS. So, I'd recommend you give it a try and let us know
| how things go....
| >
| >Sincerely,
| >
| >Rita Nikas, MCSE MCDBA
| >Product Support Services
| >Microsoft Corporation
| >
| >This posting is provided "AS IS" with no warranties, and
| confers no rights.
| >
| >
| >--------------------
| >| Subject: RE: convert fixed width Flat file to db2
| tables using SQL DTS
| >2000
| >| Date: Thu, 27 Feb 2003 15:06:28 -0800
| >|
| >| hi rita,
| >|
| >| thanx for your inputs, as regards the clarification,
| >|
| >| We are in the process of migrating the mainframe data
| >| dumped into fixed width flat file by a COBOL program
| and
| >| move the data by transforming it(business logic/rules)
| and
| >| putting it into IMB DB2 database which is the backend
| >| database. The application for which the data is
| migrated
| >| is using .NET technology and altogether a new
| application.
| >|
| >| My question is whether we could use DTS to tranform and
| >| pump data from fixed width flat file into DB2. SQL
| server
| >| is to be used only for transformation and not for the
| >| purpose of storage. Can DTS be a suitable or viable
| option
| >| for transforming and pumping data from fixed width flat
| >| file to db2 tables. Also can it process huge volumes of
| >| data ( just over 16 GB) , are there any performance
| >| issues, . I hope i have clarified enough :)
| >|
| >| i dont think bcp utility allow transformation to the
| >| sequential fixed flat file before pumping data into db2
| >| tables.
| >|
| >| Thanx again in advance
| >|
| >| Cheers
| >|
| >| Siddharth
| >|
| >|
| >| >-----Original Message-----
| >| >Hi Siddharth.
| >| >
| >| >I'm not really sure I've understand what parts (flat
| >| file, DB2, SQL Server)
| >| >will be used and what parts will be retired. It might
| be
| >| helpful if you
| >| >could clarify.
| >| >
| >| >If the data is *always* going to come from the flat
| file
| >| and move to SQL
| >| >Server, another option would be to use bcp. If the
| data
| >| will always move
| >| >from flat file to DB2, you could use a DB2 linked
| server
| >| to
| >| >query/manipulate data in SQL Server; or could use DTS.
| At
| >| this time, I'm
| >| >unable to find any maximum on DTS.
| >| >
| >| >Sincerely,
| >| >
| >| >Rita Nikas, MCSE MCDBA
| >| >Product Support Services
| >| >Microsoft Corporation
| >| >
| >| >This posting is provided "AS IS" with no warranties,
| and
| >| confers no rights.
| >| >
| >| >
| >| >--------------------
| >| >| Subject: convert fixed width Flat file to db2 tables
| >| using SQL DTS 2000
| >| >| Date: Thu, 27 Feb 2003 06:48:15 -0800
| >| >|
| >| >| hi,
| >| >| i am trying to migrate data from fixed width flat
| file
| >| >| dumped from the cobol prg into Db2 UDB tables with
| some
| >| >| transformations. i plan to use DTS for the same. The
| >| >| problem is the enormous volume of data in the order
| of
| >| >| 16GB. My question is can DTS handle this bulk data
| >| >| quantity and the transformations, are there any
| >| different
| >| >| approaches to this problem. Any suggestions or help
| >| would
| >| >| be highly appreciated
| >| >|
| >| >| Cheers
| >| >| Siddharth
| >| >|
| >| >
| >| >.
| >| >
| >|
| >
| >.
| >
|



Wed, 17 Aug 2005 06:33:05 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
Hi Siddharth.

So far, I've got a couple of suggestions from others who've had very large
DTS import processes:

* Make sure that there is plenty of space on the directory the data file
and the transaction log file.
* Make sure that there are regular jobs scheduled for taking care of the
transaction log.

But, I'm still looking for any hard data on DTS limits...

Sincerely,

Rita Nikas, MCSE MCDBA
Product Support Services
Microsoft Corporation

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
| Subject: RE: convert fixed width Flat file to db2 tables using SQL DTS
2000
| Date: Fri, 28 Feb 2003 12:09:40 -0800
|
| hi rita,
| thanx for ur prompt reply...as per ur assurances as well
| my previous encounters with DTS, it seems to be feasible,
| but the large volumes of data is much of concern, the flat
| file width is of 300K characters and the volume is 100K
| records, the sheer volume gives shivers to the strategy
| and the implementation as there is no second chance
| involved in the data migration, if u could come up with
| some figures or give a green signal that
| "is" possible rather than "should" be possible, it would
| be a great help
|
| Cheers
| Siddharth
|

Quote:
| >-----Original Message-----
| >Hi Siddharth.
| >
| >Thanks for the reply.
| >
| >As best I can tell, you *should* be able to use DTS from
| a flat text file
| >to DB2, as long as you're using an appropriate OLE DB
| provider for DB2 or
| >driver. The "DTS Driver Support for Heterogeneous Data
| Types" topic in SQL
| >Server 2000 Books Online outlines some drivers that are
| supported, too.
| >
| >And, I've not found any limits to the file size that can
| be imported using
| >DTS. So, I'd recommend you give it a try and let us know
| how things go....
| >
| >Sincerely,
| >
| >Rita Nikas, MCSE MCDBA
| >Product Support Services
| >Microsoft Corporation
| >
| >This posting is provided "AS IS" with no warranties, and

| confers no rights.
| >
| >
| >--------------------
| >| Subject: RE: convert fixed width Flat file to db2
| tables using SQL DTS
| >2000
| >| Date: Thu, 27 Feb 2003 15:06:28 -0800
| >|
| >| hi rita,
| >|
| >| thanx for your inputs, as regards the clarification,
| >|
| >| We are in the process of migrating the mainframe data
| >| dumped into fixed width flat file by a COBOL program
| and
| >| move the data by transforming it(business logic/rules)
| and
| >| putting it into IMB DB2 database which is the backend
| >| database. The application for which the data is
| migrated
| >| is using .NET technology and altogether a new
| application.
| >|
| >| My question is whether we could use DTS to tranform and
| >| pump data from fixed width flat file into DB2. SQL
| server
| >| is to be used only for transformation and not for the
| >| purpose of storage. Can DTS be a suitable or viable
| option
| >| for transforming and pumping data from fixed width flat
| >| file to db2 tables. Also can it process huge volumes of
| >| data ( just over 16 GB) , are there any performance
| >| issues, . I hope i have clarified enough :)
| >|
| >| i dont think bcp utility allow transformation to the
| >| sequential fixed flat file before pumping data into db2
| >| tables.
| >|
| >| Thanx again in advance
| >|
| >| Cheers
| >|
| >| Siddharth
| >|
| >|
| >| >-----Original Message-----
| >| >Hi Siddharth.
| >| >
| >| >I'm not really sure I've understand what parts (flat
| >| file, DB2, SQL Server)
| >| >will be used and what parts will be retired. It might
| be
| >| helpful if you
| >| >could clarify.
| >| >
| >| >If the data is *always* going to come from the flat
| file
| >| and move to SQL
| >| >Server, another option would be to use bcp. If the
| data
| >| will always move
| >| >from flat file to DB2, you could use a DB2 linked
| server
| >| to
| >| >query/manipulate data in SQL Server; or could use DTS.
| At
| >| this time, I'm
| >| >unable to find any maximum on DTS.
| >| >
| >| >Sincerely,
| >| >
| >| >Rita Nikas, MCSE MCDBA
| >| >Product Support Services
| >| >Microsoft Corporation
| >| >
| >| >This posting is provided "AS IS" with no warranties,
| and
| >| confers no rights.
| >| >
| >| >
| >| >--------------------
| >| >| Subject: convert fixed width Flat file to db2 tables
| >| using SQL DTS 2000
| >| >| Date: Thu, 27 Feb 2003 06:48:15 -0800
| >| >|
| >| >| hi,
| >| >| i am trying to migrate data from fixed width flat
| file
| >| >| dumped from the cobol prg into Db2 UDB tables with
| some
| >| >| transformations. i plan to use DTS for the same. The
| >| >| problem is the enormous volume of data in the order
| of
| >| >| 16GB. My question is can DTS handle this bulk data
| >| >| quantity and the transformations, are there any
| >| different
| >| >| approaches to this problem. Any suggestions or help
| >| would
| >| >| be highly appreciated
| >| >|
| >| >| Cheers
| >| >| Siddharth
| >| >|
| >| >
| >| >.
| >| >
| >|
| >
| >.
| >
|



Wed, 17 Aug 2005 08:18:29 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
Hi Siddharth.

I have some additional information for you regarding this issue.

NOTE: If you want more information than provided here or you want more
information based on your specific scenario, I'd recommend that you open a
support incident with Microsoft Product Support Services.

After reviewing your questions with several co-workers, we've come to the
conclusion that your scenario will work (we can't provide an absolute
answer as we don't have your scenario to test with); and, your scenario
will most likely be slow. Here's some specifics:

        *       From your NG post description, you may not be able to import the data
structure you have has described into SQL Server (300000 character rows).

        *       You're concerned about the massive size of importing and if DTS can
handle this well. So far, we've been unable to find any documented limits.

                Any limitations would be determined by the OLE DB provders involved, or
the ODBC drivers, not by DTS.  However, DTS will impact the performance.

        *       If your provided supports the characteristics present in your scenario
(flat file width of 300K characters and the volume of 100K records), then
DTS should              be able to handle it, too.

DTS can be used to do this (your scenario), but it will not be fast.  DTS
is designed for flexibility more than performance.  More specifically, the
datapump will only insert one row at a time when the destination is
something other than SQL Server.

And, bcp won't allow transformation to the sequential fixed flat file
before pumping data into db2 tables.

Sincerely,

Rita Nikas, MCSE MCDBA
Product Support Services
Microsoft Corporation

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
| Subject: RE: convert fixed width Flat file to db2 tables using SQL DTS
2000
| Date: Fri, 28 Feb 2003 12:09:40 -0800
|
| hi rita,
| thanx for ur prompt reply...as per ur assurances as well
| my previous encounters with DTS, it seems to be feasible,
| but the large volumes of data is much of concern, the flat
| file width is of 300K characters and the volume is 100K
| records, the sheer volume gives shivers to the strategy
| and the implementation as there is no second chance
| involved in the data migration, if u could come up with
| some figures or give a green signal that
| "is" possible rather than "should" be possible, it would
| be a great help
|
| Cheers
| Siddharth
|

Quote:
| >-----Original Message-----
| >Hi Siddharth.
| >
| >Thanks for the reply.
| >
| >As best I can tell, you *should* be able to use DTS from
| a flat text file
| >to DB2, as long as you're using an appropriate OLE DB
| provider for DB2 or
| >driver. The "DTS Driver Support for Heterogeneous Data
| Types" topic in SQL
| >Server 2000 Books Online outlines some drivers that are
| supported, too.
| >
| >And, I've not found any limits to the file size that can
| be imported using
| >DTS. So, I'd recommend you give it a try and let us know
| how things go....
| >
| >Sincerely,
| >
| >Rita Nikas, MCSE MCDBA
| >Product Support Services
| >Microsoft Corporation
| >
| >This posting is provided "AS IS" with no warranties, and
| confers no rights.
| >
| >
| >--------------------
| >| Subject: RE: convert fixed width Flat file to db2
| tables using SQL DTS
| >2000
| >| Date: Thu, 27 Feb 2003 15:06:28 -0800
| >|
| >| hi rita,
| >|
| >| thanx for your inputs, as regards the clarification,
| >|
| >| We are in the process of migrating the mainframe data
| >| dumped into fixed width flat file by a COBOL program
| and
| >| move the data by transforming it(business logic/rules)
| and
| >| putting it into IMB DB2 database which is the backend
| >| database. The application for which the data is
| migrated
| >| is using .NET technology and altogether a new
| application.
| >|
| >| My question is whether we could use DTS to tranform and
| >| pump data from fixed width flat file into DB2. SQL
| server
| >| is to be used only for transformation and not for the
| >| purpose of storage. Can DTS be a suitable or viable
| option
| >| for transforming and pumping data from fixed width flat
| >| file to db2 tables. Also can it process huge volumes of
| >| data ( just over 16 GB) , are there any performance
| >| issues, . I hope i have clarified enough :)
| >|
| >| i dont think bcp utility allow transformation to the
| >| sequential fixed flat file before pumping data into db2
| >| tables.
| >|
| >| Thanx again in advance
| >|
| >| Cheers
| >|
| >| Siddharth
| >|
| >|
| >| >-----Original Message-----
| >| >Hi Siddharth.
| >| >
| >| >I'm not really sure I've understand what parts (flat
| >| file, DB2, SQL Server)
| >| >will be used and what parts will be retired. It might
| be
| >| helpful if you
| >| >could clarify.
| >| >
| >| >If the data is *always* going to come from the flat
| file
| >| and move to SQL
| >| >Server, another option would be to use bcp. If the
| data
| >| will always move
| >| >from flat file to DB2, you could use a DB2 linked
| server
| >| to
| >| >query/manipulate data in SQL Server; or could use DTS.
| At
| >| this time, I'm
| >| >unable to find any maximum on DTS.
| >| >
| >| >Sincerely,
| >| >
| >| >Rita Nikas, MCSE MCDBA
| >| >Product Support Services
| >| >Microsoft Corporation
| >| >
| >| >This posting is provided "AS IS" with no warranties,
| and
| >| confers no rights.
| >| >
| >| >
| >| >--------------------
| >| >| Subject: convert fixed width Flat file to db2 tables
| >| using SQL DTS 2000
| >| >| Date: Thu, 27 Feb 2003 06:48:15 -0800
| >| >|
| >| >| hi,
| >| >| i am trying to migrate data from fixed width flat
| file
| >| >| dumped from the cobol prg into Db2 UDB tables with
| some
| >| >| transformations. i plan to use DTS for the same. The
| >| >| problem is the enormous volume of data in the order
| of
| >| >| 16GB. My question is can DTS handle this bulk data
| >| >| quantity and the transformations, are there any
| >| different
| >| >| approaches to this problem. Any suggestions or help
| >| would
| >| >| be highly appreciated
| >| >|
| >| >| Cheers
| >| >| Siddharth
| >| >|
| >| >
| >| >.
| >| >
| >|
| >
| >.
| >
|



Sat, 20 Aug 2005 01:43:53 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
Hi Siddharth.

I'm following up with you regarding this issue. To better serve you and
provide you with specialized and thorough support for this issue, I
recommend that you open a support incident with Microsoft Product Support
Services.

To expedite creation of this support incident, I'll be sending you an
e-mail, asking you for additional information. After I receive an e-mail
from you with the requested information, I can create a non-decremented,
free support incident for you. Then, one of our support professionals can
further assist you regarding this issue.

Do keep in mind that, if this issue is deemed to be by design or due to a
design limitation in your particular situation, we will need to close the
non-decremented, free support incident and open a new, paid support
incident.

As an alternative, please feel free to contact Product Support Services
yourself, if you prefer to open a support incident in that manner.

Sincerely,

Rita Nikas, MCSE MCDBA
Product Support Services
Microsoft Corporation

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
| Subject: RE: convert fixed width Flat file to db2 tables using SQL DTS
2000
| Date: Fri, 28 Feb 2003 12:09:40 -0800
|
| hi rita,
| thanx for ur prompt reply...as per ur assurances as well
| my previous encounters with DTS, it seems to be feasible,
| but the large volumes of data is much of concern, the flat
| file width is of 300K characters and the volume is 100K
| records, the sheer volume gives shivers to the strategy
| and the implementation as there is no second chance
| involved in the data migration, if u could come up with
| some figures or give a green signal that
| "is" possible rather than "should" be possible, it would
| be a great help
|
| Cheers
| Siddharth
|

Quote:
| >-----Original Message-----
| >Hi Siddharth.
| >
| >Thanks for the reply.
| >
| >As best I can tell, you *should* be able to use DTS from
| a flat text file
| >to DB2, as long as you're using an appropriate OLE DB
| provider for DB2 or
| >driver. The "DTS Driver Support for Heterogeneous Data
| Types" topic in SQL
| >Server 2000 Books Online outlines some drivers that are
| supported, too.
| >
| >And, I've not found any limits to the file size that can
| be imported using
| >DTS. So, I'd recommend you give it a try and let us know
| how things go....
| >
| >Sincerely,
| >
| >Rita Nikas, MCSE MCDBA
| >Product Support Services
| >Microsoft Corporation
| >
| >This posting is provided "AS IS" with no warranties, and
| confers no rights.
| >
| >
| >--------------------
| >| Subject: RE: convert fixed width Flat file to db2
| tables using SQL DTS
| >2000
| >| Date: Thu, 27 Feb 2003 15:06:28 -0800
| >|
| >| hi rita,
| >|
| >| thanx for your inputs, as regards the clarification,
| >|
| >| We are in the process of migrating the mainframe data
| >| dumped into fixed width flat file by a COBOL program
| and
| >| move the data by transforming it(business logic/rules)
| and
| >| putting it into IMB DB2 database which is the backend
| >| database. The application for which the data is
| migrated
| >| is using .NET technology and altogether a new
| application.
| >|
| >| My question is whether we could use DTS to tranform and
| >| pump data from fixed width flat file into DB2. SQL
| server
| >| is to be used only for transformation and not for the
| >| purpose of storage. Can DTS be a suitable or viable
| option
| >| for transforming and pumping data from fixed width flat
| >| file to db2 tables. Also can it process huge volumes of
| >| data ( just over 16 GB) , are there any performance
| >| issues, . I hope i have clarified enough :)
| >|
| >| i dont think bcp utility allow transformation to the
| >| sequential fixed flat file before pumping data into db2
| >| tables.
| >|
| >| Thanx again in advance
| >|
| >| Cheers
| >|
| >| Siddharth
| >|
| >|
| >| >-----Original Message-----
| >| >Hi Siddharth.
| >| >
| >| >I'm not really sure I've understand what parts (flat
| >| file, DB2, SQL Server)
| >| >will be used and what parts will be retired. It might
| be
| >| helpful if you
| >| >could clarify.
| >| >
| >| >If the data is *always* going to come from the flat
| file
| >| and move to SQL
| >| >Server, another option would be to use bcp. If the
| data
| >| will always move
| >| >from flat file to DB2, you could use a DB2 linked
| server
| >| to
| >| >query/manipulate data in SQL Server; or could use DTS.
| At
| >| this time, I'm
| >| >unable to find any maximum on DTS.
| >| >
| >| >Sincerely,
| >| >
| >| >Rita Nikas, MCSE MCDBA
| >| >Product Support Services
| >| >Microsoft Corporation
| >| >
| >| >This posting is provided "AS IS" with no warranties,
| and
| >| confers no rights.
| >| >
| >| >
| >| >--------------------
| >| >| Subject: convert fixed width Flat file to db2 tables
| >| using SQL DTS 2000
| >| >| Date: Thu, 27 Feb 2003 06:48:15 -0800
| >| >|
| >| >| hi,
| >| >| i am trying to migrate data from fixed width flat
| file
| >| >| dumped from the cobol prg into Db2 UDB tables with
| some
| >| >| transformations. i plan to use DTS for the same. The
| >| >| problem is the enormous volume of data in the order
| of
| >| >| 16GB. My question is can DTS handle this bulk data
| >| >| quantity and the transformations, are there any
| >| different
| >| >| approaches to this problem. Any suggestions or help
| >| would
| >| >| be highly appreciated
| >| >|
| >| >| Cheers
| >| >| Siddharth
| >| >|
| >| >
| >| >.
| >| >
| >|
| >
| >.
| >
|



Wed, 24 Aug 2005 01:52:17 GMT
 convert fixed width Flat file to db2 tables using SQL DTS 2000
Hi Siddharth.

As I understand it from your e-mail to me, you needed substantive evidence
that DTS would sustain the large volume of data importing, as you mentioned
here in this post. Your client has decided to go with SAS Software for ETL
and data transformation.

Thanks for letting us know.

Sincerely,

Rita Nikas, MCSE MCDBA
Product Support Services
Microsoft Corporation

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
| Subject: RE: convert fixed width Flat file to db2 tables using SQL DTS
2000
| Date: Fri, 28 Feb 2003 12:09:40 -0800
|
| hi rita,
| thanx for ur prompt reply...as per ur assurances as well
| my previous encounters with DTS, it seems to be feasible,
| but the large volumes of data is much of concern, the flat
| file width is of 300K characters and the volume is 100K
| records, the sheer volume gives shivers to the strategy
| and the implementation as there is no second chance
| involved in the data migration, if u could come up with
| some figures or give a green signal that
| "is" possible rather than "should" be possible, it would
| be a great help
|
| Cheers
| Siddharth
|

Quote:
| >-----Original Message-----
| >Hi Siddharth.
| >
| >Thanks for the reply.
| >
| >As best I can tell, you *should* be able to use DTS from
| a flat text file
| >to DB2, as long as you're using an appropriate OLE DB
| provider for DB2 or
| >driver. The "DTS Driver Support for Heterogeneous Data
| Types" topic in SQL
| >Server 2000 Books Online outlines some drivers that are
| supported, too.
| >
| >And, I've not found any limits to the file size that can
| be imported using
| >DTS. So, I'd recommend you give it a try and let us know
| how things go....
| >
| >Sincerely,
| >
| >Rita Nikas, MCSE MCDBA
| >Product Support Services
| >Microsoft Corporation
| >
| >This posting is provided "AS IS" with no warranties, and
| confers no rights.
| >
| >
| >--------------------
| >| Subject: RE: convert fixed width Flat file to db2
| tables using SQL DTS
| >2000
| >| Date: Thu, 27 Feb 2003 15:06:28 -0800
| >|
| >| hi rita,
| >|
| >| thanx for your inputs, as regards the clarification,
| >|
| >| We are in the process of migrating the mainframe data
| >| dumped into fixed width flat file by a COBOL program
| and
| >| move the data by transforming it(business logic/rules)
| and
| >| putting it into IMB DB2 database which is the backend
| >| database. The application for which the data is
| migrated
| >| is using .NET technology and altogether a new
| application.
| >|
| >| My question is whether we could use DTS to tranform and
| >| pump data from fixed width flat file into DB2. SQL
| server
| >| is to be used only for transformation and not for the
| >| purpose of storage. Can DTS be a suitable or viable
| option
| >| for transforming and pumping data from fixed width flat
| >| file to db2 tables. Also can it process huge volumes of
| >| data ( just over 16 GB) , are there any performance
| >| issues, . I hope i have clarified enough :)
| >|
| >| i dont think bcp utility allow transformation to the
| >| sequential fixed flat file before pumping data into db2
| >| tables.
| >|
| >| Thanx again in advance
| >|
| >| Cheers
| >|
| >| Siddharth
| >|
| >|
| >| >-----Original Message-----
| >| >Hi Siddharth.
| >| >
| >| >I'm not really sure I've understand what parts (flat
| >| file, DB2, SQL Server)
| >| >will be used and what parts will be retired. It might
| be
| >| helpful if you
| >| >could clarify.
| >| >
| >| >If the data is *always* going to come from the flat
| file
| >| and move to SQL
| >| >Server, another option would be to use bcp. If the
| data
| >| will always move
| >| >from flat file to DB2, you could use a DB2 linked
| server
| >| to
| >| >query/manipulate data in SQL Server; or could use DTS.
| At
| >| this time, I'm
| >| >unable to find any maximum on DTS.
| >| >
| >| >Sincerely,
| >| >
| >| >Rita Nikas, MCSE MCDBA
| >| >Product Support Services
| >| >Microsoft Corporation
| >| >
| >| >This posting is provided "AS IS" with no warranties,
| and
| >| confers no rights.
| >| >
| >| >
| >| >--------------------
| >| >| Subject: convert fixed width Flat file to db2 tables
| >| using SQL DTS 2000
| >| >| Date: Thu, 27 Feb 2003 06:48:15 -0800
| >| >|
| >| >| hi,
| >| >| i am trying to migrate data from fixed width flat
| file
| >| >| dumped from the cobol prg into Db2 UDB tables with
| some
| >| >| transformations. i plan to use DTS for the same. The
| >| >| problem is the enormous volume of data in the order
| of
| >| >| 16GB. My question is can DTS handle this bulk data
| >| >| quantity and the transformations, are there any
| >| different
| >| >| approaches to this problem. Any suggestions or help
| >| would
| >| >| be highly appreciated
| >| >|
| >| >| Cheers
| >| >| Siddharth
| >| >|
| >| >
| >| >.
| >| >
| >|
| >
| >.
| >
|



Wed, 24 Aug 2005 04:57:39 GMT
 
 [ 10 post ] 

 Relevant Pages 

1. Converting a Fixed Width text file to an access database table

2. problem import text file with fixed width fields using dts

3. Row width limit when importing fixed width files (SQL 7.0)

4. DTS error - fixed field width - considers width of first line only

5. DTS with Fixed Width Text Files DOES NOT WORK

6. DTS Fixed Width File import failing because of a single quote

7. DTS - Last Row in Fixed Width Text File Source Ignored

8. DTS Creating nulls on fixed width file import

9. Fixed Width Files In DTS

10. DTS Fixed Width Text File

11. BUG in DTS Fixed-width Text File Import

12. DTS Cannot Handle Blank Date Fields in Fixed-Width Text Files


 
Powered by phpBB® Forum Software