Our Compliance is taking extendedly long time... 
Author Message
 Our Compliance is taking extendedly long time...

This is a multi-part message in MIME format.

------=_NextPart_000_01E8_01C14B38.C1E274A0
Content-Type: multipart/alternative;
        boundary="----=_NextPart_001_01E9_01C14B38.C1E274A0"

------=_NextPart_001_01E9_01C14B38.C1E274A0
Content-Type: text/plain;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Dear All,
We are facing a  problem with our "Compliance Run" taking an extendedly =
long time to complete ( approximately 10 - 12 days). Ideally, the length =
of this run should  take not more than 2 days.
The "Compliance Run" may be described as the process of calculating =
interest, penalty and surcharge on taxpayer ledgers and generating the =
respective notices.
We have attached the following details:-
1. onstat -p =20
2. onstat -c=20
3. onstat -d
4. onstat -m
5. onstat -F
6. onstat -k
7. load average
8. sqlexplain.out  output taken over a period of approximately 30 min.
9. extend report of all large tables in the database.

The development server is running AIX 4.3.3 with IDS version 7.31.UD1X5 =
and the production server is running AIX 4.3.3 IDS version 7.31.UC3

This is a trial run which is being executed on a development server =
using production data. The actual Run must  take place this weekend on =
the production server which has Enterprise Replication running.=20

regards

-------------------------------------------------------------------------=
-------------------------
Rulesh Felix Rebello
Informix DBA
Fiscal Services Ltd.

Office : 1-(876)-927 1125 Extn : 446
Home : 1-(876)-926 6616

------=_NextPart_001_01E9_01C14B38.C1E274A0
Content-Type: text/html;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=3DContent-Type content=3D"text/html; =
charset=3Diso-8859-1">
<META content=3D"MSHTML 5.50.4134.600" name=3DGENERATOR>
<STYLE></STYLE>
</HEAD>
<BODY bgColor=3D#ffffff>
<DIV><FONT face=3DArial size=3D2></FONT><BR></DIV>
<DIV><FONT face=3DArial size=3D2>Dear All,</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>We are&nbsp;facing a </FONT>&nbsp;<FONT =
face=3DArial=20
size=3D2>problem with our "Compliance Run" taking an extendedly long =
time to=20
complete ( approximately 10 - 12 days). Ideally, the&nbsp;length of this =
run=20
should&nbsp; take&nbsp;not more than&nbsp;2 days.</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>The "Compliance Run" may be described =
as the=20
process of calculating interest, penalty and surcharge on taxpayer =
ledgers and=20
generating the respective notices.</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>We have attached the following=20
details:-</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>1. onstat -p&nbsp; </FONT></DIV>
<DIV><FONT face=3DArial size=3D2>2. onstat -c </FONT></DIV>
<DIV><FONT face=3DArial size=3D2>3. onstat -d</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>4. onstat -m</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>5. onstat -F</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>6. onstat -k</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>7. load average</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>8. sqlexplain.out&nbsp; output taken =
over a period=20
of approximately 30 min.</FONT></DIV>
<DIV><FONT face=3DArial size=3D2>9. extend report of all large tables in =
the=20
database.</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2>The development server is running AIX =
4.3.3 with=20
IDS version 7.31.UD1X5 and the production server is running AIX 4.3.3 =
IDS=20
version 7.31.UC3</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2>This is a trial run which is being =
executed=20
on&nbsp;a development server&nbsp;using production data.&nbsp;The actual =
Run=20
<U>must</U>&nbsp; take place this weekend on the production server which =
has=20
Enterprise Replication running. </FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2>regards</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial=20
size=3D2>----------------------------------------------------------------=
----------------------------------<BR>Rulesh=20
Felix Rebello<BR>Informix DBA<BR>Fiscal Services Ltd.<BR>Email : <A=20

1-(876)-927 1125 Extn : 446<BR>Home : 1-(876)-926=20
6616</FONT></DIV></BODY></HTML>

------=_NextPart_001_01E9_01C14B38.C1E274A0--

------=_NextPart_000_01E8_01C14B38.C1E274A0
Content-Type: text/plain;
        name="load_average.txt"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
        filename="load_average.txt"

  10:21AM   up 65 days, 50 mins,  27 users,  load average: 1.16, 1.15, =
1.10

root     pts/0       Sun10AM         34      1:15         1 e
kcampbel pts/1       07:14AM       1:56         0         0 -ksh
root     pts/2       07:14PM          3         0         0 -ksh
jcools   pts/3       Thu03PM      17:32      1:55         0 -ksh
informix pts/5       05:56PM          0         4         0 w
kcampbel pts/4       08:16AM         11        27         0 -ksh
vthomas  pts/6       08:52AM         31         0         0 -ksh
ccole    pts/7       10:14AM          7         0         0 -ksh
trn      pts/8       08:18AM          0        23         0 vi
ccole    pts/9       10:14AM          0         0         0 -ksh
rporter  pts/10      10:17AM          2         0         0 -ksh
amckenzi pts/11      08:24AM       1:03         0         0 vi
root     pts/12      08:27AM       1:42         3         0 =
/usr/lib/INed/helpe
mmarfo   pts/13      08:29AM         22         4         0 ac031.4ge
cthompsn pts/14      08:36AM          0         5         2 vi
mmarfo   pts/15      08:29AM          3         8         1 vi
mmarfo   pts/16      08:29AM         12         0         0 isql
trn      pts/17      08:33AM          9         0         0 =
/home/trn/exe/mnt_a
mbowen   pts/20      08:54AM          6         0         0 ac033.4ge
trn      pts/21      09:19AM         11        13         0 dbaccess
amckenzi pts/22      09:12AM          0         0         0 dbaccess
trn      pts/24      09:39AM         37         0         0 =
/home/trn/exe/sys_m
trn      pts/25      09:35AM          1         0         0 -ksh
kcampbel pts/26      09:47AM         10        10         0 dbaccess
informix pts/28      10:02AM          4         0         0 -ksh
jcools   pts/35      Thu03PM      17:32         5         0 -ksh
jcools   pts/37      Thu04PM      4days        47         0 -ksh

------=_NextPart_000_01E8_01C14B38.C1E274A0
Content-Type: text/plain;
        name="onstat -c.txt"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
        filename="onstat -c.txt"

Informix Dynamic Server Version 7.31.UD1X5  -- On-Line -- Up 65 days =
00:47:12 -- 616416 Kbytes

Configuration File: /home/informix/etc/onconfig.ae
#************************************************************************=
**
#
#                          INFORMIX SOFTWARE, INC.
#
#  Title:       onconfig.ae
#  Description: Informix Dynamic Server Configuration Parameters for
#               AE instance
#************************************************************************=
**

# Root Dbspace Configuration

ROOTNAME        rootdbs         # Root dbspace name
ROOTPATH        /dev/rdev_rootdbs # Path for device containing root =
dbspace
ROOTOFFSET      0               # Offset of root dbspace into device =
(Kbytes)
ROOTSIZE        480000          # Size of root dbspace (Kbytes)

# Disk Mirroring Configuration Parameters

MIRROR          0               # Mirroring flag (Yes =3D 1, No =3D 0)
MIRRORPATH                      # Path for device containing mirrored =
root
MIRROROFFSET    0               # Offset into mirrored device (Kbytes)

# Physical Log Configuration

PHYSDBS         logdbs          # Location (dbspace) of physical log
PHYSFILE        64000           # Physical log file size (Kbytes)

# Logical Log Configuration

LOGFILES        50              # Number of logical log files
LOGSIZE         5000            # Logical log size (Kbytes)

# Diagnostics

MSGPATH         /home/informix/online_ae.log # System message log file =
path
CONSOLE         /home/informix/online_ae.log # System console message =
path
ALARMPROGRAM    /home/informix/etc/log_full.sh # Alarm program path
SYSALARMPROGRAM /home/informix/etc/evidence.sh # System Alarm program =
path
TBLSPACE_STATS  1              =20

# System Archive Tape Device

TAPEDEV         /dev/null       # Tape device path=09
TAPEBLK         16              # Tape block size (Kbytes)
TAPESIZE        24000000        # Maximum amount of data to put on tape =
(Kbytes)

# Log Archive Tape Device

LTAPEDEV        /dev/null       # Log tape device path
LTAPEBLK        16              # Log tape block size (Kbytes)
LTAPESIZE       24000000        # Max amount of data to put on log tape =
(Kbytes)

# Optical

STAGEBLOB                       # Informix Dynamic Server/Optical =
staging area

# System Configuration

SERVERNUM       0               # Unique id corresponding to a Dynamic =
Server instance
DBSERVERNAME    ae              # Name of default database server
DBSERVERALIASES ae_shm          # List of alternate dbservernames
NETTYPE         ipcshm,1,50,CPU # Configure poll thread(s) for nettype
NETTYPE         soctcp,1,50,NET # Configure poll thread(s) for nettype
DEADLOCK_TIMEOUT 60              # Max time to wait of lock in =
distributed env.
RESIDENT        0               # Forced residency flag (Yes =3D 1, No =
=3D 0)

MULTIPROCESSOR  1               # 0 for single-processor, 1 for =
multi-processor
NUMCPUVPS       1               # Number of user (cpu) vps
SINGLE_CPU_VP   0               # If non-zero, limit number of cpu vps =
to one

NOAGE           0               # Process aging
AFF_SPROC       0               #
...

read more »



Sun, 21 Mar 2004 00:52:48 GMT
 Our Compliance is taking extendedly long time...

It's all in MIME, and I can't be bothered to look at it.


Sun, 21 Mar 2004 01:55:40 GMT
 Our Compliance is taking extendedly long time...

I didn't see anything glaring enough to cut down your processing time by
80-90%.

It might be that rewriting your application is necessary, I don't know enough
about how you are going about doing these calculations...

Will

Quote:

=====
>Dear All,
>We are facing a  problem with our "Compliance Run" taking an extendedly long

time to complete ( approximately 10 - 12 days). Ideally, the length of this
run should  take not more than 2 days.
Quote:
>The "Compliance Run" may be described as the process of calculating interest,

penalty and surcharge on taxpayer ledgers and generating the respective
notices.
Quote:
>We have attached the following details:-
>1. onstat -p
>2. onstat -c
>3. onstat -d
>4. onstat -m
>5. onstat -F
>6. onstat -k
>7. load average
>8. sqlexplain.out  output taken over a period of approximately 30 min.
>9. extend report of all large tables in the database.

>The development server is running AIX 4.3.3 with IDS version 7.31.UD1X5 and

the production server is running AIX 4.3.3 IDS version 7.31.UC3
Quote:

>This is a trial run which is being executed on a development server using

production data. The actual Run must  take place this weekend on the
production server which has Enterprise Replication running.
Quote:

>regards

>-----------------------------------------------------------------------------

---------------------

Quote:
>Rulesh Felix Rebello
>Informix DBA
>Fiscal Services Ltd.

>Office : 1-(876)-927 1125 Extn : 446
>Home : 1-(876)-926 6616

+++
"I am not laughing at you mom, I am laughing with Will" -Celena Cox
+++


Sun, 21 Mar 2004 03:49:34 GMT
 Our Compliance is taking extendedly long time...

--openmail-part-21190019-00000001
Content-Type: text/plain; charset=US-ASCII
Content-Disposition: inline
Content-Transfer-Encoding: 7bit

Rebello,

To find out the bottleneck areas I would put some output statements with
timestamps in my code. That would give you a good idea where do you problem if
any.

Vivek Chaudhary

______________________________ Reply Separator _________________________________
Subject: Our Compliance is taking extendedly long time...

Date:    10/2/01 9:52 AM

  10:21AM   up 65 days, 50 mins,  27 users,  load average: 1.16, 1.15, 1.10

root     pts/0       Sun10AM         34      1:15         1 e
kcampbel pts/1       07:14AM       1:56         0         0 -ksh
root     pts/2       07:14PM          3         0         0 -ksh
jcools   pts/3       Thu03PM      17:32      1:55         0 -ksh
informix pts/5       05:56PM          0         4         0 w
kcampbel pts/4       08:16AM         11        27         0 -ksh
vthomas  pts/6       08:52AM         31         0         0 -ksh
ccole    pts/7       10:14AM          7         0         0 -ksh
trn      pts/8       08:18AM          0        23         0 vi
ccole    pts/9       10:14AM          0         0         0 -ksh
rporter  pts/10      10:17AM          2         0         0 -ksh
amckenzi pts/11      08:24AM       1:03         0         0 vi
root     pts/12      08:27AM       1:42         3         0 /usr/lib/INed/helpe
mmarfo   pts/13      08:29AM         22         4         0 ac031.4ge
cthompsn pts/14      08:36AM          0         5         2 vi
mmarfo   pts/15      08:29AM          3         8         1 vi
mmarfo   pts/16      08:29AM         12         0         0 isql
trn      pts/17      08:33AM          9         0         0 /home/trn/exe/mnt_a
mbowen   pts/20      08:54AM          6         0         0 ac033.4ge
trn      pts/21      09:19AM         11        13         0 dbaccess
amckenzi pts/22      09:12AM          0         0         0 dbaccess
trn      pts/24      09:39AM         37         0         0 /home/trn/exe/sys_m
trn      pts/25      09:35AM          1         0         0 -ksh
kcampbel pts/26      09:47AM         10        10         0 dbaccess
informix pts/28      10:02AM          4         0         0 -ksh
jcools   pts/35      Thu03PM      17:32         5         0 -ksh
jcools   pts/37      Thu04PM      4days        47         0 -ksh

--openmail-part-21190019-00000001
Content-Type: text/plain; charset=US-ASCII
Content-Disposition: inline
Content-Transfer-Encoding: 7bit

Informix Dynamic Server Version 7.31.UD1X5  -- On-Line -- Up 65 days 00:47:12 -- 616416 Kbytes

Configuration File: /home/informix/etc/onconfig.ae
#**************************************************************************
#
#                          INFORMIX SOFTWARE, INC.
#
#  Title:       onconfig.ae
#  Description: Informix Dynamic Server Configuration Parameters for
#               AE instance
#**************************************************************************

# Root Dbspace Configuration

ROOTNAME        rootdbs         # Root dbspace name
ROOTPATH        /dev/rdev_rootdbs # Path for device containing root dbspace
ROOTOFFSET      0               # Offset of root dbspace into device (Kbytes)
ROOTSIZE        480000          # Size of root dbspace (Kbytes)

# Disk Mirroring Configuration Parameters

MIRROR          0               # Mirroring flag (Yes = 1, No = 0)
MIRRORPATH                      # Path for device containing mirrored root
MIRROROFFSET    0               # Offset into mirrored device (Kbytes)

# Physical Log Configuration

PHYSDBS         logdbs          # Location (dbspace) of physical log
PHYSFILE        64000           # Physical log file size (Kbytes)

# Logical Log Configuration

LOGFILES        50              # Number of logical log files
LOGSIZE         5000            # Logical log size (Kbytes)

# Diagnostics

MSGPATH         /home/informix/online_ae.log # System message log file path
CONSOLE         /home/informix/online_ae.log # System console message path
ALARMPROGRAM    /home/informix/etc/log_full.sh # Alarm program path
SYSALARMPROGRAM /home/informix/etc/evidence.sh # System Alarm program path
TBLSPACE_STATS  1              

# System Archive Tape Device

TAPEDEV         /dev/null       # Tape device path      
TAPEBLK         16              # Tape block size (Kbytes)
TAPESIZE        24000000        # Maximum amount of data to put on tape (Kbytes)

# Log Archive Tape Device

LTAPEDEV        /dev/null       # Log tape device path
LTAPEBLK        16              # Log tape block size (Kbytes)
LTAPESIZE       24000000        # Max amount of data to put on log tape (Kbytes)

# Optical

STAGEBLOB                       # Informix Dynamic Server/Optical staging area

# System Configuration

SERVERNUM       0               # Unique id corresponding to a Dynamic Server instance
DBSERVERNAME    ae              # Name of default database server
DBSERVERALIASES ae_shm          # List of alternate dbservernames
NETTYPE         ipcshm,1,50,CPU # Configure poll thread(s) for nettype
NETTYPE         soctcp,1,50,NET # Configure poll thread(s) for nettype
DEADLOCK_TIMEOUT 60              # Max time to wait of lock in distributed env.
RESIDENT        0               # Forced residency flag (Yes = 1, No = 0)

MULTIPROCESSOR  1               # 0 for single-processor, 1 for multi-processor
NUMCPUVPS       1               # Number of user (cpu) vps
SINGLE_CPU_VP   0               # If non-zero, limit number of cpu vps to one

NOAGE           0               # Process aging
AFF_SPROC       0               # Affinity start processor
AFF_NPROCS      0               # Affinity number of processors

# Shared Memory Parameters

LOCKS           500000          # Maximum number of locks
BUFFERS         120000          # Maximum number of shared buffers
NUMAIOVPS       4               # Number of IO vps
PHYSBUFF        64              # Physical log buffer size (Kbytes)
LOGBUFF         64              # Logical log buffer size (Kbytes)
LOGSMAX         250             # Maximum number of logical log files
CLEANERS        9               # Number of buffer cleaner processes
SHMBASE         0x30000000        # Shared memory base address
SHMVIRTSIZE     64000           # initial virtual shared memory segment size
SHMADD          16000           # Size of new shared memory segments (Kbytes)
SHMTOTAL        0               # Total shared memory (Kbytes). 0=>unlimited
CKPTINTVL       300             # Check point interval (in sec)
LRUS            16              # Number of LRU queues
LRU_MAX_DIRTY   70              # LRU percent dirty begin cleaning limit
LRU_MIN_DIRTY   40              # LRU percent dirty end cleaning limit
LTXHWM          40              # Long transaction high water mark percentage
LTXEHWM         70              # Long transaction high water mark (exclusive)
TXTIMEOUT       0x12c             # Transaction timeout (in sec)
STACKSIZE       32              # Stack size (Kbytes)

# System Page Size
# BUFFSIZE - Dynamic Server no longer supports this configuration parameter.
#            To determine the page size used by Dynamic Server on your platform
#            see the last line of output from the command, 'onstat -b'.

# Recovery Variables
# OFF_RECVRY_THREADS:
# Number of parallel worker threads during fast recovery or an offline restore.
# ON_RECVRY_THREADS:
# Number of parallel worker threads during an online restore.

OFF_RECVRY_THREADS 10              # Default number of offline worker threads
ON_RECVRY_THREADS 1               # Default number of online worker threads

# Data Replication Variables
# DRAUTO: 0 manual, 1 retain type, 2 reverse type
DRAUTO          0               # DR automatic switchover
DRINTERVAL      30              # DR max time between DR buffer flushes (in sec)
DRTIMEOUT       30              # DR network timeout (in sec)
DRLOSTFOUND     /usr/informix/etc/dr.lostfound # DR lost+found file path

# CDR Variables
CDR_LOGBUFFERS  2048            # size of log reading buffer pool (Kbytes)
CDR_EVALTHREADS 1,2             # evaluator threads (per-cpu-vp,additional)
CDR_DSLOCKWAIT  5               # DS lockwait timeout (seconds)
CDR_QUEUEMEM    4096            # Maximum amount of memory for any CDR queue (Kbytes)
CDR_LOGDELTA    30              # % of log space allowed in queue memory
CDR_NUMCONNECT  16              # Expected connections per server
CDR_NIFRETRY    300             # Connection retry (seconds)
CDR_NIFCOMPRESS 0               # Link level compression (-1 never, 0 none, 9 max)

# Backup/Restore variables
BAR_ACT_LOG     /tmp/bar_act.log
BAR_MAX_BACKUP  0              
BAR_RETRY       1              
BAR_NB_XPORT_COUNT 10              
BAR_XFER_BUF_SIZE 31              

# Informix Storage Manager variables
ISM_DATA_POOL   ISMData         # If the data pool name is changed, be sure to
                                # update $INFORMIXDIR/bin/onbar.  Change to
                                # ism_catalog -create_bootstrap -pool <new name>
ISM_LOG_POOL    ISMLogs        

# Read Ahead Variables
RA_PAGES        32              # Number of pages to attempt to read ahead
RA_THRESHOLD    10              # Number of pages left before next group

# DBSPACETEMP:
# Dynamic Server equivalent of DBTEMP for SE. This is the list of dbspaces
# that the Dynamic Server SQL Engine will use to create temp tables etc.
# If specified it must be a colon separated list of dbspaces that exist
# when the Dynamic Server system is brought online.  If not specified, or if
# all dbspaces specified are invalid, various ad hoc queries will create
# temporary files in /tmp instead.

DBSPACETEMP     tempdb          # Default temp dbspaces

# DUMP*:
# The following parameters control the type of diagnostics information which
# is preserved when an unanticipated error condition (assertion failure) occurs
# during Dynamic Server operations.
# For ...

read more »



Sun, 21 Mar 2004 04:34:40 GMT
 
 [ 4 post ] 

 Relevant Pages 

1. KB Q282416 - Opening the Database Folder in SQL Server Takes a Long Time

2. DTS Package takes a long time to execute

3. DTS Custom Task takes a long time to end

4. DTS package takes a long time to porcess

5. DTS package takes a long time to process

6. DTS takes a long time

7. why connecting takes such a long time(3 minutes)

8. Aggregation takes long time with DISTINCT COUNT measure

9. Calculating Aggregations taking a LONG time

10. Processing a cube takes a very very long time in sql 2000

11. using osql takes longer time...

12. Script taking longer time


 
Powered by phpBB® Forum Software