Long Checkpoints, balancing network traffic accross multiple Aliases 
Author Message
 Long Checkpoints, balancing network traffic accross multiple Aliases

I have a few questions that I hope someone can answer.

Background Info:

IDS 7.31FC2
HP/UX 11.0 64 bit
6 CPUs, 5 given to Informix w/ affinity
KAIO On
OLTP/DSS Mix, configured for OLTP

Recently I changed 3 onconfig parameters
19:42:18  Onconfig parameter BUFFERS modified from 200000 to 238400.
19:42:18  Onconfig parameter NUMAIOVPS modified from 1 to 2.
19:42:18  Onconfig parameter SHMADD modified from 153600 to 76800.

Before this change the checkpoints were 0 to 1 seconds, now they have
jumped to 2 to 5 seconds (with a 25 second checkpoint in there just to
spite me).  I have cleaners and LRU's maxed to 127 and LRU_MAX set to 1 and
LRU_MIN set to 0.

Could the addition of 38400 Buffers make this much of a change in
checkpoint time?  Before Informix would have to write 2000 Buffers at a
checkpoint, now it has to write 2286 Buffers, I am having a hard time
believing that the additional 286 Buffer writes at checkpoint time are
causing a 2 to 3 second checkpoint increase.

onstat -p, onstat -m, and the onconfig params follow.

Also, I was wondering if it would be helpful to overall performance to
configure connections to connect via different ports through multiple
aliases.

Currently we have 7 machines that connect to our main server, they
currently connect to the main server via soctcp through port 1526 server
name n2bill1.
Would it be helpful to setup /etc/services to contain ports 1526, 1527,
1528, 1529, 1530, 1531, 1532 for soctcp connections to n2bill1 and have
those connections map to different DBSERVERALIASES in the sqlhosts file?
i.e.. 1526 -> n2bill1_1, 1527 -> n2bill1_2, 1528 -> 1529, etc.?

Thanks in advance for any help,

Andrew

onstat -p

Informix Dynamic Server Version 7.31.FC2   -- On-Line -- Up 16:03:44 --
729576 Kbytes

Profile
dskreads pagreads bufreads %cached dskwrits pagwrits bufwrits %cached
9998797  15941374 278627430 96.41   566427   989045   1790101  68.36

isamtot  open     start    read     write    rewrite  delete   commit
  rollbk
253258572 428053   2501072  213369175 167719   145009   90428    128      0

gp_read  gp_write gp_rewrt gp_del   gp_alloc gp_free  gp_curs
0        0        0        0        0        0        0

ovlock   ovuserthread ovbuff   usercpu  syscpu   numckpts flushes
0        0            739      4465.31  1238.77  5        10

bufwaits lokwaits lockreqs deadlks  dltouts  ckpwaits compress seqscans
1223950  334      19767729 0        0        121      49793    2880

ixda-RA  idx-RA   da-RA    RA-pgsused lchwaits
7096142  5352     35373    7135187    465107

onstat -m

Message Log File: /usr/informix/online.log
09:13:24  Checkpoint Completed:  duration was 2 seconds.
09:23:32  Checkpoint Completed:  duration was 3 seconds.
09:33:42  Checkpoint Completed:  duration was 4 seconds.
09:43:51  Checkpoint Completed:  duration was 2 seconds.
09:54:00  Checkpoint Completed:  duration was 2 seconds.
10:04:09  Checkpoint Completed:  duration was 3 seconds.
10:14:19  Checkpoint Completed:  duration was 4 seconds.
10:24:27  Checkpoint Completed:  duration was 2 seconds.
10:34:35  Checkpoint Completed:  duration was 2 seconds.
10:44:44  Checkpoint Completed:  duration was 2 seconds.
10:54:53  Checkpoint Completed:  duration was 3 seconds.
11:05:02  Checkpoint Completed:  duration was 3 seconds.
11:13:55  listener-thread: err = -951: oserr = 0: errstr = Admin: Incorrect
password or user Admin is
 not known on the database server.

11:13:56  listener-thread: err = -951: oserr = 0: errstr = Admin: Incorrect
password or user Admin is
 not known on the database server.

11:15:10  Checkpoint Completed:  duration was 2 seconds.
11:25:20  Checkpoint Completed:  duration was 2 seconds.
11:35:28  Checkpoint Completed:  duration was 2 seconds.
11:45:38  Checkpoint Completed:  duration was 2 seconds.

Onconfig Params

ROOTNAME                        rootdbs
ROOTPATH                        /dev/informix_space/rootchunk
DBSERVERNAME                    n2bill1_shm
MIRRORPATH                      \
PHYSDBS                         bigphys
MSGPATH                         /usr/informix/online.log
CONSOLE                         /dev/console
TAPEDEV                         /dev/null
LTAPEDEV                        /dev/null
ROOTOFFSET                      0
ROOTSIZE                        100000
MIRROR                          0
MIRROROFFSET                    0
PHYSFILE                        159894
LOGFILES                        32
LOGSIZE                         1500
TAPEBLK                         16
TAPESIZE                        10240
LTAPEBLK                        16
LTAPESIZE                       10240
SERVERNUM                       0
DEADLOCK_TIMEOUT                60
RESIDENT                        1
LOCKS                           1048576
BUFFERS                         238400
ONDBSPACEDOWN                   2
LBU_PRESERVE                    1
OPCACHEMAX                      0
PHYSBUFF                        32
LOGBUFF                         32
LOGSMAX                         50
CLEANERS                        127
SHMBASE                         0xc000000000232000
CKPTINTVL                       600
LRUS                            127
LRU_MAX_DIRTY                   1
LRU_MIN_DIRTY                   0
SINGLE_CPU_VP                   0
LTXHWM                          50
LTXEHWM                         60
TXTIMEOUT                       300
NUMCPUVPS                       5
DRAUTO                          0
SHMVIRTSIZE                     128000
USEOSTIME                       0
NOAGE                           1
AFF_SPROC                       1
AFF_NPROCS                      5
RA_PAGES                        64
RA_THRESHOLD                    42
NUMAIOVPS                       2
NETTYPE                         ipcshm,,50,CPU
NETTYPE                         soctcp,,25,NET
DBSERVERALIASES                 n2bill1
MULTIPROCESSOR                  1
FILLFACTOR                      80
STACKSIZE                       64
DBSPACETEMP                     tempdbs1,tempdbs2,tempdbs3,tempdbs4
STAGEBLOB                       \
DRNODE                          1
DRNAME                          \
DRINTERVAL                      30
DRTIMEOUT                       30
DRLOSTFOUND                     /usr/informix/etc/dr.lostfound
OFF_RECVRY_THREADS              50
ON_RECVRY_THREADS               5
DUMPSHMEM                       0
DUMPGCORE                       0
DUMPCORE                        0
DUMPCNT                         1
DUMPDIR                         /var/simplified/log/dump
DATASKIP                        off
DS_MAX_QUERIES                  1024
DS_TOTAL_MEMORY                 131072
DS_MAX_SCANS                    100000
SHMADD                          0x4b00000
SHMTOTAL                        0x0
OPTCOMPIND                      2
MAX_PDQPRIORITY                 100
HETERO_COMMIT                   0
BAR_ACT_LOG                     /tmp/bar_act.log
BAR_DEBUG_LOG                   /tmp/bar_dbug.log
BAR_MAX_BACKUP                  0
BAR_RETRY                       1
BAR_NB_XPORT_COUNT              10
BAR_XFER_BUF_SIZE               31
BAR_DEBUG                       0
BAR_BSALIB_PATH                 \
VPCLASS                         \
SBSPACENAME                     \
BLOCKTIMEOUT                    3600
AFFAIL                          1025
AFWARN                          1
AFCRASH                         1537
AFLINES                         0
SYSALARMPROGRAM                 /usr/informix/etc/evidence.sh
DIRECTIVES                      1
TBLSPACE_STATS                  1
RESTARTABLE_RESTOR              0
ISM_DATA_POOL                   ISMData
ISM_LOG_POOL                    ISMLogs
OPT_GOAL                        -1
LOG_BACKUP_MODE                 MANUAL
JVPCLASSPATH                    \
JVPHOME                         \
JVPLOGFILE                      jvp.log
JVPPROPFILE                     .jvpprops
JVPJAVAHOME                     \
JVPJAVAVM                       libjava.so
JVPJAVALIB                      \
JDKVERSION                      \
JVMTHREAD                       green
JVPDEBUG                        0
BAR_PROGRESS_FREQ               0
BAR_HISTORY                     0



Wed, 18 Jun 1902 08:00:00 GMT
 Long Checkpoints, balancing network traffic accross multiple Aliases

Quote:

> I have a few questions that I hope someone can answer.

> Background Info:

> IDS 7.31FC2
> HP/UX 11.0 64 bit
> 6 CPUs, 5 given to Informix w/ affinity
> KAIO On
> OLTP/DSS Mix, configured for OLTP

> Recently I changed 3 onconfig parameters
> 19:42:18  Onconfig parameter BUFFERS modified from 200000 to 238400.
> 19:42:18  Onconfig parameter NUMAIOVPS modified from 1 to 2.
> 19:42:18  Onconfig parameter SHMADD modified from 153600 to 76800.

> Before this change the checkpoints were 0 to 1 seconds, now they have
> jumped to 2 to 5 seconds (with a 25 second checkpoint in there just to
> spite me).  I have cleaners and LRU's maxed to 127 and LRU_MAX set to 1 and
> LRU_MIN set to 0.

You have 7.31 so you can go for 128 without triggering that old
annoying 0 length Physical Log bug, FWIW.

Quote:
> Could the addition of 38400 Buffers make this much of a change in
> checkpoint time?  Before Informix would have to write 2000 Buffers at a
> checkpoint, now it has to write 2286 Buffers, I am having a hard time
> believing that the additional 286 Buffer writes at checkpoint time are
> causing a 2 to 3 second checkpoint increase.

Does seem odd.

Quote:
> onstat -p, onstat -m, and the onconfig params follow.

> Also, I was wondering if it would be helpful to overall performance to
> configure connections to connect via different ports through multiple
> aliases.

> Currently we have 7 machines that connect to our main server, they
> currently connect to the main server via soctcp through port 1526 server
> name n2bill1.
> Would it be helpful to setup /etc/services to contain ports 1526, 1527,
> 1528, 1529, 1530, 1531, 1532 for soctcp connections to n2bill1 and have
> those connections map to different DBSERVERALIASES in the sqlhosts file?
> i.e.. 1526 -> n2bill1_1, 1527 -> n2bill1_2, 1528 -> 1529, etc.?

Only if you have multiple interfaces on the machine and there seems to
be a network bottleneck.

Quote:
> Thanks in advance for any help,

Let's see onstat -F and onstat -R (from shortly before a scheduled
checkpoint not just after), also onstat -g glo and onstat -g iov.

Art S. Kagel



Wed, 18 Jun 1902 08:00:00 GMT
 Long Checkpoints, balancing network traffic accross multiple Aliases

I'll try to bump up LRU's to 128, that will most likely help a little.  Can I bump up CLEANERS as well?

Here are the requested onstats taken a few seconds before a checkpoint:

Thanks for your help,

Andrew

Informix Dynamic Server Version 7.31.FC2   -- On-Line -- Up 21:17:43 -- 729576 Kbytes

Message Log File: /usr/informix/online.log
13:37:08  Checkpoint Completed:  duration was 2 seconds.
13:47:17  Checkpoint Completed:  duration was 2 seconds.
13:57:26  Checkpoint Completed:  duration was 3 seconds.
14:07:34  Checkpoint Completed:  duration was 2 seconds.
14:17:43  Checkpoint Completed:  duration was 3 seconds.
14:27:52  Checkpoint Completed:  duration was 3 seconds.
14:37:59  Checkpoint Completed:  duration was 1 seconds.
14:48:08  Checkpoint Completed:  duration was 3 seconds.
14:58:19  Checkpoint Completed:  duration was 5 seconds.
15:08:27  Checkpoint Completed:  duration was 2 seconds.
15:18:36  Checkpoint Completed:  duration was 2 seconds.
15:28:45  Checkpoint Completed:  duration was 3 seconds.
15:38:53  Checkpoint Completed:  duration was 2 seconds.
15:49:01  Checkpoint Completed:  duration was 2 seconds.
15:59:10  Checkpoint Completed:  duration was 2 seconds.
16:09:18  Checkpoint Completed:  duration was 3 seconds.
16:19:29  Checkpoint Completed:  duration was 3 seconds.
16:29:37  Checkpoint Completed:  duration was 2 seconds.
16:39:45  Checkpoint Completed:  duration was 2 seconds.
16:49:56  Checkpoint Completed:  duration was 2 seconds.

(NET-n2bill1) /# onstat -F

Informix Dynamic Server Version 7.31.FC2   -- On-Line -- Up 21:17:44 -- 729576 Kbytes

Fg Writes     LRU Writes    Chunk Writes
5586          3323871       54917        

address          flusher  state    data    
c000000024e226f0 0        I        0        = 0X0      
c000000024e22db8 1        I        0        = 0X0      
c000000024e23480 2        I        0        = 0X0      
c000000024e23b48 3        I        0        = 0X0      
c000000024e24210 4        I        0        = 0X0      
c000000024e248d8 5        I        0        = 0X0      
c000000024e24fa0 6        I        0        = 0X0      
c000000024e25668 7        I        0        = 0X0      
c000000024e25d30 8        I        0        = 0X0      
c000000024e263f8 9        I        0        = 0X0      
c000000024e26ac0 10       I        0        = 0X0      
c000000024e27188 11       I        0        = 0X0      
c000000024e27850 12       I        0        = 0X0      
c000000024e27f18 13       I        0        = 0X0      
c000000024e285e0 14       I        0        = 0X0      
c000000024e28ca8 15       I        0        = 0X0      
c000000024e29370 16       I        0        = 0X0      
c000000024e29a38 17       I        0        = 0X0      
c000000024e2a100 18       I        0        = 0X0      
c000000024e2a7c8 19       I        0        = 0X0      
c000000024e2ae90 20       I        0        = 0X0      
c000000024e2b558 21       I        0        = 0X0      
c000000024e2bc20 22       I        0        = 0X0      
c000000024e2c2e8 23       I        0        = 0X0      
c000000024e2c9b0 24       I        0        = 0X0      
c000000024e2d078 25       I        0        = 0X0      
c000000024e2d740 26       I        0        = 0X0      
c000000024e2de08 27       I        0        = 0X0      
c000000024e2e4d0 28       I        0        = 0X0      
c000000024e2eb98 29       I        0        = 0X0      
c000000024e2f260 30       I        0        = 0X0      
c000000024e2f928 31       I        0        = 0X0      
c000000024e2fff0 32       I        0        = 0X0      
c000000024e306b8 33       I        0        = 0X0      
c000000024e30d80 34       I        0        = 0X0      
c000000024e31448 35       I        0        = 0X0      
c000000024e31b10 36       I        0        = 0X0      
c000000024e321d8 37       I        0        = 0X0      
c000000024e328a0 38       I        0        = 0X0      
c000000024e32f68 39       I        0        = 0X0      
c000000024e33630 40       I        0        = 0X0      
c000000024e33cf8 41       I        0        = 0X0      
c000000024e343c0 42       I        0        = 0X0      
c000000024e34a88 43       I        0        = 0X0      
c000000024e35150 44       I        0        = 0X0      
c000000024e35818 45       I        0        = 0X0      
c000000024e35ee0 46       I        0        = 0X0      
c000000024e365a8 47       I        0        = 0X0      
c000000024e36c70 48       I        0        = 0X0      
c000000024e37338 49       I        0        = 0X0      
c000000024e37a00 50       I        0        = 0X0      
c000000024e380c8 51       I        0        = 0X0      
c000000024e38790 52       I        0        = 0X0      
c000000024e38e58 53       I        0        = 0X0      
c000000024e39520 54       I        0        = 0X0      
c000000024e39be8 55       I        0        = 0X0      
c000000024e3a2b0 56       I        0        = 0X0      
c000000024e3a978 57       I        0        = 0X0      
c000000024e3b040 58       I        0        = 0X0      
c000000024e3b708 59       I        0        = 0X0      
c000000024e3bdd0 60       I        0        = 0X0      
c000000024e3c498 61       I        0        = 0X0      
c000000024e3cb60 62       I        0        = 0X0      
c000000024e3d228 63       I        0        = 0X0      
c000000024e3d8f0 64       I        0        = 0X0      
c000000024e3dfb8 65       I        0        = 0X0      
c000000024e3e680 66       I        0        = 0X0      
c000000024e3ed48 67       I        0        = 0X0      
c000000024e3f410 68       I        0        = 0X0      
c000000024e3fad8 69       I        0        = 0X0      
c000000024e401a0 70       I        0        = 0X0      
c000000024e40868 71       I        0        = 0X0      
c000000024e40f30 72       I        0        = 0X0      
c000000024e415f8 73       I        0        = 0X0      
c000000024e41cc0 74       I        0        = 0X0      
c000000024e42388 75       I        0        = 0X0      
c000000024e42a50 76       I        0        = 0X0      
c000000024e43118 77       I        0        = 0X0      
c000000024e437e0 78       I        0        = 0X0      
c000000024e43ea8 79       I        0        = 0X0      
c000000024e44570 80       I        0        = 0X0      
c000000024e44c38 81       I        0        = 0X0      
c000000024e45300 82       I        0        = 0X0      
c000000024e459c8 83       I        0        = 0X0      
c000000024e46090 84       I        0        = 0X0      
c000000024e46758 85       I        0        = 0X0      
c000000024e46e20 86       I        0        = 0X0      
c000000024e474e8 87       I        0        = 0X0      
c000000024e47bb0 88       I        0        = 0X0      
c000000024e48278 89       I        0        = 0X0      
c000000024e48940 90       I        0        = 0X0      
c000000024e49008 91       I        0        = 0X0      
c000000024e496d0 92       I        0        = 0X0      
c000000024e49d98 93       I        0        = 0X0      
c000000024e4a460 94       I        0        = 0X0      
c000000024e4ab28 95       I        0        = 0X0      
c000000024e4b1f0 96       I        0        = 0X0      
c000000024e4b8b8 97       I        0        = 0X0      
c000000024e4bf80 98       I        0        = 0X0      
c000000024e4c648 99       I        0        = 0X0      
c000000024e4cd10 100      I        0        = 0X0      
c000000024e4d3d8 101      I        0        = 0X0      
c000000024e4daa0 102      I        0        = 0X0      
c000000024e4e168 103      I        0        = 0X0      
c000000024e4e830 104      I        0        = 0X0      
c000000024e4eef8 105      I        0        = 0X0      
c000000024e4f5c0 106      I        0        = 0X0      
c000000024e4fc88 107      I        0        = 0X0      
c000000024e50350 108      I        0        = 0X0      
c000000024e50a18 109      I        0        = 0X0      
c000000024e510e0 110      I        0        = 0X0      
c000000024e517a8 111      I        0        = 0X0      
c000000024e51e70 112      I        0        = 0X0      
c000000024e52538 113      I        0        = 0X0      
c000000024e52c00 114      I        0        = 0X0      
c000000024e532c8 115      I        0        = 0X0      
c000000024e53990 116      I        0        = 0X0      
c000000024e54058 117      I        0        = 0X0      
c000000024e54720 118      I        0        = 0X0      
c000000024e54de8 119      I        0        = 0X0      
c000000024e554b0 120      I        0        = 0X0      
c000000024e55b78 121      I        0        = 0X0      
c000000024e56240 122      I        0        = 0X0      
c000000024e56908 123      I        0        = 0X0      
c000000024e56fd0 124      I        0        = 0X0      
c000000024e57698 125      I        0        = 0X0      
c000000024e57d60 126      I        0        = 0X0      
      states: Exit Idle Chunk Lru

(NET-n2bill1) /# onstat -R

Informix Dynamic Server Version 7.31.FC2   -- On-Line -- Up 21:17:46 -- 729576 Kbytes

127 buffer LRU queue pairs                     priority levels
# f/m  pair total  % of    length     LOW   MED_LOW  MED_HIGH   HIGH
 0 f      1753    99.8%     1750        0     1750        0        0
 1 m               0.2%        3        0        3        0        0
 2 f      1773    99.1%     1757        0     1757        0        0
 3 m               0.9%       16        0       15        1        0
 4 f      1776    99.2%     1761        0     1761        0        0
 5 m               0.8%       15        0       11        4        0
 6 f      1746    99.8%     1743        0     1743        0        0
 7 m               0.2%        3        0        3        0        0
 8 f      1762    99.4%     1752        0     1752        0        0
 9 m               0.6%       10        0        9        1        0
10 f      1756    99.0%     1739        0     1739        0  
...

read more »



Wed, 18 Jun 1902 08:00:00 GMT
 
 [ 3 post ] 

 Relevant Pages 

1. Long Checkpoints, balancing network traffic across multiple Aliases

2. Long Checkpoints, balancing network traffic across multiple Aliases

3. Balancing network traffic.

4. checkpoint during long insert blocks on sp calling long insert

5. Can't connect to MSDE accross network

6. Access Accross A Network

7. Setting up Interbase accross a network - Help Please!

8. transferring records accross a network (vb6 w/access97)

9. Paradox 7 on accross a Network

10. How to detect if a db is served accross a TCP network

11. VFP 6.0 slow accross network

12. Updating field accross multiple tables.


 
Powered by phpBB® Forum Software