Hi Guys,
I'm running NW 7.0 IDES system with oracle 10.2 database in MS 2003 server. I picked up all the kernel files from Services market place for NW7.21 database independents files as well as Oracle kernel files and upgraded my NW7.0 with patch level 300 from 111. everything worked fine but when I started the MMC it's turned green but after couple minutes Disp+work (dispatcher stopped) and it happens every time I start my MMC. It's basically just work for a minute.
After I troubleshoot for couple days, I put my old kernel back in which was 111 patch level that was working fine before I upgraded to 300, but now my old kernel has same issue. Its looks like there are some other problems in the system that cause this issue not my ne kernel. I really need help to resolve this issue. please look at my developer trace and suggest me the right direction.
Thanks in advance
---------------------------------------------------
trc file: "dev_disp", trc level: 1, release: "700"
---------------------------------------------------
sysno 69
sid S96
systemid 560 (PC with Windows NT)
relno 7000
patchlevel 0
patchno 111
intno 20050900
make: multithreaded, Unicode, optimized
pid 3448
Mon Jul 14 09:36:11 2014
kernel runs with dp version 229000(ext=109000) (@(#) DPLIB-INT-VERSION-229000-UC)
length of sys_adm_ext is 576 bytes
*** SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (69 3448) [dpxxdisp.c 1239]
shared lib "dw_xml.dll" version 111 successfully loaded
shared lib "dw_xtc.dll" version 111 successfully loaded
shared lib "dw_stl.dll" version 111 successfully loaded
shared lib "dw_gui.dll" version 111 successfully loaded
shared lib "dw_mdm.dll" version 111 successfully loaded
rdisp/softcancel_sequence : -> 0,5,-1
use internal message server connection to port 3969
Mon Jul 14 09:36:23 2014
*** WARNING => DpNetCheck: NiHostToAddr(www.doesnotexist0107.qqq.nxst) took 12 seconds
Mon Jul 14 09:36:40 2014
*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 17 seconds
***LOG GZZ=> 2 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5361]
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is not active
DpIPCInit2: start server >nineserver_S96_69 <
DpShMCreate: sizeof(wp_adm) 18672 (1436)
DpShMCreate: sizeof(tm_adm) 4232256 (21056)
DpShMCreate: sizeof(wp_ca_adm) 24000 (80)
DpShMCreate: sizeof(appc_ca_adm) 8000 (80)
DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528056/528064
DpShMCreate: sizeof(comm_adm) 528064 (1048)
DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
DpShMCreate: sizeof(slock_adm) 0 (96)
DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
DpShMCreate: sizeof(file_adm) 0 (72)
DpShMCreate: sizeof(vmc_adm) 0 (1536)
DpShMCreate: sizeof(wall_adm) (38456/34360/64/184)
DpShMCreate: sizeof(gw_adm) 48
DpShMCreate: SHM_DP_ADM_KEY (addr: 05AF0040, size: 4892312)
DpShMCreate: allocated sys_adm at 05AF0040
DpShMCreate: allocated wp_adm at 05AF2090
DpShMCreate: allocated tm_adm_list at 05AF6980
DpShMCreate: allocated tm_adm at 05AF69B0
DpShMCreate: allocated wp_ca_adm at 05EFFDF0
DpShMCreate: allocated appc_ca_adm at 05F05BB0
DpShMCreate: allocated comm_adm at 05F07AF0
DpShMCreate: system runs without slock table
DpShMCreate: system runs without file table
DpShMCreate: allocated vmc_adm_list at 05F889B0
DpShMCreate: allocated gw_adm at 05F889F0
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated ca_info at 05F88A20
DpShMCreate: allocated wall_adm at 05F88A28
MBUF state OFF
DpCommInitTable: init table for 500 entries
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 1024 kByte.
Using implementation view
<EsNT> Using memory model view.
<EsNT> Memory Reset disabled as NT default
<ES> 511 blocks reserved for free list.
ES initialized.
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1629]
***LOG Q0K=> DpMsAttach, mscon ( nineserver) [dpxxdisp.c 11753]
DpStartStopMsg: send start message (myname is >nineserver_S96_69 <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
CCMS: Initalizing shared memory of size 60000000 for monitoring segment.
CCMS: start to initalize 3.X shared alert area (first segment).
DpMsgAdmin: Set release to 7000, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]
DpMsgAdmin: Set patchno for this platform to 111
Release check o.K.
Mon Jul 14 09:37:20 2014
*** ERROR => W0 (pid 3888) died [dpxxdisp.c 14441]
*** ERROR => W1 (pid 3900) died [dpxxdisp.c 14441]
*** ERROR => W2 (pid 612) died [dpxxdisp.c 14441]
*** ERROR => W3 (pid 984) died [dpxxdisp.c 14441]
*** ERROR => W4 (pid 1076) died [dpxxdisp.c 14441]
*** ERROR => W5 (pid 3296) died [dpxxdisp.c 14441]
my types changed after wp death/restart 0xbf --> 0xbe
*** ERROR => W6 (pid 3624) died [dpxxdisp.c 14441]
my types changed after wp death/restart 0xbe --> 0xbc
*** ERROR => W7 (pid 624) died [dpxxdisp.c 14441]
my types changed after wp death/restart 0xbc --> 0xb8
*** ERROR => W8 (pid 1472) died [dpxxdisp.c 14441]
*** ERROR => W9 (pid 3168) died [dpxxdisp.c 14441]
*** ERROR => W10 (pid 2224) died [dpxxdisp.c 14441]
my types changed after wp death/restart 0xb8 --> 0xb0
*** ERROR => W11 (pid 4000) died [dpxxdisp.c 14441]
my types changed after wp death/restart 0xb0 --> 0xa0
*** ERROR => W12 (pid 908) died [dpxxdisp.c 14441]
my types changed after wp death/restart 0xa0 --> 0x80
*** DP_FATAL_ERROR => DpWPCheck: no more work processes
*** DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:30 2014
NiISelect: TIMEOUT occured (10000ms)
dump system status
Workprocess Table (long) Mon Jul 14 16:37:30 2014
========================
No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table
-------------------------------------------------------------------------------------------------------------------------------
0 DIA 3888 Ended no 1 0 0
1 DIA 3900 Ended no 1 0 0
2 DIA 612 Ended no 1 0 0
3 DIA 984 Ended no 1 0 0
4 DIA 1076 Ended no 1 0 0
5 DIA 3296 Ended no 1 0 0
6 UPD 3624 Ended no 1 0 0
7 ENQ 624 Ended no 1 0 0
8 BTC 1472 Ended no 1 0 0
9 BTC 3168 Ended no 1 0 0
10 BTC 2224 Ended no 1 0 0
11 SPO 4000 Ended no 1 0 0
12 UP2 908 Ended no 1 0 0
Dispatcher Queue Statistics Mon Jul 14 16:37:30 2014
===========================
+------+--------+--------+--------+--------+--------+
| Typ | now | high | max | writes | reads |
+------+--------+--------+--------+--------+--------+
| NOWP | 0 | 2 | 2000 | 6 | 6 |
+------+--------+--------+--------+--------+--------+
| DIA | 5 | 5 | 2000 | 5 | 0 |
+------+--------+--------+--------+--------+--------+
| UPD | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| ENQ | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| BTC | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| SPO | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| UP2 | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
max_rq_id 12
wake_evt_udp_now 0
wake events total 8, udp 7 ( 87%), shm 1 ( 12%)
since last update total 8, udp 7 ( 87%), shm 1 ( 12%)
Dump of tm_adm structure: Mon Jul 14 16:37:30 2014
=========================
Term uid man user term lastop mod wp ta a/i (modes)
Workprocess Comm. Area Blocks Mon Jul 14 16:37:30 2014
=============================
Slots: 300, Used: 1, Max: 0
+------+--------------+----------+-------------+
| id | owner | pid | eyecatcher |
+------+--------------+----------+-------------+
| 0 | DISPATCHER | -1 | *WPCAAD000* |
NiWait: sleep (5000ms) ...
NiISelect: timeout 5000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:35 2014
NiISelect: TIMEOUT occured (5000ms)
DpHalt: shutdown server >nineserver_S96_69 < (normal)
DpJ2eeDisableRestart
DpModState: buffer in state MBUF_PREPARED
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes
Stop gateway
killing process (348) (SOFT_KILL)
Stop icman
killing process (320) (SOFT_KILL)
Terminate gui connections
wait for end of work processes
wait for end of gateway
[DpProcDied] Process lives (PID:348 HANDLE:1556)
waiting for termination of gateway ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:36 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:348 HANDLE:1556)
wait for end of icman
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:37 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:38 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:39 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:40 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:41 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:42 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:43 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:44 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:45 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:46 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:320 HANDLE:1560)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1585
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Jul 14 09:37:47 2014
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:320 HANDLE:1560)
DpStartStopMsg: send stop message (myname is >nineserver_S96_69 <)
NiIMyHostName: hostname = 'nineserver'
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 189 bytes
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name -, type 4, key -
DpStartStopMsg: stop msg sent
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIRead: read for hdl 2 timed out (0ms)
DpHalt: no more messages from the message server
DpHalt: send keepalive to synchronize with the message server
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)
MsINiWrite: sent 114 bytes
send msg (len 110+4) to name MSG_SERVER, type 0, key -
MsSndName: MS_NOOP ok
Send 4 bytes to MSG_SERVER
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIPeek: peek successful for hdl 2 (r)
NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
Received 4 bytes from MSG_SERVER
Received opcode MS_NOOP from msg_server, reply MSOP_OK
MsOpReceive: ok
MsSendKeepalive : keepalive sent to message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
Mon Jul 14 09:37:48 2014
NiIPeek: peek for hdl 2 timed out (r; 1000ms)
NiIRead: read for hdl 2 timed out (1000ms)
DpHalt: no more messages from the message server
DpHalt: sync with message server o.k.
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12099]
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0
SiSelNSet: set events of sock 1496 to: ---
NiBufISelRemove: remove hdl 2 from set0
SiSelNRemove: removed sock 1496 (pos=2)
SiSelNRemove: removed sock 1496
NiSelIRemove: removed hdl 2
MBUF state OFF
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/13
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)
MBUF component DOWN
NiICloseHandle: shutdown and close hdl 2 / sock 1496
NiBufIClose: clear extension for hdl 2
MsIDetach: detach MS-system
cleanup EM
EsCleanup ....
EmCleanup() -> 0
Es2Cleanup: Cleanup ES2
***LOG Q05=> DpHalt, DPStop ( 3448) [dpxxdisp.c 10371]
Good Bye .....