tristan
关于have 6 out of 200 filedescriptors open的问题
[quote]Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2519]: nfsd 1 0 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2520]: nfsd 1 1 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2521]: nfsd 1 2 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2522]: nfsd 1 3 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2509]: nfsd do_one bind 0
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2523]: nfsd 1 4 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2524]: nfsd 1 5 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2525]: nfsd 1 6 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2526]: nfsd 1 7 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2527]: nfsd 1 8 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2528]: nfsd 1 9 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2529]: nfsd 1 10 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2530]: nfsd 1 11 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2531]: nfsd 1 12 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2532]: nfsd 1 13 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2509]: Return from t_optmgmt(XTI_DISTRIBUTE) 0
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2533]: nfsd 1 14 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2535]: nfsd 1 15 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2534]: nfsd 0 0 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2537]: nfsd 1 17 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2536]: nfsd 1 16 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2538]: nfsd 1 18 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2540]: nfsd 0 1 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2539]: nfsd 1 19 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2541]: nfsd 0 2 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2542]: nfsd 1 20 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2543]: nfsd 0 3 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2544]: nfsd 1 21 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2545]: nfsd 0 4 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2546]: nfsd 1 22 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2548]: nfsd 1 23 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2549]: nfsd 0 6 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2550]: nfsd 1 24 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2551]: nfsd 1 25 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2552]: nfsd 0 7 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2547]: nfsd 0 5 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2553]: nfsd 1 26 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2554]: nfsd 1 27 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2555]: nfsd 1 28 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2556]: nfsd 0 8 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2557]: nfsd 1 29 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2558]: nfsd 0 9 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2559]: nfsd 1 30 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2560]: nfsd 0 10 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2561]: nfsd 1 31 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2562]: nfsd 0 11 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2563]: nfsd 1 32 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2564]: nfsd 0 12 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2565]: nfsd 1 33 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2566]: nfsd 0 13 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2567]: nfsd 0 14 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2568]: nfsd 1 34 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2569]: nfsd 0 15 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2571]: nfsd 0 16 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2572]: nfsd 0 17 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2570]: nfsd 1 35 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2573]: nfsd 1 36 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2574]: nfsd 0 18 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2575]: nfsd 1 37 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2577]: nfsd 1 38 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2576]: nfsd 0 19 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2579]: nfsd 1 39 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2580]: nfsd 1 40 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2581]: nfsd 1 41 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2582]: nfsd 0 20 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2583]: nfsd 1 42 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2585]: nfsd 0 21 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2586]: nfsd 1 43 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2587]: nfsd 1 44 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2588]: nfsd 0 22 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2589]: nfsd 1 45 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2592]: nfsd 1 47 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2591]: nfsd 0 23 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2593]: nfsd 0 24 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2594]: nfsd 0 25 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2595]: nfsd 1 48 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2596]: nfsd 1 49 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2590]: nfsd 1 46 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2597]: nfsd 1 50 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2598]: nfsd 0 26 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2599]: nfsd 0 27 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2601]: nfsd 1 51 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2603]: nfsd 1 52 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2604]: nfsd 1 53 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2605]: nfsd 1 54 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2600]: nfsd 0 28 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2606]: nfsd 0 29 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2607]: nfsd 1 55 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2608]: nfsd 1 56 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2609]: nfsd 1 57 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2610]: nfsd 1 58 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2611]: nfsd 1 59 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2612]: nfsd 0 30 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2613]: nfsd 1 60 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2614]: nfsd 1 61 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2616]: nfsd 0 31 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2618]: nfsd 0 32 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2619]: nfsd 0 33 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2620]: nfsd 0 34 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2508]: nfsd 1 63 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2615]: nfsd 1 62 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2621]: nfsd 0 35 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2622]: nfsd 0 36 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2623]: nfsd 0 37 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2625]: nfsd 0 38 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2626]: nfsd 0 39 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2627]: nfsd 0 40 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2628]: nfsd 0 41 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2630]: nfsd 0 43 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2629]: nfsd 0 42 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2633]: nfsd 0 45 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2631]: nfsd 0 44 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2634]: nfsd 0 46 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2635]: nfsd 0 47 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2636]: nfsd 0 48 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2638]: nfsd 0 49 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2639]: nfsd 0 50 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2640]: nfsd 0 51 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2641]: nfsd 0 52 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2642]: nfsd 0 53 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2643]: nfsd 0 54 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2645]: nfsd 0 55 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2648]: nfsd 0 56 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2650]: nfsd 0 57 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2651]: nfsd 0 58 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2652]: nfsd 0 59 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2653]: nfsd 0 60 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2654]: nfsd 0 61 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2509]: nfsd 0 63 sock 4
Feb 1 04:13:27 cam10 /usr/sbin/nfsd[2655]: nfsd 0 62 sock 4
Feb 1 04:13:28 cam10 prngd[2752]: prngd 0.9.26 (12 Jul 2002) started up for user root
[color=Red]Feb 1 04:13:28 cam10 prngd[2752]: have 6 out of 200 filedescriptors open
Jan 31 15:13:29 cam10 krsd[2757]: Delay time is 300 seconds
Feb 1 04:14:51 cam10 su: - 1 image-root[/color][/quote]
当时的故障现象就是磁盘读写缓慢，数据无法进行存取，是否要调整一些系统参数？
czyf2001
ulimti -a
贴出
看看nofiles的值
可以考虑增大内核参数maxfiles 和 maxfiles_lim的。
建议用sam修改，这几个参数之间有关联的，修改后需要重做内核，重启。
出现读写很慢，
可以怀疑下你的nfs性能了：
测试以下：
1，服务器端：
netstat -s -p udp
查看是否有stocket overflows
如果有则服务器的 nfsd Daemon数量不够。
2，客户端：
nfsstat -rc 贴出
timeout 、retrans 和 badxid的值。
[[i] 本帖最后由 czyf2001 于 2008-2-12 19:18 编辑 [/i]]
czyf2001
sysdef | egrep "NAME|ninode|nfile|maxfiles_lim"
贴出来看看！
关于时间戳,delay 延迟这样的日志写，可能跟TZ被修改了有关(echo $TZ )
关于出现日志延迟：
可以查看HP的ProblemText：
Problem Text
CR# JAGae29874
problem
The customer checked /var/adm/syslog/syslog.log file and found the
following strange timestamp from krsd:
Jun 1 14:28:13 sahb0002 syslogd: restart
...
Jun 1 01:28:29 sahb0002 krsd[2301]: Delay time is 300 seconds <---
...
Above timestamps of message from krsd are earlier than others by 13
hours. It is apparent that this difference originates from the
difference of TZ, JST-9 and EST5EDT(default in HP-UX). Although
this "default TZ problem" has been fixed in PHCO_24942(JAGab20870), krsd
will not be fixed by this patch because krsd is using libc as
the static link. So re-compiling krsd will be necessary if we will
reflect the fix in PHCO_24942 to them.
The following workaround which set the TZ by env(1) was tested
successfully:
In /etc/inittab, we should change :
(FROM)
sfd:123456:respawn:/sbin/krsd
(TO)
sfd:123456:respawn:/usr/bin/env TZ=JST-9 /sbin/krsd -i
Fix Text
fix
This defect will not be patched.
There is a workaround (see the submitter text).
The defect is fixed in the current release (11.22) as well as future
releases. IF a patch is ever created for krsd, the timestamp fix will
be included in the patch automatically simply because of recompiling
with the new library. [color=Red]Therfore, it is not necessary to keep the
defect open to keep track of the problem.[/color]
在oracle的alert*.log 也经常会出现这样的delay现象的。
弱弱的问：
开了nfs，做oracle rac还是sap 用？
[[i] 本帖最后由 czyf2001 于 2008-2-12 18:47 编辑 [/i]]
czyf2001
当时的故障现象就是磁盘读写缓慢，数据无法进行存取，是否要调整一些系统参数？
==================
观察下存储，有没有磁盘故障或者san-switch有无不正常之处，甚至光纤线松动？
tristan
SCSI 的盘阵，纯文件服务器用，没有数据库
tristan
还没机会试，分先给了，当定金了 :mrgreen:
czyf2001
等待验证！
SCSI？
怀疑内核参数先，哈！
[[i] 本帖最后由 czyf2001 于 2008-2-15 19:32 编辑 [/i]]