msgmnb limits?
Hello,
On a server with lots of RAM (192GB), I ran into an application (DB2) which applies the following sysctl changes when it's started, if the values haven't already been set to - at least - the stated values:
- kernel.msgmax = 65535
- kernel.msgmnb = 65536
However, that doesn't work: Certain operations (LOAD and backups/restores) will fail with the following messages, unless kernel.msgmnb is increased:
DIA8557C No message was sent using the message queue.
CALLED : OS, -, msgsnd OSERR: EAGAIN (11)
DATA #1 : system V message queue identifier., PD_TYPE_SYSV_QUEUE_ID
I tried setting kernel.msgmnb to 524288, and then things work. This value was chosen out of the blue, and I'd like to make a more informed choice:
- Is there a limit to the size of msgmnb?
- Can I expect the system to start thrashing if msgmnb is increased beyond a certain value?
- Is my understanding correkt: msgmnb should always be at least as large as msgmax?
Thanks in advance.
Signature · 2 lines
Regards, Troels Arvin
Quoted 9 lines · Troels Arvin
Hello,
On a server with lots of RAM (192GB), I ran into an application (DB2) which applies the following sysctl changes when it's started, if the values haven't already been set to - at least - the stated values:
- kernel.msgmax = 65535
- kernel.msgmnb = 65536
Quoted 7 lines
However, that doesn't work: Certain operations (LOAD and backups/restores) will fail with the following messages, unless kernel.msgmnb is increased:
DIA8557C No message was sent using the message queue.
CALLED : OS, -, msgsnd OSERR: EAGAIN (11)
DATA #1 : system V message queue identifier.,PD_TYPE_SYSV_QUEUE_ID
Well, one app filled up a System V(-ish) message queue because another app is not reading messages off fast enough, or the message queue is too small to handle the burst. The EAGAIN indicates the message queue was full.
Looking at man msgsnd :
[...]
EAGAIN The message can’t be sent due to the msg_qbytes limit for the
queue and IPC_NOWAIT was specified in msgflg.
[...]
The following limits on message queue resources affect the msgsnd() call:
MSGMAX Maximum size for a message text: 8192 bytes (on Linux, this
limit can be read and modified via /proc/sys/kernel/msgmax).
MSGMNB Default maximum size in bytes of a message queue: 16384 bytes
(on Linux, this limit can be read and modified via
/proc/sys/kernel/msgmnb). The superuser can increase the size
of a message queue beyond MSGMNB by a msgctl(2) system call.
Quoted 3 lines
I tried setting kernel.msgmnb to 524288, and then things work. This value was chosen out of the blue, and I'd like to make a more informed choice:
HP-UX 10.20 had a utility called "ipcstat" that allowed one to monitor the usage of System V message queues. I would guess there is something similar under Linux or a maybe this file in /proc:
cat /proc/sysvipc/msg
see man msg_ctl or man svipc for an explanation of the fields.
You can make the most informed decision by periodically collecting statistics on the message queue usage in your running system and monitoring the applications' needs. Then set your message queue parameters based on that data with some additional headroom.
I hope that helps.
Regards,
Andy
Quoted 7 lines
- Is there a limit to the size of msgmnb?
- Can I expect the system to start thrashing if msgmnb is increased beyond a certain value?
- Is my understanding correkt: msgmnb should always be at least as large as msgmax?Thanks in advance.