Skip to contentSkip to conversation

xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

DISCUSSION Linda A. Walsh 4 participants 6 messages May 22, 2010 – Oct 16, 2010

lore
Share & tools
lore
#0 lore raw

I've seen the problem in the dump below and was wondering what could possibly cause this -- because shows loads of free memory (>20G)... how much memory do non-root attributes take to dump?

Dump fsname home, Mountpoint /home, Dumplevel=0
Notice: "-e" used in Xfsdump_options to allow exclusions
xfsdump -b 1m -l 0 -L home -e - /home | ( su -f -m backup -c " umask 027;nice -19 ionice -c3 lzop > home/home-100522-0-0349.dump.lzo " )
xfsdump: using file dump (drive_simple) strategy
xfsdump: version 3.0.1 (dump format 3.0) - Running single-threaded
xfsdump: level 0 dump of Ishtar:/home
xfsdump: dump date: Sat May 22 03:49:45 2010
xfsdump: session id: 5132d03a-d58f-4899-8a3c-a2dc86efe915
xfsdump: session label: "home"
xfsdump: ino map phase 1: constructing initial dump list
xfsdump: ino map phase 2: skipping (no pruning necessary)
xfsdump: ino map phase 3: skipping (only one dump stream)
xfsdump: ino map construction complete
xfsdump: estimated dump size: 537916877696 bytes
xfsdump: creating dump session media file 0 (media 0, file 0)
xfsdump: dumping ino map
xfsdump: dumping directories
xfsdump: dumping non-directory files
xfsdump: WARNING: could not get list of non-root attributes for nondir ino 75466: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of non-root attributes for nondir ino 75468: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of root attributes for nondir ino 75468: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of non-root attributes for nondir ino 75470: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of root attributes for nondir ino 75470: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of non-root attributes for nondir ino 75497: Cannot allocate memory (12)

kernel = 2.6.34-Vanilla
xfsdump from package numberd 3.0.1-2.1
(x86_64)

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#1 lore raw
Quoted 4 lines · Linda A. Walsh

I've seen the problem in the dump below and was wondering what could possibly cause this -- because
shows loads of free memory (>20G)... how much memory do non-root attributes take to dump?

The error comes directly from the libhandle listing routine, which is a straight forward wrapper around the kernel syscall in current xfsprogs.

What xfsprogs version are you using? I noticed your xfsdump is rather old, so making sure you have recent XFS userspace and possibly also the kernel would help debugging this.

Also can you check using strace if the ENOMEM comes directly from the attr_list_by_handle ioctl?

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#2 lore raw
Quoted 6 lines · Christoph Hellwig
Quoted 4 lines · Linda A. Walsh

I've seen the problem in the dump below and was wondering what could possibly cause this -- because
shows loads of free memory (>20G)... how much memory do non-root attributes take to dump?

Quoted 7 lines

The error comes directly from the libhandle listing routine, which is a straight forward wrapper around the kernel syscall in current xfsprogs.

What xfsprogs version are you using? I noticed your xfsdump is rather old, so making sure you have recent XFS userspace and possibly also the kernel would help debugging this.

I just saw this last night. All from ubuntu lucid:
xfsdump 3.0.4
Linux willster 2.6.32-22-generic #33-Ubuntu SMP Wed Apr 28 13:28:05 UTC 2010 x86_64 GNU/Linux

Quoted 2 lines

Also can you check using strace if the ENOMEM comes directly from the attr_list_by_handle ioctl?

Will try another dump tonight with strace on and see if i get it.

Signature · 6 lines
Stewart Smith

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
#3 lore raw
In reply to Christoph Hellwig
Quoted 10 lines · Christoph Hellwig

The error comes directly from the libhandle listing routine, which is a straight forward wrapper around the kernel syscall in current xfsprogs.

What xfsprogs version are you using? I noticed your xfsdump is rather old, so making sure you have recent XFS userspace and possibly also the kernel would help debugging this.

Also can you check using strace if the ENOMEM comes directly from the attr_list_by_handle ioctl?

---
versions:
xfsprogs/xfsdump both at 3.0.1-2.1 from suse11.2 which would likely be 3.0.1 with some patchlevel from suse. kernel is 2.6.34 (vanilla).

strace would be pretty difficult considering how far it is into a dump before it is triggered.

Maybe I should try getting updated tools and see
if it "goes away"...

looks like I need to build xfsprogs before xfsdump?

looks like best way to pull current ver is from .git.

will try rebuilding and see if I have any luck...

BTW -- how do you tell the version of the xfs progs from the individual progs -- I'm going from the installed rpm name, but if I build from the git, that won't be helpful.
I don't see a VERSION command in xfsdump/restore?

Is there one with any of the xfs tools?

tnx,
-linda

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#4 lore raw
In reply to Christoph Hellwig

FWIF -- upgrading to the latest tool set seems to have caused these messages to "go away"...

Quoted 8 lines · Christoph Hellwig
Quoted 2 lines · Linda A. Walsh

I've seen the problem in the dump below and was wondering what could possibly cause this -- because shows loads of free memory (>20G)... how much memory do non-root attributes take to dump?

The error comes directly from the libhandle listing routine, which is a straight forward wrapper around the kernel syscall in current xfsprogs.

Quoted 7 lines

What xfsprogs version are you using? I noticed your xfsdump is rather old, so making sure you have recent XFS userspace and possibly also the kernel would help debugging this.

Also can you check using strace if the ENOMEM comes directly from the attr_list_by_handle ioctl?

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#5 lore raw

Greetings Linda-

I had not seen this message until this evening, and we too are running Ubuntu Lucid (10.04.1) with all updates.

/usr/sbin/xfsdump: creating dump session media file 0 (media 0, file 0)
/usr/sbin/xfsdump: dumping ino map
/usr/sbin/xfsdump: dumping directories
/usr/sbin/xfsdump: dumping non-directory files
/usr/sbin/xfsdump: WARNING: could not get list of non-root attributes for nondir ino 235386: Cannot allocate memory (12) /usr/sbin/xfsdump: ending media file
/usr/sbin/xfsdump: media file size 98262032976 bytes
/usr/sbin/xfsdump: dump size (non-dir files) : 98162141360 bytes
/usr/sbin/xfsdump: dump complete: 3481 seconds elapsed
/usr/sbin/xfsdump: Dump Status: SUCCESS

$ uname -a
Linux ldslnx01 2.6.32-25-generic-pae #44-Ubuntu SMP Fri Sep 17 21:57:48 UTC 2010 i686 GNU/Linux
$ free -m
             total       used       free     shared    buffers     cached
Mem:          2003       1104        899          0          0       1012
-/+ buffers/cache:         92       1911
Swap:            0          0          0

Which that memory count is after the backup just completed. Usually this server draws under 512M.

Quoted 2 lines · Linda A. Walsh

FWIF -- upgrading to the latest tool set seems to have caused these messages to "go away"...

Where did you get a newer set of xfs tools than what comes from the Ubuntu repo?

I show the following versions: $ dpkg -l|grep xfs

ii  xfsdump                                   3.0.4                             Administrative utilities for the XFS filesys
ii  xfsprogs                                  3.1.0ubuntu1                      Utilities for managing the XFS filesystem

Sincerely,

Signature · 8 lines
Michael Lueck
Lueck Data Systems
http://www.lueckdatasystems.com/

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs