Skip to contentSkip to conversation

question about splice performance

DISCUSSION Francis Moreau 5 participants 6 messages May 25, 2008 – May 26, 2008

lore
Share & tools
lore
#0 lore raw

Hi,

I did a really basic benchmark and was suprise about the results.

$ echo 3 > /proc/sys/vm/drop_caches
$ time  splice-cp  vmlinux /tmp/vmlinux
real    0m10.158s
user    0m0.002s
sys     0m0.401s
$ echo 3 > /proc/sys/vm/drop_caches
$ time  cp  vmlinux /tmp/vmlinux
real    0m10.590s
user    0m0.017s
sys     0m0.459s

I was expecting splice-cp case to be faster.

Could someone enlight me ?

Thanks

Signature · 1 line
Francis
#1 lore raw
Quoted 14 lines · Francis Moreau

Hi,

I did a really basic benchmark and was suprise about the results.

$ echo 3 > /proc/sys/vm/drop_caches
$ time  splice-cp  vmlinux /tmp/vmlinux
real    0m10.158s
user    0m0.002s
sys     0m0.401s
$ echo 3 > /proc/sys/vm/drop_caches
$ time  cp  vmlinux /tmp/vmlinux
Quoted 8 lines
real    0m10.590s
user    0m0.017s
sys     0m0.459s

I was expecting splice-cp case to be faster.

Could someone enlight me ?

Slow disk outweighs memory copying overhead. And 300 MB is quickly transferred in idle systems.

#2 lore raw
In reply to Francis Moreau

<posted & mailed>

Quoted 6 lines · Francis Moreau

Hi,

I did a really basic benchmark and was suprise about the results.

$ echo 3 > /proc/sys/vm/drop_caches
$ time  splice-cp  vmlinux /tmp/vmlinux

Are vmlinux and /tmp both RAM filesystems? If not you may want to try using /dev/shm to rule out disk speed...

Signature · 1 line
Sitsofe | http://sucs.org/~sits/
#3 lore raw
In reply to Francis Moreau
Quoted 14 lines · Francis Moreau

Hi,

I did a really basic benchmark and was suprise about the results.

$ echo 3 > /proc/sys/vm/drop_caches
$ time  splice-cp  vmlinux /tmp/vmlinux
real    0m10.158s
user    0m0.002s
sys     0m0.401s
$ echo 3 > /proc/sys/vm/drop_caches
$ time  cp  vmlinux /tmp/vmlinux
Quoted 8 lines
real    0m10.590s
user    0m0.017s
sys     0m0.459s

I was expecting splice-cp case to be faster.

Could someone enlight me ?

If you drop caches you are not measuring splice speed.

Use ramfs for your tests (guarantees data is in cache) instead.

Jeff

#4 lore raw

Hello,

Quoted 5 lines · Jeff Garzik

If you drop caches you are not measuring splice speed.

Use ramfs for your tests (guarantees data is in cache) instead.

So it seems that the gain when using splice to copy a file into another file is very limited. Maybe that's the reason why cp is still using read/write...

Also splice-cp uses 2 calls to splice syscall in a loop. So it end up doing a lot of syscalls. Maybe using sendfile instead of is better.

Also2, since splice is a generalized pipe, it might be better to create to processes, one writing to the pipe and the other one reading to have better workflow.

That said I also see some use cases where splice could be more useful, specially when one of the file descriptor is actually a device: one the write side of the pipes a device could write some data while on the other side of the pipe a process can empty the pipe by writing the data to a file.

Are there any plans to improve splice interface to be used by drivers ?

Thanks.

Signature · 1 line
Francis
#5 lore raw

Hi!

Quoted 8 lines · Francis Moreau
Quoted 4 lines · Jeff Garzik

If you drop caches you are not measuring splice speed.

Use ramfs for your tests (guarantees data is in cache) instead.

So it seems that the gain when using splice to copy a file into another file is very limited. Maybe that's the reason why cp is still using read/write...

To point it out one more time: If you copy from one file on a physical harddisk (or more or less similar hardware) to another (with cold caches), the bottleneck is most probably the harddisk.

splice() simply reduces the amount of copied data in the RAM - and that is practically irrelevant if you read and write to and from harddisks.

So if you want to measure the savings of using splice() (instad of read()/write(), etc.): Copy to and from RAM disks (and thus rule out the slow hardware).

Bernd

Signature · 3 lines
Firmix Software GmbH                   http://www.firmix.at/
mobil: +43 664 4416156                 fax: +43 1 7890849-55
          Embedded Linux Development and Services