Skip to contentSkip to conversation

Houston, we have a problem: big file copying, USB, external disks

DISCUSSION John Zupfel 2 participants 2 messages May 18, 2009

lore
Share & tools
lore
#0 lore raw

Are recent kernels (since somewhere around 2.6.27 - 2.6.28) choking on big file copying?

https://bugs.launchpad.net/ubuntu/+source/gvfs/+bug/197762?comments=all

Quoting the latest post:

Quoted 33 lines

No, it's not Ubuntu specific and Canonical didn't cause it.

Right now I'm copying between two SATA drives, connected to my PC via eSATA. So far a lousy 600MB has been copied and I'm already down to 5MB/s and falling.

Here is what I know about the problem:

It affects ALL hardware.

It affects ALL file copying connections to varying degrees: USB, network, SATA/eSATA.

In some instances, it also affects multitasking, all but locking the computer up despite little to no CPU use in System Monitor.

There are no error logs, messages or anything else that occur when the problem is happening.

In my experience, if you test for the problem and nothing seems to be wrong, then that's because you aren't copying enough data, you don't know how fast your hardware should be copying files, or you are lucky enough to only be subtly affected that time. Try copying more multi- gigabytes of data, several times and see if you can't get wildly different durations for the same data size. As I state above, all hardware I have tested is affected to varying degrees, some hardware shows minor performance degradation over time, some hardware is all but useless for file copying.

If you ask me, it's either the scheduler (GUI lockups with no CPU usage makes me think this) or whatever performs the actual file copy process. It's definitely not a USB problem because it affects network copying too.

#1 lore raw

* John Zupfel <[email protected]>:

Quoted 6 lines

Are recent kernels (since somewhere around 2.6.27 - 2.6.28) choking on big file copying?

https://bugs.launchpad.net/ubuntu/+source/gvfs/+bug/197762?comments=all

Does this happen AFTER a suspend/hibernate or ALL THE TIME?

Quoted 42 lines
Quoted 29 lines

No, it's not Ubuntu specific and Canonical didn't cause it.

Right now I'm copying between two SATA drives, connected to my PC via eSATA. So far a lousy 600MB has been copied and I'm already down to 5MB/s and falling.

Here is what I know about the problem:

It affects ALL hardware.

It affects ALL file copying connections to varying degrees: USB, network, SATA/eSATA.

In some instances, it also affects multitasking, all but locking the computer up despite little to no CPU use in System Monitor.

There are no error logs, messages or anything else that occur when the problem is happening.

In my experience, if you test for the problem and nothing seems to be wrong, then that's because you aren't copying enough data, you don't know how fast your hardware should be copying files, or you are lucky enough to only be subtly affected that time. Try copying more multi- gigabytes of data, several times and see if you can't get wildly different durations for the same data size. As I state above, all hardware I have tested is affected to varying degrees, some hardware shows minor performance degradation over time, some hardware is all but useless for file copying.

Quoted 4 lines

If you ask me, it's either the scheduler (GUI lockups with no CPU usage makes me think this) or whatever performs the actual file copy process. It's definitely not a USB problem because it affects network copying too.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Signature · 7 lines
Ralf Hildebrandt
  Geschäftsbereich IT | Abteilung Netzwerk
  Charité - Universitätsmedizin Berlin
  Campus Benjamin Franklin
  Hindenburgdamm 30 | D-12200 Berlin
  Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962
  [email protected] | http://www.charite.de