Skip to contentSkip to conversation

'dd' local works, but not over net, help as to why?

DISCUSSION LA Walsh 3 participants 5 messages Oct 2, 2001

lore
Share & tools
lore

LA Walsh

author
#0 lore raw

I'm sure there's an obvious answer to this, but it is eluding me.

If I am on my local laptop, I can 'dd' an 8G partition to a removable HD of the same or slightly larger size (slightly large because of geometry differences).

If I am on my desktop, "I can 'dd' the same size partition to a slightly larger one -- again, no problem.

But if I use:

dd if=/dev/hda2 bs=1M|rsh other-system of=/dev/sda2 bs=1M, I get failures of running out of room on target.  I've tried a variety of block size ranging from 1K->64G, but no luck.

Is there something in the networking code that's preventing me from transferring more than a 2 or 4 G limit?

I just wanted an exact image off onto another system.  Would seem to have been straight forwared. but I guess not?

Thanks in advance for any work-arounds and explanations...

-linda

#1 lore raw
Quoted 1 line · LA Walsh

I'm sure there's an obvious answer to this, but it is eluding me.

    Probably...
Quoted 4 lines

If I am on my local laptop, I can 'dd' an 8G partition to a removable HD of the same or slightly larger size (slightly large because of geometry differences).

Quoted 8 lines

If I am on my desktop, "I can 'dd' the same size partition to a slightly larger one -- again, no problem.

But if I use:

dd if=/dev/hda2 bs=1M|rsh other-system of=/dev/sda2 bs=1M, I get failures of running out of room on target.  I've tried a variety of block size ranging from 1K->64G, but no luck.

You are missing one 'dd' from the other system side, but are you also sure that the remote system can support large files, and that the dd in there does support large files ?

Verify that you can 'dd if=/dev/zero of=/dev/sda2 bs=1M' at that remote system -- then we know that dd in there (and the system) can do it, and the bug-sphere shrinks.

Quoted 2 lines

Is there something in the networking code that's preventing me from transferring more than a 2 or 4 G limit?

There should not be anything such.
(But of course things like RSH could have some nasty surprises

    in them...)
Quoted 6 lines

I just wanted an exact image off onto another system.  Would seem to have been straight forwared. but I guess not?

Thanks in advance for any work-arounds and explanations...

-linda

/Matti Aarnio

author
#2 lore raw
Quoted 24 lines

-----Original Message-----
From: [email protected] [mailto:[email protected]]On Behalf Of Matti Aarnio
Sent: Tuesday, October 02, 2001 1:20 AM
To: LA Walsh
Cc: [email protected]
Subject: Re: 'dd' local works, but not over net, help as to why?

Quoted 1 line · LA Walsh

I'm sure there's an obvious answer to this, but it is eluding me.

    Probably...
Quoted 9 lines

If I am on my local laptop, I can 'dd' an 8G partition to a removable HD of the same or slightly larger size (slightly large because of geometry differences).

If I am on my desktop, "I can 'dd' the same size partition to a slightly larger one -- again, no problem.

But if I use:

Quoted 7 lines
Quoted 3 lines

dd if=/dev/hda2 bs=1M|rsh other-system of=/dev/sda2 bs=1M, I get failures of running out of room on target.  I've tried a variety of block size ranging from 1K->64G, but no luck.

You are missing one 'dd' from the other system side, but are you also sure that the remote system can support large files, and that the dd in there does support large files ?

---
Missing 'dd' typo. It's on the other system I tried copying the 8G
to a slightly large 9G partition -- that worked. On the source system I can copy 8G to another 8G partition. Just running them over rsh seems to be a problem. Same version of 'dd' on each side (SuSE 7.2).

Maybe I can fool ftp with symlinks tomorrow into doing the copy and see
if that works. Just for fun I tried 'cat' as well -- same error -- out of space on target.

It transfers a lot of data -- right around 2G the first time I tried it, so it looked awfully suspicious.

Linda

#3 lore raw
In reply to Matti Aarnio
Quoted 8 lines · LA Walsh
Quoted 3 lines

You are missing one 'dd' from the other system side, but are you also sure that the remote system can support large files, and that the dd in there does support large files ?

---
Missing 'dd' typo. It's on the other system I tried copying the 8G
to a slightly large 9G partition -- that worked. On the source system I can copy 8G to another 8G partition. Just running them over rsh seems to be a problem. Same version of 'dd' on each side (SuSE 7.2).

There could be something amiss in the dd when feeding into a pipe ( 2G limit should not matter, but...)

Try following:

dd if=/dev/sdX | cat > /dev/null

Hmm.. And also:

dd if=/dev/sdX | rsh other-host dd of=/dev/null

Quoted 3 lines

Maybe I can fool ftp with symlinks tomorrow into doing the copy and see
if that works. Just for fun I tried 'cat' as well -- same error -- out of space on target.

'cat' local or remote ?

Quoted 2 lines

It transfers a lot of data -- right around 2G the first time I tried it, so it looked awfully suspicious.

Yes, suspicuous about something in the rsh barfing.

Quoted 1 line

Linda

/Matti Aarnio

#4 lore raw
In reply to LA Walsh
Quoted 1 line · LA Walsh

Thanks in advance for any work-arounds and explanations...

not sure about explanations, but have you tried using netpipes (faucet / hose) as a work-around...?

Signature · 4 lines
Alistair Riddell - BOFH
IT Manager, George Watson's College, Edinburgh
Tel: +44 131 447 7931 Ext 176       Fax: +44 131 452 8594
Microsoft - because god hates us