Skip to contentSkip to conversation

Modems: Cable or DSL digital blunders that lartc may help with.

LARTC Mike Mestnik 3 participants 8 messages Jun 22, 2004 – Jun 23, 2004

lore
Share & tools
lore
#0 lore raw

I have a Cable 'modem' that has a problem that many of these devices is bound to have. I was wondering what other lartc user thought about this and if DSL has simular problems.

Cable, being Asymetrical, is able to upload at a given rate and hopefully has a buffer, in the modem, of some kind. When I nc(netcat) to a UDP echo, or discard, server I get about 10Mbps out on my ethernet, but only 256Kbps acctualy receved(reported by an open echo server). Other traffic on the link suffers grately from this, so I don't do it oftan :) I use htb to curve this and that seams to work nice.

NO REALY MY CABLE MODEM DOSEN'T MAKE ANY ATTEMPT TO, CALL FOR HELP, CONTROL THE FLOW(aka flow-control, supported by ethernet and rs-232).

TCP workes a bit better, but not if I use more then 7 uploads at once. With more then 7 the rate detection, read about this on your own time, generates more than 3(The TCP limit for 'giving up') * 7(The number of connectios) of these droped/missing packets that every connection gives up.

__________________________________
Do you Yahoo!?
New and Improved Yahoo! Mail - Send 10MB messages!
http://promotions.yahoo.com/new_mail
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#1 lore raw
Quoted 3 lines · Mike Mestnik

I have a Cable 'modem' that has a problem that many of these devices is bound to have. I was wondering what other lartc user thought about this and if DSL has simular problems.

Was there a question in here somewhere?

<snip>

Quoted 2 lines

NO REALY MY CABLE MODEM DOSEN'T MAKE ANY ATTEMPT TO, CALL FOR HELP, CONTROL THE FLOW(aka flow-control, supported by ethernet and rs-232).

Okay?

Quoted 5 lines

TCP workes a bit better, but not if I use more then 7 uploads at once. With more then 7 the rate detection, read about this on your own time, generates more than 3(The TCP limit for 'giving up') * 7(The number of connectios) of these droped/missing packets that every connection gives up.

"read about this on your own time"

If you're not going to explain the situation who do you expect is going to research it on their time?

Signature · 8 lines
Jason Boxman
Perl Programmer / *NIX Systems Administrator
Shimberg Center for Affordable Housing | University of Florida
http://edseek.com/ - Linux and FOSS stuff

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#2 lore raw

Re: [LARTC] Modems: Cable or DSL digital blunders that lartc may

In reply to Mike Mestnik

Hi Mike,

Quoted 5 lines

I have a Cable 'modem' that has a problem that many of these devices is bound to have. I was wondering what other lartc user thought about this and if DSL has simular problems.

Yep, we all have this problem. Read through LARTC, ADSL_QOS howto and even some recent posts to this list (which cover this in great detail)

Quoted 11 lines

Cable, being Asymetrical, is able to upload at a given rate and hopefully has a buffer, in the modem, of some kind. When I nc(netcat) to a UDP echo, or discard, server I get about 10Mbps out on my ethernet, but only 256Kbps acctualy receved(reported by an open echo server). Other traffic on the link suffers grately from this, so I don't do it oftan :) I use htb to curve this and that seams to work nice.

NO REALY MY CABLE MODEM DOSEN'T MAKE ANY ATTEMPT TO, CALL FOR HELP, CONTROL THE FLOW(aka flow-control, supported by ethernet and rs-232).

There is no such flowcontrol in ethernet or rs232. TCP only indicates congestion by dropping packets. There is something called ECN, but it is rarely implemented (and tests suggest that it doesn't help as much as theory might like).

Read the LARTC and come back for more. It's a really great document

Ed W

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#3 lore raw
In reply to Mike Mestnik
Quoted 17 lines · --- Ed Wildgoose

Hi Mike,

Quoted 1 line

Cable, being Asymetrical, is able to upload at a given rate and

hopefully

Quoted 2 lines

has a buffer, in the modem, of some kind. When I nc(netcat) to a UDP echo, or discard, server I get about 10Mbps out on my ethernet, but

only

Quoted 1 line

256Kbps acctualy receved(reported by an open echo server). Other

traffic

Quoted 7 lines

on the link suffers grately from this, so I don't do it oftan :) I use htb to curve this and that seams to work nice.

NO REALY MY CABLE MODEM DOSEN'T MAKE ANY ATTEMPT TO, CALL FOR HELP, CONTROL THE FLOW(aka flow-control, supported by ethernet and rs-232).

Quoted 6 lines

There is no such flowcontrol in ethernet or rs232. TCP only indicates congestion by dropping packets. There is something called ECN, but it is rarely implemented (and tests suggest that it doesn't help as much as

theory might like).

http://www.lammertbies.nl/comm/info/RS-232_flow_control.html
ECN is software flow control. There is also icmp for software FC? The idea is too prevent 'buffer underruns' in the modem, any SNMP or other stats on this buffer would also provide SWFC.

http://www.nwfusion.com/netresources/0913flow.html
This is ethernets HWFC, that any directly connected modem could use. The idea then is for the directly connected computer to use SwFC(ECN or ?icmp?) to pass this FC onto other hosts using the modem.

Quoted 2 lines

Ed W

Thanx Ed.
Mike M

__________________________________
Do you Yahoo!?
New and Improved Yahoo! Mail - Send 10MB messages!
http://promotions.yahoo.com/new_mail
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#4 lore raw

Re: [LARTC] Modems: Cable or DSL digital blunders that lartc may

In reply to Mike Mestnik
Quoted 7 lines

http://www.lammertbies.nl/comm/info/RS-232_flow_control.html
ECN is software flow control. There is also icmp for software FC? The idea is too prevent 'buffer underruns' in the modem, any SNMP or other stats on this buffer would also provide SWFC.

I don't consider this to be "flow-control" in the sense of throttling sending. This is really a syncronisation protocol.

Quoted 6 lines

http://www.nwfusion.com/netresources/0913flow.html
This is ethernets HWFC, that any directly connected modem could use. The idea then is for the directly connected computer to use SwFC(ECN or ?icmp?) to pass this FC onto other hosts using the modem.

Hmm, I wasn't aware of a "pause" ability for ethernet. But still this is a very low level layer 1 protocol. In other words this will calm your 100mb net card talking to your 10mbit port on your cable modem. But it has no idea that the cable modem only has a 256kb link

You need something which works at IP level or above. TCP (level higher) has some stuff, but (I repeat) it basically involves dropping traffic until the sender slows down. There are protocols like ECN, but they are broadly unsupported. ICMP stuff is frequently dropped by routers/firewalls making it problematic (look at how difficult it is just to do MTU discovery!)

What's your question though? Read the LARTC howto and the ADSL QOS howto. They are both excellent docs. Also read up on some basic TCP notes. There is nothing really clever that you can do - it's all in the docs you just have to work around the limitations of the protocols

Ed W
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#5 lore raw
In reply to Mike Mestnik
Quoted 11 lines · --- Ed Wildgoose
Quoted 7 lines

http://www.lammertbies.nl/comm/info/RS-232_flow_control.html
ECN is software flow control. There is also icmp for software FC? The idea is too prevent 'buffer underruns' in the modem, any SNMP or other stats on this buffer would also provide SWFC.

I don't consider this to be "flow-control" in the sense of throttling sending. This is really a syncronisation protocol.

Yes, SwFC is lame. Howerver it would be a good band-aid, to have router and modem syncronisation take place.

Quoted 8 lines
Quoted 2 lines

http://www.nwfusion.com/netresources/0913flow.html
This is ethernets HWFC, that any directly connected modem could use.

The

Quoted 4 lines

idea then is for the directly connected computer to use SwFC(ECN or ?icmp?) to pass this FC onto other hosts using the modem.

Quoted 5 lines

Hmm, I wasn't aware of a "pause" ability for ethernet. But still this is a very low level layer 1 protocol. In other words this will calm your 100mb net card talking to your 10mbit port on your cable modem. But it has no idea that the cable modem only has a 256kb link

The router(PC) has no idea of the buffer fullness, this is the underlying problem! The cable modem needs to triger a "pause" when it's buffer reaches %80 full, regardless of any other rate limiting. Linux kernel can do this with some cards, under heavy CPU strain(htb).

CONFIG_NET_HW_FLOWCONTROL: net/Kconfig

Quoted 2 lines

You need something which works at IP level or above. TCP (level higher)

No, the DEVICE is not > layer 3. It's simply a bridge, with a stoplight on one end. The idea is to not make any cars crash, that has nothing todo with the ball game a car might want to get too.

Quoted 3 lines

has some stuff, but (I repeat) it basically involves dropping traffic until the sender slows down. There are protocols like ECN, but they are

Yes, ECN will/should be used for routers attached to bridges.

Quoted 4 lines

broadly unsupported. ICMP stuff is frequently dropped by routers/firewalls making it problematic (look at how difficult it is just to do MTU discovery!)

ECN makes this a non-issue.

Quoted 6 lines

What's your question though? Read the LARTC howto and the ADSL QOS howto. They are both excellent docs. Also read up on some basic TCP notes. There is nothing really clever that you can do - it's all in the

docs you just have to work around the limitations of the protocols

I would like to know is maby a ?$6000.00? Cisco cable mobem will not only use HwFC but ECN as well? Thought i'd like to find a $150.00 modem that will just do HwFC, maby an internal one?

Quoted 2 lines

Ed W

__________________________________
Do you Yahoo!?
New and Improved Yahoo! Mail - Send 10MB messages!
http://promotions.yahoo.com/new_mail
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#6 lore raw

Re: [LARTC] Modems: Cable or DSL digital blunders that lartc may

In reply to Mike Mestnik
Quoted 5 lines

Yes, SwFC is lame. Howerver it would be a good band-aid, to have router and modem syncronisation take place.

You have got to consider that some devices are asynchronous and some are synchronous

Quoted 8 lines

The router(PC) has no idea of the buffer fullness, this is the underlying problem! The cable modem needs to triger a "pause" when it's buffer reaches %80 full, regardless of any other rate limiting. Linux kernel can do this with some cards, under heavy CPU strain(htb).

CONFIG_NET_HW_FLOWCONTROL: net/Kconfig

Possibly, but this doesn't help you that much. If your http download is whacking out packets then your SSH session will still effectively get crowded out.

You want something to queue for a bit and prioritise this extra traffic.

...you have read the LARTC Howto haven't you?

Quoted 8 lines
Quoted 3 lines

You need something which works at IP level or above. TCP (level higher)

No, the DEVICE is not > layer 3. It's simply a bridge, with a stoplight on one end. The idea is to not make any cars crash, that has nothing todo with the ball game a car might want to get too.

??

Quoted 3 lines

Yes, ECN will/should be used for routers attached to bridges.

Not as far as I am aware? (today)

Quoted 9 lines
Quoted 6 lines

broadly unsupported. ICMP stuff is frequently dropped by routers/firewalls making it problematic (look at how difficult it is just to do MTU discovery!)

ECN makes this a non-issue.

??? Eh?

Quoted 4 lines
Quoted 4 lines

What's your question though? Read the LARTC howto and the ADSL QOS howto. They are both excellent docs. Also read up on some basic TCP notes. There is nothing really clever that you can do - it's all in the

Quoted 9 lines
Quoted 4 lines

docs you just have to work around the limitations of the protocols

I would like to know is maby a ?$6000.00? Cisco cable mobem will not only use HwFC but ECN as well? Thought i'd like to find a $150.00 modem that will just do HwFC, maby an internal one?

No it won't. Well, even if it did, I don't think it would help. Unless the rest of the world understands your protocol then you will still have problems with incoming connections.

You can get a £250 cisco adsl modem which looks rather powerful. Try that if you want to experiment.

Please, please read the LARTC-Howto and ADSL-qos howto. I think it has everything that you need.

Quoted 10 lines
Quoted 6 lines

Ed W

Quoted 9 lines

__________________________________
Do you Yahoo!?
New and Improved Yahoo! Mail - Send 10MB messages!
http://promotions.yahoo.com/new_mail
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#7 lore raw
In reply to Mike Mestnik

Yes, I do understand the LARTC and wondershaper. As for ADSL-qos I didn't, but I did read all the TCP rfcs regarding packet lose and throughput negotiation, ect.

Quoted 11 lines · --- Ed Wildgoose
Quoted 2 lines

Yes, SwFC is lame. Howerver it would be a good band-aid, to have

router

Quoted 3 lines

and modem syncronisation take place.

You have got to consider that some devices are asynchronous and some are

synchronous

I don't follow you? The router would never tell the modem to stop the downward, exept for the rare cases where you need HW_FLOWCONTROL. As for upward that has the most problems where moving to a slower bandwith.

Quoted 11 lines
Quoted 1 line

The router(PC) has no idea of the buffer fullness, this is the

underlying

Quoted 2 lines

problem! The cable modem needs to triger a "pause" when it's buffer reaches %80 full, regardless of any other rate limiting. Linux kernel

can

Quoted 5 lines

do this with some cards, under heavy CPU strain(htb).

CONFIG_NET_HW_FLOWCONTROL: net/Kconfig

Quoted 9 lines

Possibly, but this doesn't help you that much. If your http download is

whacking out packets then your SSH session will still effectively get crowded out.

You want something to queue for a bit and prioritise this extra traffic.

....you have read the LARTC Howto haven't you?

This is where tos comes into play.
Most users won't need much more then pfifo_fast with a 3 second fifo buffer in the modem. Keep in mind we only use the modem's fifo buffer for overflow(%20 to %80).

Quoted 4 lines
Quoted 1 line
Quoted 1 line

You need something which works at IP level or above. TCP (level

higher)

Quoted 2 lines
Quoted 2 lines
Quoted 8 lines
Quoted 1 line

No, the DEVICE is not > layer 3. It's simply a bridge, with a

stoplight

Quoted 1 line

on one end. The idea is to not make any cars crash, that has nothing

todo

Quoted 3 lines

with the ball game a car might want to get too.

??

The DEVICE is a modem, like a serial v.34, ect. It's a bit of hardware and some modulation protocol. So there's no need for it to work with the upper layers. It's sufficent for the device to use it's ?ethernet/USB? line to signal a pause when it's gettting congested.

This means that any router attached to it is responsible for carrying out the upper layers flow control(ECN).

Quoted 7 lines
Quoted 5 lines

Yes, ECN will/should be used for routers attached to bridges.

Not as far as I am aware? (today)

This was my next question, dose htb or tbf effect linuxes ECN? Directly or indirectly?

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

broadly unsupported. ICMP stuff is frequently dropped by routers/firewalls making it problematic (look at how difficult it is just to do MTU discovery!)

Quoted 5 lines
Quoted 3 lines

ECN makes this a non-issue.

??? Eh?

ECN like IPv6 fixes some of the short commings in current technology.

For non-ECN connections droping one packet will signal a leveling of bandwith(TC-SFQ). If a TCP conection loses 3 packets, regardless of what router droped each, it's bandwith is cut in half. It would be nice to add a droped packet monitor to linux's connection tracking and feed this into sfq.

Quoted 18 lines
Quoted 4 lines
Quoted 4 lines

What's your question though? Read the LARTC howto and the ADSL QOS howto. They are both excellent docs. Also read up on some basic TCP notes. There is nothing really clever that you can do - it's all in

the

Quoted 6 lines
Quoted 5 lines

docs you just have to work around the limitations of the protocols

I would like to know is maby a ?$6000.00? Cisco cable mobem will not

only

Quoted 1 line

use HwFC but ECN as well? Thought i'd like to find a $150.00 modem

that

Quoted 3 lines

will just do HwFC, maby an internal one?

Quoted 6 lines

No it won't. Well, even if it did, I don't think it would help. Unless

the rest of the world understands your protocol then you will still have

problems with incoming connections.

It's only a hardware flow control for a directly connected modem? There is no software protocol, exept ECN and TCP.

That's what I'm saying is that the rest of the world FAILED to read about the ethernet standered and implement it correctly. Even thought it's clearly documented in the linux kernel how to implement.

Quoted 3 lines

You can get a £250 cisco adsl modem which looks rather powerful. Try that if you want to experiment.

I have looked at cisco cable modems. I would hope that thay would not only have proper flow control, including ECN, but also have a big buffer with lots of TC. However they are out of my price range.

Quoted 9 lines

Please, please read the LARTC-Howto and ADSL-qos howto. I think it has everything that you need.

Quoted 6 lines
Quoted 6 lines

Ed W

__________________________________
Do you Yahoo!?
Yahoo! Mail Address AutoComplete - You start. We finish.
http://promotions.yahoo.com/new_mail
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/