serial: 8250_dma: Rearm DMA Rx if more data is pending
PATCH 1/1 serial: 8250_dma: Rearm DMA Rx if more data is pending
When DMA Rx completes, the current behavior is to just exit the DMA completion handler without future actions. If the transfer is still on-going, UART will trigger an interrupt and that eventually rearms the DMA Rx. The extra interrupt round-trip has an inherent latency cost that increases the risk of FIFO overrun. In such situations, the latency margin tends to already be less due to FIFO not being empty.
Add check into DMA Rx completion handler to detect if LSR has DR (Data Ready) still set. DR indicates there will be more characters pending and DMA Rx can be rearmed right away to handle them.
--- drivers/tty/serial/8250/8250_dma.c | 19 ++++++++++++++++--- 1 file changed, 16 insertions(+), 3 deletions(-)
drivers/tty/serial/8250/8250_dma.c +16 -3
@@ -38,9 +38,8 @@ static void __dma_tx_complete(void *param)spin_unlock_irqrestore (&p->port.lock, flags); } -static void __dma_rx_complete (void *param) +static void __dma_rx_complete (struct uart_8250_port *p) { -struct uart_8250_port *p = param;struct uart_8250_dma *dma = p->dma;struct tty_port *tty_port = &p->port.state->port;struct dma_tx_state state;
@@ -57,6 +56,20 @@ static void __dma_rx_complete(void *param)tty_flip_buffer_push (tty_port); } +static void dma_rx_complete (void *param) +{ +struct uart_8250_port *p = param; +struct uart_8250_dma *dma = p->dma; +unsigned long flags; + +__dma_rx_complete (p); + +spin_lock_irqsave (&p->port.lock, flags); +if (!dma->rx_running && (serial_lsr_in (p) &UART_LSR_DR )) + p->dma->rx_dma (p); +spin_unlock_irqrestore (&p->port.lock, flags); +} +int serial8250_tx_dma (struct uart_8250_port *p) {struct uart_8250_dma *dma = p->dma;
@@ -130,7 +143,7 @@ int serial8250_rx_dma(struct uart_8250_port *p)return -EBUSY ; dma->rx_running =1 ; - desc->callback = __dma_rx_complete; + desc->callback = dma_rx_complete; desc->callback_param = p; dma->rx_cookie =dmaengine_submit (desc);
Signature · 1 line
2.30.2
Quoted 10 lines · Ilpo Järvinen
When DMA Rx completes, the current behavior is to just exit the DMA completion handler without future actions. If the transfer is still on-going, UART will trigger an interrupt and that eventually rearms the DMA Rx. The extra interrupt round-trip has an inherent latency cost that increases the risk of FIFO overrun. In such situations, the latency margin tends to already be less due to FIFO not being empty.
Add check into DMA Rx completion handler to detect if LSR has DR (Data Ready) still set. DR indicates there will be more characters pending and DMA Rx can be rearmed right away to handle them.
Yep, I used to have something like draft of the below change locally. Thanks for putting it in shape and upstreamimg!
Quoted 54 lines
Cc Gilles BULOZ <[email protected]>Signed-off-by Ilpo Järvinen <[email protected]>--- drivers/tty/serial/8250/8250_dma.c | 19 ++++++++++++++++--- 1 file changed, 16 insertions(+), 3 deletions(-)drivers/tty/serial/8250/8250_dma.c +16
-3@@ -38,9 +38,8 @@ static void __dma_tx_complete(void *param)spin_unlock_irqrestore (&p->port.lock, flags); } -static void __dma_rx_complete (void *param) +static void __dma_rx_complete (struct uart_8250_port *p) { -struct uart_8250_port *p = param;struct uart_8250_dma *dma = p->dma;struct tty_port *tty_port = &p->port.state->port;struct dma_tx_state state;@@ -57,6 +56,20 @@ static void __dma_rx_complete(void *param)tty_flip_buffer_push (tty_port); } +static void dma_rx_complete (void *param) +{ +struct uart_8250_port *p = param; +struct uart_8250_dma *dma = p->dma; +unsigned long flags; + +__dma_rx_complete (p); + +spin_lock_irqsave (&p->port.lock, flags); +if (!dma->rx_running && (serial_lsr_in (p) &UART_LSR_DR )) + p->dma->rx_dma (p); +spin_unlock_irqrestore (&p->port.lock, flags); +} +int serial8250_tx_dma (struct uart_8250_port *p) {struct uart_8250_dma *dma = p->dma;@@ -130,7 +143,7 @@ int serial8250_rx_dma(struct uart_8250_port *p)return -EBUSY ; dma->rx_running =1 ; - desc->callback = __dma_rx_complete; + desc->callback = dma_rx_complete; desc->callback_param = p; dma->rx_cookie =dmaengine_submit (desc);Signature · 1 line
2.30.2
Signature · 2 lines
With Best Regards, Andy Shevchenko
Quoted 1 line · Andy Shevchenko
On Mon, Nov 07, 2022 at 12:21:26PM +0200, Ilpo Järvinen wrote:
...
Quoted 4 lines
Yep, I used to have something like draft of the below change locally. Thanks for putting it in shape and upstreamimg!
Reviewed-by Andy Shevchenko <[email protected]>
...
Quoted 5 lines
drivers/tty/serial/8250/8250_dma.c static void __dma_tx_complete(void *param) · line 43
Quoted 5 lines
drivers/tty/serial/8250/8250_dma.c +1
-2-static void __dma_rx_complete (void *param) +static void __dma_rx_complete (struct uart_8250_port *p) { -struct uart_8250_port *p = param;struct uart_8250_dma *dma = p->dma;
Btw, looking into my patch in archives I noticed that dma can also be passed as a parameter...
...
Quoted 5 lines
drivers/tty/serial/8250/8250_dma.c static void __dma_rx_complete(void *param) · line 62
Quoted 5 lines
drivers/tty/serial/8250/8250_dma.c +4
-0+static void dma_rx_complete (void *param) +{ +struct uart_8250_port *p = param; +struct uart_8250_dma *dma = p->dma;
...since you have it already here.
Quoted 3 lines
Quoted 3 lines
drivers/tty/serial/8250/8250_dma.c +3
-0+unsigned long flags; + +__dma_rx_complete (p);
Signature · 2 lines
With Best Regards, Andy Shevchenko