Skip to contentSkip to conversation

arm: Activating dcache breaks 'usb start' and 'tftpboot' on jadecpu

U-Boot Matthias Weißer 3 participants 8 messages Dec 3, 2010

lore
Share & tools
lore
#0 lore raw

Hi

I just activated the dcache on our jadecpu board but it seems to me that this breaks some commands.

jade> dcache
Data (writethrough) Cache is OFF
jade> usb start
(Re)start USB...
USB: scanning bus for devices... 2 USB Device(s) found
scanning bus for storage devices... 1 Storage Device(s) found
jade> dcache on
Data (writethrough) Cache is ON
jade> usb start
(Re)start USB...
USB: scanning bus for devices... ERROR: CTL:TIMEOUT
2 USB Device(s) found
scanning bus for storage devices... 0 Storage Device(s) found
jade> dcache off
Data (writethrough) Cache is OFF
jade> usb start
(Re)start USB...
USB: scanning bus for devices... 2 USB Device(s) found
scanning bus for storage devices... 1 Storage Device(s) found
jade>

Same goes for tftpboot on this machine and also on a imx25 based system which is currently not in mainline. As there is a timeout involved I had the timer implementation under suspicion where some static variables may be used before relocation but moving them to gd_t didn't help.

Has anyone an explanation for this behavior? Is anyone out there having dcache running on an ARM926 and working usb/tftpboot?

Many thanks,
Matthias

#1 lore raw

Dear =?ISO-8859-15?Q?Matthias_Wei=DFer?=,

Quoted 3 lines · In message <[email protected]> you wrote:

I just activated the dcache on our jadecpu board but it seems to me that this breaks some commands.

I am not surprised.

Quoted 2 lines

Has anyone an explanation for this behavior? Is anyone out there having dcache running on an ARM926 and working usb/tftpboot?

Many drivers have not been written to work with enabled caches.

As far as USB is concerned, you might be lucky that your system usies a EHCI controller, so setting CONFIG_EHCI_DCACHE should help.

As for the network driver, you will probably have to figure out yourself how to fix that.

Patches welcome.

Best regards,

Wolfgang Denk

Signature · 4 lines
DENX Software Engineering GmbH,     MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: wd at denx.de
When all is said and done, more is said than done.
#2 lore raw

Hello Wolfgang

Am 03.12.2010 15:47, schrieb Wolfgang Denk:

Quoted 4 lines
Quoted 2 lines

Has anyone an explanation for this behavior? Is anyone out there having dcache running on an ARM926 and working usb/tftpboot?

Many drivers have not been written to work with enabled caches.

What is the reason that special handling is needed when dcache is enabled? If a driver doesn't use any DMA there should be no need as the dcache is only enabled for the RAM and not for any memory mapped IO if I understand the code in arch/arm/lib/cache-cp15.c right.

Quoted 2 lines

As far as USB is concerned, you might be lucky that your system usies a EHCI controller, so setting CONFIG_EHCI_DCACHE should help.

No, only OHCI.

Quoted 2 lines

As for the network driver, you will probably have to figure out yourself how to fix that.

As the memory mapped network controller (SMSC9221) is not cached it shouldn't be a problem or do I miss something here?

Quoted 1 line

Patches welcome.

If someone can give me a little push into the right direction I will try but currently I have no idea what to do besides activating the cache right before the default "bootm" booting.

Thanks a lot
Matthias

#3 lore raw

Dear =?ISO-8859-1?Q?Matthias_Wei=DFer?=,

Quoted 10 lines · In message <[email protected]> you wrote:
Quoted 5 lines
Quoted 3 lines

Has anyone an explanation for this behavior? Is anyone out there having dcache running on an ARM926 and working usb/tftpboot?

Many drivers have not been written to work with enabled caches.

What is the reason that special handling is needed when dcache is enabled? If a driver doesn't use any DMA there should be no need as the dcache is only enabled for the RAM and not for any memory mapped IO if I understand the code in arch/arm/lib/cache-cp15.c right.

On ARM, device write accesses are typically just store instructions (in C: assignments to a volatile pointer). With caches on, these accesses will be - guess what? cached, i. e. they are NOT written to the device, at least not immediately. And if you repeatedly read a register (like when polling for some status bit to change) these accesses will be cached, too.

You need to make sure that caches are properly flushed / invalidated at the right points.

Quoted 4 lines
Quoted 2 lines

As far as USB is concerned, you might be lucky that your system usies a EHCI controller, so setting CONFIG_EHCI_DCACHE should help.

No, only OHCI.

Bad luck.

Quoted 2 lines

As the memory mapped network controller (SMSC9221) is not cached it shouldn't be a problem or do I miss something here?

You said you had enabled the data cache, so why do you think these accesses are not cached?

Best regards,

Wolfgang Denk

Signature · 6 lines
DENX Software Engineering GmbH,     MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: wd at denx.de
Blast medicine anyway!  We've learned to tie into every organ in the
human body but one.  The brain!  The brain is what life is all about.
	-- McCoy, "The Menagerie", stardate 3012.4
#4 lore raw

Le 03/12/2010 16:33, Wolfgang Denk a ?crit :

Quoted 11 lines
Quoted 4 lines

What is the reason that special handling is needed when dcache is enabled? If a driver doesn't use any DMA there should be no need as the dcache is only enabled for the RAM and not for any memory mapped IO if I understand the code in arch/arm/lib/cache-cp15.c right.

On ARM, device write accesses are typically just store instructions (in C: assignments to a volatile pointer). With caches on, these accesses will be - guess what? cached, i. e. they are NOT written to the device, at least not immediately. And if you repeatedly read a register (like when polling for some status bit to change) these accesses will be cached, too.

In addition to making sure that register reads/write are not bitten by caching, note that some controllers have DMA capabilities which require proper cache handling for DMA memory buffers -- typically flushing them from cache before a DMA to the device, and invalidating their cache entries after a DMA from the device.

Quoted 3 lines

Best regards,

Wolfgang Denk

Amicalement,

Signature · 1 line
Albert.
#5 lore raw

Am 03.12.2010 17:34, schrieb Albert ARIBAUD:

Quoted 5 lines

In addition to making sure that register reads/write are not bitten by caching, note that some controllers have DMA capabilities which require proper cache handling for DMA memory buffers -- typically flushing them from cache before a DMA to the device, and invalidating their cache entries after a DMA from the device.

This is true. DMA and caching can be a lot of fun for a driver developer :-) But I can guarantee that the network driver doesn't use any DMA transfer as the hardware doesn't support it.

Thanks
Matthias Wei?er

#6 lore raw
In reply to Wolfgang Denk

Hello Wolfgang

Am 03.12.2010 16:33, schrieb Wolfgang Denk:

Quoted 14 lines

Dear =?ISO-8859-1?Q?Matthias_Wei=DFer?=,

Quoted 10 lines · In message <[email protected]> you wrote:
Quoted 5 lines
Quoted 3 lines

Has anyone an explanation for this behavior? Is anyone out there having dcache running on an ARM926 and working usb/tftpboot?

Many drivers have not been written to work with enabled caches.

What is the reason that special handling is needed when dcache is enabled? If a driver doesn't use any DMA there should be no need as the dcache is only enabled for the RAM and not for any memory mapped IO if I understand the code in arch/arm/lib/cache-cp15.c right.

Quoted 7 lines

On ARM, device write accesses are typically just store instructions (in C: assignments to a volatile pointer). With caches on, these accesses will be - guess what? cached, i. e. they are NOT written to

the device, at least not immediately. And if you repeatedly read a register (like when polling for some status bit to change) these accesses will be cached, too.

I understand this behavior. But it is only true if the memory area in question is marked as cacheable.

Quoted 5 lines
Quoted 2 lines

As the memory mapped network controller (SMSC9221) is not cached it shouldn't be a problem or do I miss something here?

You said you had enabled the data cache, so why do you think these accesses are not cached?

Please see arch/arm/lib/cache-cp15.c
The code there creates 4096 page table entries (1MB each) for the whole 4GB address space and initializes each entry in a way that it is not cacheable (mmu_setup():71). It then changes the page table entries which are pointing to a RAM area to make these, and only these, cacheable (dram_bank_mmu_setup():57).

If the whole address space would be cached I would expect that even writing to NOR flash fails as the write accesses wouldn't reach the flash chip. But that works perfect on both of my systems.

Thanks
Matthias Wei?er

#7 lore raw

Dear =?ISO-8859-1?Q?Matthias_Wei=DFer?=,

Quoted 10 lines · In message <[email protected]> you wrote:
Quoted 3 lines

You said you had enabled the data cache, so why do you think these accesses are not cached?

Please see arch/arm/lib/cache-cp15.c
The code there creates 4096 page table entries (1MB each) for the whole 4GB address space and initializes each entry in a way that it is not cacheable (mmu_setup():71). It then changes the page table entries which are pointing to a RAM area to make these, and only these, cacheable (dram_bank_mmu_setup():57).

You did not mention this before. You just said: "I enabled dcache" which for e sounds as if you did this globally.

Well, I'm not an export for AT91 in any way...

Best regards,

Wolfgang Denk

Signature · 5 lines
DENX Software Engineering GmbH,     MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: wd at denx.de
The human mind treats a new idea the way the body  treats  a  strange
protein - it rejects it.                                 - P. Medawar