Regression: boot failure on AMD Elan TS-5500
The symptons are either a crash or reboot on booting the kernel. No printk's have occurred yet -- even with early printk on.
2.6.15 worked on this board however current does not. I've bisected it to:
commit a24e785111a32ccb7cebafd24b1b1cb474ea8e5d
Author: Rusty Russell <[email protected]>
Date: Sun Oct 21 16:41:35 2007 -0700
i386: paravirt boot sequence
This patch uses the updated boot protocol to do paravirtualized boot. If the boot version is >= 2.07, then it will do two things:
1. Check the bootparams loadflags to see if we should reload the segment registers and clear interrupts. This is appropriate for normal native boot and some paravirtualized environments, but inapproprate for others.
2. Check the hardware architecture, and dispatch to the appropriate kernel entrypoint. If the bootloader doesn't set this, then we simply do the normal boot sequence.
Unfortunately this patch can't be reverse-applied onto mainline, so I've tried it on 2.6.24-rc1. 2.6.24-rc1 as-is fails, but with this patch reverted it does work.
This is the board:
http://www.embeddedarm.com/products/board-detail.php?product=TS-5500
Regards
Sean
Quoted 10 lines · On Monday 16 June 2008 22:11:39 Sean Young wrote:
The symptons are either a crash or reboot on booting the kernel. No printk's have occurred yet -- even with early printk on.
2.6.15 worked on this board however current does not. I've bisected it to:
commit a24e785111a32ccb7cebafd24b1b1cb474ea8e5d Author: Rusty Russell <[email protected]> Date: Sun Oct 21 16:41:35 2007 -0700 i386: paravirt boot sequence
Hi Sean,
Thanks for tracking this down. Can we try reverting this in pieces to see
exactly what the cause was?
1) Revert arch/x86/boot/compressed/head_32.S
2) If that doesn't fix it, Try removing the 8 lines which were added to arch/x86/kernel/head_32.S
I assume this is CONFIG_PARAVIRT=n?
Thanks,
Rusty.
Quoted 14 lines · Rusty Russell
Quoted 11 lines · On Monday 16 June 2008 22:11:39 Sean Young wrote:
The symptons are either a crash or reboot on booting the kernel. No printk's have occurred yet -- even with early printk on.
2.6.15 worked on this board however current does not. I've bisected it to:
commit a24e785111a32ccb7cebafd24b1b1cb474ea8e5d Author: Rusty Russell <[email protected]> Date: Sun Oct 21 16:41:35 2007 -0700 i386: paravirt boot sequence
Quoted 8 lines
Hi Sean,
Thanks for tracking this down. Can we try reverting this in pieces to see
exactly what the cause was?1) Revert
arch/x86/boot/compressed/head_32.S
2) If that doesn't fix it, Try removing the 8 lines which were added toarch/x86/kernel/head_32.S
And the arch/x86/boot/compressed/misc_32.c change too, just in case...
Quoted 1 line
I assume this is
CONFIG_PARAVIRT=n?
What bootloader does this platform use? I wonder if it's setting things up in an unexpected way?
J
Quoted 17 lines · Jeremy Fitzhardinge
Quoted 16 lines · Rusty Russell
Quoted 11 lines · On Monday 16 June 2008 22:11:39 Sean Young wrote:
The symptons are either a crash or reboot on booting the kernel. No printk's have occurred yet -- even with early printk on.
2.6.15 worked on this board however current does not. I've bisected it to:
commit a24e785111a32ccb7cebafd24b1b1cb474ea8e5d Author: Rusty Russell <[email protected]> Date: Sun Oct 21 16:41:35 2007 -0700 i386: paravirt boot sequenceHi Sean,
Quoted 8 lines
Quoted 7 lines
Thanks for tracking this down. Can we try reverting this in pieces to see exactly what the cause was?
1) Revert
arch/x86/boot/compressed/head_32.S
2) If that doesn't fix it, Try removing the 8 lines which were added toarch/x86/kernel/head_32.SAnd the
arch/x86/boot/compressed/misc_32.cchange too, just in case...
Reverting only head_32.S makes the problem go away. I didn't try any other changes.
Quoted 1 line
Quoted 1 line
I assume this is
CONFIG_PARAVIRT=n?
Indeed.
Quoted 2 lines
What bootloader does this platform use? I wonder if it's setting things up in an unexpected way?
It's syslinux. That must be the culprit, considering the change to head_32.S.
I'm digging in syslinux right now.
Thanks
Sean
Quoted 41 lines · Sean Young
Quoted 19 lines · Jeremy Fitzhardinge
Quoted 17 lines · Rusty Russell
Quoted 12 lines · On Monday 16 June 2008 22:11:39 Sean Young wrote:
The symptons are either a crash or reboot on booting the kernel. No printk's have occurred yet -- even with early printk on.
2.6.15 worked on this board however current does not. I've bisected it to:
commit a24e785111a32ccb7cebafd24b1b1cb474ea8e5d Author: Rusty Russell <[email protected]> Date: Sun Oct 21 16:41:35 2007 -0700 i386: paravirt boot sequenceHi Sean,
Quoted 9 lines
Quoted 7 lines
Thanks for tracking this down. Can we try reverting this in pieces to see exactly what the cause was?
1) Revert
arch/x86/boot/compressed/head_32.S
2) If that doesn't fix it, Try removing the 8 lines which were added toarch/x86/kernel/head_32.SAnd the
arch/x86/boot/compressed/misc_32.cchange too, just in case...Reverting only
head_32.Smakes the problem go away. I didn't try any other changes.Quoted 2 lines
Quoted 2 lines
I assume this is
CONFIG_PARAVIRT=n?Indeed.
Quoted 6 lines
Quoted 2 lines
What bootloader does this platform use? I wonder if it's setting things up in an unexpected way?
It's syslinux. That must be the culprit, considering the change to
head_32.S.I'm digging in syslinux right now.
Weird. That change has been in there a fairly long time now, and lots of people have successfully used syslinux to boot it in that time. Must be some specific combination of factors on your platform.
I would guess the KEEP_SEGMENTS flag is being set for some reason, but it's hard to imagine how, unless there's some memory corruption going on.
J
H. Peter Anvin
reviewerQuoted 7 lines · Sean Young
Quoted 2 lines
What bootloader does this platform use? I wonder if it's setting things up in an unexpected way?
It's syslinux. That must be the culprit, considering the change to
head_32.S.I'm digging in syslinux right now.
What makes you draw that conclusion?
-hpa
Quoted 5 lines · H. Peter Anvin
Quoted 4 lines · Sean Young
Quoted 3 lines
What bootloader does this platform use? I wonder if it's setting things up in an unexpected way?
Quoted 7 lines
Quoted 5 lines
It's syslinux. That must be the culprit, considering the change to
head_32.S.I'm digging in syslinux right now.
What makes you draw that conclusion?
The thinking was that syslinux sets the boot parameters which are being read in head_32.S. I've used syslinux 3.53 but have just moved to 3.63.
That was the theory at least. I'm not sure what's going on now. I'll spend some more time on this.
Thanks
Sean
H. Peter Anvin
reviewerQuoted 6 lines · Sean Young
The thinking was that syslinux sets the boot parameters which are being read in
head_32.S. I've used syslinux 3.53 but have just moved to 3.63.That was the theory at least. I'm not sure what's going on now. I'll spend some more time on this.
Most of the boot parameters actually come from the real-mode boot code (arch/x86/boot). A few of them come from the bootloader.
With a version of Syslinux that recent there shouldn't be any issues, especially since Syslinux is, for somewhat obvious reasons, my reference bootloader. You may want to experiment with using the optional linux.c32 module just to see if it changes the behaviour:
boot: linux.c32 kernel options...
Or, in the configuration file:
label blah
kernel linux.c32
append kernel options...
-hpa
H. Peter Anvin
reviewerQuoted 7 lines · Sean Young
Quoted 2 lines
What bootloader does this platform use? I wonder if it's setting things up in an unexpected way?
It's syslinux. That must be the culprit, considering the change to
head_32.S.I'm digging in syslinux right now.
Also, what version of syslinux?
-hpa
Quoted 21 lines · Sean Young
Quoted 20 lines · Jeremy Fitzhardinge
Quoted 19 lines · Rusty Russell
Quoted 11 lines · On Monday 16 June 2008 22:11:39 Sean Young wrote:
The symptons are either a crash or reboot on booting the kernel. No printk's have occurred yet -- even with early printk on.
2.6.15 worked on this board however current does not. I've bisected it to:
commit a24e785111a32ccb7cebafd24b1b1cb474ea8e5d Author: Rusty Russell <[email protected]> Date: Sun Oct 21 16:41:35 2007 -0700 i386: paravirt boot sequenceHi Sean,
Thanks for tracking this down. Can we try reverting this in pieces to see exactly what the cause was?
Quoted 8 lines
Quoted 5 lines
Quoted 4 lines
1) Revert
arch/x86/boot/compressed/head_32.S
2) If that doesn't fix it, Try removing the 8 lines which were added toarch/x86/kernel/head_32.SAnd the
arch/x86/boot/compressed/misc_32.cchange too, just in case...Reverting only
head_32.Smakes the problem go away. I didn't try any other changes.
Looking at the beginning of startup_32, it seems ds is used before it is set:
startup_32:
cld
/* test KEEP_SEGMENTS flag to see if the bootloader is asking
* us to not reload segments */
testb $(1<<6), BP_loadflags(%esi)
jnz 1f
cli
movl $(__BOOT_DS),%eax
movl %eax,%ds
movl %eax,%es
movl %eax,%fs
movl %eax,%gs
movl %eax,%ss1:
Since the testb instruction is a dereference, ds is implicitly used. If I move the testb to after "movl %eax,%ds" it seems to work (not that it would make any sense there, but just to prove the point).
1) Am I barking up the wrong tree?
2) If I'm right I have no idea what the correct solution is; it seems that a chicken & egg issue is introduced.
Please advise. I am very new to all of this.
Sean
Quoted 58 lines · Sean Young
Quoted 24 lines · Sean Young
Quoted 22 lines · Jeremy Fitzhardinge
Quoted 20 lines · Rusty Russell
Quoted 12 lines · On Monday 16 June 2008 22:11:39 Sean Young wrote:
The symptons are either a crash or reboot on booting the kernel. No printk's have occurred yet -- even with early printk on.
2.6.15 worked on this board however current does not. I've bisected it to:
commit a24e785111a32ccb7cebafd24b1b1cb474ea8e5d Author: Rusty Russell <[email protected]> Date: Sun Oct 21 16:41:35 2007 -0700 i386: paravirt boot sequenceHi Sean,
Thanks for tracking this down. Can we try reverting this in pieces to see exactly what the cause was?
Quoted 9 lines
Quoted 6 lines
Quoted 4 lines
1) Revert
arch/x86/boot/compressed/head_32.S
2) If that doesn't fix it, Try removing the 8 lines which were added toarch/x86/kernel/head_32.SAnd the
arch/x86/boot/compressed/misc_32.cchange too, just in case...Reverting only
head_32.Smakes the problem go away. I didn't try any other changes.Looking at the beginning of
startup_32, it seems ds is used before it is set:
startup_32:cld /* test KEEP_SEGMENTS flag to see if the bootloader is asking * us to not reload segments */ testb $(1<<6), BP_loadflags(%esi) jnz 1f cli movl $(__BOOT_DS),%eax movl %eax,%ds movl %eax,%es movl %eax,%fs movl %eax,%gs movl %eax,%ss1:
Since the testb instruction is a dereference, ds is implicitly used. If I move the testb to after "movl %eax,%ds" it seems to work (not that it would make any sense there, but just to prove the point).
Quoted 6 lines
1) Am I barking up the wrong tree?
2) If I'm right I have no idea what the correct solution is; it seems that a chicken & egg issue is introduced.
Please advise. I am very new to all of this.
It's a bit odd that the boot loader neglected to set up ds properly, but changing the testb line to
testb $(1<<6), %cs:BP_loadflags(%esi)
should work. (Or perhaps a %ss: override would be better?)
I'm assuming that the GDT setup isn't completely mad and that the segments have the same base at least.
J
H. Peter Anvin
reviewerQuoted 30 lines · Jeremy Fitzhardinge
Quoted 23 lines
Looking at the beginning of
startup_32, it seems ds is used before it is set:
startup_32:cld /* test KEEP_SEGMENTS flag to see if the bootloader is asking * us to not reload segments */ testb $(1<<6), BP_loadflags(%esi) jnz 1f cli movl $(__BOOT_DS),%eax movl %eax,%ds movl %eax,%es movl %eax,%fs movl %eax,%gs movl %eax,%ss1:
Since the testb instruction is a dereference, ds is implicitly used. If I move the testb to after "movl %eax,%ds" it seems to work (not that it would make any sense there, but just to prove the point).
Quoted 6 lines
1) Am I barking up the wrong tree?
2) If I'm right I have no idea what the correct solution is; it seems that a chicken & egg issue is introduced.
Please advise. I am very new to all of this.
Quoted 8 lines
It's a bit odd that the boot loader neglected to set up ds properly, but changing the testb line to
testb $(1<<6), %cs:BP_loadflags(%esi)should work. (Or perhaps a %ss: override would be better?)
I'm assuming that the GDT setup isn't completely mad and that the segments have the same base at least.
This should have been set up by the *boot code* (specifically lines 57-61 of arch/x86/boot/pmjump.S) since he's using a conventional boot loader (syslinux) so something is utterly fuggled up. Using %cs: here should be safe, though (and *is* more conservative, after all, why otherwise bother reloading these segments at all?), but it still concerns me a great deal if this is broken in this way. It's definitely better than %ss:.
In particular, I'm wondering if the Elan CPU has any strange ordering requirements with regards to the protected mode transition that we're not obeying.
It would be interesting to put in a heavyweight "brutally synchronizing" instruction like WBINVD at various places in arch/x86/boot/pmjump.S and see if it helps.
-hpa
H. Peter Anvin
reviewerQuoted 8 lines · H. Peter Anvin
Quoted 8 lines
Quoted 8 lines
startup_32:cld /* test KEEP_SEGMENTS flag to see if the bootloader is asking * us to not reload segments */ testb $(1<<6), BP_loadflags(%esi) jnz 1f
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
cli movl $(__BOOT_DS),%eax movl %eax,%ds movl %eax,%es movl %eax,%fs movl %eax,%gs movl %eax,%ss1:
On this general subject... I keep thinking that it would be better to have this as:
movl %cs, %eax addl $8, %eax movl %eax, %cs
... instead of a hard-coded constant. That actually removes all hard-coded uses of BOOT_CS/BOOT_DS until we eventually load the kernel's own boot GDT at head_32.S:94.
Does anyone see any problem with that? As far as I can tell, we're requiring %cs == BOOT_CS for the current code anyway (unless KEEP_SEGMENTS), but %ds == %cs + 8 seems like a more sensible requirement.
-hpa
Quoted 18 lines · H. Peter Anvin
Quoted 8 lines · H. Peter Anvin
Quoted 8 lines
Quoted 8 lines
startup_32:cld /* test KEEP_SEGMENTS flag to see if the bootloader is asking * us to not reload segments */ testb $(1<<6), BP_loadflags(%esi) jnz 1fQuoted 8 lines
Quoted 8 lines
Quoted 8 lines
cli movl $(__BOOT_DS),%eax movl %eax,%ds movl %eax,%es movl %eax,%fs movl %eax,%gs movl %eax,%ss1:
Quoted 5 lines
On this general subject... I keep thinking that it would be better to have this as:
movl %cs, %eax addl $8, %eax movl %eax, %cs
What's your intent? You can't directly load %cs; do you mean the other segment registers?
Quoted 5 lines
... instead of a hard-coded constant. That actually removes all hard-coded uses of BOOT_CS/BOOT_DS until we eventually load the kernel's own boot GDT at head_32.S:94.
Does anyone see any problem with that? As far as I can tell, we're requiring %cs ==
BOOT_CSfor the current code anyway (unlessKEEP_SEGMENTS), but %ds == %cs + 8 seems like a more sensible requirement.
Oh, you mean
mov %cs, %eax add $8, %eax mov %eax, %ds (etc)
?
Seems reasonable.
J
H. Peter Anvin
reviewerQuoted 10 lines · Jeremy Fitzhardinge
Quoted 6 lines
On this general subject... I keep thinking that it would be better to have this as:
movl %cs, %eax addl $8, %eax movl %eax, %csWhat's your intent? You can't directly load %cs; do you mean the other segment registers?
Quoted 9 lines
Oh, you mean
mov %cs, %eax add $8, %eax mov %eax, %ds (etc)?
Seems reasonable.
Uhm, yeah ;)
-hpa
Quoted 20 lines · H. Peter Anvin
Quoted 10 lines · Jeremy Fitzhardinge
It's a bit odd that the boot loader neglected to set up ds properly, but changing the testb line to
testb $(1<<6), %cs:BP_loadflags(%esi)should work. (Or perhaps a %ss: override would be better?)
I'm assuming that the GDT setup isn't completely mad and that the segments have the same base at least.
This should have been set up by the *boot code* (specifically lines 57-61 of
arch/x86/boot/pmjump.S) since he's using a conventional boot loader (syslinux) so something is utterly fuggled up. Using %cs: here should be safe, though (and *is* more conservative, after all, why otherwise bother reloading these segments at all?), but it still concerns me a great deal if this is broken in this way. It's definitely better than %ss:.
Quoted 7 lines
In particular, I'm wondering if the Elan CPU has any strange ordering requirements with regards to the protected mode transition that we're not obeying.
It would be interesting to put in a heavyweight "brutally synchronizing" instruction like WBINVD at various places in
arch/x86/boot/pmjump.Sand see if it helps.
You are right. With wbinvd before %ds is changed in that file the kernel boots.
Sean
Quoted 33 lines · H. Peter Anvin
Quoted 32 lines · Jeremy Fitzhardinge
Quoted 23 lines
Looking at the beginning of
startup_32, it seems ds is used before it is set:
startup_32:cld /* test KEEP_SEGMENTS flag to see if the bootloader is asking * us to not reload segments */ testb $(1<<6), BP_loadflags(%esi) jnz 1f cli movl $(__BOOT_DS),%eax movl %eax,%ds movl %eax,%es movl %eax,%fs movl %eax,%gs movl %eax,%ss1:
Since the testb instruction is a dereference, ds is implicitly used. If I move the testb to after "movl %eax,%ds" it seems to work (not that it would make any sense there, but just to prove the point).
Quoted 6 lines
1) Am I barking up the wrong tree?
2) If I'm right I have no idea what the correct solution is; it seems that a chicken & egg issue is introduced.
Please advise. I am very new to all of this.
It's a bit odd that the boot loader neglected to set up ds properly, but changing the testb line to
Quoted 8 lines
Quoted 6 lines
testb $(1<<6), %cs:BP_loadflags(%esi)should work. (Or perhaps a %ss: override would be better?)
I'm assuming that the GDT setup isn't completely mad and that the segments have the same base at least.
This should have been set up by the *boot code* (specifically lines 57-61 of
arch/x86/boot/pmjump.S) since he's using a conventional boot loader (syslinux) so something is utterly fuggled up.
Hm, yeah.
Quoted 3 lines
Using %cs: here should be safe, though (and *is* more conservative, after all, why otherwise bother reloading these segments at all?), but it still concerns me a great deal if this is broken in this way. It's definitely better than %ss:.
In particular, I'm wondering if the Elan CPU has any strange ordering requirements with regards to the protected mode transition that we're not obeying.
Maybe it really does require the far jump immediately after setting PE in cr0...
Hm, I don't remember this paragraph being in vol 3a, section 8.9.1 before. Is it a recent addition?
Random failures can occur if other instructions exist between steps 3 and 4 above. Failures will be readily seen in some situations, such as when instructions that reference memory are inserted between steps 3 and 4 while in system management mode.
J
H. Peter Anvin
reviewerQuoted 10 lines · Jeremy Fitzhardinge
Maybe it really does require the far jump immediately after setting PE in cr0...
Hm, I don't remember this paragraph being in vol 3a, section 8.9.1 before. Is it a recent addition?
Random failures can occur if other instructions exist between steps 3 and 4 above. Failures will be readily seen in some situations, such as when instructions that reference memory are inserted between steps 3 and 4 while in system management mode.
I don't remember that, either.
Sean: could you try the following patch?
-hpa
arch/x86/boot/pmjump.S +2 -2
@@ -33,6 +33,8 @@ protected_mode_jump: movw %cs, %bx shll $4, %ebx addl %ebx, 2f + jmp 1f # Short jump to serialize on 386/486 +1: movw $__BOOT_DS, %cx movw $__BOOT_TSS, %di
@@ -40,8 +42,6 @@ protected_mode_jump: movl %cr0, %edx orb $X86_CR0_PE, %dl # Protected mode movl %edx, %cr0 - jmp 1f # Short jump to serialize on 386/486 -1: # Transition to 32-bit mode .byte 0x66, 0xea # ljmpl opcode
Quoted 8 lines · H. Peter Anvin
Quoted 7 lines · Jeremy Fitzhardinge
Maybe it really does require the far jump immediately after setting PE in cr0...
Hm, I don't remember this paragraph being in vol 3a, section 8.9.1 before. Is it a recent addition?
Quoted 7 lines
Quoted 5 lines
Random failures can occur if other instructions exist between steps 3 and 4 above. Failures will be readily seen in some situations, such as when instructions that reference memory are inserted between steps 3 and 4 while in system management mode.
I don't remember that, either.
Which document are we talking about?
Quoted 18 lines
Sean: could you try the following patch?
-hpa
arch/x86/boot/pmjump.S +2
-0@@ -33,6 +33,8 @@ protected_mode_jump: movw %cs, %bx shll $4, %ebx addl %ebx, 2f + jmp 1f # Short jump to serialize on 386/486 +1: movw $__BOOT_DS, %cx movw $__BOOT_TSS, %di
arch/x86/boot/pmjump.S protected_mode_jump: · line 47
Quoted 8 lines
arch/x86/boot/pmjump.S +0
-2@@ -40,8 +42,6 @@ protected_mode_jump: movl %cr0, %edx orb $X86_CR0_PE, %dl # Protected mode movl %edx, %cr0 - jmp 1f # Short jump to serialize on 386/486 -1: # Transition to 32-bit mode .byte 0x66, 0xea # ljmpl opcode
I'm afraid it doesn't work. Maybe I can find something in the AMD Elan documentation. Would a fence make sense?
Thanks
Sean
Quoted 21 lines · Sean Young
Quoted 20 lines · H. Peter Anvin
arch/x86/boot/pmjump.S +2
-2@@ -33,6 +33,8 @@ protected_mode_jump: movw %cs, %bx shll $4, %ebx addl %ebx, 2f + jmp 1f # Short jump to serialize on 386/486 +1: movw $__BOOT_DS, %cx movw $__BOOT_TSS, %di@@ -40,8 +42,6 @@ protected_mode_jump: movl %cr0, %edx orb $X86_CR0_PE, %dl # Protected mode movl %edx, %cr0 - jmp 1f # Short jump to serialize on 386/486 -1:
Quoted 5 lines
arch/x86/boot/pmjump.S protected_mode_jump: · line 47
Quoted 2 lines
arch/x86/boot/pmjump.S +0
-0# Transition to 32-bit mode .byte 0x66, 0xea # ljmpl opcodeI'm afraid it doesn't work. Maybe I can find something in the AMD Elan documentation. Would a fence make sense?
I was just trying to confirm this with postive and negative tests which is failing. I'm probably being an idiot, please let systematically test this.
This does not seem like the heisenbug category, or is it?
Sean
Quoted 5 lines · Sean Young
I was just trying to confirm this with postive and negative tests which is failing. I'm probably being an idiot, please let systematically test this.
This does not seem like the heisenbug category, or is it?
Possibly. Does the platform use system-management mode? If it does, it may depend on whether you get an SMM interrupt in a critical window.
J
H. Peter Anvin
reviewerQuoted 6 lines · Sean Young
I was just trying to confirm this with postive and negative tests which is failing. I'm probably being an idiot, please let systematically test this.
This does not seem like the heisenbug category, or is it?
It could easily be something timing-dependent, which might affect only X boots out of Y. Please keep us posted on your testing progress.
It would also be very interesting if you put, say, a WBINVD at the point
of label 1:
-hpa
Quoted 28 lines · Sean Young
Quoted 21 lines · Sean Young
Quoted 20 lines · H. Peter Anvin
arch/x86/boot/pmjump.S +2
-2@@ -33,6 +33,8 @@ protected_mode_jump: movw %cs, %bx shll $4, %ebx addl %ebx, 2f + jmp 1f # Short jump to serialize on 386/486 +1: movw $__BOOT_DS, %cx movw $__BOOT_TSS, %di@@ -40,8 +42,6 @@ protected_mode_jump: movl %cr0, %edx orb $X86_CR0_PE, %dl # Protected mode movl %edx, %cr0 - jmp 1f # Short jump to serialize on 386/486 -1:Quoted 5 lines
arch/x86/boot/pmjump.S protected_mode_jump: · line 47
Quoted 2 lines
arch/x86/boot/pmjump.S +0
-0# Transition to 32-bit mode .byte 0x66, 0xea # ljmpl opcodeI'm afraid it doesn't work. Maybe I can find something in the AMD Elan documentation. Would a fence make sense?
Quoted 3 lines
I was just trying to confirm this with postive and negative tests which is failing. I'm probably being an idiot, please let systematically test this.
When I bisected this issue between latest and 2.6.23 the issue seemed to be here (round about 2.6.24-rc1). Trying to repeat the same things on latest just led to confusion.
So I've started from scratch with contemporary trees and found something very different.
2.6.25: works
2.6.25.5: works
2.6.25.6: broken
2.6.25.10: broken
2.6.26: works
Now the issue which was introduced in 2.6.25.6 is that a rdtsc will be done even though this CPU does not support it (before console_init(), leaving me with only one led for output!). This issue has been fixed in 2.6.26 but not in 2.6.25-stable.
The protected mode jump was just a red herring (or at least whatever was broken back then is fixed now); 2.6.26 is working fine and that's good enough for me.
Thanks for all the help,
Sean
H. Peter Anvin
reviewerQuoted 12 lines · Sean Young
When I bisected this issue between latest and 2.6.23 the issue seemed to be
here (round about 2.6.24-rc1). Trying to repeat the same things on latest just led to confusion.So I've started from scratch with contemporary trees and found something very different.
2.6.25: works
2.6.25.5: works
2.6.25.6: broken
2.6.25.10: broken
2.6.26: works
Quoted 6 lines
Now the issue which was introduced in 2.6.25.6 is that a rdtsc will be done
even though this CPU does not support it (beforeconsole_init(), leaving
me with only one led for output!). This issue has been fixed in 2.6.26 but not in 2.6.25-stable.The protected mode jump was just a red herring (or at least whatever was broken back then is fixed now); 2.6.26 is working fine and that's good enough for me.
Okay, that is good to know. We did move the jmp in pmjump.S for 2.6.26; even if it ended up being redundant I have to say I'm happier following the documented script, especially given the apparent recent documentation change on Intel's part about this.
-hpa
Quoted 14 lines · Sean Young
Quoted 12 lines · H. Peter Anvin
Quoted 10 lines · Jeremy Fitzhardinge
Maybe it really does require the far jump immediately after setting PE in cr0...
Hm, I don't remember this paragraph being in vol 3a, section 8.9.1 before. Is it a recent addition?
Random failures can occur if other instructions exist between steps 3 and 4 above. Failures will be readily seen in some situations, such as when instructions that reference memory are inserted between steps 3 and 4 while in system management mode.
Quoted 5 lines
Quoted 2 lines
I don't remember that, either.
Which document are we talking about?
*The* document ;)
http://www.intel.com/products/processor/manuals/ specifically, Volume 3a: System Programming Guide, Part 1.
Section 8.9.1 describes the steps needed to turn on protected mode correctly. It says that you need to do a far jump or call immediately after turning on protected mode. Linux has not done it immediately, and there has been a school of thought that this advice is a workaround for some obsolete CPU, and is not something we have to worry about now.
However, the paragraph I quoted was added since the previous release of the manual, and so presumably documents a current concern. Specifically, the mention of SMM is interesting, because I gather that embedded-class processors like the Elan are very SMM-dependent.
Quoted 26 lines
Quoted 26 lines
Sean: could you try the following patch?
-hpa
arch/x86/boot/pmjump.S +2
-2@@ -33,6 +33,8 @@ protected_mode_jump: movw %cs, %bx shll $4, %ebx addl %ebx, 2f + jmp 1f # Short jump to serialize on 386/486 +1: movw $__BOOT_DS, %cx movw $__BOOT_TSS, %di@@ -40,8 +42,6 @@ protected_mode_jump: movl %cr0, %edx orb $X86_CR0_PE, %dl # Protected mode movl %edx, %cr0 - jmp 1f # Short jump to serialize on 386/486 -1:
Quoted 7 lines
arch/x86/boot/pmjump.S protected_mode_jump: · line 47
Quoted 3 lines
arch/x86/boot/pmjump.S +0
-0# Transition to 32-bit mode .byte 0x66, 0xea # ljmpl opcodeI'm afraid it doesn't work. Maybe I can find something in the AMD Elan documentation. Would a fence make sense?
Not really, but if it fixes the bug it won't hurt anyone else (unless older processors treat it as an illegal instruction).
J
H. Peter Anvin
reviewerQuoted 6 lines · Sean Young
Quoted 5 lines · H. Peter Anvin
Quoted 4 lines · Jeremy Fitzhardinge
Maybe it really does require the far jump immediately after setting PE in cr0...
Hm, I don't remember this paragraph being in vol 3a, section 8.9.1 before. Is it a recent addition?
Quoted 9 lines
Quoted 6 lines
Quoted 5 lines
Random failures can occur if other instructions exist between steps 3 and 4 above. Failures will be readily seen in some situations, such as when instructions that reference memory are inserted between steps 3 and 4 while in system management mode.
I don't remember that, either.
Which document are we talking about?
Intel's Software Developer's Manual, volume 3a.
Quoted 2 lines
I'm afraid it doesn't work. Maybe I can find something in the AMD Elan documentation. Would a fence make sense?
Not really. In particular, I really don't want to add something that is even remotely likely to break on other platforms, and a fence instruction is relatively recent.
-hpa
Quoted 1 line · H. Peter Anvin
Not really. In particular, I really don't want to add something that is even remotely likely to break on other platforms, and a fence instruction is relatively recent.
I wonder if a cpuid would do the trick? Do we still support cpuid-less processors?
J
H. Peter Anvin
reviewerQuoted 4 lines · Jeremy Fitzhardinge
Quoted 1 line · H. Peter Anvin
Not really. In particular, I really don't want to add something that is even remotely likely to break on other platforms, and a fence instruction is relatively recent.
I wonder if a cpuid would do the trick? Do we still support cpuid-less processors?
Yes, we do. Worst case, we could bypass it, but I'd like to understand what the real constraint is, here.
-hpa
Quoted 7 lines · Jeremy Fitzhardinge
Quoted 3 lines · H. Peter Anvin
Not really. In particular, I really don't want to add something that is even remotely likely to break on other platforms, and a fence instruction is relatively recent.
I wonder if a cpuid would do the trick? Do we still support cpuid-less processors?
We still support 386~~, AFAICT.
Pavel
Signature · 2 lines
(english) http://www.livejournal.com/~pavelmachek (cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html
Quoted 6 lines · Jeremy Fitzhardinge
It's a bit odd that the boot loader neglected to set up ds properly, but changing the testb line to
testb $(1<<6), %cs:BP_loadflags(%esi)should work. (Or perhaps a %ss: override would be better?)
Yup, it does (%cs: prefix).
Quoted 2 lines
I'm assuming that the GDT setup isn't completely mad and that the segments have the same base at least.
Where do I go from here?
Thanks
Sean
Quoted 9 lines · Sean Young
Quoted 6 lines · Jeremy Fitzhardinge
It's a bit odd that the boot loader neglected to set up ds properly, but changing the testb line to
testb $(1<<6), %cs:BP_loadflags(%esi)should work. (Or perhaps a %ss: override would be better?)
Yup, it does (%cs: prefix).
Guys I have a fuzzy memory of reads and definitely writes through %cs not working, on some processor models. i386?
If that hadn't been the case I would have used that form more to remove the dependencies before we reached lgdt in haed.S when I was in there years ago.
Eric
H. Peter Anvin
reviewerQuoted 5 lines · Eric W. Biederman
Quoted 3 lines · Sean Young
Quoted 2 lines · Jeremy Fitzhardinge
It's a bit odd that the boot loader neglected to set up ds properly, but changing the testb line to
Quoted 8 lines
Quoted 4 lines
Quoted 3 lines
testb $(1<<6), %cs:BP_loadflags(%esi)should work. (Or perhaps a %ss: override would be better?)
Yup, it does (%cs: prefix).
Guys I have a fuzzy memory of reads and definitely writes through %cs not working, on some processor models. i386?
You can never write through %cs in protected mode.
You can read through %cs: in protected mode unless %cs contains an execute-only descriptor.
-hpa