mtd: document linux-specific partition parser DT binding
Subsystems (2)
PATCH 1/1 mtd: document linux-specific partition parser DT binding
The Linux code in drivers/mtd/maps/physmap_of.c will optionally look for this binding for hints on a partition type to look for in the MTD. It was added in commit 9d5da3a9b849
"mtd: extend physmap_of to let the device tree specify the parition probe" but no corresponding device tree binding was added. Fix this.
--- Documentation/devicetree/bindings/mtd/mtd-physmap.txt | 3 +++ 1 file changed, 3 insertions(+)
Documentation/devicetree/bindings/mtd/mtd-physmap.txt +3 -0
@@ -26,6 +26,9 @@ file systems on embedded devices. - linux,mtd-name: allow to specify the mtd name for retro capability with physmap-flash drivers as boot loader pass the mtd partition via the old device name physmap-flash. + - linux,part-probe: a flash partition type to look for, using the + Linux-internal partition naming scheme, e.g. "afs" for the ARM + Flash footers. - use-advanced-sector-protection: boolean to enable support for the advanced sector protection (Spansion: PPB - Persistent Protection Bits) locking.
Signature · 1 line
2.4.3
PATCH 1/1 mtd: document linux-specific partition parser DT binding
+ others
Hi Linus,
Quoted 11 lines · Linus Walleij
The Linux code in
drivers/mtd/maps/physmap_of.cwill optionally look for this binding for hints on a partition type to look for in the MTD. It was added in commit9d5da3a9b849
"mtd: extendphysmap_ofto let the device tree specify the parition probe" but no corresponding device tree binding was added. Fix this.Cc devicetree at vger.kernel.orgCc Jason Gunthorpe <[email protected]>Cc Liviu Dudau <[email protected]>Reported-by Liviu Dudau <[email protected]>Signed-off-by Linus Walleij <[email protected]>
Are you trying to use this binding, or is this just purely a mechanical documentation issue? I ask, because it seems that binding never really got reviewed at all, and others have recently tried to extend support for it generically [1], but a few objections came up [2][3].
Unfortunately I/we dropped the ball a bit on that thread, but we'd ideally like to address those concerns in a new binding that is supported for all MTDs, and deprecate the old one. The new one would probably not directly use the parser name as used by Linux, but define some list of compatible strings that fit DT conventions better. Also, I don't want people including things like "cmdlinepart" in DT, but it should be available as an override if necessary. IOW, DT shouldn't supersede the kernel command line.
That's not to say we can't document the old one, but I'm curious if there are real users. I'd also like to encourage new users to avoid the old one if we can make that feasible.
Quoted 9 lines
--- Documentation/devicetree/bindings/mtd/mtd-physmap.txt | 3 +++ 1 file changed, 3 insertions(+)Documentation/devicetree/bindings/mtd/mtd-physmap.txt +0
-0
Documentation/devicetree/bindings/mtd/mtd-physmap.txt file systems on embedded devices. · line 31
Quoted 6 lines
Documentation/devicetree/bindings/mtd/mtd-physmap.txt +3
-0@@ -26,6 +26,9 @@ file systems on embedded devices. - linux,mtd-name: allow to specify the mtd name for retro capability with physmap-flash drivers as boot loader pass the mtd partition via the old device name physmap-flash. + - linux,part-probe: a flash partition type to look for, using the + Linux-internal partition naming scheme, e.g. "afs" for the ARM + Flash footers.
IIUC, this property actually supports a list of parsers, not just a single partition type.
Also, if we're really going to support this, we should list exactly what strings we support. And that's one of the problems with the existing binding; it supports any old string Linux supports, which doesn't match how we typically want to add bindings (i.e., via proposal + review).
Documentation/devicetree/bindings/mtd/mtd-physmap.txt file systems on embedded devices. · line 34
Quoted 3 lines
Documentation/devicetree/bindings/mtd/mtd-physmap.txt +0
-0- use-advanced-sector-protection: boolean to enable support for the advanced sector protection (Spansion: PPB - Persistent Protection Bits) locking.
Brian
[1] http://lists.infradead.org/pipermail/linux-mtd/2015-May/059226.html
[2] http://lists.infradead.org/pipermail/linux-mtd/2015-May/059276.html
[3] Tail end of Arnd's comments here:
http://thread.gmane.org/gmane.linux.drivers.devicetree/122479/focus=122788
PATCH 1/1 mtd: document linux-specific partition parser DT binding
Quoted 4 lines · Brian Norris
Are you trying to use this binding, or is this just purely a mechanical documentation issue? I ask, because it seems that binding never really got reviewed at all, and others have recently tried to extend support
I wrote it before ARM started down the DT direction and all these formalities were developed.
Quoted 3 lines
That's not to say we can't document the old one, but I'm curious if there are real users. I'd also like to encourage new users to avoid the old one if we can make that feasible.
We continue to use it here, there is just no way to autodetect flash partition layouts. I'm not fussed about having to change to something else in future.
The reason the original patch exposed the cmdline parser is because that is how the internal mechanisms work - but realistically, the cmdline parser is a hack to get around the lack of DT partition description. If the DT can describe the partitions it should supersede and obsolete the old command line hack. IMHO
Quoted 4 lines
Also, if we're really going to support this, we should list exactly what strings we support. And that's one of the problems with the existing binding; it supports any old string Linux supports, which doesn't match how we typically want to add bindings (i.e., via proposal + review).
That is why it is prefixed with linux, the review of the part parser name is the responsibility of the MTD crew, not the DT folks.
bcm47xxpart seems like a terrible name for a partition scheme. Really, almost any scheme can be used on any SOC, naming a partition parser after a SOC family makes very little sense to me..
Jason
PATCH 1/1 mtd: document linux-specific partition parser DT binding
Hi Jason,
Quoted 7 lines · Jason Gunthorpe
Quoted 4 lines · Brian Norris
Are you trying to use this binding, or is this just purely a mechanical documentation issue? I ask, because it seems that binding never really got reviewed at all, and others have recently tried to extend support
Quoted 8 lines
I wrote it before ARM started down the DT direction and all these formalities were developed.
Quoted 3 lines
That's not to say we can't document the old one, but I'm curious if there are real users. I'd also like to encourage new users to avoid the old one if we can make that feasible.
We continue to use it here,
Good to know.
Quoted 2 lines
there is just no way to autodetect flash
partition layouts.
Right. It'd be lovely if things were more standardized, and we could just build all parsers in for all MTDs, like how block devices do it, but sadly that's probably not feasible, given the quirks of various parsers, and how they often require scanning a large portion of the device :(
Quoted 2 lines
I'm not fussed about having to change to something else in future.
OK, good to know. Recent developments have put maintainers in a tough position sometimes, since as soon as there's a DT binding used in the wild, some people like to claim that it is ABI and must never change. This ties the hands when wanting to deprecate/improve/replace features. In reality, there are few (my guess: a negligible near-zero-percent) DT users that actually have DTs locked into some kind of firmware in a way that they (1) can never update their DT and (2) expect to be able to run mainline kernels, so this all just becomes a lot of fuss over nothing.
Quoted 2 lines
The reason the original patch exposed the cmdline parser is because that is how the internal mechanisms work
Right. And that's why it's best these days not to directly expose internal mechanisms via DT.
Quoted 4 lines
- but realistically, the
cmdline parser is a hack to get around the lack of DT partition description. If the DT can describe the partitions it should supersede and obsolete the old command line hack. IMHO
Hmm, I don't know. I wouldn't expect people should really be using cmdlineparts as a production solution, but I'd consider it more of a debugging/development option -- if I want to override the DT (which is sometimes a bit harder to change) or the on-flash layout (e.g., RedBoot), then I can fiddle with the command line. So I wouldn't quite qualify it as a hack (though many might use it in a hacky way) nor would I suggest that the DT should override it.
Quoted 7 lines
Quoted 4 lines
Also, if we're really going to support this, we should list exactly what strings we support. And that's one of the problems with the existing binding; it supports any old string Linux supports, which doesn't match how we typically want to add bindings (i.e., via proposal + review).
That is why it is prefixed with linux, the review of the part parser name is the responsibility of the MTD crew, not the DT folks.
OK. That works for now. But I don't want to extend this binding to any other drivers, if I can help it. And I don't want to encourage it (lest it *really* becomes ABI).
I don't think it would be too hard to fix this to not be so Linux-specific. I think any partition layouts that people would want to specify in DT can be reasonably well-defined to not consider them Linux-specific. Some probably didn't even have a Linux target in mind when they were developed. We'd just need to give them better names and a short description and/or pointers to documentation. e.g. [1][2].
Quoted 3 lines
bcm47xxpart seems like a terrible name for a partition scheme. Really, almost any scheme can be used on any SOC, naming a partition parser after a SOC family makes very little sense to me..
I believe it was defined purely by Broadcom, for use with their firmwares mostly seen on that SoC family. And in the spirit of DT naming, IP often gets named after the first SoC that implements it, even if later revs aren't the same SoC (or SoC family) but are still compatible. So I can see the name being reasonable, even if not perfect.
Any better nominations for names?
Brian
[1] http://infocenter.arm.com/help/topic/com.arm.doc.dui0102g/DUI0102F_afs1_4_rg.pdf
[2] https://sourceware.org/redboot/
PATCH 1/1 mtd: document linux-specific partition parser DT binding
Quoted 5 lines · Brian Norris
Hmm, I don't know. I wouldn't expect people should really be using cmdlineparts as a production solution, but I'd consider it more of a debugging/development option -- if I want to override the DT (which is sometimes a bit harder to change) or the on-flash layout (e.g., RedBoot), then I can fiddle with the command line.
We don't have cmdline overrides for very much (if any?) of DT.
The DT is supposed to describe the hardware/boot environment, if overriding the partition layout is really common, then is the DT binding really describing the hardware at all?
The partition layout is already very border line to support in DT, it is really very close to a software configuration which is strongly discouraged from DT files.
I justify it as the boot loader communicating the partition scheme it understands to the OS, so the OS can have a hope of setting up the flash in a way the bootloader understands.
I've never used the cmdline option, so maybe I don't see the use case, but it seems like a really weird desire to change the partitioning away from what the bootloader supports.
Quoted 1 line
Any better nominations for names?
bcrm-part-table-43 ?
Jason
PATCH 1/1 mtd: document linux-specific partition parser DT binding
In reply to Brian NorrisQuoted 4 lines · Brian Norris
Are you trying to use this binding, or is this just purely a mechanical documentation issue? I ask, because it seems that binding never really got reviewed at all, and others have recently tried to extend support for it generically [1], but a few objections came up [2][3].
I am using it in this devicetree patch:
http://marc.info/?l=linux-arm-kernel&m=144492610417605&w=2
And this devicetree patch:
http://marc.info/?l=linux-arm-kernel&m=144490455308758&w=2
Otherwise the AFS partition type will not be scanned.
The other option is to add "afs" to this list indrivers/mtd/maps/physmap_of.c:
drivers/mtd/maps/physmap_of.c +0 -0
@@ -110,7 +110,7 @@ static struct mtd_info *obsolete_probe(struct
platform_device *dev,
default is use. These take precedence over other device tree information. */
static const char * const part_probe_types_def[] = {
- "cmdlinepart", "RedBoot", "ofpart", "ofoldpart", NULL };
+ "cmdlinepart", "RedBoot", "ofpart", "ofoldpart", "afs", NULL };
I can send a patch like this if you prefer?
Quoted 8 lines
Unfortunately I/we dropped the ball a bit on that thread, but we'd ideally like to address those concerns in a new binding that is supported for all MTDs, and deprecate the old one. The new one would probably not directly use the parser name as used by Linux, but define some list of compatible strings that fit DT conventions better. Also, I don't want people including things like "cmdlinepart" in DT, but it should be available as an override if necessary. IOW, DT shouldn't supersede the kernel command line.
This is not for cmdlinepart, as AFS is an actual on-flash format.
Quoted 3 lines
That's not to say we can't document the old one, but I'm curious if there are real users. I'd also like to encourage new users to avoid the old one if we can make that feasible.
I'm happy to do either patch, or define a new binding if you prefer, like simply:
partition-type = <string>;
and then we define this as "arm,arm-flash-structure" or something, and parse that to "afs" internally in physmap_of.c.
Quoted 6 lines
Review
Quoted 3 lines
+ - linux,part-probe: a flash partition type to look for, using the
(quoted diff) +2
-0+ Linux-internal partition naming scheme, e.g. "afs" for the ARM + Flash footers.IIUC, this property actually supports a list of parsers, not just a single partition type.
Ah it does. If we wanna go with this patch I'll fix it.
Quoted 4 lines
Also, if we're really going to support this, we should list exactly what strings we support. And that's one of the problems with the existing binding; it supports any old string Linux supports, which doesn't match how we typically want to add bindings (i.e., via proposal + review).
OK that sounds like a case for "arm,arm-flash-structure" for this specific binding.
Yours,
Linus Walleij
PATCH 1/1 mtd: document linux-specific partition parser DT binding
Hi Linus,
Quoted 31 lines · Linus Walleij
Quoted 4 lines · Brian Norris
Are you trying to use this binding, or is this just purely a mechanical documentation issue? I ask, because it seems that binding never really got reviewed at all, and others have recently tried to extend support for it generically [1], but a few objections came up [2][3].
I am using it in this devicetree patch:
http://marc.info/?l=linux-arm-kernel&m=144492610417605&w=2And this devicetree patch:
http://marc.info/?l=linux-arm-kernel&m=144490455308758&w=2Otherwise the AFS partition type will not be scanned.
The other option is to add "afs" to this list in
drivers/mtd/maps/physmap_of.c:drivers/mtd/maps/physmap_of.c +1
-1@@ -110,7 +110,7 @@ static struct mtd_info *obsolete_probe(structplatform_device *dev, default is use. These take precedence over other device tree information. */ static const char *const part_probe_types_def[] = { -"cmdlinepart" ,"RedBoot" ,"ofpart" ,"ofoldpart" ,NULL }; +"cmdlinepart" ,"RedBoot" ,"ofpart" ,"ofoldpart" ,"afs" ,NULL };
Quoted 1 line
I can send a patch like this if you prefer?
Hmm, not really. While I'd love to have a good common set of reasonably generic partition parsers that we could always run on all MTDs (or in this case, all physmap_of MTDs) similar to how the block subsystem does it, I don't think that is really workable here, as there is too much variation in parsers and mamy of them actually scan the whole flash (or at least, the headers of each block). This can get very expensive, and potentially leaves room for false matches, especially when you start layering on all the other potential parsers others might want to use.
IOW, this solution is not scalable IMO. In previous discussions, I think we've agreed that partition parsing must be informed by platform knowledge.
Quoted 10 lines
Quoted 8 lines
Unfortunately I/we dropped the ball a bit on that thread, but we'd ideally like to address those concerns in a new binding that is supported for all MTDs, and deprecate the old one. The new one would probably not directly use the parser name as used by Linux, but define some list of compatible strings that fit DT conventions better. Also, I don't want people including things like "cmdlinepart" in DT, but it should be available as an override if necessary. IOW, DT shouldn't supersede the kernel command line.
This is not for cmdlinepart, as AFS is an actual on-flash format.
Right. I was just mentioning that this binding:
(1) allows people to specify nonsensical things like "ofpart" and "cmdlinepart" in their DT and
(2) allows people to specify DTs that *don't* allow developer overrides like cmdlinepart (e.g., the partition layout is corrupted, so we want to boot a recovery kernel with a predetermined 'mtdparts=...' parameter)
Neither is directly related to your use of AFS, but it's just part of my thoughts on codifying the use of this binding.
Quoted 6 lines
Quoted 3 lines
That's not to say we can't document the old one, but I'm curious if there are real users. I'd also like to encourage new users to avoid the old one if we can make that feasible.
I'm happy to do either patch, or define a new binding if you prefer, like simply:
I would prefer a new binding. And personally, I'd like to get something like this extended to all MTDs (there are other users asking for similar things), but I haven't made the time to write the patch :(
Quoted 4 lines
partition-type = <string>;
and then we define this as "arm,arm-flash-structure" or something, and parse that to "afs" internally in
physmap_of.c.
Seems OK to me. Again, I'd prefer this not live in physmap_of.c, but if that's the expedient solution, I could probably take it from there.
Quoted 8 lines
Quoted 6 lines
Review
Quoted 3 lines
+ - linux,part-probe: a flash partition type to look for, using the
(quoted diff) +2
-0+ Linux-internal partition naming scheme, e.g. "afs" for the ARM + Flash footers.IIUC, this property actually supports a list of parsers, not just a single partition type.
Ah it does. If we wanna go with this patch I'll fix it.
I'd rather not take this patch if we can safely pivot to an improved binding, but I'm not sure if that violates the DT policy party line :)
Quoted 7 lines
Quoted 4 lines
Also, if we're really going to support this, we should list exactly what strings we support. And that's one of the problems with the existing binding; it supports any old string Linux supports, which doesn't match how we typically want to add bindings (i.e., via proposal + review).
OK that sounds like a case for "arm,arm-flash-structure" for this specific binding.
Right.
Brian