Skip to contentSkip to conversation

ref-manual: Document BB_GIT_SHALLOW and friends

PATCH In review Paul Barker 2 participants 2 messages Aug 13, 2021 – Aug 16, 2021

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 ref-manual: Document BB_GIT_SHALLOW and friends

Documentation is based on the commit message of bitbake rev 5ed7d85fda and mailing list discussion.

[YOCTO #14493]

---
 documentation/ref-manual/variables.rst | 55 ++++++++++++++++++++++++++
 1 file changed, 55 insertions(+)
documentation/ref-manual/variables.rst +55 -0
index f6d248a19..edab054f1 100644
@@ -524,6 +524,61 @@ system and gives an overview of their function and contents.
       clean up your :term:`DL_DIR` directory by deleting any Git or other
       source control work directories.
 
+   :term:`BB_GENERATE_SHALLOW_TARBALLS`
+      Setting this variable to "1" when :term:`BB_GIT_SHALLOW` is also set to
+      "1" causes bitbake to generate shallow mirror tarballs when fetching git
+      repositories. The number of commits included in the shallow mirror
+      tarballs is controlled by :term:`BB_GIT_SHALLOW_DEPTH`.
+
+      If both :term:`BB_GIT_SHALLOW` and :term:`BB_GENERATE_MIRROR_TARBALLS` are
+      enabled, bitbake will generate shallow mirror tarballs by default for git
+      repositories. This separate variable exists so that shallow tarball
+      generation can be enabled without needing to also enable normal mirror
+      generation if it is not desired.
+
+      For example usage, see :term:`BB_GIT_SHALLOW`.
+
+   :term:`BB_GIT_SHALLOW`
+      Setting this variable to "1" enables the support for fetching, using and
+      generating mirror tarballs of shallow git repositories. The external
+      git-make-shallow script is used for shallow mirror tarball creation.
+
+      When BB_GIT_SHALLOW is enabled, bitbake will attempt to fetch a shallow
+      mirror tarball. If the shallow mirror tarball cannot be fetched, it will
+      try to fetch the full mirror tarball and use that.
+
+      When a mirror tarball is not available, a full git clone will be performed
+      regardless of whether this variable is set or not. Support for shallow
+      clones is not currently implemented as git does not directly support
+      shallow cloning a particular git commit hash (it only supports cloning
+      from a tag or branch reference).
+
+      See also :term:`BB_GIT_SHALLOW_DEPTH` and
+      :term:`BB_GENERATE_SHALLOW_TARBALLS`.
+
+      Example usage::
+
+         BB_GIT_SHALLOW ?= "1"
+
+         # Keep only the top commit
+         BB_GIT_SHALLOW_DEPTH ?= "1"
+
+         # This defaults to enabled if both BB_GIT_SHALLOW and
+         # BB_GENERATE_MIRROR_TARBALLS are enabled
+         BB_GENERATE_SHALLOW_TARBALLS ?= "1"
+
+   :term:`BB_GIT_SHALLOW_DEPTH`
+      When used with :term:`BB_GENERATE_SHALLOW_TARBALLS`, this variable sets
+      the number of commits to include in generated shallow mirror tarballs.
+      With a depth of 1, only the commit referenced in :term:`SRCREV` is
+      included in the shallow mirror tarball. Increasing the depth includes
+      additional parent commits, working back through the commit history.
+
+      If this variable is unset, bitbake will default to a depth of 1 when
+      generating shallow mirror tarballs.
+
+      For example usage, see :term:`BB_GIT_SHALLOW`.
+
    :term:`BB_NUMBER_THREADS`
       The maximum number of tasks BitBake should run in parallel at any one
       time. The OpenEmbedded build system automatically configures this
Signature · 1 line
2.31.1
Reviewed-by on v1 1/1
#1 lore raw

Hi Paul,

Quoted 10 lines · Paul Barker

Documentation is based on the commit message of bitbake rev 5ed7d85fda and mailing list discussion.

[YOCTO #14493]

---
 documentation/ref-manual/variables.rst | 55 ++++++++++++++++++++++++++
 1 file changed, 55 insertions(+)

Since those variables are used in Bitbake source code, I'd say this addition would make more sense in Bitbake documentation.

Quoted 18 lines
documentation/ref-manual/variables.rst +10 -0
index f6d248a19..edab054f1 100644
@@ -524,6 +524,61 @@ system and gives an overview of their function and contents.
       clean up your :term:`DL_DIR` directory by deleting any Git or other
       source control work directories.
 
+   :term:`BB_GENERATE_SHALLOW_TARBALLS`
+      Setting this variable to "1" when :term:`BB_GIT_SHALLOW` is also set to
+      "1" causes bitbake to generate shallow mirror tarballs when fetching git
+      repositories. The number of commits included in the shallow mirror
+      tarballs is controlled by :term:`BB_GIT_SHALLOW_DEPTH`.
+
+      If both :term:`BB_GIT_SHALLOW` and :term:`BB_GENERATE_MIRROR_TARBALLS` are
+      enabled, bitbake will generate shallow mirror tarballs by default for git
+      repositories. This separate variable exists so that shallow tarball
+      generation can be enabled without needing to also enable normal mirror

documentation/ref-manual/variables.rst system and gives an overview of their function and contents. · line 546

Quoted 10 lines
documentation/ref-manual/variables.rst +10 -0
+      generation if it is not desired.
+
+      For example usage, see :term:`BB_GIT_SHALLOW`.
+
+   :term:`BB_GIT_SHALLOW`
+      Setting this variable to "1" enables the support for fetching, using and
+      generating mirror tarballs of shallow git repositories. The external
+      git-make-shallow script is used for shallow mirror tarball creation.
+
+      When BB_GIT_SHALLOW is enabled, bitbake will attempt to fetch a shallow

s/BB_GIT_SHALLOW/:term:BB_GIT_SHALLOW/

Quoted 25 lines
documentation/ref-manual/variables.rst +25 -0
+      mirror tarball. If the shallow mirror tarball cannot be fetched, it will
+      try to fetch the full mirror tarball and use that.
+
+      When a mirror tarball is not available, a full git clone will be performed
+      regardless of whether this variable is set or not. Support for shallow
+      clones is not currently implemented as git does not directly support
+      shallow cloning a particular git commit hash (it only supports cloning
+      from a tag or branch reference).
+
+      See also :term:`BB_GIT_SHALLOW_DEPTH` and
+      :term:`BB_GENERATE_SHALLOW_TARBALLS`.
+
+      Example usage::
+
+         BB_GIT_SHALLOW ?= "1"
+
+         # Keep only the top commit
+         BB_GIT_SHALLOW_DEPTH ?= "1"
+
+         # This defaults to enabled if both BB_GIT_SHALLOW and
+         # BB_GENERATE_MIRROR_TARBALLS are enabled
+         BB_GENERATE_SHALLOW_TARBALLS ?= "1"
+
+   :term:`BB_GIT_SHALLOW_DEPTH`
+      When used with :term:`BB_GENERATE_SHALLOW_TARBALLS`, this variable sets

documentation/ref-manual/variables.rst system and gives an overview of their function and contents. · line 581

Quoted 10 lines
documentation/ref-manual/variables.rst +10 -0
+      the number of commits to include in generated shallow mirror tarballs.
+      With a depth of 1, only the commit referenced in :term:`SRCREV` is
+      included in the shallow mirror tarball. Increasing the depth includes
+      additional parent commits, working back through the commit history.
+
+      If this variable is unset, bitbake will default to a depth of 1 when
+      generating shallow mirror tarballs.
+
+      For example usage, see :term:`BB_GIT_SHALLOW`.
+

I'd have liked a link to a small article/tutorial/man page explaining what shallow cloning is and what are its advantages and downsides since I have never used this before. But in any case, I guess people looking for this variable will know what it's for or could Google this.

Except for the location of this doc (for me should be in bitbake docs):

Thanks!
Quentin