utils/scanpypi: protect against zip-slip vulnerability in zip/tar handling
PATCH 1/1 utils/scanpypi: protect against zip-slip vulnerability in zip/tar handling
For details, see https://github.com/snyk/zip-slip-vulnerability
Older python versions do not validate that the extracted files are inside the target directory. Detect and error out on evil paths before extracting .zip / .tar file.
Given the scope of this (zip issue was fixed in python 2.7.4, released 2013-04-06, scanpypi is only used by a developer when adding a new python package), the security impact is fairly minimal, but it is good to get it fixed anyway.
--- utils/scanpypi | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+)
utils/scanpypi +18 -0
@@ -225,6 +225,22 @@ class BuildrootPackage(): self.filename = self.used_url['filename'] self.url = self.used_url['url'] + def check_archive(self, members): + """ + Check archive content before extracting + + Keyword arguments: + members -- list of archive members + """ + # Protect against https://github.com/snyk/zip-slip-vulnerability + # Older python versions do not validate that the extracted files are + # inside the target directory. Detect and error out on evil paths + evil = [e for e in members if os.path.relpath(e).startswith(('/', '..'))] + if evil: + print('ERROR: Refusing to extract {} with suspicious members {}'.format( + self.filename, evil)) + sys.exit(1) + def extract_package(self, tmp_path): """ Extract the package contents into a directrory
@@ -249,6 +265,7 @@ class BuildrootPackage(): print('Removing {pkg}...'.format(pkg=tmp_pkg)) shutil.rmtree(tmp_pkg) os.makedirs(tmp_pkg) + self.check_archive(as_zipfile.namelist()) as_zipfile.extractall(tmp_pkg) pkg_filename = self.filename.split(".zip")[0] else:
@@ -264,6 +281,7 @@ class BuildrootPackage(): print('Removing {pkg}...'.format(pkg=tmp_pkg)) shutil.rmtree(tmp_pkg) os.makedirs(tmp_pkg) + self.check_archive(as_tarfile.getnames()) as_tarfile.extractall(tmp_pkg) pkg_filename = self.filename.split(".tar")[0]
Signature · 1 line
2.11.0
PATCH 1/1 utils/scanpypi: protect against zip-slip vulnerability in zip/tar handling
Quoted 7 lines
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line
"Peter" == Peter Korsgaard <[email protected]> writes:
For details, see https://github.com/snyk/zip-slip-vulnerability
Older python versions do not validate that the extracted files are inside the target directory. Detect and error out on evil paths before extracting .zip / .tar file.
Quoted 7 lines
Given the scope of this (zip issue was fixed in python 2.7.4, released 2013-04-06, scanpypi is only used by a developer when adding a new python package), the security impact is fairly minimal, but it is good to get it fixed anyway.
Reported-by Bas van Schaik <[email protected]>Signed-off-by Peter Korsgaard <[email protected]>
Committed, thanks.
Signature · 1 line
Bye, Peter Korsgaard
PATCH 1/1 utils/scanpypi: protect against zip-slip vulnerability in zip/tar handling
In reply to Peter KorsgaardOn 2019-02-11 23:22 +0100, Peter Korsgaard spake thusly:
Quoted 26 lines
For details, see https://github.com/snyk/zip-slip-vulnerability
Older python versions do not validate that the extracted files are inside the target directory. Detect and error out on evil paths before extracting .zip / .tar file.
Given the scope of this (zip issue was fixed in python 2.7.4, released 2013-04-06, scanpypi is only used by a developer when adding a new python package), the security impact is fairly minimal, but it is good to get it fixed anyway.
Reported-by Bas van Schaik <[email protected]>Signed-off-by Peter Korsgaard <[email protected]>--- utils/scanpypi | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+)utils/scanpypi +1
-0@@ -225,6 +225,22 @@ class BuildrootPackage(): self.filename = self.used_url['filename'] self.url = self.used_url['url'] + def check_archive(self, members):
utils/scanpypi class BuildrootPackage(): · line 238
Quoted 10 lines
utils/scanpypi +10
-0+ """ + Check archive content before extracting + + Keyword arguments: + members -- list of archive members + """ + # Protect against https://github.com/snyk/zip-slip-vulnerability + # Older python versions do not validate that the extracted files are + # inside the target directory. Detect and error out on evil paths + evil = [e for e in members if os.path.relpath(e).startswith(('/', '..'))]
As I said on IRC: I would really prefer if we could reject archive that do have paths merely containiug /../ components, because those are already fishy, even if they still point in-tree, e.g. foo/../bar is still technically OK, but why the heck would it be constructed that way to begin with? Normal archivers do not do that.
But making the path canonical with relpath() is already better than the current situation, so:
Yet, a little tiny comment, below:
utils/scanpypi class BuildrootPackage(): · line 241
Quoted 3 lines
utils/scanpypi +3
-0+ if evil: + print('ERROR: Refusing to extract {} with suspicious members {}'.format( + self.filename, evil))
I would have sent that to stderr: print(..., file=sys.stderr)
Regards,
Yann E. MORIN.
Quoted 28 lines
utils/scanpypi +4
-0+ sys.exit(1) + def extract_package(self, tmp_path): """ Extract the package contents into a directrory@@ -249,6 +265,7 @@ class BuildrootPackage(): print('Removing {pkg}...'.format(pkg=tmp_pkg)) shutil.rmtree(tmp_pkg) os.makedirs(tmp_pkg) + self.check_archive(as_zipfile.namelist()) as_zipfile.extractall(tmp_pkg) pkg_filename = self.filename.split(".zip")[0] else:@@ -264,6 +281,7 @@ class BuildrootPackage(): print('Removing {pkg}...'.format(pkg=tmp_pkg)) shutil.rmtree(tmp_pkg) os.makedirs(tmp_pkg) + self.check_archive(as_tarfile.getnames()) as_tarfile.extractall(tmp_pkg) pkg_filename = self.filename.split(".tar")[0]Signature · 6 lines
2.11.0 _______________________________________________ buildroot mailing list buildroot at busybox.net http://lists.busybox.net/mailman/listinfo/buildroot
Signature · 6 lines
.-----------------.--------------------.------------------.--------------------. | Yann E. MORIN | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: | | +33 662 376 056 | Software Designer | \ / CAMPAIGN | ___ | | +33 561 099 427 `------------.-------: X AGAINST | \e/ There is no | | http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL | v conspiracy. | '------------------------------^-------^------------------^--------------------'
PATCH 1/1 utils/scanpypi: protect against zip-slip vulnerability in zip/tar handling
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line
"Yann" == Yann E MORIN <[email protected]> writes:
Hi,
Quoted 5 lines
As I said on IRC: I would really prefer if we could reject archive that do have paths merely containiug /../ components, because those are already fishy, even if they still point in-tree, e.g. foo/../bar is still technically OK, but why the heck would it be constructed that way to begin with? Normal archivers do not do that.
Agreed, but that code seems somewhat more complicated to me, and I wanted the simplest possible solution.
Quoted 5 lines
But making the path canonical with
relpath()is already better than the current situation, so:Reviewed-by "Yann E. MORIN" <[email protected]>
Quoted 7 lines
Yet, a little tiny comment, below:
utils/scanpypi class BuildrootPackage(): · line 241
Quoted 3 lines
utils/scanpypi +3
-0+ if evil: + print('ERROR: Refusing to extract {} with suspicious members {}'.format( + self.filename, evil))I would have sent that to stderr:
print(..., file=sys.stderr)
Correct, but scanpypi sems (almost all) error messages to stdout, so I kept it like this for consistency.
Signature · 1 line
Bye, Peter Korsgaard
PATCH 1/1 utils/scanpypi: protect against zip-slip vulnerability in zip/tar handling
In reply to Peter KorsgaardQuoted 7 lines
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line
"Peter" == Peter Korsgaard <[email protected]> writes:
For details, see https://github.com/snyk/zip-slip-vulnerability
Older python versions do not validate that the extracted files are inside the target directory. Detect and error out on evil paths before extracting .zip / .tar file.
Quoted 7 lines
Given the scope of this (zip issue was fixed in python 2.7.4, released 2013-04-06, scanpypi is only used by a developer when adding a new python package), the security impact is fairly minimal, but it is good to get it fixed anyway.
Reported-by Bas van Schaik <[email protected]>Signed-off-by Peter Korsgaard <[email protected]>
Committed to 2018.02.x and 2018.11.x, thanks.
Signature · 1 line
Bye, Peter Korsgaard