Skip to contentSkip to conversation

Support librte_pci on Windows

PATCH In review Pallavi Kadam 3 participants 5 messages Mar 17, 2020 – Mar 18, 2020

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

cover Support librte_pci on Windows

Includes Windows specific EAL changes and meson changes to support pci lib on Windows.
Added mman.c and mman.h to support common code.
These files are under MIT license and need exception.

note: license/exceptions.txt will be modified once exception is approved.

Pallavi Kadam (2):
eal: mman implementation for windows
build: add module definitions and pci lib support

 lib/librte_eal/rte_eal_exports.def            |   2 +
 lib/librte_eal/windows/eal/include/sys/mman.h |  84 ++++++++
 lib/librte_eal/windows/eal/meson.build        |   1 +
 lib/librte_eal/windows/eal/mman.c             | 181 ++++++++++++++++++
 lib/meson.build                               |   2 +-
 5 files changed, 269 insertions(+), 1 deletion(-)
 create mode 100644 lib/librte_eal/windows/eal/include/sys/mman.h
 create mode 100644 lib/librte_eal/windows/eal/mman.c
Signature · 1 line
2.18.0.windows.1
#1 lore raw

PATCH 1/2 eal: mman implementation for windows

Adding sys/mman.h and mman.c on Windows for supporting common code.
This implementation has MIT licensing.
https://github.com/witwall/mman-win32

---
 lib/librte_eal/windows/eal/include/sys/mman.h |  84 ++++++++
 lib/librte_eal/windows/eal/meson.build        |   1 +
 lib/librte_eal/windows/eal/mman.c             | 181 ++++++++++++++++++
 3 files changed, 266 insertions(+)
 create mode 100644 lib/librte_eal/windows/eal/include/sys/mman.h
 create mode 100644 lib/librte_eal/windows/eal/mman.c
lib/librte_eal/windows/eal/include/sys/mman.h new file +84 -0
new file mode 100644
index 000000000..281302717
@@ -0,0 +1,84 @@
+/* SPDX-License-Identifier: MIT
+ */
+/*
+ * sys/mman.h
+ * mman-win32
+ */
+
+#ifndef _SYS_MMAN_H_
+#define _SYS_MMAN_H_
+
+/* Allow use of features specific to Windows XP or later.
+ */
+#ifndef _WIN32_WINNT
+/* Change this to the appropriate value to target other versions of Windows.
+ */
+#define _WIN32_WINNT 0x0501
+#endif
+
+/* All the headers include this file. */
+#ifndef _MSC_VER
+#include <_mingw.h>
+#endif
+
+#if defined(MMAN_LIBRARY_DLL)
+/* Windows shared libraries (DLL) must be declared export when building the lib
+ * and import when building the application which links against the library.
+ */
+#if defined(MMAN_LIBRARY)
+#define MMANSHARED_EXPORT __declspec(dllexport)
+#else
+#define MMANSHARED_EXPORT __declspec(dllimport)
+#endif /* MMAN_LIBRARY */
+#else
+/* Static libraries do not require a __declspec attribute.*/
+#define MMANSHARED_EXPORT
+#endif /* MMAN_LIBRARY_DLL */
+
+/* Determine offset type */
+#include <stdint.h>
+#if defined(_WIN64)
+typedef int64_t OffsetType;
+#else
+typedef uint32_t OffsetType;
+#endif
+
+#include <sys/types.h>
+
+#ifdef __cplusplus
+extern "C" {
+#endif
+
+#define PROT_NONE       0
+#define PROT_READ       1
+#define PROT_WRITE      2
+#define PROT_EXEC       4
+
+#define MAP_FILE        0
+#define MAP_SHARED      1
+#define MAP_PRIVATE     2
+#define MAP_TYPE        0xf
+#define MAP_FIXED       0x10
+#define MAP_ANONYMOUS   0x20
+#define MAP_ANON        MAP_ANONYMOUS
+
+#define MAP_FAILED      ((void *)-1)
+
+/* Flags for msync. */
+#define MS_ASYNC        1
+#define MS_SYNC         2
+#define MS_INVALIDATE   4
+
+MMANSHARED_EXPORT void   *mmap(void *addr, size_t len, int prot, int flags,
+				int fildes, OffsetType off);
+MMANSHARED_EXPORT int     munmap(void *addr, size_t len);
+MMANSHARED_EXPORT int     _mprotect(void *addr, size_t len, int prot);
+MMANSHARED_EXPORT int     msync(void *addr, size_t len, int flags);
+MMANSHARED_EXPORT int     mlock(const void *addr, size_t len);
+MMANSHARED_EXPORT int     munlock(const void *addr, size_t len);
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif /*  _SYS_MMAN_H_ */
lib/librte_eal/windows/eal/meson.build +1 -0
index 2a062c365..634b689c8 100644
@@ -24,4 +24,5 @@ env_sources = files('eal.c',
 	'eal_lcore.c',
 	'eal_thread.c',
 	'getopt.c',
+	'mman.c',
 )
lib/librte_eal/windows/eal/mman.c new file +181 -0

181 lines not on this page · raw message

Signature · 1 line
2.18.0.windows.1
#2 lore raw

PATCH 2/2 build: add module definitions and pci lib support

In reply to Pallavi Kadam

Added mman functions to eal exports list.
Added librte_pci support for Windows.

---
 lib/librte_eal/rte_eal_exports.def | 2 ++
 lib/meson.build                    | 2 +-
 2 files changed, 3 insertions(+), 1 deletion(-)
lib/librte_eal/rte_eal_exports.def +2 -0
index 12a6c79d6..bc577dd45 100644
@@ -7,3 +7,5 @@ EXPORTS
 	rte_eal_remote_launch
 	rte_log
 	rte_vlog
+	mmap
+	munmap
lib/meson.build +1 -1
index 0af3efab2..ab580202b 100644
@@ -33,7 +33,7 @@ libraries = [
 	'flow_classify', 'bpf', 'telemetry']
 
 if is_windows
-	libraries = ['kvargs','eal'] # only supported libraries for windows
+	libraries = ['kvargs','eal','pci'] # only supported libraries for windows
 endif
 
 default_cflags = machine_args
Signature · 1 line
2.18.0.windows.1
#3 lore raw

Re: [dpdk-dev] [PATCH 2/2] build: add module definitions and pci lib support

17/03/2020 01:48, Pallavi Kadam:

Quoted 1 line

Added mman functions to eal exports list.

[...]

lib/librte_eal/rte_eal_exports.def

Quoted 2 lines
lib/librte_eal/rte_eal_exports.def +0 -0

This file is generated. Only the .map can be updated.

lib/librte_eal/rte_eal_exports.def EXPORTS · line 11

Quoted 6 lines
lib/librte_eal/rte_eal_exports.def +2 -0
@@ -7,3 +7,5 @@ EXPORTS
 	rte_eal_remote_launch
 	rte_log
 	rte_vlog
+	mmap
+	munmap

These functions should not be exported for Linux.

And in general, I think it would be better to state what is the memory management strategy on Windows first. Maybe we will need to use a different abstraction.

#4 lore raw

Re: [dpdk-dev] [PATCH 2/2] build: add module definitions and pci lib support

Quoted 7 lines

17/03/2020 01:48, Pallavi Kadam:

Quoted 1 line

Added mman functions to eal exports list.

[...]

lib/librte_eal/rte_eal_exports.def

Quoted 2 lines
lib/librte_eal/rte_eal_exports.def +0 -0

This file is generated. Only the .map can be updated.

A minor correction: this file is not generated, it overrides generation of *.def from *.map, see buildtools/map_to_def.py.

Quoted 9 lines

lib/librte_eal/rte_eal_exports.def EXPORTS · line 11

Quoted 6 lines
lib/librte_eal/rte_eal_exports.def +2 -0
@@ -7,3 +7,5 @@ EXPORTS
 	rte_eal_remote_launch
 	rte_log
 	rte_vlog
+	mmap
+	munmap  

These functions should not be exported for Linux.

Quoted 3 lines

And in general, I think it would be better to state what is the memory management strategy on Windows first. Maybe we will need to use a different abstraction.

I concur, this patch should be postponed at least. Hopefully we'll settle to something regarding Windows MM at the nearest Community Call.

EAL will have to export mmap/munmap-like functions for mapping files and anonymous pages to support library code. Depending on the approach to MM implementation for Windows, not all mmap() calls may even translate into its Win32 equivalent. For example, hugepage allocation on Windows will use different approach that MMF.

Mapping device BARs can only be done using IOCTLs on Windows, so rte_pci_map/unmap_resource() code will not work even if it compiles.

Signature · 1 line
Dmitry Kozlyuk