Crypto API and device framework
Subsystems (2)
cover Crypto API and device framework
This series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.
The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwarded
Current Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.
Declan Doherty (5):
cryptodev: Initial DPDK Crypto APIs and device framework release
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
docs: add getting started guides for multi-buffer pmd and qat pmd app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
John Griffin (1):
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
app/test/Makefile | 3 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1993 ++++++++++++++++++++ app/test/test_cryptodev.h | 68 + app/test/test_cryptodev_perf.c | 1415 ++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- config/common_bsdapp | 23 +- config/common_linuxapp | 30 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + doc/guides/cryptodevs/aesni_mb.rst | 76 + doc/guides/cryptodevs/index.rst | 43 + doc/guides/cryptodevs/qat.rst | 155 ++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 38 + drivers/crypto/aesni_mb/Makefile | 67 + drivers/crypto/aesni_mb/aesni_mb_ops.h | 206 ++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 632 +++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 295 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 210 +++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 5 + drivers/crypto/qat/Makefile | 63 + .../qat/qat_adf/adf_transport_access_macros.h | 173 ++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 ++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 ++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 576 ++++++ drivers/crypto/qat/qat_crypto.c | 505 +++++ drivers/crypto/qat/qat_crypto.h | 111 ++ drivers/crypto/qat/qat_logs.h | 78 + drivers/crypto/qat/qat_qp.c | 372 ++++ drivers/crypto/qat/rte_pmd_qat_version.map | 5 + drivers/crypto/qat/rte_qat_cryptodev.c | 130 ++ examples/l2fwd-crypto/Makefile | 50 + examples/l2fwd-crypto/main.c | 1475 +++++++++++++++ lib/Makefile | 1 + lib/librte_cryptodev/Makefile | 60 + lib/librte_cryptodev/rte_crypto.h | 720 +++++++ lib/librte_cryptodev/rte_crypto_version.map | 40 + lib/librte_cryptodev/rte_cryptodev.c | 1126 +++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 592 ++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 577 ++++++ lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.c | 1 + lib/librte_mbuf/rte_mbuf.h | 53 +- mk/rte.app.mk | 8 + 54 files changed, 13263 insertions(+), 80 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_crypto_version.map create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h
Signature · 1 line
2.4.3
PATCH 1/6 cryptodev: Initial DPDK Crypto APIs and device framework release
This patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
changes from RFC:
- Session management API changes to support specification of crypto transform(xform) chains using linked list of xforms.
- Changes to the crypto operation struct as a result of session management changes.
- Some movement of common MACROS shared by cryptodevs and ethdevs to common headers
--- config/common_bsdapp | 7 + config/common_linuxapp | 10 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + lib/Makefile | 1 + lib/librte_cryptodev/Makefile | 60 ++ lib/librte_cryptodev/rte_crypto.h | 720 +++++++++++++++++ lib/librte_cryptodev/rte_crypto_version.map | 40 + lib/librte_cryptodev/rte_cryptodev.c | 1126 +++++++++++++++++++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 592 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 577 ++++++++++++++ lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.c | 1 + lib/librte_mbuf/rte_mbuf.h | 53 +- mk/rte.app.mk | 1 + 19 files changed, 3230 insertions(+), 34 deletions(-) create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_crypto_version.map create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h
config/common_bsdapp +7 -0
@@ -147,6 +147,13 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=y +CONFIG_RTE_MAX_CRYPTOPORTS=32 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -145,6 +145,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=y +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTO_MAX_XFORM_CHAIN_LENGTH=2 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/api/doxy-api-index.md +1 -0
@@ -39,6 +39,7 @@ There are many libraries, so their headers may be grouped by topics: [dev] (@ref rte_dev.h), [ethdev] (@ref rte_ethdev.h), [ethctrl] (@ref rte_eth_ctrl.h), + [cryptodev] (@ref rte_cryptodev.h), [devargs] (@ref rte_devargs.h), [bond] (@ref rte_eth_bond.h), [vhost] (@ref rte_virtio_net.h),
doc/api/doxy-api.conf +1 -0
@@ -37,6 +37,7 @@ INPUT = doc/api/doxy-api-index.md \ lib/librte_cfgfile \ lib/librte_cmdline \ lib/librte_compat \ + lib/librte_cryptodev \ lib/librte_distributor \ lib/librte_ether \ lib/librte_hash \
lib/Makefile +1 -0
@@ -40,6 +40,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline DIRS-$(CONFIG_RTE_LIBRTE_ETHER) += librte_ether +DIRS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += librte_cryptodev DIRS-$(CONFIG_RTE_LIBRTE_VHOST) += librte_vhost DIRS-$(CONFIG_RTE_LIBRTE_HASH) += librte_hash DIRS-$(CONFIG_RTE_LIBRTE_LPM) += librte_lpm
lib/librte_cryptodev/Makefile new file +60 -0
60 lines not on this page · raw message
lib/librte_cryptodev/rte_crypto.h new file +720 -0
720 lines not on this page · raw message
lib/librte_cryptodev/rte_crypto_version.map new file +40 -0
@@ -0,0 +1,40 @@ +DPDK_2.2 { + global: + + rte_cryptodev_create_vdev; + rte_cryptodev_get_dev_id; + rte_cryptodev_count; + rte_cryptodev_configure; + rte_cryptodev_start; + rte_cryptodev_stop; + rte_cryptodev_close; + rte_cryptodev_queue_pair_setup; + rte_cryptodev_queue_pair_start; + rte_cryptodev_queue_pair_stop; + rte_cryptodev_queue_pair_count; + rte_cryptodev_stats_get; + rte_cryptodev_stats_reset; + rte_cryptodev_info_get; + rte_cryptodev_callback_register; + rte_cryptodev_callback_unregister; + rte_cryptodev_enqueue_burst; + rte_cryptodev_dequeue_burst; + rte_cryptodev_create_crypto_op; + rte_cryptodev_crypto_op_free; + rte_cryptodev_session_create; + rte_cryptodev_session_free; + + rte_cryptodev_pmd_get_dev; + rte_cryptodev_pmd_get_named_dev; + rte_cryptodev_pmd_is_valid_dev; + rte_cryptodev_pmd_allocate; + rte_cryptodev_pmd_virtual_dev_init; + rte_cryptodev_pmd_release_device; + rte_cryptodev_pmd_attach; + rte_cryptodev_pmd_detach; + rte_cryptodev_pmd_driver_register; + rte_cryptodev_pmd_socket_id; + rte_cryptodev_pmd_callback_process; + + local: *; +};
lib/librte_cryptodev/rte_cryptodev.c new file +1126 -0
1,126 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.h new file +592 -0
592 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_pmd.h new file +577 -0
407 lines not on this page · raw message
lib/librte_eal/common/include/rte_common.h +15 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_eal.h +14 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_log.h +1 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_memory.h +12 -2
Lines of this file are not shown. View the raw message.
lib/librte_mbuf/rte_mbuf.h +52 -1
53 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
Re: [PATCH 1/6] cryptodev: Initial DPDK Crypto APIs and device framework release
Hi Declan,
2015-10-03 00:01, Declan Doherty:
Quoted 3 lines
Co-authored-by Des O Dea <[email protected]>Co-authored-by John Griffin <[email protected]>Co-authored-by Fiona Trahe <[email protected]>
Common practice is to use Signed-off-by below for co-authors.
Quoted 15 lines
This patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
It would be easier to review if features were split in separate patches. You don't need to have a fine grain but maybe 1 patch for basic management then 1 for the session management, 1 for the algos and another 1 for the stats.
Other comment: you've added some API which are not implemented (hotplug, restore). Why not declare them later when they will be implemented?
The QuickAssist doc is not needed if the code is not submitted.
Volunteer for a sub-tree?
Thanks.
Re: [PATCH 1/6] cryptodev: Initial DPDK Crypto APIs and device framework release
Quoted 8 lines · Thomas Monjalon
Hi Declan,
2015-10-03 00:01, Declan Doherty:
Quoted 3 lines
Co-authored-by Des O Dea <[email protected]>Co-authored-by John Griffin <[email protected]>Co-authored-by Fiona Trahe <[email protected]>Common practice is to use Signed-off-by below for co-authors.
Cool, I didn't know that, I will change in the V2.
Quoted 17 lines
Quoted 4 lines
This patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
Quoted 12 lines
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
Quoted 3 lines
It would be easier to review if features were split in separate patches. You don't need to have a fine grain but maybe 1 patch for basic management then 1 for the session management, 1 for the algos and another 1 for the stats.
I'll take a look and see how feasible it would be to split the patches that way.
Quoted 4 lines
Other comment: you've added some API which are not implemented (hotplug, restore). Why not declare them later when they will be implemented?
I'll remove these
Quoted 2 lines
The QuickAssist doc is not needed if the code is not submitted.
There is a QuickAssist PMD included in the patch set, see patch 2/6
Quoted 3 lines
Volunteer for a sub-tree?
Thanks.
PATCH 2/6 qat_crypto_pmd: Addition of a new QAT DPDK PMD.
In reply to Declan DohertyFrom: John Griffin <[email protected]>
This patch adds a PMD for the Intel Quick Assist Technology DH895xxC hardware accelerator.
This patch depends on a QAT PF driver which may be downloaded from 01.org (please see the file docs/guides/cryptodevs/qat.rst contained in this a subsquent patch in this patchset).
This is a limited patchset which has support for a chain of cipher and hash the following algorithms are supported:
Cipher algorithms:
- RTE_CRYPTO_SYM_CIPHER_AES128_CBC
- RTE_CRYPTO_SYM_CIPHER_AES256_CBC
- RTE_CRYPTO_SYM_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_SYM_HASH_SHA1_HMAC
- RTE_CRYPTO_SYM_HASH_SHA256_HMAC
- RTE_CRYPTO_SYM_HASH_SHA512_HMAC
Some limitation on this patchset which shall be contributed in a subsequent release:
- Chained mbufs are not supported.
- Hash only is not supported.
- Cipher only is not supported.
- Only in-place is currently supported (destination address is the same as source address).
- Only supports session-oriented API implementation (session-less APIs are not supported).
--- config/common_bsdapp | 16 +- config/common_linuxapp | 14 + drivers/Makefile | 1 + drivers/crypto/Makefile | 37 ++ drivers/crypto/qat/Makefile | 63 +++ .../qat/qat_adf/adf_transport_access_macros.h | 173 +++++++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++++++++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 +++++++++++++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++++++++++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 +++++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 576 +++++++++++++++++++++ drivers/crypto/qat/qat_crypto.c | 505 ++++++++++++++++++ drivers/crypto/qat/qat_crypto.h | 111 ++++ drivers/crypto/qat/qat_logs.h | 78 +++ drivers/crypto/qat/qat_qp.c | 372 +++++++++++++ drivers/crypto/qat/rte_pmd_qat_version.map | 5 + drivers/crypto/qat/rte_qat_cryptodev.c | 130 +++++ mk/rte.app.mk | 3 + 18 files changed, 3234 insertions(+), 1 deletion(-) create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c
config/common_bsdapp +15 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -154,6 +154,20 @@ CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=y CONFIG_RTE_MAX_CRYPTOPORTS=32 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=y +CONFIG_RTE_LIBRTE_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_TX=y +CONFIG_RTE_LIBRTE_QAT_DEBUG_RX=y +CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=y +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +14 -0
@@ -153,6 +153,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTO_MAX_XFORM_CHAIN_LENGTH=2 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=y +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
drivers/Makefile +1 -0
@@ -32,5 +32,6 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-y += net +DIRS-y += crypto include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/Makefile new file +37 -0
@@ -0,0 +1,37 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +include $(RTE_SDK)/mk/rte.vars.mk + +DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat + +include $(RTE_SDK)/mk/rte.sharelib.mk +include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/qat/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/qat/qat_adf/adf_transport_access_macros.h new file +173 -0
173 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw.h new file +316 -0
316 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw_la.h new file +404 -0
404 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_hw.h new file +306 -0
306 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs.h new file +125 -0
125 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs_build_desc.c new file +576 -0
576 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.c new file +505 -0
505 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.h new file +111 -0
111 lines not on this page · raw message
drivers/crypto/qat/qat_logs.h new file +78 -0
78 lines not on this page · raw message
drivers/crypto/qat/qat_qp.c new file +372 -0
253 lines not on this page · raw message
drivers/crypto/qat/rte_pmd_qat_version.map new file +5 -0
Lines of this file are not shown. View the raw message.
drivers/crypto/qat/rte_qat_cryptodev.c new file +130 -0
130 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH 3/6 aesni_mb_pmd: Initial implementation of multi buffer based crypto device
In reply to Declan DohertyThis patch provides the initial implementation of the AES-NI multi-buffer based crypto poll mode driver using DPDK's new cryptodev framework.
This PMD is dependent on Intel's multibuffer library, see the whitepaper "Fast Multi-buffer IPsec Implementations on Intel® Architecture Processors", see ref 1 for details on the library's design and ref 2 to download the library itself. This initial implementation is limited to supporting the chained operations of "hash then cipher" or "cipher then hash" for the following cipher and hash algorithms:
- RTE_CRYPTO_SYM_CIPHER_AES128_CBC
- RTE_CRYPTO_SYM_CIPHER_AES256_CBC
- RTE_CRYPTO_SYM_CIPHER_AES512_CBC
- RTE_CRYPTO_SYM_HASH_SHA1_HMAC
- RTE_CRYPTO_SYM_HASH_SHA256_HMAC
- RTE_CRYPTO_SYM_HASH_SHA512_HMAC
Important Note:
Due to the fact that the multi-buffer library is designed for accelerating IPsec crypto oepration, the digest's generated for the HMAC functions are truncated to lengths specified by IPsec RFC's, ie RFC2404 for using HMAC-SHA-1 with IPsec specifies that the digest is truncate from 20 to 12 bytes.
Build instructions:
To build DPKD with the AESNI_MB_PMD the user is required to download (ref 2) and compile the multi-buffer library on there user system before building DPDK. The environmental variable AESNI_MULTI_BUFFER_LIB_PATH must be exported with the path where you extracted and built the multi buffer library and finally set CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y in config/common_linuxapp.
Current status: It's doesn't support crypto operation across chained mbufs, or cipher only or hash only operations.
ref 2: https://downloadcenter.intel.com/download/22972
--- config/common_linuxapp | 6 + drivers/crypto/Makefile | 1 + drivers/crypto/aesni_mb/Makefile | 67 +++ drivers/crypto/aesni_mb/aesni_mb_ops.h | 206 +++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 632 +++++++++++++++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 295 ++++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 210 +++++++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 5 + mk/rte.app.mk | 4 + 9 files changed, 1426 insertions(+) create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map
config/common_linuxapp +6 -0
@@ -166,6 +166,12 @@ CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n # CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_DEBUG=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_MAX_SESSIONS=2048 + # # Support NIC bypass logic #
drivers/crypto/Makefile +1 -0
@@ -31,6 +31,7 @@ include $(RTE_SDK)/mk/rte.vars.mk +DIRS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += aesni_mb DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat include $(RTE_SDK)/mk/rte.sharelib.mk
drivers/crypto/aesni_mb/Makefile new file +67 -0
67 lines not on this page · raw message
drivers/crypto/aesni_mb/aesni_mb_ops.h new file +206 -0
206 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c new file +632 -0
632 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c new file +295 -0
295 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h new file +210 -0
210 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_pmd_aesni_version.map new file +5 -0
@@ -0,0 +1,5 @@ +DPDK_2.2 { + global: + + local: *; +};
mk/rte.app.mk +4 -0
@@ -147,6 +147,10 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_NULL) += -lrte_pmd_null # QAT PMD has a dependency on libcrypto (from openssl) for calculating HMAC precomputes _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += -lrte_pmd_qat -lcrypto +# AESNI MULTI BUFFER is dependent on the IPSec_MB library +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -lrte_pmd_aesni_mb +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -L$(AESNI_MULTI_BUFFER_LIB_PATH) -lIPSec_MB + endif # ! $(CONFIG_RTE_BUILD_SHARED_LIB) endif # ! CONFIG_RTE_BUILD_COMBINE_LIBS
Signature · 1 line
2.4.3
PATCH 4/6 docs: add getting started guides for multi-buffer pmd and qat pmd
In reply to Declan Doherty--- doc/guides/cryptodevs/aesni_mb.rst | 76 ++++++++++++++++++ doc/guides/cryptodevs/index.rst | 43 ++++++++++ doc/guides/cryptodevs/qat.rst | 155 +++++++++++++++++++++++++++++++++++++ doc/guides/index.rst | 1 + 4 files changed, 275 insertions(+) create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst
doc/guides/cryptodevs/aesni_mb.rst new file +76 -0
@@ -0,0 +1,76 @@ +.. BSD LICENSE + Copyright(c) 2015 Intel Corporation. All rights reserved. + + Redistribution and use in source and binary forms, with or without + modification, are permitted provided that the following conditions + are met: + + * Redistributions of source code must retain the above copyright + notice, this list of conditions and the following disclaimer. + * Redistributions in binary form must reproduce the above copyright + notice, this list of conditions and the following disclaimer in + the documentation and/or other materials provided with the + distribution. + * Neither the name of Intel Corporation nor the names of its + contributors may be used to endorse or promote products derived + from this software without specific prior written permission. + + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR + A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT + OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, + DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY + THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT + (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE + OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +AESN-NI Multi Buffer Crytpo Poll Mode Driver +============================================ + + +The AESNI MB PMD (**librte_pmd_aesni_mb**) provides poll mode crypto driver +support for utilising Intel multi buffer library, see the white paper +`Fast Multi-buffer IPsec Implementations on Intel® Architecture Processors +<https://www-ssl.intel.com/content/www/us/en/intelligent-systems/intel-technology/fast-multi-buffer-ipsec-implementations-ia-processors-paper.html?wapkw=multi+buffer>`_. + +The AES-NI MB PMD has current only been tested on Fedora 21 64-bit with gcc. + +Features +-------- + +AESNI MB PMD has support for: + +Cipher algorithms: + +* RTE_CRYPTO_SYM_CIPHER_AES128_CBC +* RTE_CRYPTO_SYM_CIPHER_AES256_CBC +* RTE_CRYPTO_SYM_CIPHER_AES512_CBC + +Hash algorithms: + +* RTE_CRYPTO_SYM_HASH_SHA1_HMAC +* RTE_CRYPTO_SYM_HASH_SHA256_HMAC +* RTE_CRYPTO_SYM_HASH_SHA512_HMAC + +Limitations +----------- + +* Chained mbufs are not supported. +* Hash only is not supported. +* Cipher only is not supported. +* Only in-place is currently supported (destination address is the same as source address). +* Only supports session-oriented API implementation (session-less APIs are not supported). +* Not performance tuned. + +Installation +------------ + +To build DPKD with the AESNI_MB_PMD the user is required to download the library +from `here <https://downloadcenter.intel.com/download/22972>`_ and compile it on +their user system before building DPDK. The environmental variable +AESNI_MULTI_BUFFER_LIB_PATH must be exported with the path where you extracted +and built the multi buffer library and finally set +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y in config/common_linuxapp.
doc/guides/cryptodevs/index.rst new file +43 -0
43 lines not on this page · raw message
doc/guides/cryptodevs/qat.rst new file +155 -0
155 lines not on this page · raw message
doc/guides/index.rst +1 -0
@@ -42,6 +42,7 @@ Contents: xen/index prog_guide/index nics/index + cryptodevs/index sample_app_ug/index testpmd_app_ug/index faq/index
Signature · 1 line
2.4.3
Re: [PATCH 4/6] docs: add getting started guides for multi-buffer pmd and qat pmd
2015-10-03 00:01, Declan Doherty:
Quoted 4 lines
doc/guides/cryptodevs/aesni_mb.rst | 76 ++++++++++++++++++ doc/guides/cryptodevs/index.rst | 43 ++++++++++ doc/guides/cryptodevs/qat.rst | 155 +++++++++++++++++++++++++++++++++++++ doc/guides/index.rst | 1 +
Please avoid separate doc patches.
The good habit is to update doc and code at the same time in the same patch. The index can be brought by the first API patch.
PATCH 5/6 app/test: add cryptodev unit and performance tests
In reply to Declan Dohertyunit tests are run by using cryptodev_qat_autotest or cryptodev_aesni_autotest from the test apps interactive console.
performance tests are run by using the cryptodev_qat_perftest or cryptodev_aesni_mb_perftest command from the test apps interactive console.
If you which to run the tests on a QAT device there must be one bound to igb_uio kernel driver.
--- app/test/Makefile | 3 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1993 ++++++++++++++++++++++++++++++++++++ app/test/test_cryptodev.h | 68 ++ app/test/test_cryptodev_perf.c | 1415 +++++++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- 8 files changed, 3573 insertions(+), 45 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c
app/test/Makefile +3 -0
@@ -140,6 +140,9 @@ SRCS-$(CONFIG_RTE_LIBRTE_PMD_BOND) += test_link_bonding.c SRCS-$(CONFIG_RTE_LIBRTE_PMD_BOND) += test_link_bonding_mode4.c endif +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev_perf.c +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev.c + SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring.c SRCS-$(CONFIG_RTE_LIBRTE_KVARGS) += test_kvargs.c
app/test/test.c +61 -31
112 lines not on this page · raw message
app/test/test.h +27 -7
@@ -33,7 +33,7 @@#ifndef _TEST_H_#define _TEST_H_ - +#include <stddef.h> #include <sys/queue.h> #define TEST_SUCCESS (0)
@@ -64,6 +64,17 @@ } \ } while (0) + +#define TEST_ASSERT_BUFFERS_ARE_EQUAL (a, b, len, msg, ...) do { \ + if (memcmp(a, b, len)) { \ + printf("TestCase %s() line %d failed: " \ + msg "\n", __func__, __LINE__, ##__VA_ARGS__); \ + TEST_TRACE_FAILURE(__FILE__, __LINE__, __func__); \ + return TEST_FAILED; \ + } \ +} while (0) + +#define TEST_ASSERT_NOT_EQUAL (a, b, msg, ...) do { \ if (!(a != b)) { \ printf("TestCase %s() line %d failed: " \
@@ -113,27 +124,36 @@struct unit_test_case {int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );int (*testcase)(void );const char *success_msg;const char *fail_msg; +unsigned enabled; }; -#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed"} +#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed", 1 }#define TEST_CASE_NAMED (name, fn) { NULL, NULL, fn, name " succeeded", \ - name " failed"} + name " failed", 1 }#define TEST_CASE_ST (setup, teardown, testcase) \ { setup, teardown, testcase, #testcase " succeeded", \ - #testcase " failed "} + #testcase " failed ", 1 } + + +#define TEST_CASE_DISABLED (fn) { NULL, NULL, fn, #fn " succeeded", \ + #fn " failed", 0 } + +#define TEST_CASE_ST_DISABLED (setup, teardown, testcase) \ + { setup, teardown, testcase, #testcase " succeeded", \ + #testcase " failed ", 0 } -#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL } +#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL, 0 }struct unit_test_suite {const char *suite_name;int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );struct unit_test_case unit_test_cases[]; };
app/test/test_cryptodev.c new file +1993 -0
1,993 lines not on this page · raw message
app/test/test_cryptodev.h new file +68 -0
68 lines not on this page · raw message
app/test/test_cryptodev_perf.c new file +1415 -0
751 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH 6/6 l2fwd-crypto: crypto
In reply to Declan DohertyThis patch creates a new sample applicaiton based off the l2fwd application which performs specified crypto operations on IP packet payloads which are forwarding.
--- examples/l2fwd-crypto/Makefile | 50 ++ examples/l2fwd-crypto/main.c | 1475 ++++++++++++++++++++++++++++++++++++++++ 2 files changed, 1525 insertions(+) create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c
examples/l2fwd-crypto/Makefile new file +50 -0
@@ -0,0 +1,50 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +ifeq ($(RTE_SDK),) +$(error "Please define RTE_SDK environment variable") +endif + +# Default target, can be overridden by command line or environment +RTE_TARGET ?= x86_64-native-linuxapp-gcc + +include $(RTE_SDK)/mk/rte.vars.mk + +# binary name +APP = l2fwd-crypto + +# all source are stored in SRCS-y +SRCS-y := main.c + +CFLAGS += -O3 +CFLAGS += $(WERROR_FLAGS) + +include $(RTE_SDK)/mk/rte.extapp.mk
examples/l2fwd-crypto/main.c new file +1475 -0
1,475 lines not on this page · raw message
Signature · 1 line
2.4.3
Quoted 10 lines · Declan Doherty
Co-authored-by Des O Dea <[email protected]>Co-authored-by John Griffin <[email protected]>Co-authored-by Fiona Trahe <[email protected]>This series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
....
Hey all,
I'm just looking for any comments on this patch set? I working on a V2 with some small bug fixes, tidy ups and more documentation. I would really like to address any further comments which might be out there before submitting, so if you have any comments or you intend to review this patch set could you please do so ASAP. I would really like to have any comments addressed by the end of this week as I'm out of the office for a couple of days early next week.
Thanks
Declan
v2 cover Crypto API and device framework
In reply to Declan DohertyThis series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.
The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwarded
Current Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.
v2:
- Introduces a new library to support attaching offload operations to a mbuf
- Remove unused APIs from cryptodev
- PMD code refactor due to new rte_mbuf_offload structure
- General bug fixes and code tidy up
Declan Doherty (6):
cryptodev: Initial DPDK Crypto APIs and device framework release
mbuf_offload: library to support attaching offloads to a mbuf
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
app/test/Makefile | 3 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1924 ++++++++++++++++++++ app/test/test_cryptodev.h | 68 + app/test/test_cryptodev_perf.c | 1449 +++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- config/common_bsdapp | 37 +- config/common_linuxapp | 36 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + doc/guides/cryptodevs/aesni_mb.rst | 76 + doc/guides/cryptodevs/index.rst | 43 + doc/guides/cryptodevs/qat.rst | 188 ++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 38 + drivers/crypto/aesni_mb/Makefile | 67 + drivers/crypto/aesni_mb/aesni_mb_ops.h | 212 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 790 ++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 296 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 230 +++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + drivers/crypto/qat/Makefile | 63 + .../qat/qat_adf/adf_transport_access_macros.h | 173 ++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 ++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 ++++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 ++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 578 ++++++ drivers/crypto/qat/qat_crypto.c | 547 ++++++ drivers/crypto/qat/qat_crypto.h | 113 ++ drivers/crypto/qat/qat_logs.h | 78 + drivers/crypto/qat/qat_qp.c | 416 +++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 130 ++ examples/l2fwd-crypto/Makefile | 50 + examples/l2fwd-crypto/main.c | 1472 +++++++++++++++ lib/Makefile | 2 + lib/librte_cryptodev/Makefile | 60 + lib/librte_cryptodev/rte_crypto.h | 604 ++++++ lib/librte_cryptodev/rte_cryptodev.c | 1065 +++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 619 +++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 529 ++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.h | 36 +- lib/librte_mbuf_offload/Makefile | 52 + lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 + lib/librte_mbuf_offload/rte_mbuf_offload.h | 289 +++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 9 + 57 files changed, 13784 insertions(+), 80 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
Signature · 1 line
2.4.3
PATCH v2 1/6 cryptodev: Initial DPDK Crypto APIs and device framework release
This patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
changes from RFC:
- Session management API changes to support specification of crypto transform(xform) chains using linked list of xforms.
- Changes to the crypto operation struct as a result of session management changes.
- Some movement of common MACROS shared by cryptodevs and ethdevs to common headers
--- config/common_bsdapp | 10 +- config/common_linuxapp | 10 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + lib/Makefile | 1 + lib/librte_cryptodev/Makefile | 60 ++ lib/librte_cryptodev/rte_crypto.h | 604 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev.c | 1065 ++++++++++++++++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 619 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 529 ++++++++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.h | 30 +- mk/rte.app.mk | 1 + 18 files changed, 3011 insertions(+), 35 deletions(-) create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map
config/common_bsdapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -147,6 +147,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -145,6 +145,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/api/doxy-api-index.md +1 -0
@@ -39,6 +39,7 @@ There are many libraries, so their headers may be grouped by topics: [dev] (@ref rte_dev.h), [ethdev] (@ref rte_ethdev.h), [ethctrl] (@ref rte_eth_ctrl.h), + [cryptodev] (@ref rte_cryptodev.h), [devargs] (@ref rte_devargs.h), [bond] (@ref rte_eth_bond.h), [vhost] (@ref rte_virtio_net.h),
doc/api/doxy-api.conf +1 -0
@@ -37,6 +37,7 @@ INPUT = doc/api/doxy-api-index.md \ lib/librte_cfgfile \ lib/librte_cmdline \ lib/librte_compat \ + lib/librte_cryptodev \ lib/librte_distributor \ lib/librte_ether \ lib/librte_hash \
lib/Makefile +1 -0
@@ -40,6 +40,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline DIRS-$(CONFIG_RTE_LIBRTE_ETHER) += librte_ether +DIRS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += librte_cryptodev DIRS-$(CONFIG_RTE_LIBRTE_VHOST) += librte_vhost DIRS-$(CONFIG_RTE_LIBRTE_HASH) += librte_hash DIRS-$(CONFIG_RTE_LIBRTE_LPM) += librte_lpm
lib/librte_cryptodev/Makefile new file +60 -0
60 lines not on this page · raw message
lib/librte_cryptodev/rte_crypto.h new file +604 -0
604 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.c new file +1065 -0
1,065 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.h new file +619 -0
619 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_pmd.h new file +529 -0
529 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_version.map new file +41 -0
41 lines not on this page · raw message
lib/librte_eal/common/include/rte_common.h +15 -0
@@ -270,8 +270,23 @@ rte_align64pow2(uint64_t v) _a > _b ? _a : _b; \ }) +/*********** Other general functions / macros ********/ +#define FUNC_PTR_OR_ERR_RET (func, retval) do { \ + if ((func) == NULL) { \ + RTE_LOG(ERR, PMD, "Function not supported"); \ + return retval; \ + } \ +} while (0) + +#define FUNC_PTR_OR_RET (func) do { \ + if ((func) == NULL) { \ + RTE_LOG(ERR, PMD, "Function not supported"); \ + return; \ + } \ +} while (0)
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_eal.h +14 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_log.h +1 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_memory.h +12 -2
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v2 2/6 mbuf_offload: library to support attaching offloads to a mbuf
In reply to Declan DohertyThis library add support for adding a chain of offload operations to a mbuf. It contains the definition of the rte_mbuf_offload structure as well as helper funtions for attaching offloads to mbufs and a mempool management functions.
This initial implementation supports attaching multiple offload operations to a single mbuf, but only a single offload operation of a specific type can be attach to that mbuf.
--- config/common_bsdapp | 6 + config/common_linuxapp | 6 + lib/Makefile | 1 + lib/librte_mbuf/rte_mbuf.h | 6 + lib/librte_mbuf_offload/Makefile | 52 ++++ lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 +++++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 289 +++++++++++++++++++++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 1 + 9 files changed, 468 insertions(+) create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
config/common_bsdapp +6 -0
@@ -320,6 +320,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
config/common_linuxapp +6 -0
@@ -328,6 +328,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
lib/Makefile +1 -0
@@ -36,6 +36,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_EAL) += librte_eal DIRS-$(CONFIG_RTE_LIBRTE_RING) += librte_ring DIRS-$(CONFIG_RTE_LIBRTE_MEMPOOL) += librte_mempool DIRS-$(CONFIG_RTE_LIBRTE_MBUF) += librte_mbuf +DIRS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += librte_mbuf_offload DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline
lib/librte_mbuf/rte_mbuf.h +6 -0
@@ -729,6 +729,9 @@ typedef uint8_t MARKER8[0]; /**< generic marker with 1B alignment */typedef uint64_t MARKER64 [0 ];/**< marker that allows us to overwrite 8 bytes * with a single assignment */ +/** Opaque rte_mbuf_offload structure declarations */ +struct rte_mbuf_offload ; +/** * The generic rte_mbuf, containing a packet mbuf. */
@@ -842,6 +845,9 @@ struct rte_mbuf {/** Timesync flags for use with IEEE1588. */ uint16_t timesync; + +/* Chain of off-load operations to perform on mbuf */ +struct rte_mbuf_offload *offload_ops; } __rte_cache_aligned;static inline uint16_t rte_pktmbuf_priv_size (struct rte_mempool *mp);
lib/librte_mbuf_offload/Makefile new file +52 -0
52 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.c new file +100 -0
100 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h new file +289 -0
289 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload_version.map new file +7 -0
@@ -0,0 +1,7 @@ +DPDK_2.2 { + global: + + rte_pktmbuf_offload_pool_create; + + local: *; +};
mk/rte.app.mk +1 -0
@@ -112,6 +112,7 @@ ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) _LDLIBS-$(CONFIG_RTE_LIBRTE_KVARGS) += -lrte_kvargs _LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF) += -lrte_mbuf +_LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += -lrte_mbuf_offload _LDLIBS-$(CONFIG_RTE_LIBRTE_IP_FRAG) += -lrte_ip_frag _LDLIBS-$(CONFIG_RTE_LIBRTE_ETHER) += -lethdev _LDLIBS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += -lrte_cryptodev
Signature · 1 line
2.4.3
PATCH v2 3/6 qat_crypto_pmd: Addition of a new QAT DPDK PMD.
In reply to Declan DohertyThis patch adds a PMD for the Intel Quick Assist Technology DH895xxC hardware accelerator.
This patch depends on a QAT PF driver for device initialization. See the file docs/guides/cryptodevs/qat.rst for configuration details
This patch supports a limited subset of QAT device functionality, currently supporting chaining of cipher and hash operations for the following algorithmsd:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Some limitation on this patchset which shall be contributed in a subsequent release:
- Chained mbufs are not supported.
- Hash only is not supported.
- Cipher only is not supported.
- Only in-place is currently supported (destination address is the same as source address).
- Only supports session-oriented API implementation (session-less APIs are not supported).
--- config/common_bsdapp | 14 + config/common_linuxapp | 14 + doc/guides/cryptodevs/index.rst | 42 ++ doc/guides/cryptodevs/qat.rst | 188 +++++++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 37 ++ drivers/crypto/qat/Makefile | 63 +++ .../qat/qat_adf/adf_transport_access_macros.h | 173 ++++++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++++++++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++++++++++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++++++++++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 +++++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 578 +++++++++++++++++++++ drivers/crypto/qat/qat_crypto.c | 547 +++++++++++++++++++ drivers/crypto/qat/qat_crypto.h | 113 ++++ drivers/crypto/qat/qat_logs.h | 78 +++ drivers/crypto/qat/qat_qp.c | 416 +++++++++++++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 130 +++++ mk/rte.app.mk | 3 + 21 files changed, 3552 insertions(+) create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c
config/common_bsdapp +14 -0
@@ -155,6 +155,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +14 -0
@@ -153,6 +153,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=y +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/guides/cryptodevs/index.rst new file +42 -0
42 lines not on this page · raw message
doc/guides/cryptodevs/qat.rst new file +188 -0
188 lines not on this page · raw message
doc/guides/index.rst +1 -0
@@ -42,6 +42,7 @@ Contents: xen/index prog_guide/index nics/index + cryptodevs/index sample_app_ug/index testpmd_app_ug/index faq/index
drivers/Makefile +1 -0
@@ -32,5 +32,6 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-y += net +DIRS-y += crypto include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/Makefile new file +37 -0
@@ -0,0 +1,37 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +include $(RTE_SDK)/mk/rte.vars.mk + +DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat + +include $(RTE_SDK)/mk/rte.sharelib.mk +include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/qat/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/qat/qat_adf/adf_transport_access_macros.h new file +173 -0
173 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw.h new file +316 -0
316 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw_la.h new file +404 -0
404 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_hw.h new file +306 -0
306 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs.h new file +125 -0
125 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs_build_desc.c new file +578 -0
578 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.c new file +547 -0
547 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.h new file +113 -0
113 lines not on this page · raw message
drivers/crypto/qat/qat_logs.h new file +78 -0
55 lines not on this page · raw message
drivers/crypto/qat/qat_qp.c new file +416 -0
416 lines not on this page · raw message
drivers/crypto/qat/rte_pmd_qat_version.map new file +3 -0
Lines of this file are not shown. View the raw message.
drivers/crypto/qat/rte_qat_cryptodev.c new file +130 -0
130 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v2 4/6 aesni_mb_pmd: Initial implementation of multi buffer based crypto device
In reply to Declan DohertyThis patch provides the initial implementation of the AES-NI multi-buffer based crypto poll mode driver using DPDK's new cryptodev framework.
This PMD is dependent on Intel's multibuffer library, see the whitepaper "Fast Multi-buffer IPsec Implementations on Intel® Architecture Processors", see ref 1 for details on the library's design and ref 2 to download the library itself. This initial implementation is limited to supporting the chained operations of "hash then cipher" or "cipher then hash" for the following cipher and hash algorithms:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Important Note:
Due to the fact that the multi-buffer library is designed for accelerating IPsec crypto oepration, the digest's generated for the HMAC functions are truncated to lengths specified by IPsec RFC's, ie RFC2404 for using HMAC-SHA-1 with IPsec specifies that the digest is truncate from 20 to 12 bytes.
Build instructions:
To build DPKD with the AESNI_MB_PMD the user is required to download (ref 2) and compile the multi-buffer library on there user system before building DPDK. The environmental variable AESNI_MULTI_BUFFER_LIB_PATH must be exported with the path where you extracted and built the multi buffer library and finally set CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y in config/common_linuxapp.
Current status: It's doesn't support crypto operation across chained mbufs, or cipher only or hash only operations.
ref 2: https://downloadcenter.intel.com/download/22972
--- config/common_bsdapp | 7 + config/common_linuxapp | 6 + doc/guides/cryptodevs/aesni_mb.rst | 76 ++ doc/guides/cryptodevs/index.rst | 1 + drivers/crypto/Makefile | 1 + drivers/crypto/aesni_mb/Makefile | 67 ++ drivers/crypto/aesni_mb/aesni_mb_ops.h | 212 ++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 790 +++++++++++++++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 296 ++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 230 ++++++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + mk/rte.app.mk | 4 + 12 files changed, 1693 insertions(+) create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map
config/common_bsdapp +7 -0
@@ -168,6 +168,13 @@ CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n # CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_AESNI_MB_DEBUG=n + # # Support NIC bypass logic #
config/common_linuxapp +6 -0
@@ -166,6 +166,12 @@ CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n # CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_DEBUG=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_MAX_SESSIONS=2048 + # # Support NIC bypass logic #
doc/guides/cryptodevs/aesni_mb.rst new file +76 -0
76 lines not on this page · raw message
doc/guides/cryptodevs/index.rst +1 -0
@@ -39,4 +39,5 @@ Crypto Device Drivers :maxdepth: 2 :numbered: + aesni_mb qat
drivers/crypto/Makefile +1 -0
@@ -31,6 +31,7 @@ include $(RTE_SDK)/mk/rte.vars.mk +DIRS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += aesni_mb DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat include $(RTE_SDK)/mk/rte.sharelib.mk
drivers/crypto/aesni_mb/Makefile new file +67 -0
67 lines not on this page · raw message
drivers/crypto/aesni_mb/aesni_mb_ops.h new file +212 -0
212 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c new file +790 -0
790 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c new file +296 -0
296 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h new file +230 -0
230 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_pmd_aesni_version.map new file +3 -0
@@ -0,0 +1,3 @@ +DPDK_2.2 { + local: *; +};
mk/rte.app.mk +4 -0
@@ -148,6 +148,10 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_NULL) += -lrte_pmd_null # QAT PMD has a dependency on libcrypto (from openssl) for calculating HMAC precomputes _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += -lrte_pmd_qat -lcrypto +# AESNI MULTI BUFFER is dependent on the IPSec_MB library +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -lrte_pmd_aesni_mb +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -L$(AESNI_MULTI_BUFFER_LIB_PATH) -lIPSec_MB + endif # ! $(CONFIG_RTE_BUILD_SHARED_LIB) endif # ! CONFIG_RTE_BUILD_COMBINE_LIBS
Signature · 1 line
2.4.3
PATCH v2 5/6 app/test: add cryptodev unit and performance tests
In reply to Declan Dohertyunit tests are run by using cryptodev_qat_autotest or cryptodev_aesni_autotest from the test apps interactive console.
performance tests are run by using the cryptodev_qat_perftest or cryptodev_aesni_mb_perftest command from the test apps interactive console.
If you which to run the tests on a QAT device there must be one bound to igb_uio kernel driver.
--- app/test/Makefile | 3 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1924 ++++++++++++++++++++++++++++++++++++ app/test/test_cryptodev.h | 68 ++ app/test/test_cryptodev_perf.c | 1449 +++++++++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- 8 files changed, 3538 insertions(+), 45 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c
app/test/Makefile +3 -0
@@ -140,6 +140,9 @@ SRCS-$(CONFIG_RTE_LIBRTE_PMD_BOND) += test_link_bonding.c SRCS-$(CONFIG_RTE_LIBRTE_PMD_BOND) += test_link_bonding_mode4.c endif +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev_perf.c +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev.c + SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring.c SRCS-$(CONFIG_RTE_LIBRTE_KVARGS) += test_kvargs.c
app/test/test.c +61 -31
112 lines not on this page · raw message
app/test/test.h +27 -7
@@ -33,7 +33,7 @@#ifndef _TEST_H_#define _TEST_H_ - +#include <stddef.h> #include <sys/queue.h> #define TEST_SUCCESS (0)
@@ -64,6 +64,17 @@ } \ } while (0) + +#define TEST_ASSERT_BUFFERS_ARE_EQUAL (a, b, len, msg, ...) do { \ + if (memcmp(a, b, len)) { \ + printf("TestCase %s() line %d failed: " \ + msg "\n", __func__, __LINE__, ##__VA_ARGS__); \ + TEST_TRACE_FAILURE(__FILE__, __LINE__, __func__); \ + return TEST_FAILED; \ + } \ +} while (0) + +#define TEST_ASSERT_NOT_EQUAL (a, b, msg, ...) do { \ if (!(a != b)) { \ printf("TestCase %s() line %d failed: " \
@@ -113,27 +124,36 @@struct unit_test_case {int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );int (*testcase)(void );const char *success_msg;const char *fail_msg; +unsigned enabled; }; -#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed"} +#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed", 1 }#define TEST_CASE_NAMED (name, fn) { NULL, NULL, fn, name " succeeded", \ - name " failed"} + name " failed", 1 }#define TEST_CASE_ST (setup, teardown, testcase) \ { setup, teardown, testcase, #testcase " succeeded", \ - #testcase " failed "} + #testcase " failed ", 1 } + + +#define TEST_CASE_DISABLED (fn) { NULL, NULL, fn, #fn " succeeded", \ + #fn " failed", 0 } + +#define TEST_CASE_ST_DISABLED (setup, teardown, testcase) \ + { setup, teardown, testcase, #testcase " succeeded", \ + #testcase " failed ", 0 } -#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL } +#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL, 0 }struct unit_test_suite {const char *suite_name;int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );struct unit_test_case unit_test_cases[]; };
app/test/test_cryptodev.c new file +1924 -0
1,924 lines not on this page · raw message
app/test/test_cryptodev.h new file +68 -0
68 lines not on this page · raw message
app/test/test_cryptodev_perf.c new file +1449 -0
820 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v2 6/6 l2fwd-crypto: crypto
In reply to Declan DohertyThis patch creates a new sample applicaiton based off the l2fwd application which performs specified crypto operations on IP packet payloads which are forwarding.
--- examples/l2fwd-crypto/Makefile | 50 ++ examples/l2fwd-crypto/main.c | 1472 ++++++++++++++++++++++++++++++++++++++++ 2 files changed, 1522 insertions(+) create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c
examples/l2fwd-crypto/Makefile new file +50 -0
@@ -0,0 +1,50 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +ifeq ($(RTE_SDK),) +$(error "Please define RTE_SDK environment variable") +endif + +# Default target, can be overridden by command line or environment +RTE_TARGET ?= x86_64-native-linuxapp-gcc + +include $(RTE_SDK)/mk/rte.vars.mk + +# binary name +APP = l2fwd-crypto + +# all source are stored in SRCS-y +SRCS-y := main.c + +CFLAGS += -O3 +CFLAGS += $(WERROR_FLAGS) + +include $(RTE_SDK)/mk/rte.extapp.mk
examples/l2fwd-crypto/main.c new file +1472 -0
1,472 lines not on this page · raw message
Signature · 1 line
2.4.3
v3 cover Crypto API and device framework
In reply to Declan DohertyThis series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.
The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwarded
Current Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.
v3:
- Fixes a document build error, which I missed in the V2
- Fixes for remaining checkpatch errors
- Disables QAT and AESNI_MB PMD being build by default as they have external library dependences
v2:
- Introduces a new library to support attaching offload operations to a mbuf
- Remove unused APIs from cryptodev
- PMD code refactor due to new rte_mbuf_offload structure
- General bug fixes and code tidy up
Declan Doherty (6):
cryptodev: Initial DPDK Crypto APIs and device framework release
mbuf_offload: library to support attaching offloads to a mbuf
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
app/test/Makefile | 3 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1968 ++++++++++++++++++++ app/test/test_cryptodev.h | 68 + app/test/test_cryptodev_perf.c | 1449 ++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- config/common_bsdapp | 37 +- config/common_linuxapp | 36 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + doc/guides/cryptodevs/aesni_mb.rst | 76 + doc/guides/cryptodevs/index.rst | 43 + doc/guides/cryptodevs/qat.rst | 195 ++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 38 + drivers/crypto/aesni_mb/Makefile | 67 + drivers/crypto/aesni_mb/aesni_mb_ops.h | 212 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 790 ++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 296 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 230 +++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + drivers/crypto/qat/Makefile | 63 + .../qat/qat_adf/adf_transport_access_macros.h | 174 ++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 ++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 ++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 597 ++++++ drivers/crypto/qat/qat_crypto.c | 559 ++++++ drivers/crypto/qat/qat_crypto.h | 117 ++ drivers/crypto/qat/qat_logs.h | 78 + drivers/crypto/qat/qat_qp.c | 429 +++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 130 ++ examples/l2fwd-crypto/Makefile | 50 + examples/l2fwd-crypto/main.c | 1472 +++++++++++++++ lib/Makefile | 2 + lib/librte_cryptodev/Makefile | 60 + lib/librte_cryptodev/rte_crypto.h | 610 ++++++ lib/librte_cryptodev/rte_cryptodev.c | 1077 +++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 647 +++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 543 ++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.h | 33 + lib/librte_mbuf_offload/Makefile | 52 + lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 + lib/librte_mbuf_offload/rte_mbuf_offload.h | 282 +++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 9 + 57 files changed, 13935 insertions(+), 79 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
Signature · 1 line
2.4.3
PATCH v3 1/6 cryptodev: Initial DPDK Crypto APIs and device framework release
This patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
changes from RFC:
- Session management API changes to support specification of crypto transform(xform) chains using linked list of xforms.
- Changes to the crypto operation struct as a result of session management changes.
- Some movement of common MACROS shared by cryptodevs and ethdevs to common headers
--- config/common_bsdapp | 10 +- config/common_linuxapp | 10 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + lib/Makefile | 1 + lib/librte_cryptodev/Makefile | 60 ++ lib/librte_cryptodev/rte_crypto.h | 610 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev.c | 1077 ++++++++++++++++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 647 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 543 ++++++++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.h | 27 + mk/rte.app.mk | 1 + 18 files changed, 3069 insertions(+), 34 deletions(-) create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map
config/common_bsdapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -147,6 +147,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -145,6 +145,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/api/doxy-api-index.md +1 -0
@@ -39,6 +39,7 @@ There are many libraries, so their headers may be grouped by topics: [dev] (@ref rte_dev.h), [ethdev] (@ref rte_ethdev.h), [ethctrl] (@ref rte_eth_ctrl.h), + [cryptodev] (@ref rte_cryptodev.h), [devargs] (@ref rte_devargs.h), [bond] (@ref rte_eth_bond.h), [vhost] (@ref rte_virtio_net.h),
doc/api/doxy-api.conf +1 -0
@@ -37,6 +37,7 @@ INPUT = doc/api/doxy-api-index.md \ lib/librte_cfgfile \ lib/librte_cmdline \ lib/librte_compat \ + lib/librte_cryptodev \ lib/librte_distributor \ lib/librte_ether \ lib/librte_hash \
lib/Makefile +1 -0
@@ -40,6 +40,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline DIRS-$(CONFIG_RTE_LIBRTE_ETHER) += librte_ether +DIRS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += librte_cryptodev DIRS-$(CONFIG_RTE_LIBRTE_VHOST) += librte_vhost DIRS-$(CONFIG_RTE_LIBRTE_HASH) += librte_hash DIRS-$(CONFIG_RTE_LIBRTE_LPM) += librte_lpm
lib/librte_cryptodev/Makefile new file +60 -0
61 lines not on this page · raw message
lib/librte_cryptodev/rte_crypto.h new file +610 -0
610 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.c new file +1077 -0
1,077 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.h new file +647 -0
647 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_pmd.h new file +543 -0
542 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_version.map new file +41 -0
41 lines not on this page · raw message
lib/librte_eal/common/include/rte_common.h +15 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_eal.h +14 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_log.h +1 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_memory.h +12 -2
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v3 2/6 mbuf_offload: library to support attaching offloads to a mbuf
In reply to Declan DohertyThis library add support for adding a chain of offload operations to a mbuf. It contains the definition of the rte_mbuf_offload structure as well as helper functions for attaching offloads to mbufs and a mempool management functions.
This initial implementation supports attaching multiple offload operations to a single mbuf, but only a single offload operation of a specific type can be attach to that mbuf.
--- config/common_bsdapp | 6 + config/common_linuxapp | 6 + lib/Makefile | 1 + lib/librte_mbuf/rte_mbuf.h | 6 + lib/librte_mbuf_offload/Makefile | 52 ++++ lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 +++++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 289 +++++++++++++++++++++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 1 + 9 files changed, 468 insertions(+) create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
config/common_bsdapp +6 -0
@@ -320,6 +320,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
config/common_linuxapp +6 -0
@@ -328,6 +328,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
lib/Makefile +1 -0
@@ -36,6 +36,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_EAL) += librte_eal DIRS-$(CONFIG_RTE_LIBRTE_RING) += librte_ring DIRS-$(CONFIG_RTE_LIBRTE_MEMPOOL) += librte_mempool DIRS-$(CONFIG_RTE_LIBRTE_MBUF) += librte_mbuf +DIRS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += librte_mbuf_offload DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline
lib/librte_mbuf/rte_mbuf.h +6 -0
@@ -728,6 +728,9 @@ typedef uint8_t MARKER8[0]; /**< generic marker with 1B alignment */typedef uint64_t MARKER64 [0 ];/**< marker that allows us to overwrite 8 bytes * with a single assignment */ +/** Opaque rte_mbuf_offload structure declarations */ +struct rte_mbuf_offload ; +/** * The generic rte_mbuf, containing a packet mbuf. */
@@ -841,6 +844,9 @@ struct rte_mbuf {/** Timesync flags for use with IEEE1588. */ uint16_t timesync; + +/* Chain of off-load operations to perform on mbuf */ +struct rte_mbuf_offload *offload_ops; } __rte_cache_aligned;static inline uint16_t rte_pktmbuf_priv_size (struct rte_mempool *mp);
lib/librte_mbuf_offload/Makefile new file +52 -0
52 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.c new file +100 -0
100 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h new file +289 -0
289 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload_version.map new file +7 -0
@@ -0,0 +1,7 @@ +DPDK_2.2 { + global: + + rte_pktmbuf_offload_pool_create; + + local: *; +};
mk/rte.app.mk +1 -0
@@ -112,6 +112,7 @@ ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) _LDLIBS-$(CONFIG_RTE_LIBRTE_KVARGS) += -lrte_kvargs _LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF) += -lrte_mbuf +_LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += -lrte_mbuf_offload _LDLIBS-$(CONFIG_RTE_LIBRTE_IP_FRAG) += -lrte_ip_frag _LDLIBS-$(CONFIG_RTE_LIBRTE_ETHER) += -lethdev _LDLIBS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += -lrte_cryptodev
Signature · 1 line
2.4.3
Re: [PATCH v3 2/6] mbuf_offload: library to support attaching offloads to a mbuf
Quoted 12 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Declan Doherty
Sent: Friday, October 30, 2015 4:09 PM
To: [email protected]
Subject: [dpdk-dev] [PATCH v3 2/6]mbuf_offload: library to support attaching offloads to a mbufThis library add support for adding a chain of offload operations to a mbuf. It contains the definition of the
rte_mbuf_offloadstructure as well as helper functions for attaching offloads to mbufs and a mempool management functions.
Quoted 6 lines
This initial implementation supports attaching multiple offload operations to a single mbuf, but only a single offload operation of a specific type can be attach to that mbuf.
Signed-off-by Declan Doherty <[email protected]>---
PATCH v3 3/6 qat_crypto_pmd: Addition of a new QAT DPDK PMD.
In reply to Declan DohertyThis patch adds a PMD for the Intel Quick Assist Technology DH895xxC hardware accelerator.
This patch depends on a QAT PF driver for device initialization. See the file docs/guides/cryptodevs/qat.rst for configuration details
This patch supports a limited subset of QAT device functionality, currently supporting chaining of cipher and hash operations for the following algorithmsd:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Some limitation on this patchset which shall be contributed in a subsequent release:
- Chained mbufs are not supported.
- Hash only is not supported.
- Cipher only is not supported.
- Only in-place is currently supported (destination address is the same as source address).
- Only supports session-oriented API implementation (session-less APIs are not supported).
--- config/common_bsdapp | 14 + config/common_linuxapp | 14 + doc/guides/cryptodevs/index.rst | 42 ++ doc/guides/cryptodevs/qat.rst | 195 +++++++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 37 ++ drivers/crypto/qat/Makefile | 63 +++ .../qat/qat_adf/adf_transport_access_macros.h | 174 ++++++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++++++++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++++++++++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++++++++++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 +++++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 597 +++++++++++++++++++++ drivers/crypto/qat/qat_crypto.c | 559 +++++++++++++++++++ drivers/crypto/qat/qat_crypto.h | 117 ++++ drivers/crypto/qat/qat_logs.h | 78 +++ drivers/crypto/qat/qat_qp.c | 429 +++++++++++++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 130 +++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 9 +- mk/rte.app.mk | 3 + 22 files changed, 3609 insertions(+), 8 deletions(-) create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c
config/common_bsdapp +14 -0
@@ -155,6 +155,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +14 -0
@@ -153,6 +153,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/guides/cryptodevs/index.rst new file +42 -0
42 lines not on this page · raw message
doc/guides/cryptodevs/qat.rst new file +195 -0
195 lines not on this page · raw message
doc/guides/index.rst +1 -0
@@ -42,6 +42,7 @@ Contents: xen/index prog_guide/index nics/index + cryptodevs/index sample_app_ug/index testpmd_app_ug/index faq/index
drivers/Makefile +1 -0
@@ -32,5 +32,6 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-y += net +DIRS-y += crypto include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/Makefile new file +37 -0
@@ -0,0 +1,37 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +include $(RTE_SDK)/mk/rte.vars.mk + +DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat + +include $(RTE_SDK)/mk/rte.sharelib.mk +include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/qat/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/qat/qat_adf/adf_transport_access_macros.h new file +174 -0
174 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw.h new file +316 -0
316 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw_la.h new file +404 -0
404 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_hw.h new file +306 -0
306 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs.h new file +125 -0
125 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs_build_desc.c new file +597 -0
597 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.c new file +559 -0
559 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.h new file +117 -0
117 lines not on this page · raw message
drivers/crypto/qat/qat_logs.h new file +78 -0
12 lines not on this page · raw message
drivers/crypto/qat/qat_qp.c new file +429 -0
429 lines not on this page · raw message
drivers/crypto/qat/rte_pmd_qat_version.map new file +3 -0
Lines of this file are not shown. View the raw message.
drivers/crypto/qat/rte_qat_cryptodev.c new file +130 -0
130 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h +1 -8
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v3 4/6 aesni_mb_pmd: Initial implementation of multi buffer based crypto device
In reply to Declan DohertyThis patch provides the initial implementation of the AES-NI multi-buffer based crypto poll mode driver using DPDK's new cryptodev framework.
This PMD is dependent on Intel's multibuffer library, see the whitepaper "Fast Multi-buffer IPsec Implementations on Intel® Architecture Processors", see ref 1 for details on the library's design and ref 2 to download the library itself. This initial implementation is limited to supporting the chained operations of "hash then cipher" or "cipher then hash" for the following cipher and hash algorithms:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Important Note:
Due to the fact that the multi-buffer library is designed for accelerating IPsec crypto oepration, the digest's generated for the HMAC functions are truncated to lengths specified by IPsec RFC's, ie RFC2404 for using HMAC-SHA-1 with IPsec specifies that the digest is truncate from 20 to 12 bytes.
Build instructions:
To build DPKD with the AESNI_MB_PMD the user is required to download (ref 2) and compile the multi-buffer library on there user system before building DPDK. The environmental variable AESNI_MULTI_BUFFER_LIB_PATH must be exported with the path where you extracted and built the multi buffer library and finally set CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y in config/common_linuxapp.
Current status: It's doesn't support crypto operation across chained mbufs, or cipher only or hash only operations.
ref 2: https://downloadcenter.intel.com/download/22972
--- config/common_bsdapp | 7 + config/common_linuxapp | 6 + doc/guides/cryptodevs/aesni_mb.rst | 76 ++ doc/guides/cryptodevs/index.rst | 1 + drivers/crypto/Makefile | 1 + drivers/crypto/aesni_mb/Makefile | 67 ++ drivers/crypto/aesni_mb/aesni_mb_ops.h | 212 ++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 790 +++++++++++++++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 296 ++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 230 ++++++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + mk/rte.app.mk | 4 + 12 files changed, 1693 insertions(+) create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map
config/common_bsdapp +7 -0
@@ -168,6 +168,13 @@ CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n # CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_AESNI_MB_DEBUG=n + # # Support NIC bypass logic #
config/common_linuxapp +6 -0
@@ -166,6 +166,12 @@ CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n # CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_DEBUG=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_MAX_SESSIONS=2048 + # # Support NIC bypass logic #
doc/guides/cryptodevs/aesni_mb.rst new file +76 -0
76 lines not on this page · raw message
doc/guides/cryptodevs/index.rst +1 -0
@@ -39,4 +39,5 @@ Crypto Device Drivers :maxdepth: 2 :numbered: + aesni_mb qat
drivers/crypto/Makefile +1 -0
@@ -31,6 +31,7 @@ include $(RTE_SDK)/mk/rte.vars.mk +DIRS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += aesni_mb DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat include $(RTE_SDK)/mk/rte.sharelib.mk
drivers/crypto/aesni_mb/Makefile new file +67 -0
67 lines not on this page · raw message
drivers/crypto/aesni_mb/aesni_mb_ops.h new file +212 -0
212 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c new file +790 -0
790 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c new file +296 -0
296 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h new file +230 -0
230 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_pmd_aesni_version.map new file +3 -0
@@ -0,0 +1,3 @@ +DPDK_2.2 { + local: *; +};
mk/rte.app.mk +4 -0
@@ -148,6 +148,10 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_NULL) += -lrte_pmd_null # QAT PMD has a dependency on libcrypto (from openssl) for calculating HMAC precomputes _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += -lrte_pmd_qat -lcrypto +# AESNI MULTI BUFFER is dependent on the IPSec_MB library +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -lrte_pmd_aesni_mb +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -L$(AESNI_MULTI_BUFFER_LIB_PATH) -lIPSec_MB + endif # ! $(CONFIG_RTE_BUILD_SHARED_LIB) endif # ! CONFIG_RTE_BUILD_COMBINE_LIBS
Signature · 1 line
2.4.3
PATCH v3 5/6 app/test: add cryptodev unit and performance tests
In reply to Declan Dohertyunit tests are run by using cryptodev_qat_autotest or cryptodev_aesni_autotest from the test apps interactive console.
performance tests are run by using the cryptodev_qat_perftest or cryptodev_aesni_mb_perftest command from the test apps interactive console.
If you which to run the tests on a QAT device there must be one bound to igb_uio kernel driver.
--- app/test/Makefile | 3 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1968 ++++++++++++++++++++++++++++++++++++ app/test/test_cryptodev.h | 68 ++ app/test/test_cryptodev_perf.c | 1449 ++++++++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- 8 files changed, 3582 insertions(+), 45 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c
app/test/Makefile +3 -0
@@ -140,6 +140,9 @@ SRCS-$(CONFIG_RTE_LIBRTE_PMD_BOND) += test_link_bonding.c SRCS-$(CONFIG_RTE_LIBRTE_PMD_BOND) += test_link_bonding_mode4.c endif +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev_perf.c +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev.c + SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring.c SRCS-$(CONFIG_RTE_LIBRTE_KVARGS) += test_kvargs.c
app/test/test.c +61 -31
112 lines not on this page · raw message
app/test/test.h +27 -7
@@ -33,7 +33,7 @@#ifndef _TEST_H_#define _TEST_H_ - +#include <stddef.h> #include <sys/queue.h> #define TEST_SUCCESS (0)
@@ -64,6 +64,17 @@ } \ } while (0) + +#define TEST_ASSERT_BUFFERS_ARE_EQUAL (a, b, len, msg, ...) do { \ + if (memcmp(a, b, len)) { \ + printf("TestCase %s() line %d failed: " \ + msg "\n", __func__, __LINE__, ##__VA_ARGS__); \ + TEST_TRACE_FAILURE(__FILE__, __LINE__, __func__); \ + return TEST_FAILED; \ + } \ +} while (0) + +#define TEST_ASSERT_NOT_EQUAL (a, b, msg, ...) do { \ if (!(a != b)) { \ printf("TestCase %s() line %d failed: " \
@@ -113,27 +124,36 @@struct unit_test_case {int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );int (*testcase)(void );const char *success_msg;const char *fail_msg; +unsigned enabled; }; -#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed"} +#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed", 1 }#define TEST_CASE_NAMED (name, fn) { NULL, NULL, fn, name " succeeded", \ - name " failed"} + name " failed", 1 }#define TEST_CASE_ST (setup, teardown, testcase) \ { setup, teardown, testcase, #testcase " succeeded", \ - #testcase " failed "} + #testcase " failed ", 1 } + + +#define TEST_CASE_DISABLED (fn) { NULL, NULL, fn, #fn " succeeded", \ + #fn " failed", 0 } + +#define TEST_CASE_ST_DISABLED (setup, teardown, testcase) \ + { setup, teardown, testcase, #testcase " succeeded", \ + #testcase " failed ", 0 } -#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL } +#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL, 0 }struct unit_test_suite {const char *suite_name;int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );struct unit_test_case unit_test_cases[]; };
app/test/test_cryptodev.c new file +1968 -0
1,968 lines not on this page · raw message
app/test/test_cryptodev.h new file +68 -0
68 lines not on this page · raw message
app/test/test_cryptodev_perf.c new file +1449 -0
776 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v3 6/6 l2fwd-crypto: crypto
In reply to Declan DohertyThis patch creates a new sample applicaiton based off the l2fwd application which performs specified crypto operations on IP packet payloads which are forwarding.
--- examples/l2fwd-crypto/Makefile | 50 ++ examples/l2fwd-crypto/main.c | 1472 ++++++++++++++++++++++++++++++++++++++++ 2 files changed, 1522 insertions(+) create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c
examples/l2fwd-crypto/Makefile new file +50 -0
@@ -0,0 +1,50 @@ +# BSD LICENSE +# +# Copyright(c) 2015 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +ifeq ($(RTE_SDK),) +$(error "Please define RTE_SDK environment variable") +endif + +# Default target, can be overridden by command line or environment +RTE_TARGET ?= x86_64-native-linuxapp-gcc + +include $(RTE_SDK)/mk/rte.vars.mk + +# binary name +APP = l2fwd-crypto + +# all source are stored in SRCS-y +SRCS-y := main.c + +CFLAGS += -O3 +CFLAGS += $(WERROR_FLAGS) + +include $(RTE_SDK)/mk/rte.extapp.mk
examples/l2fwd-crypto/main.c new file +1472 -0
1,472 lines not on this page · raw message
Signature · 1 line
2.4.3
v4 cover Crypto API and device framework
In reply to Declan DohertyThis series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.
The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwarded
Current Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.
v4:
- Some more EOF whitespace and checkpatch fixes
v3:
- Fixes a document build error, which I missed in the V2
- Fixes for remaining checkpatch errors
- Disables QAT and AESNI_MB PMD being build by default as they have external library dependences
v2:
- Introduces a new library to support attaching offload operations to a mbuf
- Remove unused APIs from cryptodev
- PMD code refactor due to new rte_mbuf_offload structure
- General bug fixes and code tidy up
Declan Doherty (6):
cryptodev: Initial DPDK Crypto APIs and device framework release
mbuf_offload: library to support attaching offloads to a mbuf
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
app/test/Makefile | 4 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1975 +++++++++++++++++++ app/test/test_cryptodev.h | 68 + app/test/test_cryptodev_perf.c | 2063 ++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- config/common_bsdapp | 37 +- config/common_linuxapp | 36 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + doc/guides/cryptodevs/aesni_mb.rst | 76 + doc/guides/cryptodevs/index.rst | 43 + doc/guides/cryptodevs/qat.rst | 194 ++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 38 + drivers/crypto/aesni_mb/Makefile | 63 + drivers/crypto/aesni_mb/aesni_mb_ops.h | 212 ++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 798 ++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 297 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 232 +++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + drivers/crypto/qat/Makefile | 63 + .../qat/qat_adf/adf_transport_access_macros.h | 174 ++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 ++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 601 ++++++ drivers/crypto/qat/qat_crypto.c | 557 ++++++ drivers/crypto/qat/qat_crypto.h | 119 ++ drivers/crypto/qat/qat_logs.h | 78 + drivers/crypto/qat/qat_qp.c | 429 ++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 131 ++ examples/l2fwd-crypto/Makefile | 50 + examples/l2fwd-crypto/main.c | 1473 ++++++++++++++ lib/Makefile | 2 + lib/librte_cryptodev/Makefile | 60 + lib/librte_cryptodev/rte_crypto.h | 613 ++++++ lib/librte_cryptodev/rte_cryptodev.c | 1092 +++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 647 ++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 543 ++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.h | 33 + lib/librte_mbuf_offload/Makefile | 52 + lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 + lib/librte_mbuf_offload/rte_mbuf_offload.h | 284 +++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 9 + 57 files changed, 14589 insertions(+), 79 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
Signature · 1 line
2.4.3
PATCH v4 1/6 cryptodev: Initial DPDK Crypto APIs and device framework release
This patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
changes from RFC:
- Session management API changes to support specification of crypto transform(xform) chains using linked list of xforms.
- Changes to the crypto operation struct as a result of session management changes.
- Some movement of common MACROS shared by cryptodevs and ethdevs to common headers
--- config/common_bsdapp | 10 +- config/common_linuxapp | 10 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + lib/Makefile | 1 + lib/librte_cryptodev/Makefile | 60 ++ lib/librte_cryptodev/rte_crypto.h | 613 +++++++++++++ lib/librte_cryptodev/rte_cryptodev.c | 1092 ++++++++++++++++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 647 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 543 ++++++++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_common.h | 15 + lib/librte_eal/common/include/rte_eal.h | 14 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 30 - lib/librte_mbuf/rte_mbuf.h | 27 + mk/rte.app.mk | 1 + 18 files changed, 3087 insertions(+), 34 deletions(-) create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map
config/common_bsdapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -147,6 +147,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -145,6 +145,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/api/doxy-api-index.md +1 -0
@@ -39,6 +39,7 @@ There are many libraries, so their headers may be grouped by topics: [dev] (@ref rte_dev.h), [ethdev] (@ref rte_ethdev.h), [ethctrl] (@ref rte_eth_ctrl.h), + [cryptodev] (@ref rte_cryptodev.h), [devargs] (@ref rte_devargs.h), [bond] (@ref rte_eth_bond.h), [vhost] (@ref rte_virtio_net.h),
doc/api/doxy-api.conf +1 -0
@@ -37,6 +37,7 @@ INPUT = doc/api/doxy-api-index.md \ lib/librte_cfgfile \ lib/librte_cmdline \ lib/librte_compat \ + lib/librte_cryptodev \ lib/librte_distributor \ lib/librte_ether \ lib/librte_hash \
lib/Makefile +1 -0
@@ -40,6 +40,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline DIRS-$(CONFIG_RTE_LIBRTE_ETHER) += librte_ether +DIRS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += librte_cryptodev DIRS-$(CONFIG_RTE_LIBRTE_VHOST) += librte_vhost DIRS-$(CONFIG_RTE_LIBRTE_HASH) += librte_hash DIRS-$(CONFIG_RTE_LIBRTE_LPM) += librte_lpm
lib/librte_cryptodev/Makefile new file +60 -0
61 lines not on this page · raw message
lib/librte_cryptodev/rte_crypto.h new file +613 -0
613 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.c new file +1092 -0
1,092 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.h new file +647 -0
647 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_pmd.h new file +543 -0
524 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_version.map new file +41 -0
41 lines not on this page · raw message
lib/librte_eal/common/include/rte_common.h +15 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_eal.h +14 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_log.h +1 -0
Lines of this file are not shown. View the raw message.
lib/librte_eal/common/include/rte_memory.h +12 -2
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v4 2/6 mbuf_offload: library to support attaching offloads to a mbuf
In reply to Declan DohertyThis library add support for adding a chain of offload operations to a mbuf. It contains the definition of the rte_mbuf_offload structure as well as helper functions for attaching offloads to mbufs and a mempool management functions.
This initial implementation supports attaching multiple offload operations to a single mbuf, but only a single offload operation of a specific type can be attach to that mbuf.
--- config/common_bsdapp | 6 + config/common_linuxapp | 6 + lib/Makefile | 1 + lib/librte_mbuf/rte_mbuf.h | 6 + lib/librte_mbuf_offload/Makefile | 52 ++++ lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 +++++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 291 +++++++++++++++++++++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 1 + 9 files changed, 470 insertions(+) create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
config/common_bsdapp +6 -0
@@ -331,6 +331,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
config/common_linuxapp +6 -0
@@ -339,6 +339,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
lib/Makefile +1 -0
@@ -36,6 +36,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_EAL) += librte_eal DIRS-$(CONFIG_RTE_LIBRTE_RING) += librte_ring DIRS-$(CONFIG_RTE_LIBRTE_MEMPOOL) += librte_mempool DIRS-$(CONFIG_RTE_LIBRTE_MBUF) += librte_mbuf +DIRS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += librte_mbuf_offload DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline
lib/librte_mbuf/rte_mbuf.h +6 -0
@@ -728,6 +728,9 @@ typedef uint8_t MARKER8[0]; /**< generic marker with 1B alignment */typedef uint64_t MARKER64 [0 ];/**< marker that allows us to overwrite 8 bytes * with a single assignment */ +/** Opaque rte_mbuf_offload structure declarations */ +struct rte_mbuf_offload ; +/** * The generic rte_mbuf, containing a packet mbuf. */
@@ -841,6 +844,9 @@ struct rte_mbuf {/** Timesync flags for use with IEEE1588. */ uint16_t timesync; + +/* Chain of off-load operations to perform on mbuf */ +struct rte_mbuf_offload *offload_ops; } __rte_cache_aligned;static inline uint16_t rte_pktmbuf_priv_size (struct rte_mempool *mp);
lib/librte_mbuf_offload/Makefile new file +52 -0
52 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.c new file +100 -0
100 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h new file +291 -0
291 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload_version.map new file +7 -0
@@ -0,0 +1,7 @@ +DPDK_2.2 { + global: + + rte_pktmbuf_offload_pool_create; + + local: *; +};
mk/rte.app.mk +1 -0
@@ -116,6 +116,7 @@ ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) _LDLIBS-$(CONFIG_RTE_LIBRTE_KVARGS) += -lrte_kvargs _LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF) += -lrte_mbuf +_LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += -lrte_mbuf_offload _LDLIBS-$(CONFIG_RTE_LIBRTE_IP_FRAG) += -lrte_ip_frag _LDLIBS-$(CONFIG_RTE_LIBRTE_ETHER) += -lethdev _LDLIBS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += -lrte_cryptodev
Signature · 1 line
2.4.3
PATCH v4 3/6 qat_crypto_pmd: Addition of a new QAT DPDK PMD.
In reply to Declan DohertyThis patch adds a PMD for the Intel Quick Assist Technology DH895xxC hardware accelerator.
This patch depends on a QAT PF driver for device initialization. See the file docs/guides/cryptodevs/qat.rst for configuration details
This patch supports a limited subset of QAT device functionality, currently supporting chaining of cipher and hash operations for the following algorithmsd:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Some limitation on this patchset which shall be contributed in a subsequent release:
- Chained mbufs are not supported.
- Hash only is not supported.
- Cipher only is not supported.
- Only in-place is currently supported (destination address is the same as source address).
- Only supports session-oriented API implementation (session-less APIs are not supported).
--- config/common_bsdapp | 14 + config/common_linuxapp | 14 + doc/guides/cryptodevs/index.rst | 42 ++ doc/guides/cryptodevs/qat.rst | 194 +++++++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 37 ++ drivers/crypto/qat/Makefile | 63 +++ .../qat/qat_adf/adf_transport_access_macros.h | 174 ++++++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++++++++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++++++++++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++++++++++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 +++++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 601 +++++++++++++++++++++ drivers/crypto/qat/qat_crypto.c | 557 +++++++++++++++++++ drivers/crypto/qat/qat_crypto.h | 119 ++++ drivers/crypto/qat/qat_logs.h | 78 +++ drivers/crypto/qat/qat_qp.c | 429 +++++++++++++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 131 +++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 9 +- mk/rte.app.mk | 3 + 22 files changed, 3613 insertions(+), 8 deletions(-) create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c
config/common_bsdapp +14 -0
@@ -155,6 +155,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +14 -0
@@ -153,6 +153,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/guides/cryptodevs/index.rst new file +42 -0
42 lines not on this page · raw message
doc/guides/cryptodevs/qat.rst new file +194 -0
194 lines not on this page · raw message
doc/guides/index.rst +1 -0
@@ -42,6 +42,7 @@ Contents: xen/index prog_guide/index nics/index + cryptodevs/index sample_app_ug/index testpmd_app_ug/index faq/index
drivers/Makefile +1 -0
@@ -32,5 +32,6 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-y += net +DIRS-y += crypto include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/Makefile new file +37 -0
@@ -0,0 +1,37 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +include $(RTE_SDK)/mk/rte.vars.mk + +DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat + +include $(RTE_SDK)/mk/rte.sharelib.mk +include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/qat/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/qat/qat_adf/adf_transport_access_macros.h new file +174 -0
174 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw.h new file +316 -0
316 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw_la.h new file +404 -0
404 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_hw.h new file +306 -0
306 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs.h new file +125 -0
125 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs_build_desc.c new file +601 -0
601 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.c new file +557 -0
557 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.h new file +119 -0
119 lines not on this page · raw message
drivers/crypto/qat/qat_logs.h new file +78 -0
8 lines not on this page · raw message
drivers/crypto/qat/qat_qp.c new file +429 -0
429 lines not on this page · raw message
drivers/crypto/qat/rte_pmd_qat_version.map new file +3 -0
Lines of this file are not shown. View the raw message.
drivers/crypto/qat/rte_qat_cryptodev.c new file +131 -0
131 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h +1 -8
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v4 4/6 aesni_mb_pmd: Initial implementation of multi buffer based crypto device
In reply to Declan DohertyThis patch provides the initial implementation of the AES-NI multi-buffer based crypto poll mode driver using DPDK's new cryptodev framework.
This PMD is dependent on Intel's multibuffer library, see the whitepaper "Fast Multi-buffer IPsec Implementations on Intel® Architecture Processors", see ref 1 for details on the library's design and ref 2 to download the library itself. This initial implementation is limited to supporting the chained operations of "hash then cipher" or "cipher then hash" for the following cipher and hash algorithms:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Important Note:
Due to the fact that the multi-buffer library is designed for accelerating IPsec crypto oepration, the digest's generated for the HMAC functions are truncated to lengths specified by IPsec RFC's, ie RFC2404 for using HMAC-SHA-1 with IPsec specifies that the digest is truncate from 20 to 12 bytes.
Build instructions:
To build DPKD with the AESNI_MB_PMD the user is required to download (ref 2) and compile the multi-buffer library on there user system before building DPDK. The environmental variable AESNI_MULTI_BUFFER_LIB_PATH must be exported with the path where you extracted and built the multi buffer library and finally set CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y in config/common_linuxapp.
Current status: It's doesn't support crypto operation across chained mbufs, or cipher only or hash only operations.
ref 2: https://downloadcenter.intel.com/download/22972
--- config/common_bsdapp | 7 + config/common_linuxapp | 6 + doc/guides/cryptodevs/aesni_mb.rst | 76 ++ doc/guides/cryptodevs/index.rst | 1 + drivers/crypto/Makefile | 1 + drivers/crypto/aesni_mb/Makefile | 63 ++ drivers/crypto/aesni_mb/aesni_mb_ops.h | 212 ++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 798 +++++++++++++++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 297 ++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 232 ++++++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + mk/rte.app.mk | 4 + 12 files changed, 1700 insertions(+) create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map
config/common_bsdapp +7 -0
@@ -168,6 +168,13 @@ CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n # CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_AESNI_MB_DEBUG=n + # # Support NIC bypass logic #
config/common_linuxapp +6 -0
@@ -166,6 +166,12 @@ CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n # CONFIG_RTE_LIBRTE_PMD_QAT_MAX_SESSIONS=2048 +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_DEBUG=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_MAX_SESSIONS=2048 + # # Support NIC bypass logic #
doc/guides/cryptodevs/aesni_mb.rst new file +76 -0
76 lines not on this page · raw message
doc/guides/cryptodevs/index.rst +1 -0
@@ -39,4 +39,5 @@ Crypto Device Drivers :maxdepth: 2 :numbered: + aesni_mb qat
drivers/crypto/Makefile +1 -0
@@ -31,6 +31,7 @@ include $(RTE_SDK)/mk/rte.vars.mk +DIRS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += aesni_mb DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat include $(RTE_SDK)/mk/rte.sharelib.mk
drivers/crypto/aesni_mb/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/aesni_mb/aesni_mb_ops.h new file +212 -0
212 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c new file +798 -0
798 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c new file +297 -0
297 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h new file +232 -0
232 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_pmd_aesni_version.map new file +3 -0
@@ -0,0 +1,3 @@ +DPDK_2.2 { + local: *; +};
mk/rte.app.mk +4 -0
@@ -153,6 +153,10 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_NULL) += -lrte_pmd_null # QAT PMD has a dependency on libcrypto (from openssl) for calculating HMAC precomputes _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += -lrte_pmd_qat -lcrypto +# AESNI MULTI BUFFER is dependent on the IPSec_MB library +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -lrte_pmd_aesni_mb +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -L$(AESNI_MULTI_BUFFER_LIB_PATH) -lIPSec_MB + endif # ! $(CONFIG_RTE_BUILD_SHARED_LIB) endif # ! CONFIG_RTE_BUILD_COMBINE_LIBS
Signature · 1 line
2.4.3
PATCH v4 5/6 app/test: add cryptodev unit and performance tests
In reply to Declan Dohertyunit tests are run by using cryptodev_qat_autotest or cryptodev_aesni_autotest from the test apps interactive console.
performance tests are run by using the cryptodev_qat_perftest or cryptodev_aesni_mb_perftest command from the test apps interactive console.
If you which to run the tests on a QAT device there must be one bound to igb_uio kernel driver.
--- app/test/Makefile | 4 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1975 ++++++++++++++++++++++++++++++++++ app/test/test_cryptodev.h | 68 ++ app/test/test_cryptodev_perf.c | 2063 ++++++++++++++++++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- 8 files changed, 4204 insertions(+), 45 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c
app/test/Makefile +4 -0
@@ -149,6 +149,10 @@ endif SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring.c SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring_perf.c + +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev_perf.c +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev.c + SRCS-$(CONFIG_RTE_LIBRTE_KVARGS) += test_kvargs.c CFLAGS += -O3
app/test/test.c +61 -31
112 lines not on this page · raw message
app/test/test.h +27 -7
@@ -33,7 +33,7 @@#ifndef _TEST_H_#define _TEST_H_ - +#include <stddef.h> #include <sys/queue.h> #define TEST_SUCCESS (0)
@@ -64,6 +64,17 @@ } \ } while (0) + +#define TEST_ASSERT_BUFFERS_ARE_EQUAL (a, b, len, msg, ...) do { \ + if (memcmp(a, b, len)) { \ + printf("TestCase %s() line %d failed: " \ + msg "\n", __func__, __LINE__, ##__VA_ARGS__); \ + TEST_TRACE_FAILURE(__FILE__, __LINE__, __func__); \ + return TEST_FAILED; \ + } \ +} while (0) + +#define TEST_ASSERT_NOT_EQUAL (a, b, msg, ...) do { \ if (!(a != b)) { \ printf("TestCase %s() line %d failed: " \
@@ -113,27 +124,36 @@struct unit_test_case {int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );int (*testcase)(void );const char *success_msg;const char *fail_msg; +unsigned enabled; }; -#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed"} +#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed", 1 }#define TEST_CASE_NAMED (name, fn) { NULL, NULL, fn, name " succeeded", \ - name " failed"} + name " failed", 1 }#define TEST_CASE_ST (setup, teardown, testcase) \ { setup, teardown, testcase, #testcase " succeeded", \ - #testcase " failed "} + #testcase " failed ", 1 } + + +#define TEST_CASE_DISABLED (fn) { NULL, NULL, fn, #fn " succeeded", \ + #fn " failed", 0 } + +#define TEST_CASE_ST_DISABLED (setup, teardown, testcase) \ + { setup, teardown, testcase, #testcase " succeeded", \ + #testcase " failed ", 0 } -#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL } +#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL, 0 }struct unit_test_suite {const char *suite_name;int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );struct unit_test_case unit_test_cases[]; };
app/test/test_cryptodev.c new file +1975 -0
1,975 lines not on this page · raw message
app/test/test_cryptodev.h new file +68 -0
68 lines not on this page · raw message
app/test/test_cryptodev_perf.c new file +2063 -0
768 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v4 6/6 l2fwd-crypto: crypto
In reply to Declan DohertyThis patch creates a new sample applicaiton based off the l2fwd application which performs specified crypto operations on IP packet payloads which are forwarding.
--- examples/l2fwd-crypto/Makefile | 50 ++ examples/l2fwd-crypto/main.c | 1473 ++++++++++++++++++++++++++++++++++++++++ 2 files changed, 1523 insertions(+) create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c
examples/l2fwd-crypto/Makefile new file +50 -0
@@ -0,0 +1,50 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +ifeq ($(RTE_SDK),) +$(error "Please define RTE_SDK environment variable") +endif + +# Default target, can be overridden by command line or environment +RTE_TARGET ?= x86_64-native-linuxapp-gcc + +include $(RTE_SDK)/mk/rte.vars.mk + +# binary name +APP = l2fwd-crypto + +# all source are stored in SRCS-y +SRCS-y := main.c + +CFLAGS += -O3 +CFLAGS += $(WERROR_FLAGS) + +include $(RTE_SDK)/mk/rte.extapp.mk
examples/l2fwd-crypto/main.c new file +1473 -0
1,473 lines not on this page · raw message
Signature · 1 line
2.4.3
Quoted 63 lines · Declan Doherty
This series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwardedCurrent Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.v4:
- Some more EOF whitespace and checkpatch fixesv3:
- Fixes a document build error, which I missed in the V2
- Fixes for remaining checkpatch errors
- Disables QAT andAESNI_MBPMD being build by default as they have external library dependencesv2:
- Introduces a new library to support attaching offload operations to a mbuf
- Remove unused APIs from cryptodev
- PMD code refactor due to newrte_mbuf_offloadstructure
- General bug fixes and code tidy up
Quoted 10 lines
Declan Doherty (6):
cryptodev: Initial DPDK Crypto APIs and device framework release
mbuf_offload: library to support attaching offloads to a mbuf
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
Series Acked-by: Sergio Gonzalez Monroy <[email protected]>
v5 cover Crypto API and device framework
In reply to Declan Dohertyhis series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.
The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwarded
Current Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.
v5:
- Making ethdev marcos for function pointer and port id checking public and available for use in by the cryptodev. The intialise to patches combine changes from original cryptodev patch and discussion in
http://dpdk.org/ml/archives/dev/2015-November/027871.html
- Split out changes to create new __rte_packed and __rte_aligned macros into seperate patches form the main cryptodev patch set for clairty
- further code cleaning, removal of currently unsupported gcm code from aesni_mb pmd
v4:
- Some more EOF whitespace and checkpatch fixes
v3:
- Fixes a document build error, which I missed in the V2
- Fixes for remaining checkpatch errors
- Disables QAT and AESNI_MB PMD being build by default as they have external library dependences
v2:
- Introduces a new library to support attaching offload operations to a mbuf
- Remove unused APIs from cryptodev
- PMD code refactor due to new rte_mbuf_offload structure
- General bug fixes and code tidy up
Declan Doherty (10):
ethdev: rename macros to have RTE_ prefix
ethdev: make error checking macros public
eal: add __rte_packed /__rte_aligned macros
mbuf: add new marcos to get the physical address of data
cryptodev: Initial DPDK Crypto APIs and device framework release
mbuf_offload: library to support attaching offloads to a mbuf
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
MAINTAINERS | 14 + app/test/Makefile | 4 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1986 +++++++++++++++++++ app/test/test_cryptodev.h | 68 + app/test/test_cryptodev_perf.c | 2062 ++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- app/test/test_link_bonding_rssconf.c | 7 +- config/common_bsdapp | 37 +- config/common_linuxapp | 37 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + doc/guides/cryptodevs/aesni_mb.rst | 76 + doc/guides/cryptodevs/index.rst | 43 + doc/guides/cryptodevs/qat.rst | 194 ++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 38 + drivers/crypto/aesni_mb/Makefile | 63 + drivers/crypto/aesni_mb/aesni_mb_ops.h | 210 ++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 669 +++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 298 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 229 +++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + drivers/crypto/qat/Makefile | 63 + .../qat/qat_adf/adf_transport_access_macros.h | 174 ++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 ++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 601 ++++++ drivers/crypto/qat/qat_crypto.c | 561 ++++++ drivers/crypto/qat/qat_crypto.h | 124 ++ drivers/crypto/qat/qat_logs.h | 78 + drivers/crypto/qat/qat_qp.c | 429 ++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 137 ++ examples/l2fwd-crypto/Makefile | 50 + examples/l2fwd-crypto/main.c | 1473 ++++++++++++++ lib/Makefile | 2 + lib/librte_cryptodev/Makefile | 60 + lib/librte_cryptodev/rte_crypto.h | 613 ++++++ lib/librte_cryptodev/rte_cryptodev.c | 1092 +++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 649 ++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 549 ++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_dev.h | 52 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 12 +- lib/librte_ether/rte_ethdev.c | 607 +++--- lib/librte_ether/rte_ethdev.h | 26 + lib/librte_mbuf/rte_mbuf.h | 29 + lib/librte_mbuf_offload/Makefile | 52 + lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 + lib/librte_mbuf_offload/rte_mbuf_offload.h | 284 +++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 9 + 59 files changed, 14828 insertions(+), 382 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
Signature · 1 line
2.4.3
PATCH v5 1/10 ethdev: rename macros to have RTE_ prefix
The macros to check that the function pointers and port ids are valid for an ethdev are potentially useful to have in a common headers for use with all PMDs. However, since they would then become externally visible, we apply the RTE_ & RTE_ETH_ prefix to them as approtiate.
--- lib/librte_ether/rte_ethdev.c | 595 +++++++++++++++++++++--------------------- 1 file changed, 298 insertions(+), 297 deletions(-)
lib/librte_ether/rte_ethdev.c +298 -297
@@ -70,58 +70,59 @@#include "rte_ethdev.h" #ifdef RTE_LIBRTE_ETHDEV_DEBUG -#define PMD_DEBUG_TRACE(fmt, args...) do { \ +#define RTE_PMD_DEBUG_TRACE(fmt, args...) do {do { \ RTE_LOG(ERR, PMD, "%s: " fmt, __func__, ## args); \ } while (0)#else -#define PMD_DEBUG_TRACE(fmt, args...) +#define RTE_PMD_DEBUG_TRACE(fmt, args...)#endif /* Macros for checking for restricting functions to primary instance only */ -#define PROC_PRIMARY_OR_ERR_RET (retval) do { \ +#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ return (retval); \ } \ } while (0) -#define PROC_PRIMARY_OR_RET () do { \ +#define RTE_PROC_PRIMARY_OR_RET () do { \ if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ return; \ } \ } while (0)/* Macros to check for invalid function pointers in dev_ops structure */ -#define FUNC_PTR_OR_ERR_RET (func, retval) do { \ +#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ if ((func) == NULL) { \ - PMD_DEBUG_TRACE("Function not supported\n"); \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ return (retval); \ } \ } while (0) -#define FUNC_PTR_OR_RET (func) do { \ +#define RTE_FUNC_PTR_OR_RET (func) do { \ if ((func) == NULL) { \ - PMD_DEBUG_TRACE("Function not supported\n"); \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ return; \ } \ } while (0)/* Macros to check for valid port */ -#define VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return retval; \ - } \ +#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return retval; \ + } \ } while (0) -#define VALID_PORTID_OR_RET (port_id) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return; \ - } \ +#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return; \ + } \ } while (0) +static const char *MZ_RTE_ETH_DEV_DATA ="rte_eth_dev_data" ;struct rte_eth_dev rte_eth_devices[RTE_MAX_ETHPORTS ];static struct rte_eth_dev_data *rte_eth_dev_data;
@@ -244,7 +245,7 @@ rte_eth_dev_allocate(const char *name, enum rte_eth_dev_type type) port_id =rte_eth_dev_find_free_port ();if (port_id ==RTE_MAX_ETHPORTS ) { -PMD_DEBUG_TRACE ("Reached maximum number of Ethernet ports\n" ); +RTE_PMD_DEBUG_TRACE ("Reached maximum number of Ethernet ports\n" );return NULL ; }
@@ -252,7 +253,7 @@ rte_eth_dev_allocate(const char *name, enum rte_eth_dev_type type)rte_eth_dev_data_alloc ();if (rte_eth_dev_allocated (name) !=NULL ) { -PMD_DEBUG_TRACE ("Ethernet Device with name %s already allocated!\n" , +RTE_PMD_DEBUG_TRACE ("Ethernet Device with name %s already allocated!\n" , name);return NULL ; }
@@ -339,7 +340,7 @@ rte_eth_dev_init(struct rte_pci_driver *pci_drv,if (diag ==0 )return 0 ; -PMD_DEBUG_TRACE ("driver %s: eth_dev_init(vendor_id=0x%u device_id=0x%x) failed\n" , +RTE_PMD_DEBUG_TRACE ("driver %s: eth_dev_init(vendor_id=0x%u device_id=0x%x) failed\n" , pci_drv->name, (unsigned ) pci_dev->id.vendor_id, (unsigned ) pci_dev->id.device_id);
@@ -447,10 +448,10 @@ rte_eth_dev_get_device_type(uint8_t port_id)static int rte_eth_dev_get_addr_by_port (uint8_t port_id,struct rte_pci_addr *addr) { -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL );if (addr ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -463,10 +464,10 @@ rte_eth_dev_get_name_by_port(uint8_t port_id, char *name) {char *tmp; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL );if (name ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -483,7 +484,7 @@ rte_eth_dev_get_port_by_name(const char *name, uint8_t *port_id)int i;if (name ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -509,7 +510,7 @@ rte_eth_dev_get_port_by_addr(const struct rte_pci_addr *addr, uint8_t *port_id)struct rte_pci_device *pci_dev =NULL ;if (addr ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -536,7 +537,7 @@ rte_eth_dev_is_detachable(uint8_t port_id)uint32_t dev_flags;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -EINVAL ; }
@@ -735,7 +736,7 @@ rte_eth_dev_rx_queue_config(struct rte_eth_dev *dev, uint16_t nb_queues)return -(ENOMEM ); } }else {/* re-configure */ -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_release, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_release, -ENOTSUP ); rxq = dev->data->rx_queues;
@@ -766,20 +767,20 @@ rte_eth_dev_rx_queue_start(uint8_t port_id, uint16_t rx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_start, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_start, -ENOTSUP );if (dev->data->rx_queue_state[rx_queue_id] !=RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already started\n" , rx_queue_id, port_id);return 0 ;
@@ -796,20 +797,20 @@ rte_eth_dev_rx_queue_stop(uint8_t port_id, uint16_t rx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_stop, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_stop, -ENOTSUP );if (dev->data->rx_queue_state[rx_queue_id] ==RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already stopped\n" , rx_queue_id, port_id);return 0 ;
@@ -826,20 +827,20 @@ rte_eth_dev_tx_queue_start(uint8_t port_id, uint16_t tx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (tx_queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_start, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_start, -ENOTSUP );if (dev->data->tx_queue_state[tx_queue_id] !=RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already started\n" , tx_queue_id, port_id);return 0 ;
@@ -856,20 +857,20 @@ rte_eth_dev_tx_queue_stop(uint8_t port_id, uint16_t tx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (tx_queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_stop, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_stop, -ENOTSUP );if (dev->data->tx_queue_state[tx_queue_id] ==RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already stopped\n" , tx_queue_id, port_id);return 0 ;
@@ -895,7 +896,7 @@ rte_eth_dev_tx_queue_config(struct rte_eth_dev *dev, uint16_t nb_queues)return -(ENOMEM ); } }else {/* re-configure */ -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_release, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_release, -ENOTSUP ); txq = dev->data->tx_queues;
@@ -929,19 +930,19 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL );if (nb_rx_q >RTE_MAX_QUEUES_PER_PORT ) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("Number of RX queues requested (%u) is greater than max supported(%d)\n" , nb_rx_q,RTE_MAX_QUEUES_PER_PORT );return -EINVAL ; }if (nb_tx_q >RTE_MAX_QUEUES_PER_PORT ) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("Number of TX queues requested (%u) is greater than max supported(%d)\n" , nb_tx_q,RTE_MAX_QUEUES_PER_PORT );return -EINVAL ;
@@ -949,11 +950,11 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q, dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_configure, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_configure, -ENOTSUP );if (dev->data->dev_started) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("port %d must be stopped to allow configuration\n" , port_id);return -EBUSY ; }
@@ -965,22 +966,22 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,*/ (*dev->dev_ops->dev_infos_get)(dev, &dev_info);if (nb_rx_q > dev_info.max_rx_queues) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_queues=%d > %d\n" , +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_queues=%d > %d\n" , port_id, nb_rx_q, dev_info.max_rx_queues);return -EINVAL ; }if (nb_rx_q ==0 ) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_q == 0\n" , port_id); +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_q == 0\n" , port_id);return -EINVAL ; }if (nb_tx_q > dev_info.max_tx_queues) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_queues=%d > %d\n" , +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_queues=%d > %d\n" , port_id, nb_tx_q, dev_info.max_tx_queues);return -EINVAL ; }if (nb_tx_q ==0 ) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_q == 0\n" , port_id); +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_q == 0\n" , port_id);return -EINVAL ; }
@@ -993,7 +994,7 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,*/ if ((dev_conf->intr_conf.lsc ==1 ) && (!(dev->data->dev_flags &RTE_ETH_DEV_INTR_LSC ))) { -PMD_DEBUG_TRACE ("driver %s does not support lsc\n" , +RTE_PMD_DEBUG_TRACE ("driver %s does not support lsc\n" , dev->data->drv_name);return -EINVAL ; }
@@ -1005,14 +1006,14 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,if (dev_conf->rxmode.jumbo_frame ==1 ) {if (dev_conf->rxmode.max_rx_pkt_len > dev_info.max_rx_pktlen) { -PMD_DEBUG_TRACE ("ethdev port_id=%d max_rx_pkt_len %u" +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d max_rx_pkt_len %u" " > max valid value %u\n" , port_id, (unsigned )dev_conf->rxmode.max_rx_pkt_len, (unsigned )dev_info.max_rx_pktlen);return -EINVAL ; }else if (dev_conf->rxmode.max_rx_pkt_len <ETHER_MIN_LEN ) { - PMD_DEBUG_TRACE("ethdev port_id=%d max_rx_pkt_len %u" + RTE_PMD_DEBUG_TRACE("ethdev port_id=%d max_rx_pkt_len %u" " < min valid value %u\n", port_id, (unsigned)dev_conf->rxmode.max_rx_pkt_len,
@@ -1032,14 +1033,14 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,*/ diag =rte_eth_dev_rx_queue_config (dev, nb_rx_q);if (diag !=0 ) { -PMD_DEBUG_TRACE ("port%d rte_eth_dev_rx_queue_config = %d\n" , +RTE_PMD_DEBUG_TRACE ("port%d rte_eth_dev_rx_queue_config = %d\n" , port_id, diag);return diag; } diag =rte_eth_dev_tx_queue_config (dev, nb_tx_q);if (diag !=0 ) { -PMD_DEBUG_TRACE ("port%d rte_eth_dev_tx_queue_config = %d\n" , +RTE_PMD_DEBUG_TRACE ("port%d rte_eth_dev_tx_queue_config = %d\n" , port_id, diag);rte_eth_dev_rx_queue_config (dev,0 );return diag;
@@ -1047,7 +1048,7 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q, diag = (*dev->dev_ops->dev_configure)(dev);if (diag !=0 ) { -PMD_DEBUG_TRACE ("port%d dev_configure = %d\n" , +RTE_PMD_DEBUG_TRACE ("port%d dev_configure = %d\n" , port_id, diag);rte_eth_dev_rx_queue_config (dev,0 );rte_eth_dev_tx_queue_config (dev,0 );
@@ -1086,7 +1087,7 @@ rte_eth_dev_config_restore(uint8_t port_id) (dev->data->mac_pool_sel[i] & (1ULL << pool))) (*dev->dev_ops->mac_addr_add)(dev, &addr, i, pool); else { -PMD_DEBUG_TRACE ("port %d: MAC address array not supported\n" , +RTE_PMD_DEBUG_TRACE ("port %d: MAC address array not supported\n" , port_id);/* exit the loop but not return an error */ break ;
@@ -1114,16 +1115,16 @@ rte_eth_dev_start(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_start, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_start, -ENOTSUP );if (dev->data->dev_started !=0 ) { -PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8" already started\n" , port_id);return 0 ;
@@ -1138,7 +1139,7 @@ rte_eth_dev_start(uint8_t port_id)rte_eth_dev_config_restore (port_id);if (dev->data->dev_conf.intr_conf.lsc ==0 ) { -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->link_update, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->link_update, -ENOTSUP ); (*dev->dev_ops->link_update)(dev,0 ); }return 0 ;
@@ -1151,15 +1152,15 @@ rte_eth_dev_stop(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_RET (); +RTE_PROC_PRIMARY_OR_RET (); -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->dev_stop); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->dev_stop);if (dev->data->dev_started ==0 ) { -PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8" already stopped\n" , port_id);return ;
@@ -1176,13 +1177,13 @@ rte_eth_dev_set_link_up(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_up, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_up, -ENOTSUP );return (*dev->dev_ops->dev_set_link_up)(dev); }
@@ -1193,13 +1194,13 @@ rte_eth_dev_set_link_down(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_down, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_down, -ENOTSUP );return (*dev->dev_ops->dev_set_link_down)(dev); }
@@ -1210,12 +1211,12 @@ rte_eth_dev_close(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_RET (); +RTE_PROC_PRIMARY_OR_RET (); -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->dev_close); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->dev_close); dev->data->dev_started =0 ; (*dev->dev_ops->dev_close)(dev);
@@ -1238,24 +1239,24 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id,/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id);return -EINVAL ; }if (dev->data->dev_started) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("port %d must be stopped to allow configuration\n" , port_id);return -EBUSY ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_setup, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_setup, -ENOTSUP );/* * Check the size of the mbuf data buffer.
@@ -1264,7 +1265,7 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id,*/ rte_eth_dev_info_get (port_id, &dev_info);if (mp->private_data_size <sizeof (struct rte_pktmbuf_pool_private )) { -PMD_DEBUG_TRACE ("%s private_data_size %d < %d\n" , +RTE_PMD_DEBUG_TRACE ("%s private_data_size %d < %d\n" , mp->name, (int ) mp->private_data_size, (int )sizeof (struct rte_pktmbuf_pool_private ));return -ENOSPC ;
@@ -1272,7 +1273,7 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id, mbp_buf_size =rte_pktmbuf_data_room_size (mp);if ((mbp_buf_size -RTE_PKTMBUF_HEADROOM ) < dev_info.min_rx_bufsize) { - PMD_DEBUG_TRACE("%s mbuf_data_room_size %d < %d " + RTE_PMD_DEBUG_TRACE("%s mbuf_data_room_size %d < %d " "(RTE_PKTMBUF_HEADROOM=%d + min_rx_bufsize(dev)" "=%d)\n", mp->name,
@@ -1288,7 +1289,7 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id, nb_rx_desc < dev_info.rx_desc_lim.nb_min || nb_rx_desc % dev_info.rx_desc_lim.nb_align != 0) { - PMD_DEBUG_TRACE("Invalid value for nb_rx_desc(=%hu), " + RTE_PMD_DEBUG_TRACE("Invalid value for nb_rx_desc(=%hu), " "should be: <= %hu, = %hu, and a product of %hu\n", nb_rx_desc, dev_info.rx_desc_lim.nb_max,
@@ -1321,24 +1322,24 @@ rte_eth_tx_queue_setup(uint8_t port_id, uint16_t tx_queue_id,/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (tx_queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id);return -EINVAL ; }if (dev->data->dev_started) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("port %d must be stopped to allow configuration\n" , port_id);return -EBUSY ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_setup, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_setup, -ENOTSUP );rte_eth_dev_info_get (port_id, &dev_info);
@@ -1354,10 +1355,10 @@ rte_eth_promiscuous_enable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_enable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_enable); (*dev->dev_ops->promiscuous_enable)(dev); dev->data->promiscuous =1 ; }
@@ -1367,10 +1368,10 @@ rte_eth_promiscuous_disable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_disable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_disable); dev->data->promiscuous =0 ; (*dev->dev_ops->promiscuous_disable)(dev); }
@@ -1380,7 +1381,7 @@ rte_eth_promiscuous_get(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];return dev->data->promiscuous;
@@ -1391,10 +1392,10 @@ rte_eth_allmulticast_enable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_enable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_enable); (*dev->dev_ops->allmulticast_enable)(dev); dev->data->all_multicast =1 ; }
@@ -1404,10 +1405,10 @@ rte_eth_allmulticast_disable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_disable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_disable); dev->data->all_multicast =0 ; (*dev->dev_ops->allmulticast_disable)(dev); }
@@ -1417,7 +1418,7 @@ rte_eth_allmulticast_get(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];return dev->data->all_multicast;
@@ -1442,13 +1443,13 @@ rte_eth_link_get(uint8_t port_id, struct rte_eth_link *eth_link) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];if (dev->data->dev_conf.intr_conf.lsc !=0 )rte_eth_dev_atomic_read_link_status (dev, eth_link);else { -FUNC_PTR_OR_RET (*dev->dev_ops->link_update); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->link_update); (*dev->dev_ops->link_update)(dev,1 ); *eth_link = dev->data->dev_link; }
@@ -1459,13 +1460,13 @@ rte_eth_link_get_nowait(uint8_t port_id, struct rte_eth_link *eth_link) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];if (dev->data->dev_conf.intr_conf.lsc !=0 )rte_eth_dev_atomic_read_link_status (dev, eth_link);else { -FUNC_PTR_OR_RET (*dev->dev_ops->link_update); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->link_update); (*dev->dev_ops->link_update)(dev,0 ); *eth_link = dev->data->dev_link; }
@@ -1476,12 +1477,12 @@ rte_eth_stats_get(uint8_t port_id, struct rte_eth_stats *stats) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];memset (stats,0 ,sizeof (*stats)); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->stats_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->stats_get, -ENOTSUP ); (*dev->dev_ops->stats_get)(dev, stats); stats->rx_nombuf = dev->data->rx_mbuf_alloc_failed;return 0 ;
@@ -1492,10 +1493,10 @@ rte_eth_stats_reset(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->stats_reset); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->stats_reset); (*dev->dev_ops->stats_reset)(dev); }
@@ -1510,7 +1511,7 @@ rte_eth_xstats_get(uint8_t port_id, struct rte_eth_xstats *xstats,signed xcount =0 ;uint64_t val, *stats_ptr; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];
@@ -1590,7 +1591,7 @@ rte_eth_xstats_reset(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];/* implemented by the driver */
@@ -1609,11 +1610,11 @@ set_queue_stats_mapping(uint8_t port_id, uint16_t queue_id, uint8_t stat_idx, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->queue_stats_mapping_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->queue_stats_mapping_set, -ENOTSUP );return (*dev->dev_ops->queue_stats_mapping_set) (dev, queue_id, stat_idx, is_rx); }
@@ -1647,14 +1648,14 @@ rte_eth_dev_info_get(uint8_t port_id, struct rte_eth_dev_info *dev_info) .nb_align = 1, }; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];memset (dev_info,0 ,sizeof (struct rte_eth_dev_info )); dev_info->rx_desc_lim = lim; dev_info->tx_desc_lim = lim; -FUNC_PTR_OR_RET (*dev->dev_ops->dev_infos_get); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->dev_infos_get); (*dev->dev_ops->dev_infos_get)(dev, dev_info); dev_info->pci_dev = dev->pci_dev; dev_info->driver_name = dev->data->drv_name;
@@ -1665,7 +1666,7 @@ rte_eth_macaddr_get(uint8_t port_id, struct ether_addr *mac_addr) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];ether_addr_copy (&dev->data->mac_addrs[0 ], mac_addr); }
@@ -1676,7 +1677,7 @@ rte_eth_dev_get_mtu(uint8_t port_id, uint16_t *mtu) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; *mtu = dev->data->mtu;
@@ -1689,9 +1690,9 @@ rte_eth_dev_set_mtu(uint8_t port_id, uint16_t mtu)int ret;struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mtu_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mtu_set, -ENOTSUP ); ret = (*dev->dev_ops->mtu_set)(dev, mtu);if (!ret)
@@ -1705,19 +1706,19 @@ rte_eth_dev_vlan_filter(uint8_t port_id, uint16_t vlan_id, int on) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (!(dev->data->dev_conf.rxmode.hw_vlan_filter)) { -PMD_DEBUG_TRACE ("port %d: vlan-filtering disabled\n" , port_id); +RTE_PMD_DEBUG_TRACE ("port %d: vlan-filtering disabled\n" , port_id);return -ENOSYS ; }if (vlan_id >4095 ) { -PMD_DEBUG_TRACE ("(port_id=%d) invalid vlan_id=%u > 4095\n" , +RTE_PMD_DEBUG_TRACE ("(port_id=%d) invalid vlan_id=%u > 4095\n" , port_id, (unsigned ) vlan_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_filter_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_filter_set, -ENOTSUP );return (*dev->dev_ops->vlan_filter_set)(dev, vlan_id, on); }
@@ -1727,14 +1728,14 @@ rte_eth_dev_set_vlan_strip_on_queue(uint8_t port_id, uint16_t rx_queue_id, int o {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid rx_queue_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid rx_queue_id=%d\n" , port_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_strip_queue_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_strip_queue_set, -ENOTSUP ); (*dev->dev_ops->vlan_strip_queue_set)(dev, rx_queue_id, on);return 0 ;
@@ -1745,9 +1746,9 @@ rte_eth_dev_set_vlan_ether_type(uint8_t port_id, uint16_t tpid) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_tpid_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_tpid_set, -ENOTSUP ); (*dev->dev_ops->vlan_tpid_set)(dev, tpid);return 0 ;
@@ -1761,7 +1762,7 @@ rte_eth_dev_set_vlan_offload(uint8_t port_id, int offload_mask)int mask =0 ;int cur, org =0 ; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];/*check which option changed by application*/
@@ -1790,7 +1791,7 @@ rte_eth_dev_set_vlan_offload(uint8_t port_id, int offload_mask)if (mask ==0 )return ret; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_offload_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_offload_set, -ENOTSUP ); (*dev->dev_ops->vlan_offload_set)(dev, mask);return ret;
@@ -1802,7 +1803,7 @@ rte_eth_dev_get_vlan_offload(uint8_t port_id)struct rte_eth_dev *dev;int ret =0 ; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (dev->data->dev_conf.rxmode.hw_vlan_strip)
@@ -1822,9 +1823,9 @@ rte_eth_dev_set_vlan_pvid(uint8_t port_id, uint16_t pvid, int on) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_pvid_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_pvid_set, -ENOTSUP ); (*dev->dev_ops->vlan_pvid_set)(dev, pvid, on);return 0 ;
@@ -1835,9 +1836,9 @@ rte_eth_dev_flow_ctrl_get(uint8_t port_id, struct rte_eth_fc_conf *fc_conf) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_get, -ENOTSUP );memset (fc_conf,0 ,sizeof (*fc_conf));return (*dev->dev_ops->flow_ctrl_get)(dev, fc_conf); }
@@ -1847,14 +1848,14 @@ rte_eth_dev_flow_ctrl_set(uint8_t port_id, struct rte_eth_fc_conf *fc_conf) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if ((fc_conf->send_xon !=0 ) && (fc_conf->send_xon !=1 )) { -PMD_DEBUG_TRACE ("Invalid send_xon, only 0/1 allowed\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid send_xon, only 0/1 allowed\n" );return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_set, -ENOTSUP );return (*dev->dev_ops->flow_ctrl_set)(dev, fc_conf); }
@@ -1863,9 +1864,9 @@ rte_eth_dev_priority_flow_ctrl_set(uint8_t port_id, struct rte_eth_pfc_conf *pfc {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (pfc_conf->priority > (ETH_DCB_NUM_USER_PRIORITIES -1 )) { -PMD_DEBUG_TRACE ("Invalid priority, only 0-7 allowed\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid priority, only 0-7 allowed\n" );return -EINVAL ; }
@@ -1886,7 +1887,7 @@ rte_eth_check_reta_mask(struct rte_eth_rss_reta_entry64 *reta_conf,return -EINVAL ;if (reta_size !=RTE_ALIGN (reta_size,RTE_RETA_GROUP_SIZE )) { -PMD_DEBUG_TRACE ("Invalid reta size, should be %u aligned\n" , +RTE_PMD_DEBUG_TRACE ("Invalid reta size, should be %u aligned\n" ,RTE_RETA_GROUP_SIZE );return -EINVAL ; }
@@ -1911,7 +1912,7 @@ rte_eth_check_reta_entry(struct rte_eth_rss_reta_entry64 *reta_conf,return -EINVAL ;if (max_rxq ==0 ) { -PMD_DEBUG_TRACE ("No receive queue is available\n" ); +RTE_PMD_DEBUG_TRACE ("No receive queue is available\n" );return -EINVAL ; }
@@ -1920,7 +1921,7 @@ rte_eth_check_reta_entry(struct rte_eth_rss_reta_entry64 *reta_conf, shift = i %RTE_RETA_GROUP_SIZE ;if ((reta_conf[idx].mask & (1ULL << shift)) && (reta_conf[idx].reta[shift] >= max_rxq)) { -PMD_DEBUG_TRACE ("reta_conf[%u]->reta[%u]: %u exceeds " +RTE_PMD_DEBUG_TRACE ("reta_conf[%u]->reta[%u]: %u exceeds " "the maximum rxq index: %u\n" , idx, shift, reta_conf[idx].reta[shift], max_rxq);return -EINVAL ;
@@ -1938,7 +1939,7 @@ rte_eth_dev_rss_reta_update(uint8_t port_id,struct rte_eth_dev *dev;int ret; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );/* Check mask bits */ ret =rte_eth_check_reta_mask (reta_conf, reta_size);if (ret <0 )
@@ -1952,7 +1953,7 @@ rte_eth_dev_rss_reta_update(uint8_t port_id,if (ret <0 )return ret; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_update, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_update, -ENOTSUP );return (*dev->dev_ops->reta_update)(dev, reta_conf, reta_size); }
@@ -1965,7 +1966,7 @@ rte_eth_dev_rss_reta_query(uint8_t port_id,int ret;if (port_id >= nb_ports) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; }
@@ -1975,7 +1976,7 @@ rte_eth_dev_rss_reta_query(uint8_t port_id,return ret; dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_query, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_query, -ENOTSUP );return (*dev->dev_ops->reta_query)(dev, reta_conf, reta_size); }
@@ -1985,16 +1986,16 @@ rte_eth_dev_rss_hash_update(uint8_t port_id, struct rte_eth_rss_conf *rss_conf)struct rte_eth_dev *dev;uint16_t rss_hash_protos; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); rss_hash_protos = rss_conf->rss_hf;if ((rss_hash_protos !=0 ) && ((rss_hash_protos Ð_RSS_PROTO_MASK ) ==0 )) { -PMD_DEBUG_TRACE ("Invalid rss_hash_protos=0x%x\n" , +RTE_PMD_DEBUG_TRACE ("Invalid rss_hash_protos=0x%x\n" , rss_hash_protos);return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_update, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_update, -ENOTSUP );return (*dev->dev_ops->rss_hash_update)(dev, rss_conf); }
@@ -2004,9 +2005,9 @@ rte_eth_dev_rss_hash_conf_get(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_conf_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_conf_get, -ENOTSUP );return (*dev->dev_ops->rss_hash_conf_get)(dev, rss_conf); }
@@ -2016,19 +2017,19 @@ rte_eth_dev_udp_tunnel_add(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (udp_tunnel ==NULL ) { -PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" );return -EINVAL ; }if (udp_tunnel->prot_type >=RTE_TUNNEL_TYPE_MAX ) { -PMD_DEBUG_TRACE ("Invalid tunnel type\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid tunnel type\n" );return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_add, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_add, -ENOTSUP );return (*dev->dev_ops->udp_tunnel_add)(dev, udp_tunnel); }
@@ -2038,20 +2039,20 @@ rte_eth_dev_udp_tunnel_delete(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (udp_tunnel ==NULL ) { -PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" );return -EINVAL ; }if (udp_tunnel->prot_type >=RTE_TUNNEL_TYPE_MAX ) { -PMD_DEBUG_TRACE ("Invalid tunnel type\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid tunnel type\n" );return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_del, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_del, -ENOTSUP );return (*dev->dev_ops->udp_tunnel_del)(dev, udp_tunnel); }
@@ -2060,9 +2061,9 @@ rte_eth_led_on(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_on, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_on, -ENOTSUP );return (*dev->dev_ops->dev_led_on)(dev); }
@@ -2071,9 +2072,9 @@ rte_eth_led_off(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_off, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_off, -ENOTSUP );return (*dev->dev_ops->dev_led_off)(dev); }
@@ -2107,17 +2108,17 @@ rte_eth_dev_mac_addr_add(uint8_t port_id, struct ether_addr *addr,int index;uint64_t pool_mask; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_add, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_add, -ENOTSUP );if (is_zero_ether_addr (addr)) { -PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , +RTE_PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , port_id);return -EINVAL ; }if (pool >=ETH_64_POOLS ) { -PMD_DEBUG_TRACE ("pool id must be 0-%d\n" ,ETH_64_POOLS -1 ); +RTE_PMD_DEBUG_TRACE ("pool id must be 0-%d\n" ,ETH_64_POOLS -1 );return -EINVAL ; }
@@ -2125,7 +2126,7 @@ rte_eth_dev_mac_addr_add(uint8_t port_id, struct ether_addr *addr,if (index <0 ) { index =get_mac_addr_index (port_id, &null_mac_addr);if (index <0 ) { -PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , +RTE_PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , port_id);return -ENOSPC ; }
@@ -2155,13 +2156,13 @@ rte_eth_dev_mac_addr_remove(uint8_t port_id, struct ether_addr *addr)struct rte_eth_dev *dev;int index; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_remove, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_remove, -ENOTSUP ); index =get_mac_addr_index (port_id, addr);if (index ==0 ) { -PMD_DEBUG_TRACE ("port %d: Cannot remove default MAC address\n" , port_id); +RTE_PMD_DEBUG_TRACE ("port %d: Cannot remove default MAC address\n" , port_id);return -EADDRINUSE ; }else if (index <0 )return 0 ;/* Do nothing if address wasn't found */
@@ -2183,13 +2184,13 @@ rte_eth_dev_default_mac_addr_set(uint8_t port_id, struct ether_addr *addr) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (!is_valid_assigned_ether_addr (addr))return -EINVAL ; dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_set, -ENOTSUP );/* Update default address in NIC data structure */ ether_addr_copy (addr, &dev->data->mac_addrs[0 ]);
@@ -2207,22 +2208,22 @@ rte_eth_dev_set_vf_rxmode(uint8_t port_id, uint16_t vf,struct rte_eth_dev *dev;struct rte_eth_dev_info dev_info; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); num_vfs = dev_info.max_vfs;if (vf > num_vfs) { -PMD_DEBUG_TRACE ("set VF RX mode:invalid VF id %d\n" , vf); +RTE_PMD_DEBUG_TRACE ("set VF RX mode:invalid VF id %d\n" , vf);return -EINVAL ; }if (rx_mode ==0 ) { -PMD_DEBUG_TRACE ("set VF RX mode:mode mask ca not be zero\n" ); +RTE_PMD_DEBUG_TRACE ("set VF RX mode:mode mask ca not be zero\n" );return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx_mode, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx_mode, -ENOTSUP );return (*dev->dev_ops->set_vf_rx_mode)(dev, vf, rx_mode, on); }
@@ -2257,11 +2258,11 @@ rte_eth_dev_uc_hash_table_set(uint8_t port_id, struct ether_addr *addr,int ret;struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (is_zero_ether_addr (addr)) { -PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , +RTE_PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , port_id);return -EINVAL ; }
@@ -2273,20 +2274,20 @@ rte_eth_dev_uc_hash_table_set(uint8_t port_id, struct ether_addr *addr,if (index <0 ) {if (!on) { -PMD_DEBUG_TRACE ("port %d: the MAC address was not " +RTE_PMD_DEBUG_TRACE ("port %d: the MAC address was not " "set in UTA\n" , port_id);return -EINVAL ; } index =get_hash_mac_addr_index (port_id, &null_mac_addr);if (index <0 ) { -PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , +RTE_PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , port_id);return -ENOSPC ; } } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_hash_table_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_hash_table_set, -ENOTSUP ); ret = (*dev->dev_ops->uc_hash_table_set)(dev, addr, on);if (ret ==0 ) {/* Update address in NIC data structure */
@@ -2306,11 +2307,11 @@ rte_eth_dev_uc_all_hash_table_set(uint8_t port_id, uint8_t on) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_all_hash_table_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_all_hash_table_set, -ENOTSUP );return (*dev->dev_ops->uc_all_hash_table_set)(dev, on); }
@@ -2321,18 +2322,18 @@ rte_eth_dev_set_vf_rx(uint8_t port_id, uint16_t vf, uint8_t on)struct rte_eth_dev *dev;struct rte_eth_dev_info dev_info; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); num_vfs = dev_info.max_vfs;if (vf > num_vfs) { -PMD_DEBUG_TRACE ("port %d: invalid vf id\n" , port_id); +RTE_PMD_DEBUG_TRACE ("port %d: invalid vf id\n" , port_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx, -ENOTSUP );return (*dev->dev_ops->set_vf_rx)(dev, vf, on); }
@@ -2343,18 +2344,18 @@ rte_eth_dev_set_vf_tx(uint8_t port_id, uint16_t vf, uint8_t on)struct rte_eth_dev *dev;struct rte_eth_dev_info dev_info; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); num_vfs = dev_info.max_vfs;if (vf > num_vfs) { -PMD_DEBUG_TRACE ("set pool tx:invalid pool id=%d\n" , vf); +RTE_PMD_DEBUG_TRACE ("set pool tx:invalid pool id=%d\n" , vf);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_tx, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_tx, -ENOTSUP );return (*dev->dev_ops->set_vf_tx)(dev, vf, on); }
@@ -2364,22 +2365,22 @@ rte_eth_dev_set_vf_vlan_filter(uint8_t port_id, uint16_t vlan_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (vlan_id >ETHER_MAX_VLAN_ID ) { -PMD_DEBUG_TRACE ("VF VLAN filter:invalid VLAN id=%d\n" , +RTE_PMD_DEBUG_TRACE ("VF VLAN filter:invalid VLAN id=%d\n" , vlan_id);return -EINVAL ; }if (vf_mask ==0 ) { -PMD_DEBUG_TRACE ("VF VLAN filter:pool_mask can not be 0\n" ); +RTE_PMD_DEBUG_TRACE ("VF VLAN filter:pool_mask can not be 0\n" );return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_vlan_filter, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_vlan_filter, -ENOTSUP );return (*dev->dev_ops->set_vf_vlan_filter)(dev, vlan_id, vf_mask, vlan_on); }
@@ -2391,26 +2392,26 @@ int rte_eth_set_queue_rate_limit(uint8_t port_id, uint16_t queue_idx,struct rte_eth_dev_info dev_info;struct rte_eth_link link; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); link = dev->data->dev_link;if (queue_idx > dev_info.max_tx_queues) { -PMD_DEBUG_TRACE ("set queue rate limit:port %d: " +RTE_PMD_DEBUG_TRACE ("set queue rate limit:port %d: " "invalid queue id=%d\n" , port_id, queue_idx);return -EINVAL ; }if (tx_rate > link.link_speed) { -PMD_DEBUG_TRACE ("set queue rate limit:invalid tx_rate=%d, " +RTE_PMD_DEBUG_TRACE ("set queue rate limit:invalid tx_rate=%d, " "bigger than link speed= %d\n" , tx_rate, link.link_speed);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_queue_rate_limit, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_queue_rate_limit, -ENOTSUP );return (*dev->dev_ops->set_queue_rate_limit)(dev, queue_idx, tx_rate); }
@@ -2424,26 +2425,26 @@ int rte_eth_set_vf_rate_limit(uint8_t port_id, uint16_t vf, uint16_t tx_rate,if (q_msk ==0 )return 0 ; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); link = dev->data->dev_link;if (vf > dev_info.max_vfs) { -PMD_DEBUG_TRACE ("set VF rate limit:port %d: " +RTE_PMD_DEBUG_TRACE ("set VF rate limit:port %d: " "invalid vf id=%d\n" , port_id, vf);return -EINVAL ; }if (tx_rate > link.link_speed) { -PMD_DEBUG_TRACE ("set VF rate limit:invalid tx_rate=%d, " +RTE_PMD_DEBUG_TRACE ("set VF rate limit:invalid tx_rate=%d, " "bigger than link speed= %d\n" , tx_rate, link.link_speed);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rate_limit, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rate_limit, -ENOTSUP );return (*dev->dev_ops->set_vf_rate_limit)(dev, vf, tx_rate, q_msk); }
@@ -2454,14 +2455,14 @@ rte_eth_mirror_rule_set(uint8_t port_id, {struct rte_eth_dev *dev = &rte_eth_devices[port_id]; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (mirror_conf->rule_type ==0 ) { -PMD_DEBUG_TRACE ("mirror rule type can not be 0.\n" ); +RTE_PMD_DEBUG_TRACE ("mirror rule type can not be 0.\n" );return -EINVAL ; }if (mirror_conf->dst_pool >=ETH_64_POOLS ) { -PMD_DEBUG_TRACE ("Invalid dst pool, pool id must be 0-%d\n" , +RTE_PMD_DEBUG_TRACE ("Invalid dst pool, pool id must be 0-%d\n" ,ETH_64_POOLS -1 );return -EINVAL ; }
@@ -2469,18 +2470,18 @@ rte_eth_mirror_rule_set(uint8_t port_id,if ((mirror_conf->rule_type & (ETH_MIRROR_VIRTUAL_POOL_UP |ETH_MIRROR_VIRTUAL_POOL_DOWN )) && (mirror_conf->pool_mask ==0 )) { -PMD_DEBUG_TRACE ("Invalid mirror pool, pool mask can not be 0.\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid mirror pool, pool mask can not be 0.\n" );return -EINVAL ; }if ((mirror_conf->rule_type Ð_MIRROR_VLAN ) && mirror_conf->vlan.vlan_mask ==0 ) { -PMD_DEBUG_TRACE ("Invalid vlan mask, vlan mask can not be 0.\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid vlan mask, vlan mask can not be 0.\n" );return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_set, -ENOTSUP );return (*dev->dev_ops->mirror_rule_set)(dev, mirror_conf, rule_id, on); }
@@ -2490,10 +2491,10 @@ rte_eth_mirror_rule_reset(uint8_t port_id, uint8_t rule_id) {struct rte_eth_dev *dev = &rte_eth_devices[port_id]; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_reset, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_reset, -ENOTSUP );return (*dev->dev_ops->mirror_rule_reset)(dev, rule_id); }
@@ -2505,12 +2506,12 @@ rte_eth_rx_burst(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id,0 ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id,0 ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->rx_pkt_burst,0 ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->rx_pkt_burst,0 );if (queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id);return 0 ; } return (*dev->rx_pkt_burst)(dev->data->rx_queues[queue_id],
@@ -2523,13 +2524,13 @@ rte_eth_tx_burst(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id,0 ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id,0 ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->tx_pkt_burst,0 ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->tx_pkt_burst,0 );if (queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id);return 0 ; } return (*dev->tx_pkt_burst)(dev->data->tx_queues[queue_id],
@@ -2541,10 +2542,10 @@ rte_eth_rx_queue_count(uint8_t port_id, uint16_t queue_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id,0 ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id,0 ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_count,0 ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_count,0 );return (*dev->dev_ops->rx_queue_count)(dev, queue_id); }
@@ -2553,10 +2554,10 @@ rte_eth_rx_descriptor_done(uint8_t port_id, uint16_t queue_id, uint16_t offset) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_descriptor_done, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_descriptor_done, -ENOTSUP );return (*dev->dev_ops->rx_descriptor_done)(dev->data->rx_queues[queue_id], offset); }
@@ -2573,7 +2574,7 @@ rte_eth_dev_callback_register(uint8_t port_id,if (!cb_fn)return -EINVAL ; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];rte_spinlock_lock (&rte_eth_dev_cb_lock);
@@ -2613,7 +2614,7 @@ rte_eth_dev_callback_unregister(uint8_t port_id,if (!cb_fn)return -EINVAL ; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];rte_spinlock_lock (&rte_eth_dev_cb_lock);
@@ -2676,14 +2677,14 @@ rte_eth_dev_rx_intr_ctl(uint8_t port_id, int epfd, int op, void *data)int rc;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id]; intr_handle = &dev->pci_dev->intr_handle;if (!intr_handle->intr_vec) { -PMD_DEBUG_TRACE ("RX Intr vector unset\n" ); +RTE_PMD_DEBUG_TRACE ("RX Intr vector unset\n" );return -EPERM ; }
@@ -2691,7 +2692,7 @@ rte_eth_dev_rx_intr_ctl(uint8_t port_id, int epfd, int op, void *data) vec = intr_handle->intr_vec[qid]; rc =rte_intr_rx_ctl (intr_handle, epfd, op, vec, data);if (rc && rc != -EEXIST ) { -PMD_DEBUG_TRACE ("p %u q %u rx ctl error" +RTE_PMD_DEBUG_TRACE ("p %u q %u rx ctl error" " op %d epfd %d vec %u\n" , port_id, qid, op, epfd, vec); }
@@ -2710,26 +2711,26 @@ rte_eth_dev_rx_intr_ctl_q(uint8_t port_id, uint16_t queue_id,int rc;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id];if (queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%u\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%u\n" , queue_id);return -EINVAL ; } intr_handle = &dev->pci_dev->intr_handle;if (!intr_handle->intr_vec) { -PMD_DEBUG_TRACE ("RX Intr vector unset\n" ); +RTE_PMD_DEBUG_TRACE ("RX Intr vector unset\n" );return -EPERM ; } vec = intr_handle->intr_vec[queue_id]; rc =rte_intr_rx_ctl (intr_handle, epfd, op, vec, data);if (rc && rc != -EEXIST ) { -PMD_DEBUG_TRACE ("p %u q %u rx ctl error" +RTE_PMD_DEBUG_TRACE ("p %u q %u rx ctl error" " op %d epfd %d vec %u\n" , port_id, queue_id, op, epfd, vec);return rc;
@@ -2745,13 +2746,13 @@ rte_eth_dev_rx_intr_enable(uint8_t port_id,struct rte_eth_dev *dev;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_enable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_enable, -ENOTSUP );return (*dev->dev_ops->rx_queue_intr_enable)(dev, queue_id); }
@@ -2762,13 +2763,13 @@ rte_eth_dev_rx_intr_disable(uint8_t port_id,struct rte_eth_dev *dev;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_disable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_disable, -ENOTSUP );return (*dev->dev_ops->rx_queue_intr_disable)(dev, queue_id); }
@@ -2777,10 +2778,10 @@ int rte_eth_dev_bypass_init(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_init, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_init, -ENOTSUP ); (*dev->dev_ops->bypass_init)(dev);return 0 ; }
@@ -2790,10 +2791,10 @@ rte_eth_dev_bypass_state_show(uint8_t port_id, uint32_t *state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); (*dev->dev_ops->bypass_state_show)(dev, state);return 0 ; }
@@ -2803,10 +2804,10 @@ rte_eth_dev_bypass_state_set(uint8_t port_id, uint32_t *new_state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_set, -ENOTSUP ); (*dev->dev_ops->bypass_state_set)(dev, new_state);return 0 ; }
@@ -2816,10 +2817,10 @@ rte_eth_dev_bypass_event_show(uint8_t port_id, uint32_t event, uint32_t *state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); (*dev->dev_ops->bypass_event_show)(dev, event, state);return 0 ; }
@@ -2829,11 +2830,11 @@ rte_eth_dev_bypass_event_store(uint8_t port_id, uint32_t event, uint32_t state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_event_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_event_set, -ENOTSUP ); (*dev->dev_ops->bypass_event_set)(dev, event, state);return 0 ; }
@@ -2843,11 +2844,11 @@ rte_eth_dev_wd_timeout_store(uint8_t port_id, uint32_t timeout) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_set, -ENOTSUP ); (*dev->dev_ops->bypass_wd_timeout_set)(dev, timeout);return 0 ; }
@@ -2857,11 +2858,11 @@ rte_eth_dev_bypass_ver_show(uint8_t port_id, uint32_t *ver) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_ver_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_ver_show, -ENOTSUP ); (*dev->dev_ops->bypass_ver_show)(dev, ver);return 0 ; }
@@ -2871,11 +2872,11 @@ rte_eth_dev_bypass_wd_timeout_show(uint8_t port_id, uint32_t *wd_timeout) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_show, -ENOTSUP ); (*dev->dev_ops->bypass_wd_timeout_show)(dev, wd_timeout);return 0 ; }
@@ -2885,11 +2886,11 @@ rte_eth_dev_bypass_wd_reset(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_reset, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_reset, -ENOTSUP ); (*dev->dev_ops->bypass_wd_reset)(dev);return 0 ; }
@@ -2900,10 +2901,10 @@ rte_eth_dev_filter_supported(uint8_t port_id, enum rte_filter_type filter_type) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP );return (*dev->dev_ops->filter_ctrl)(dev, filter_type,RTE_ETH_FILTER_NOP ,NULL ); }
@@ -2914,10 +2915,10 @@ rte_eth_dev_filter_ctrl(uint8_t port_id, enum rte_filter_type filter_type, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP );return (*dev->dev_ops->filter_ctrl)(dev, filter_type, filter_op, arg); }
@@ -3087,18 +3088,18 @@ rte_eth_rx_queue_info_get(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (qinfo ==NULL )return -EINVAL ; dev = &rte_eth_devices[port_id];if (queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rxq_info_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rxq_info_get, -ENOTSUP );memset (qinfo,0 ,sizeof (*qinfo)); dev->dev_ops->rxq_info_get (dev, queue_id, qinfo);
@@ -3111,18 +3112,18 @@ rte_eth_tx_queue_info_get(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (qinfo ==NULL )return -EINVAL ; dev = &rte_eth_devices[port_id];if (queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->txq_info_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->txq_info_get, -ENOTSUP );memset (qinfo,0 ,sizeof (*qinfo)); dev->dev_ops->txq_info_get (dev, queue_id, qinfo);
@@ -3136,10 +3137,10 @@ rte_eth_dev_set_mc_addr_list(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_mc_addr_list, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_mc_addr_list, -ENOTSUP );return dev->dev_ops->set_mc_addr_list (dev, mc_addr_set, nb_mc_addr); }
@@ -3148,10 +3149,10 @@ rte_eth_timesync_enable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_enable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_enable, -ENOTSUP );return (*dev->dev_ops->timesync_enable)(dev); }
@@ -3160,10 +3161,10 @@ rte_eth_timesync_disable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_disable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_disable, -ENOTSUP );return (*dev->dev_ops->timesync_disable)(dev); }
@@ -3173,10 +3174,10 @@ rte_eth_timesync_read_rx_timestamp(uint8_t port_id, struct timespec *timestamp, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_rx_timestamp, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_rx_timestamp, -ENOTSUP );return (*dev->dev_ops->timesync_read_rx_timestamp)(dev, timestamp, flags); }
@@ -3185,10 +3186,10 @@ rte_eth_timesync_read_tx_timestamp(uint8_t port_id, struct timespec *timestamp) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_tx_timestamp, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_tx_timestamp, -ENOTSUP );return (*dev->dev_ops->timesync_read_tx_timestamp)(dev, timestamp); }
@@ -3197,10 +3198,10 @@ rte_eth_dev_get_reg_length(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg_length, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg_length, -ENOTSUP );return (*dev->dev_ops->get_reg_length)(dev); }
@@ -3209,10 +3210,10 @@ rte_eth_dev_get_reg_info(uint8_t port_id, struct rte_dev_reg_info *info) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg, -ENOTSUP );return (*dev->dev_ops->get_reg)(dev, info); }
@@ -3221,10 +3222,10 @@ rte_eth_dev_get_eeprom_length(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom_length, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom_length, -ENOTSUP );return (*dev->dev_ops->get_eeprom_length)(dev); }
@@ -3233,10 +3234,10 @@ rte_eth_dev_get_eeprom(uint8_t port_id, struct rte_dev_eeprom_info *info) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom, -ENOTSUP );return (*dev->dev_ops->get_eeprom)(dev, info); }
@@ -3245,10 +3246,10 @@ rte_eth_dev_set_eeprom(uint8_t port_id, struct rte_dev_eeprom_info *info) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_eeprom, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_eeprom, -ENOTSUP );return (*dev->dev_ops->set_eeprom)(dev, info); }
@@ -3259,14 +3260,14 @@ rte_eth_dev_get_dcb_info(uint8_t port_id,struct rte_eth_dev *dev;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id];memset (dcb_info,0 ,sizeof (struct rte_eth_dcb_info )); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_dcb_info, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_dcb_info, -ENOTSUP );return (*dev->dev_ops->get_dcb_info)(dev, dcb_info); }
@@ -3274,7 +3275,7 @@ void rte_eth_copy_pci_info(struct rte_eth_dev *eth_dev, struct rte_pci_device *pci_dev) {if ((eth_dev ==NULL ) || (pci_dev ==NULL )) { -PMD_DEBUG_TRACE ("NULL pointer eth_dev=%p pci_dev=%p\n" , +RTE_PMD_DEBUG_TRACE ("NULL pointer eth_dev=%p pci_dev=%p\n" , eth_dev, pci_dev); }
Signature · 1 line
2.4.3
Re: [PATCH v5 01/10] ethdev: rename macros to have RTE_ prefix
Quoted 4 lines · Declan Doherty
The macros to check that the function pointers and port ids are valid for an ethdev are potentially useful to have in a common headers for use with all PMDs. However, since they would then become externally visible, we apply the
RTE_&RTE_ETH_prefix to them as approtiate.
Typo: appropriate
Quoted 2 lines
Signed-off-by Declan Doherty <[email protected]>
PATCH v5 2/10 ethdev: make error checking macros public
In reply to Declan DohertyMove the function pointer and port id checking macros to rte_ethdev and rte_dev header files, so that they can be used in the static inline functions there. Also replace the RTE_LOG call within RTE_PMD_DEBUG_TRACE so this macro can be built with the -pedantic flag
--- lib/librte_eal/common/include/rte_dev.h | 52 +++++++++++++++++++++++++++++++ lib/librte_ether/rte_ethdev.c | 54 --------------------------------- lib/librte_ether/rte_ethdev.h | 26 ++++++++++++++++ 3 files changed, 78 insertions(+), 54 deletions(-)
lib/librte_eal/common/include/rte_dev.h +52 -0
@@ -46,8 +46,60 @@extern "C" {#endif +#include <stdio.h> #include <sys/queue.h> +#include <rte_log.h> + +__attribute__((format (printf,2 ,0 ))) +static inline void +rte_pmd_debug_trace (const char *func_name,const char *fmt, ...) +{ +va_list ap; + +va_start (ap, fmt); +char buffer[vsnprintf (NULL ,0 , fmt, ap)]; + +va_end (ap); + +va_start (ap, fmt); +vsnprintf (buffer,sizeof (buffer), fmt, ap); +va_end (ap); + +rte_log (RTE_LOG_ERR ,RTE_LOGTYPE_PMD ,"%s: %s" , func_name, buffer); +} + +/* Macros for checking for restricting functions to primary instance only */ +#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_PROC_PRIMARY_OR_RET () do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return; \ + } \ +} while (0) + +/* Macros to check for invalid function pointers */ +#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_FUNC_PTR_OR_RET (func) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return; \ + } \ +} while (0) + +/** Double linked list of device drivers. */ TAILQ_HEAD (rte_driver_list, rte_driver);
lib/librte_ether/rte_ethdev.c +0 -54
60 lines not on this page · raw message
lib/librte_ether/rte_ethdev.h +26 -0
@@ -172,6 +172,8 @@ extern "C" {#include <stdint.h> +#include <rte_dev.h> +/* Use this macro to check if LRO API is supported */ #define RTE_ETHDEV_HAS_LRO_SUPPORT
@@ -931,6 +933,30 @@ struct rte_eth_dev_callback;/** @internal Structure to keep track of registered callbacks */ TAILQ_HEAD (rte_eth_dev_cb_list, rte_eth_dev_callback); + +#ifdef RTE_LIBRTE_ETHDEV_DEBUG +#define RTE_PMD_DEBUG_TRACE (...) \ + rte_pmd_debug_trace(__func__, __VA_ARGS__) +#else +#define RTE_PMD_DEBUG_TRACE(fmt, args...) +#endif + + +/* Macros to check for valid port */ +#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return retval; \ + } \ +} while (0) + +#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return; \ + } \ +} while (0) +/* * Definitions of all functions exported by an Ethernet driver through the * the generic structure of type *eth_dev_ops* supplied in the *rte_eth_dev*
Signature · 1 line
2.4.3
Re: [PATCH v5 02/10] ethdev: make error checking macros public
Quoted 6 lines · Declan Doherty
Move the function pointer and port id checking macros to
rte_ethdevandrte_devheader files, so that they can be used in the static inline functions there. Also replace theRTE_LOGcall withinRTE_PMD_DEBUG_TRACEso this macro can be built with the -pedantic flagSigned-off-by Declan Doherty <[email protected]>
Thanks, Declan. I'll rebase my other patchset that was very similar to this on top of this patch and your previous one.
Quoted 183 lines
--- lib/librte_eal/common/include/rte_dev.h | 52 +++++++++++++++++++++++++++++++ lib/librte_ether/rte_ethdev.c | 54 --------------------------------- lib/librte_ether/rte_ethdev.h | 26 ++++++++++++++++ 3 files changed, 78 insertions(+), 54 deletions(-)lib/librte_eal/common/include/rte_dev.h +52
-0@@ -46,8 +46,60 @@extern "C" {#endif +#include <stdio.h> #include <sys/queue.h> +#include <rte_log.h> + +__attribute__((format (printf,2 ,0 ))) +static inline void +rte_pmd_debug_trace (const char *func_name,const char *fmt, ...) +{ +va_list ap; + +va_start (ap, fmt); +char buffer[vsnprintf (NULL ,0 , fmt, ap)]; + +va_end (ap); + +va_start (ap, fmt); +vsnprintf (buffer,sizeof (buffer), fmt, ap); +va_end (ap); + +rte_log (RTE_LOG_ERR ,RTE_LOGTYPE_PMD ,"%s: %s" , func_name, buffer); +} + +/* Macros for checking for restricting functions to primary instance only */ +#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_PROC_PRIMARY_OR_RET () do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return; \ + } \ +} while (0) + +/* Macros to check for invalid function pointers */ +#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_FUNC_PTR_OR_RET (func) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return; \ + } \ +} while (0) + +/** Double linked list of device drivers. */ TAILQ_HEAD (rte_driver_list, rte_driver);lib/librte_ether/rte_ethdev.c +0
-54@@ -69,60 +69,6 @@#include "rte_ether.h" #include "rte_ethdev.h" -#ifdef RTE_LIBRTE_ETHDEV_DEBUG -#define RTE_PMD_DEBUG_TRACE(fmt, args...) do {do { \ - RTE_LOG(ERR, PMD, "%s: " fmt, __func__, ## args); \ - } while (0) -#else -#define RTE_PMD_DEBUG_TRACE(fmt, args...) -#endif - -/* Macros for checking for restricting functions to primary instance only */ -#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ - if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ - return (retval); \ - } \ -} while (0) - -#define RTE_PROC_PRIMARY_OR_RET () do { \ - if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ - return; \ - } \ -} while (0) - -/* Macros to check for invalid function pointers in dev_ops structure */ -#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ - if ((func) == NULL) { \ - RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ - return (retval); \ - } \ -} while (0) - -#define RTE_FUNC_PTR_OR_RET (func) do { \ - if ((func) == NULL) { \ - RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ - return; \ - } \ -} while (0) - -/* Macros to check for valid port */ -#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return retval; \ - } \ -} while (0) - -#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return; \ - } \ -} while (0) - -static const char *MZ_RTE_ETH_DEV_DATA ="rte_eth_dev_data" ;struct rte_eth_dev rte_eth_devices[RTE_MAX_ETHPORTS ];static struct rte_eth_dev_data *rte_eth_dev_data;lib/librte_ether/rte_ethdev.h +26
-0@@ -172,6 +172,8 @@ extern "C" {#include <stdint.h> +#include <rte_dev.h> +/* Use this macro to check if LRO API is supported */ #define RTE_ETHDEV_HAS_LRO_SUPPORT @@ -931,6 +933,30 @@ struct rte_eth_dev_callback;/** @internal Structure to keep track of registered callbacks */ TAILQ_HEAD (rte_eth_dev_cb_list, rte_eth_dev_callback); + +#ifdef RTE_LIBRTE_ETHDEV_DEBUG +#define RTE_PMD_DEBUG_TRACE (...) \ + rte_pmd_debug_trace(__func__, __VA_ARGS__) +#else +#define RTE_PMD_DEBUG_TRACE(fmt, args...) +#endif + + +/* Macros to check for valid port */ +#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return retval; \ + } \ +} while (0) + +#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return; \ + } \ +} while (0) +/* * Definitions of all functions exported by an Ethernet driver through the * the generic structure of type *eth_dev_ops* supplied in the *rte_eth_dev* Signature · 1 line
2.4.3
Re: [PATCH v5 02/10] ethdev: make error checking macros public
In reply to Declan DohertyQuoted 22 lines · Declan Doherty
Move the function pointer and port id checking macros to
rte_ethdevandrte_devheader files, so that they can be used in the static inline functions there. Also replace theRTE_LOGcall withinRTE_PMD_DEBUG_TRACEso this macro can be built with the -pedantic flagSigned-off-by Declan Doherty <[email protected]>--- lib/librte_eal/common/include/rte_dev.h | 52 +++++++++++++++++++++++++++++++ lib/librte_ether/rte_ethdev.c | 54 --------------------------------- lib/librte_ether/rte_ethdev.h | 26 ++++++++++++++++ 3 files changed, 78 insertions(+), 54 deletions(-)lib/librte_eal/common/include/rte_dev.h +1
-0@@ -46,8 +46,60 @@extern "C" {#endif +#include <stdio.h> #include <sys/queue.h>
lib/librte_eal/common/include/rte_dev.h line 60
Quoted 10 lines
lib/librte_eal/common/include/rte_dev.h +9
-0+#include <rte_log.h> + +__attribute__((format (printf,2 ,0 ))) +static inline void +rte_pmd_debug_trace (const char *func_name,const char *fmt, ...) +{ +va_list ap; + +va_start (ap, fmt);
I suggest adding an empty line here since we're mixing code and declarations.
lib/librte_eal/common/include/rte_dev.h line 61
Quoted 1 line
lib/librte_eal/common/include/rte_dev.h +1
-0+char buffer[vsnprintf (NULL ,0 , fmt, ap)];
I forgot an extra byte for trailing '\0' in my original comment, the above line should read:
char buffer[vsnprintf(NULL, 0, fmt, ap) + 1];
Otherwise the last character will be missing. Did you test that function?
Quoted 156 lines
lib/librte_eal/common/include/rte_dev.h +41
-0+ +va_end (ap); + +va_start (ap, fmt); +vsnprintf (buffer,sizeof (buffer), fmt, ap); +va_end (ap); + +rte_log (RTE_LOG_ERR ,RTE_LOGTYPE_PMD ,"%s: %s" , func_name, buffer); +} + +/* Macros for checking for restricting functions to primary instance only */ +#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_PROC_PRIMARY_OR_RET () do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return; \ + } \ +} while (0) + +/* Macros to check for invalid function pointers */ +#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_FUNC_PTR_OR_RET (func) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return; \ + } \ +} while (0) + +/** Double linked list of device drivers. */ TAILQ_HEAD (rte_driver_list, rte_driver);lib/librte_ether/rte_ethdev.c +0
-54@@ -69,60 +69,6 @@#include "rte_ether.h" #include "rte_ethdev.h" -#ifdef RTE_LIBRTE_ETHDEV_DEBUG -#define RTE_PMD_DEBUG_TRACE(fmt, args...) do {do { \ - RTE_LOG(ERR, PMD, "%s: " fmt, __func__, ## args); \ - } while (0) -#else -#define RTE_PMD_DEBUG_TRACE(fmt, args...) -#endif - -/* Macros for checking for restricting functions to primary instance only */ -#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ - if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ - return (retval); \ - } \ -} while (0) - -#define RTE_PROC_PRIMARY_OR_RET () do { \ - if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ - return; \ - } \ -} while (0) - -/* Macros to check for invalid function pointers in dev_ops structure */ -#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ - if ((func) == NULL) { \ - RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ - return (retval); \ - } \ -} while (0) - -#define RTE_FUNC_PTR_OR_RET (func) do { \ - if ((func) == NULL) { \ - RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ - return; \ - } \ -} while (0) - -/* Macros to check for valid port */ -#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return retval; \ - } \ -} while (0) - -#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return; \ - } \ -} while (0) - -static const char *MZ_RTE_ETH_DEV_DATA ="rte_eth_dev_data" ;struct rte_eth_dev rte_eth_devices[RTE_MAX_ETHPORTS ];static struct rte_eth_dev_data *rte_eth_dev_data;lib/librte_ether/rte_ethdev.h +26
-0@@ -172,6 +172,8 @@ extern "C" {#include <stdint.h> +#include <rte_dev.h> +/* Use this macro to check if LRO API is supported */ #define RTE_ETHDEV_HAS_LRO_SUPPORT @@ -931,6 +933,30 @@ struct rte_eth_dev_callback;/** @internal Structure to keep track of registered callbacks */ TAILQ_HEAD (rte_eth_dev_cb_list, rte_eth_dev_callback); + +#ifdef RTE_LIBRTE_ETHDEV_DEBUG +#define RTE_PMD_DEBUG_TRACE (...) \ + rte_pmd_debug_trace(__func__, __VA_ARGS__) +#else +#define RTE_PMD_DEBUG_TRACE(fmt, args...) +#endif + + +/* Macros to check for valid port */ +#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return retval; \ + } \ +} while (0) + +#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return; \ + } \ +} while (0) +/* * Definitions of all functions exported by an Ethernet driver through the * the generic structure of type *eth_dev_ops* supplied in the *rte_eth_dev* Signature · 1 line
2.4.3
Signature · 2 lines
Adrien Mazarguil 6WIND
Re: [PATCH v5 02/10] ethdev: make error checking macros public
Quoted 24 lines · Adrien Mazarguil
Quoted 23 lines · Declan Doherty
Move the function pointer and port id checking macros to
rte_ethdevandrte_devheader files, so that they can be used in the static inline functions there. Also replace theRTE_LOGcall withinRTE_PMD_DEBUG_TRACEso this macro can be built with the -pedantic flagSigned-off-by Declan Doherty <[email protected]>--- lib/librte_eal/common/include/rte_dev.h | 52 +++++++++++++++++++++++++++++++ lib/librte_ether/rte_ethdev.c | 54 --------------------------------- lib/librte_ether/rte_ethdev.h | 26 ++++++++++++++++ 3 files changed, 78 insertions(+), 54 deletions(-)lib/librte_eal/common/include/rte_dev.h +1
-0@@ -46,8 +46,60 @@extern "C" {#endif +#include <stdio.h> #include <sys/queue.h>
Quoted 13 lines
lib/librte_eal/common/include/rte_dev.h line 60
Quoted 9 lines
lib/librte_eal/common/include/rte_dev.h +9
-0+#include <rte_log.h> + +__attribute__((format (printf,2 ,0 ))) +static inline void +rte_pmd_debug_trace (const char *func_name,const char *fmt, ...) +{ +va_list ap; + +va_start (ap, fmt);I suggest adding an empty line here since we're mixing code and declarations.
sure no problem.
Quoted 9 lines
lib/librte_eal/common/include/rte_dev.h line 61
Quoted 1 line
lib/librte_eal/common/include/rte_dev.h +1
-0+char buffer[vsnprintf (NULL ,0 , fmt, ap)];I forgot an extra byte for trailing '\0' in my original comment, the above line should read:
char buffer[vsnprintf(NULL, 0, fmt, ap) + 1];Otherwise the last character will be missing. Did you test that function?
I didn't notice the truncation in the log message, I was just missing and "!" in the log message and didn't miss it. I'll push a new version with this fix.
Quoted 10 lines
Quoted 10 lines
lib/librte_eal/common/include/rte_dev.h +10
-0+ +va_end (ap); + +va_start (ap, fmt); +vsnprintf (buffer,sizeof (buffer), fmt, ap); +va_end (ap); + +rte_log (RTE_LOG_ERR ,RTE_LOGTYPE_PMD ,"%s: %s" , func_name, buffer); +} +
<snip>
Quoted 4 lines
Quoted 3 lines
--
2.4.3
PATCH v5 3/10 eal: add __rte_packed /__rte_aligned macros
In reply to Declan DohertyAdding a new marco for specifing __aligned__ attribute, and updating the current __rte_cache_aligned macro to use it.
Also adding a new macro to specify the __packed__ attribute
--- lib/librte_eal/common/include/rte_memory.h | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-)
lib/librte_eal/common/include/rte_memory.h +11 -1
@@ -76,9 +76,19 @@ enum rte_page_sizes {/**< Return the first cache-aligned value greater or equal to size. */ /** +* Force alignment +*/ +#define __rte_aligned (a) __attribute__((__aligned__(a))) + +/** * Force alignment to cache line. */ -#define __rte_cache_aligned __attribute__((__aligned__(RTE_CACHE_LINE_SIZE))) +#define __rte_cache_aligned __rte_aligned(RTE_CACHE_LINE_SIZE) + +/** +* Force a structure to be packed +*/ +#define __rte_packed __attribute__((__packed__))typedef uint64_t phys_addr_t ;/**< Physical address definition. */ #define RTE_BAD_PHYS_ADDR ((phys_addr_t)-1)
Signature · 1 line
2.4.3
PATCH v5 4/10 mbuf: add new marcos to get the physical address of data
In reply to Declan Doherty--- lib/librte_mbuf/rte_mbuf.h | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)
lib/librte_mbuf/rte_mbuf.h +23 -0
@@ -1622,6 +1622,29 @@ static inline struct rte_mbuf *rte_pktmbuf_lastseg(struct rte_mbuf *m)#define rte_pktmbuf_mtod (m, t) rte_pktmbuf_mtod_offset(m, t, 0)/** +* A macro that returns the physical address that points to an offset of the +* start of the data in the mbuf +* +* @param m +* The packet mbuf. +* @param o +* The offset into the data to calculate address from. +*/ +#define rte_pktmbuf_mtophys_offset (m, o) \ + ((phys_addr_t)((char *)(m)->buf_physaddr + (m)->data_off) + (o)) + +/** +* A macro that returns the physical address that points to the start of the +* data in the mbuf +* +* @param m +* The packet mbuf. +* @param o +* The offset into the data to calculate address from. +*/ +#define rte_pktmbuf_mtophys (m) rte_pktmbuf_mtophys_offset(m, 0) + +/** * A macro that returns the length of the packet. * * The value can be read or assigned.
Signature · 1 line
2.4.3
PATCH v5 5/10 cryptodev: Initial DPDK Crypto APIs and device framework release
In reply to Declan DohertyThis patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
changes from RFC:
- Session management API changes to support specification of crypto transform(xform) chains using linked list of xforms.
- Changes to the crypto operation struct as a result of session management changes.
- Some movement of common MACROS shared by cryptodevs and ethdevs to common headers
--- MAINTAINERS | 4 + config/common_bsdapp | 10 +- config/common_linuxapp | 10 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + lib/Makefile | 1 + lib/librte_cryptodev/Makefile | 60 ++ lib/librte_cryptodev/rte_crypto.h | 613 +++++++++++++ lib/librte_cryptodev/rte_cryptodev.c | 1092 ++++++++++++++++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 649 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 549 ++++++++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_log.h | 1 + mk/rte.app.mk | 1 + 14 files changed, 3031 insertions(+), 2 deletions(-) create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map
MAINTAINERS +4 -0
@@ -196,6 +196,10 @@ M: Thomas Monjalon <[email protected]> F: lib/librte_ether/ F: scripts/test-null.sh +Crypto API +M: Declan Doherty <[email protected]> +F: lib/librte_cryptodev +F: docs/guides/cryptodevs Drivers -------
config/common_bsdapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -147,6 +147,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -145,6 +145,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/api/doxy-api-index.md +1 -0
@@ -39,6 +39,7 @@ There are many libraries, so their headers may be grouped by topics: [dev] (@ref rte_dev.h), [ethdev] (@ref rte_ethdev.h), [ethctrl] (@ref rte_eth_ctrl.h), + [cryptodev] (@ref rte_cryptodev.h), [devargs] (@ref rte_devargs.h), [bond] (@ref rte_eth_bond.h), [vhost] (@ref rte_virtio_net.h),
doc/api/doxy-api.conf +1 -0
@@ -37,6 +37,7 @@ INPUT = doc/api/doxy-api-index.md \ lib/librte_cfgfile \ lib/librte_cmdline \ lib/librte_compat \ + lib/librte_cryptodev \ lib/librte_distributor \ lib/librte_ether \ lib/librte_hash \
lib/Makefile +1 -0
@@ -40,6 +40,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline DIRS-$(CONFIG_RTE_LIBRTE_ETHER) += librte_ether +DIRS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += librte_cryptodev DIRS-$(CONFIG_RTE_LIBRTE_VHOST) += librte_vhost DIRS-$(CONFIG_RTE_LIBRTE_HASH) += librte_hash DIRS-$(CONFIG_RTE_LIBRTE_LPM) += librte_lpm
lib/librte_cryptodev/Makefile new file +60 -0
61 lines not on this page · raw message
lib/librte_cryptodev/rte_crypto.h new file +613 -0
613 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.c new file +1092 -0
1,092 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.h new file +649 -0
649 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_pmd.h new file +549 -0
512 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_version.map new file +41 -0
41 lines not on this page · raw message
lib/librte_eal/common/include/rte_log.h +1 -0
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v5 6/10 mbuf_offload: library to support attaching offloads to a mbuf
In reply to Declan DohertyThis library add support for adding a chain of offload operations to a mbuf. It contains the definition of the rte_mbuf_offload structure as well as helper functions for attaching offloads to mbufs and a mempool management functions.
This initial implementation supports attaching multiple offload operations to a single mbuf, but only a single offload operation of a specific type can be attach to that mbuf.
--- MAINTAINERS | 4 + config/common_bsdapp | 6 + config/common_linuxapp | 6 + lib/Makefile | 1 + lib/librte_mbuf/rte_mbuf.h | 6 + lib/librte_mbuf_offload/Makefile | 52 ++++ lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 +++++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 291 +++++++++++++++++++++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 1 + 10 files changed, 474 insertions(+) create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
MAINTAINERS +4 -0
@@ -191,6 +191,10 @@ F: lib/librte_mbuf/ F: doc/guides/prog_guide/mbuf_lib.rst F: app/test/test_mbuf.c +Packet buffer offload +M: Declan Doherty <[email protected]> +F: lib/librte_mbuf_offload/ + Ethernet API M: Thomas Monjalon <[email protected]> F: lib/librte_ether/
config/common_bsdapp +6 -0
@@ -332,6 +332,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
config/common_linuxapp +6 -0
@@ -340,6 +340,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
lib/Makefile +1 -0
@@ -36,6 +36,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_EAL) += librte_eal DIRS-$(CONFIG_RTE_LIBRTE_RING) += librte_ring DIRS-$(CONFIG_RTE_LIBRTE_MEMPOOL) += librte_mempool DIRS-$(CONFIG_RTE_LIBRTE_MBUF) += librte_mbuf +DIRS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += librte_mbuf_offload DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline
lib/librte_mbuf/rte_mbuf.h +6 -0
@@ -728,6 +728,9 @@ typedef uint8_t MARKER8[0]; /**< generic marker with 1B alignment */typedef uint64_t MARKER64 [0 ];/**< marker that allows us to overwrite 8 bytes * with a single assignment */ +/** Opaque rte_mbuf_offload structure declarations */ +struct rte_mbuf_offload ; +/** * The generic rte_mbuf, containing a packet mbuf. */
@@ -841,6 +844,9 @@ struct rte_mbuf {/** Timesync flags for use with IEEE1588. */ uint16_t timesync; + +/* Chain of off-load operations to perform on mbuf */ +struct rte_mbuf_offload *offload_ops; } __rte_cache_aligned;static inline uint16_t rte_pktmbuf_priv_size (struct rte_mempool *mp);
lib/librte_mbuf_offload/Makefile new file +52 -0
52 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.c new file +100 -0
100 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h new file +291 -0
291 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload_version.map new file +7 -0
@@ -0,0 +1,7 @@ +DPDK_2.2 { + global: + + rte_pktmbuf_offload_pool_create; + + local: *; +};
mk/rte.app.mk +1 -0
@@ -116,6 +116,7 @@ ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) _LDLIBS-$(CONFIG_RTE_LIBRTE_KVARGS) += -lrte_kvargs _LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF) += -lrte_mbuf +_LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += -lrte_mbuf_offload _LDLIBS-$(CONFIG_RTE_LIBRTE_IP_FRAG) += -lrte_ip_frag _LDLIBS-$(CONFIG_RTE_LIBRTE_ETHER) += -lethdev _LDLIBS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += -lrte_cryptodev
Signature · 1 line
2.4.3
PATCH v5 7/10 qat_crypto_pmd: Addition of a new QAT DPDK PMD.
In reply to Declan DohertyThis patch adds a PMD for the Intel Quick Assist Technology DH895xxC hardware accelerator.
This patch depends on a QAT PF driver for device initialization. See the file docs/guides/cryptodevs/qat.rst for configuration details
This patch supports a limited subset of QAT device functionality, currently supporting chaining of cipher and hash operations for the following algorithmsd:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Some limitation on this patchset which shall be contributed in a subsequent release:
- Chained mbufs are not supported.
- Hash only is not supported.
- Cipher only is not supported.
- Only in-place is currently supported (destination address is the same as source address).
- Only supports session-oriented API implementation (session-less APIs are not supported).
--- config/common_bsdapp | 14 + config/common_linuxapp | 14 + doc/guides/cryptodevs/index.rst | 42 ++ doc/guides/cryptodevs/qat.rst | 194 +++++++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 37 ++ drivers/crypto/qat/Makefile | 63 +++ .../qat/qat_adf/adf_transport_access_macros.h | 174 ++++++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++++++++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++++++++++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++++++++++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 +++++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 601 +++++++++++++++++++++ drivers/crypto/qat/qat_crypto.c | 561 +++++++++++++++++++ drivers/crypto/qat/qat_crypto.h | 124 +++++ drivers/crypto/qat/qat_logs.h | 78 +++ drivers/crypto/qat/qat_qp.c | 429 +++++++++++++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 137 +++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 9 +- mk/rte.app.mk | 3 + 22 files changed, 3628 insertions(+), 8 deletions(-) create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c
config/common_bsdapp +14 -0
@@ -155,6 +155,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +14 -0
@@ -153,6 +153,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_QAT_PMD_MAX_NB_SESSIONS=2048 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/guides/cryptodevs/index.rst new file +42 -0
42 lines not on this page · raw message
doc/guides/cryptodevs/qat.rst new file +194 -0
194 lines not on this page · raw message
doc/guides/index.rst +1 -0
@@ -42,6 +42,7 @@ Contents: xen/index prog_guide/index nics/index + cryptodevs/index sample_app_ug/index testpmd_app_ug/index faq/index
drivers/Makefile +1 -0
@@ -32,5 +32,6 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-y += net +DIRS-y += crypto include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/Makefile new file +37 -0
@@ -0,0 +1,37 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +include $(RTE_SDK)/mk/rte.vars.mk + +DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat + +include $(RTE_SDK)/mk/rte.sharelib.mk +include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/qat/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/qat/qat_adf/adf_transport_access_macros.h new file +174 -0
174 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw.h new file +316 -0
316 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw_la.h new file +404 -0
404 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_hw.h new file +306 -0
306 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs.h new file +125 -0
125 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs_build_desc.c new file +601 -0
601 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.c new file +561 -0
561 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.h new file +124 -0
123 lines not on this page · raw message
drivers/crypto/qat/qat_logs.h new file +78 -0
78 lines not on this page · raw message
drivers/crypto/qat/qat_qp.c new file +429 -0
429 lines not on this page · raw message
drivers/crypto/qat/rte_pmd_qat_version.map new file +3 -0
Lines of this file are not shown. View the raw message.
drivers/crypto/qat/rte_qat_cryptodev.c new file +137 -0
137 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h +1 -8
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v5 8/10 aesni_mb_pmd: Initial implementation of multi buffer based crypto device
In reply to Declan DohertyThis patch provides the initial implementation of the AES-NI multi-buffer based crypto poll mode driver using DPDK's new cryptodev framework.
This PMD is dependent on Intel's multibuffer library, see the whitepaper "Fast Multi-buffer IPsec Implementations on Intel® Architecture Processors", see ref 1 for details on the library's design and ref 2 to download the library itself. This initial implementation is limited to supporting the chained operations of "hash then cipher" or "cipher then hash" for the following cipher and hash algorithms:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Important Note:
Due to the fact that the multi-buffer library is designed for accelerating IPsec crypto oepration, the digest's generated for the HMAC functions are truncated to lengths specified by IPsec RFC's, ie RFC2404 for using HMAC-SHA-1 with IPsec specifies that the digest is truncate from 20 to 12 bytes.
Build instructions:
To build DPKD with the AESNI_MB_PMD the user is required to download (ref 2) and compile the multi-buffer library on there user system before building DPDK. The environmental variable AESNI_MULTI_BUFFER_LIB_PATH must be exported with the path where you extracted and built the multi buffer library and finally set CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y in config/common_linuxapp.
Current status: It's doesn't support crypto operation across chained mbufs, or cipher only or hash only operations.
ref 2: https://downloadcenter.intel.com/download/22972
--- MAINTAINERS | 3 + config/common_bsdapp | 7 + config/common_linuxapp | 7 + doc/guides/cryptodevs/aesni_mb.rst | 76 +++ doc/guides/cryptodevs/index.rst | 1 + drivers/crypto/Makefile | 1 + drivers/crypto/aesni_mb/Makefile | 63 ++ drivers/crypto/aesni_mb/aesni_mb_ops.h | 210 +++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 669 +++++++++++++++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 298 +++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 229 +++++++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + mk/rte.app.mk | 4 + 13 files changed, 1571 insertions(+) create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map
MAINTAINERS +3 -0
@@ -303,6 +303,9 @@ Null PMD M: Tetsuya Mukawa <[email protected]> F: drivers/net/null/ +Crypto AES-NI Multi-Buffer PMD +M: Declan Doherty <[email protected]> +F: driver/crypto/aesni_mb Packet processing -----------------
config/common_bsdapp +7 -0
@@ -168,6 +168,13 @@ CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n # CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_AESNI_MB_DEBUG=n + # # Support NIC bypass logic #
config/common_linuxapp +7 -0
@@ -166,6 +166,13 @@ CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n # CONFIG_RTE_QAT_PMD_MAX_NB_SESSIONS=2048 +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_DEBUG=n +CONFIG_RTE_AESNI_MB_PMD_MAX_NB_QUEUE_PAIRS=8 +CONFIG_RTE_AESNI_MB_PMD_MAX_NB_SESSIONS=2048 + # # Support NIC bypass logic #
doc/guides/cryptodevs/aesni_mb.rst new file +76 -0
76 lines not on this page · raw message
doc/guides/cryptodevs/index.rst +1 -0
@@ -39,4 +39,5 @@ Crypto Device Drivers :maxdepth: 2 :numbered: + aesni_mb qat
drivers/crypto/Makefile +1 -0
@@ -31,6 +31,7 @@ include $(RTE_SDK)/mk/rte.vars.mk +DIRS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += aesni_mb DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat include $(RTE_SDK)/mk/rte.sharelib.mk
drivers/crypto/aesni_mb/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/aesni_mb/aesni_mb_ops.h new file +210 -0
210 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c new file +669 -0
669 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c new file +298 -0
298 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h new file +229 -0
229 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_pmd_aesni_version.map new file +3 -0
@@ -0,0 +1,3 @@ +DPDK_2.2 { + local: *; +};
mk/rte.app.mk +4 -0
@@ -153,6 +153,10 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_NULL) += -lrte_pmd_null # QAT PMD has a dependency on libcrypto (from openssl) for calculating HMAC precomputes _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += -lrte_pmd_qat -lcrypto +# AESNI MULTI BUFFER is dependent on the IPSec_MB library +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -lrte_pmd_aesni_mb +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -L$(AESNI_MULTI_BUFFER_LIB_PATH) -lIPSec_MB + endif # ! $(CONFIG_RTE_BUILD_SHARED_LIB) endif # ! CONFIG_RTE_BUILD_COMBINE_LIBS
Signature · 1 line
2.4.3
PATCH v5 9/10 app/test: add cryptodev unit and performance tests
In reply to Declan Dohertyunit tests are run by using cryptodev_qat_autotest or cryptodev_aesni_autotest from the test apps interactive console.
performance tests are run by using the cryptodev_qat_perftest or cryptodev_aesni_mb_perftest command from the test apps interactive console.
If you which to run the tests on a QAT device there must be one bound to igb_uio kernel driver.
--- MAINTAINERS | 2 + app/test/Makefile | 4 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1986 ++++++++++++++++++++++++++++++++ app/test/test_cryptodev.h | 68 ++ app/test/test_cryptodev_perf.c | 2062 ++++++++++++++++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- app/test/test_link_bonding_rssconf.c | 7 +- 10 files changed, 4219 insertions(+), 49 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c
MAINTAINERS +2 -0
@@ -204,6 +204,8 @@ Crypto API M: Declan Doherty <[email protected]> F: lib/librte_cryptodev F: docs/guides/cryptodevs +F: app/test/test_cryptodev.c +F: app/test/test_cryptodev_perf.c Drivers -------
app/test/Makefile +4 -0
@@ -149,6 +149,10 @@ endif SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring.c SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring_perf.c + +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev_perf.c +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev.c + SRCS-$(CONFIG_RTE_LIBRTE_KVARGS) += test_kvargs.c CFLAGS += -O3
app/test/test.c +61 -31
112 lines not on this page · raw message
app/test/test.h +27 -7
@@ -33,7 +33,7 @@#ifndef _TEST_H_#define _TEST_H_ - +#include <stddef.h> #include <sys/queue.h> #define TEST_SUCCESS (0)
@@ -64,6 +64,17 @@ } \ } while (0) + +#define TEST_ASSERT_BUFFERS_ARE_EQUAL (a, b, len, msg, ...) do { \ + if (memcmp(a, b, len)) { \ + printf("TestCase %s() line %d failed: " \ + msg "\n", __func__, __LINE__, ##__VA_ARGS__); \ + TEST_TRACE_FAILURE(__FILE__, __LINE__, __func__); \ + return TEST_FAILED; \ + } \ +} while (0) + +#define TEST_ASSERT_NOT_EQUAL (a, b, msg, ...) do { \ if (!(a != b)) { \ printf("TestCase %s() line %d failed: " \
@@ -113,27 +124,36 @@struct unit_test_case {int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );int (*testcase)(void );const char *success_msg;const char *fail_msg; +unsigned enabled; }; -#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed"} +#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed", 1 }#define TEST_CASE_NAMED (name, fn) { NULL, NULL, fn, name " succeeded", \ - name " failed"} + name " failed", 1 }#define TEST_CASE_ST (setup, teardown, testcase) \ { setup, teardown, testcase, #testcase " succeeded", \ - #testcase " failed "} + #testcase " failed ", 1 } + + +#define TEST_CASE_DISABLED (fn) { NULL, NULL, fn, #fn " succeeded", \ + #fn " failed", 0 } + +#define TEST_CASE_ST_DISABLED (setup, teardown, testcase) \ + { setup, teardown, testcase, #testcase " succeeded", \ + #testcase " failed ", 0 } -#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL } +#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL, 0 }struct unit_test_suite {const char *suite_name;int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );struct unit_test_case unit_test_cases[]; };
app/test/test_cryptodev.c new file +1986 -0
1,986 lines not on this page · raw message
app/test/test_cryptodev.h new file +68 -0
68 lines not on this page · raw message
app/test/test_cryptodev_perf.c new file +2062 -0
749 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v5 10/10 l2fwd-crypto: crypto
In reply to Declan DohertyThis patch creates a new sample applicaiton based off the l2fwd application which performs specified crypto operations on IP packet payloads which are forwarding.
--- MAINTAINERS | 1 + examples/l2fwd-crypto/Makefile | 50 ++ examples/l2fwd-crypto/main.c | 1473 ++++++++++++++++++++++++++++++++++++++++ 3 files changed, 1524 insertions(+) create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c
MAINTAINERS +1 -0
@@ -206,6 +206,7 @@ F: lib/librte_cryptodev F: docs/guides/cryptodevs F: app/test/test_cryptodev.c F: app/test/test_cryptodev_perf.c +F: examples/l2fwd-crypto Drivers -------
examples/l2fwd-crypto/Makefile new file +50 -0
50 lines not on this page · raw message
examples/l2fwd-crypto/main.c new file +1473 -0
1,473 lines not on this page · raw message
Signature · 1 line
2.4.3
v6 cover Crypto API and device framework
In reply to Declan DohertyThis series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.
The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwarded
Current Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.
v6:
- Fix 32-bit build issue caused by casting in new rte_pktmbuf_mtophys_offset macro
- Fix truncation of log message by new rte_pmd_debug_trace inline function
v5:
- Making ethdev marcos for function pointer and port id checking public and available for use in by the cryptodev. The intialise to patches combine changes from original cryptodev patch and discussion in
http://dpdk.org/ml/archives/dev/2015-November/027871.html
- Split out changes to create new __rte_packed and __rte_aligned macros into seperate patches form the main cryptodev patch set for clairty
- further code cleaning, removal of currently unsupported gcm code from aesni_mb pmd
v4:
- Some more EOF whitespace and checkpatch fixes
v3:
- Fixes a document build error, which I missed in the V2
- Fixes for remaining checkpatch errors
- Disables QAT and AESNI_MB PMD being build by default as they have external library dependences
v2:
- Introduces a new library to support attaching offload operations to a mbuf
- Remove unused APIs from cryptodev
- PMD code refactor due to new rte_mbuf_offload structure
- General bug fixes and code tidy up
Declan Doherty (10):
ethdev: rename macros to have RTE_ prefix
ethdev: make error checking macros public
eal: add __rte_packed /__rte_aligned macros
mbuf: add new marcos to get the physical address of data
cryptodev: Initial DPDK Crypto APIs and device framework release
mbuf_offload: library to support attaching offloads to a mbuf
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
MAINTAINERS | 14 + app/test/Makefile | 4 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1986 +++++++++++++++++++ app/test/test_cryptodev.h | 68 + app/test/test_cryptodev_perf.c | 2062 ++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- app/test/test_link_bonding_rssconf.c | 7 +- config/common_bsdapp | 37 +- config/common_linuxapp | 37 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + doc/guides/cryptodevs/aesni_mb.rst | 76 + doc/guides/cryptodevs/index.rst | 43 + doc/guides/cryptodevs/qat.rst | 194 ++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 38 + drivers/crypto/aesni_mb/Makefile | 63 + drivers/crypto/aesni_mb/aesni_mb_ops.h | 210 ++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 669 +++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 298 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 229 +++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + drivers/crypto/qat/Makefile | 63 + .../qat/qat_adf/adf_transport_access_macros.h | 174 ++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 ++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 601 ++++++ drivers/crypto/qat/qat_crypto.c | 561 ++++++ drivers/crypto/qat/qat_crypto.h | 124 ++ drivers/crypto/qat/qat_logs.h | 78 + drivers/crypto/qat/qat_qp.c | 429 ++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 137 ++ examples/l2fwd-crypto/Makefile | 50 + examples/l2fwd-crypto/main.c | 1473 ++++++++++++++ lib/Makefile | 2 + lib/librte_cryptodev/Makefile | 60 + lib/librte_cryptodev/rte_crypto.h | 613 ++++++ lib/librte_cryptodev/rte_cryptodev.c | 1092 +++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 649 ++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 549 ++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_dev.h | 53 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 607 +++--- lib/librte_ether/rte_ethdev.h | 26 + lib/librte_mbuf/rte_mbuf.h | 29 + lib/librte_mbuf_offload/Makefile | 52 + lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 + lib/librte_mbuf_offload/rte_mbuf_offload.h | 284 +++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 9 + 59 files changed, 14830 insertions(+), 383 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
Signature · 1 line
2.4.3
PATCH v6 1/10 ethdev: rename macros to have RTE_ prefix
The macros to check that the function pointers and port ids are valid for an ethdev are potentially useful to have in a common headers for use with all PMDs. However, since they would then become externally visible, we apply the RTE_ & RTE_ETH_ prefix to them as approtiate.
--- lib/librte_ether/rte_ethdev.c | 595 +++++++++++++++++++++--------------------- 1 file changed, 298 insertions(+), 297 deletions(-)
lib/librte_ether/rte_ethdev.c +298 -297
@@ -70,58 +70,59 @@#include "rte_ethdev.h" #ifdef RTE_LIBRTE_ETHDEV_DEBUG -#define PMD_DEBUG_TRACE(fmt, args...) do { \ +#define RTE_PMD_DEBUG_TRACE(fmt, args...) do { \ RTE_LOG(ERR, PMD, "%s: " fmt, __func__, ## args); \ } while (0)#else -#define PMD_DEBUG_TRACE(fmt, args...) +#define RTE_PMD_DEBUG_TRACE(fmt, args...)#endif /* Macros for checking for restricting functions to primary instance only */ -#define PROC_PRIMARY_OR_ERR_RET (retval) do { \ +#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ return (retval); \ } \ } while (0) -#define PROC_PRIMARY_OR_RET () do { \ +#define RTE_PROC_PRIMARY_OR_RET () do { \ if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ - PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ return; \ } \ } while (0)/* Macros to check for invalid function pointers in dev_ops structure */ -#define FUNC_PTR_OR_ERR_RET (func, retval) do { \ +#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ if ((func) == NULL) { \ - PMD_DEBUG_TRACE("Function not supported\n"); \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ return (retval); \ } \ } while (0) -#define FUNC_PTR_OR_RET (func) do { \ +#define RTE_FUNC_PTR_OR_RET (func) do { \ if ((func) == NULL) { \ - PMD_DEBUG_TRACE("Function not supported\n"); \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ return; \ } \ } while (0)/* Macros to check for valid port */ -#define VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return retval; \ - } \ +#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return retval; \ + } \ } while (0) -#define VALID_PORTID_OR_RET (port_id) do { \ - if (!rte_eth_dev_is_valid_port(port_id)) { \ - PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ - return; \ - } \ +#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return; \ + } \ } while (0) +static const char *MZ_RTE_ETH_DEV_DATA ="rte_eth_dev_data" ;struct rte_eth_dev rte_eth_devices[RTE_MAX_ETHPORTS ];static struct rte_eth_dev_data *rte_eth_dev_data;
@@ -244,7 +245,7 @@ rte_eth_dev_allocate(const char *name, enum rte_eth_dev_type type) port_id =rte_eth_dev_find_free_port ();if (port_id ==RTE_MAX_ETHPORTS ) { -PMD_DEBUG_TRACE ("Reached maximum number of Ethernet ports\n" ); +RTE_PMD_DEBUG_TRACE ("Reached maximum number of Ethernet ports\n" );return NULL ; }
@@ -252,7 +253,7 @@ rte_eth_dev_allocate(const char *name, enum rte_eth_dev_type type)rte_eth_dev_data_alloc ();if (rte_eth_dev_allocated (name) !=NULL ) { -PMD_DEBUG_TRACE ("Ethernet Device with name %s already allocated!\n" , +RTE_PMD_DEBUG_TRACE ("Ethernet Device with name %s already allocated!\n" , name);return NULL ; }
@@ -339,7 +340,7 @@ rte_eth_dev_init(struct rte_pci_driver *pci_drv,if (diag ==0 )return 0 ; -PMD_DEBUG_TRACE ("driver %s: eth_dev_init(vendor_id=0x%u device_id=0x%x) failed\n" , +RTE_PMD_DEBUG_TRACE ("driver %s: eth_dev_init(vendor_id=0x%u device_id=0x%x) failed\n" , pci_drv->name, (unsigned ) pci_dev->id.vendor_id, (unsigned ) pci_dev->id.device_id);
@@ -447,10 +448,10 @@ rte_eth_dev_get_device_type(uint8_t port_id)static int rte_eth_dev_get_addr_by_port (uint8_t port_id,struct rte_pci_addr *addr) { -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL );if (addr ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -463,10 +464,10 @@ rte_eth_dev_get_name_by_port(uint8_t port_id, char *name) {char *tmp; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL );if (name ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -483,7 +484,7 @@ rte_eth_dev_get_port_by_name(const char *name, uint8_t *port_id)int i;if (name ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -509,7 +510,7 @@ rte_eth_dev_get_port_by_addr(const struct rte_pci_addr *addr, uint8_t *port_id)struct rte_pci_device *pci_dev =NULL ;if (addr ==NULL ) { -PMD_DEBUG_TRACE ("Null pointer is specified\n" ); +RTE_PMD_DEBUG_TRACE ("Null pointer is specified\n" );return -EINVAL ; }
@@ -536,7 +537,7 @@ rte_eth_dev_is_detachable(uint8_t port_id)uint32_t dev_flags;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -EINVAL ; }
@@ -735,7 +736,7 @@ rte_eth_dev_rx_queue_config(struct rte_eth_dev *dev, uint16_t nb_queues)return -(ENOMEM ); } }else {/* re-configure */ -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_release, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_release, -ENOTSUP ); rxq = dev->data->rx_queues;
@@ -766,20 +767,20 @@ rte_eth_dev_rx_queue_start(uint8_t port_id, uint16_t rx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_start, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_start, -ENOTSUP );if (dev->data->rx_queue_state[rx_queue_id] !=RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already started\n" , rx_queue_id, port_id);return 0 ;
@@ -796,20 +797,20 @@ rte_eth_dev_rx_queue_stop(uint8_t port_id, uint16_t rx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_stop, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_stop, -ENOTSUP );if (dev->data->rx_queue_state[rx_queue_id] ==RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already stopped\n" , rx_queue_id, port_id);return 0 ;
@@ -826,20 +827,20 @@ rte_eth_dev_tx_queue_start(uint8_t port_id, uint16_t tx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (tx_queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_start, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_start, -ENOTSUP );if (dev->data->tx_queue_state[tx_queue_id] !=RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already started\n" , tx_queue_id, port_id);return 0 ;
@@ -856,20 +857,20 @@ rte_eth_dev_tx_queue_stop(uint8_t port_id, uint16_t tx_queue_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (tx_queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_stop, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_stop, -ENOTSUP );if (dev->data->tx_queue_state[tx_queue_id] ==RTE_ETH_QUEUE_STATE_STOPPED ) { -PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Queue %" PRIu16" of device with port_id=%" PRIu8" already stopped\n" , tx_queue_id, port_id);return 0 ;
@@ -895,7 +896,7 @@ rte_eth_dev_tx_queue_config(struct rte_eth_dev *dev, uint16_t nb_queues)return -(ENOMEM ); } }else {/* re-configure */ -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_release, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_release, -ENOTSUP ); txq = dev->data->tx_queues;
@@ -929,19 +930,19 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL );if (nb_rx_q >RTE_MAX_QUEUES_PER_PORT ) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("Number of RX queues requested (%u) is greater than max supported(%d)\n" , nb_rx_q,RTE_MAX_QUEUES_PER_PORT );return -EINVAL ; }if (nb_tx_q >RTE_MAX_QUEUES_PER_PORT ) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("Number of TX queues requested (%u) is greater than max supported(%d)\n" , nb_tx_q,RTE_MAX_QUEUES_PER_PORT );return -EINVAL ;
@@ -949,11 +950,11 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q, dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_configure, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_configure, -ENOTSUP );if (dev->data->dev_started) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("port %d must be stopped to allow configuration\n" , port_id);return -EBUSY ; }
@@ -965,22 +966,22 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,*/ (*dev->dev_ops->dev_infos_get)(dev, &dev_info);if (nb_rx_q > dev_info.max_rx_queues) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_queues=%d > %d\n" , +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_queues=%d > %d\n" , port_id, nb_rx_q, dev_info.max_rx_queues);return -EINVAL ; }if (nb_rx_q ==0 ) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_q == 0\n" , port_id); +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_rx_q == 0\n" , port_id);return -EINVAL ; }if (nb_tx_q > dev_info.max_tx_queues) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_queues=%d > %d\n" , +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_queues=%d > %d\n" , port_id, nb_tx_q, dev_info.max_tx_queues);return -EINVAL ; }if (nb_tx_q ==0 ) { -PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_q == 0\n" , port_id); +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d nb_tx_q == 0\n" , port_id);return -EINVAL ; }
@@ -993,7 +994,7 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,*/ if ((dev_conf->intr_conf.lsc ==1 ) && (!(dev->data->dev_flags &RTE_ETH_DEV_INTR_LSC ))) { -PMD_DEBUG_TRACE ("driver %s does not support lsc\n" , +RTE_PMD_DEBUG_TRACE ("driver %s does not support lsc\n" , dev->data->drv_name);return -EINVAL ; }
@@ -1005,14 +1006,14 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,if (dev_conf->rxmode.jumbo_frame ==1 ) {if (dev_conf->rxmode.max_rx_pkt_len > dev_info.max_rx_pktlen) { -PMD_DEBUG_TRACE ("ethdev port_id=%d max_rx_pkt_len %u" +RTE_PMD_DEBUG_TRACE ("ethdev port_id=%d max_rx_pkt_len %u" " > max valid value %u\n" , port_id, (unsigned )dev_conf->rxmode.max_rx_pkt_len, (unsigned )dev_info.max_rx_pktlen);return -EINVAL ; }else if (dev_conf->rxmode.max_rx_pkt_len <ETHER_MIN_LEN ) { - PMD_DEBUG_TRACE("ethdev port_id=%d max_rx_pkt_len %u" + RTE_PMD_DEBUG_TRACE("ethdev port_id=%d max_rx_pkt_len %u" " < min valid value %u\n", port_id, (unsigned)dev_conf->rxmode.max_rx_pkt_len,
@@ -1032,14 +1033,14 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q,*/ diag =rte_eth_dev_rx_queue_config (dev, nb_rx_q);if (diag !=0 ) { -PMD_DEBUG_TRACE ("port%d rte_eth_dev_rx_queue_config = %d\n" , +RTE_PMD_DEBUG_TRACE ("port%d rte_eth_dev_rx_queue_config = %d\n" , port_id, diag);return diag; } diag =rte_eth_dev_tx_queue_config (dev, nb_tx_q);if (diag !=0 ) { -PMD_DEBUG_TRACE ("port%d rte_eth_dev_tx_queue_config = %d\n" , +RTE_PMD_DEBUG_TRACE ("port%d rte_eth_dev_tx_queue_config = %d\n" , port_id, diag);rte_eth_dev_rx_queue_config (dev,0 );return diag;
@@ -1047,7 +1048,7 @@ rte_eth_dev_configure(uint8_t port_id, uint16_t nb_rx_q, uint16_t nb_tx_q, diag = (*dev->dev_ops->dev_configure)(dev);if (diag !=0 ) { -PMD_DEBUG_TRACE ("port%d dev_configure = %d\n" , +RTE_PMD_DEBUG_TRACE ("port%d dev_configure = %d\n" , port_id, diag);rte_eth_dev_rx_queue_config (dev,0 );rte_eth_dev_tx_queue_config (dev,0 );
@@ -1086,7 +1087,7 @@ rte_eth_dev_config_restore(uint8_t port_id) (dev->data->mac_pool_sel[i] & (1ULL << pool))) (*dev->dev_ops->mac_addr_add)(dev, &addr, i, pool); else { -PMD_DEBUG_TRACE ("port %d: MAC address array not supported\n" , +RTE_PMD_DEBUG_TRACE ("port %d: MAC address array not supported\n" , port_id);/* exit the loop but not return an error */ break ;
@@ -1114,16 +1115,16 @@ rte_eth_dev_start(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_start, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_start, -ENOTSUP );if (dev->data->dev_started !=0 ) { -PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8" already started\n" , port_id);return 0 ;
@@ -1138,7 +1139,7 @@ rte_eth_dev_start(uint8_t port_id)rte_eth_dev_config_restore (port_id);if (dev->data->dev_conf.intr_conf.lsc ==0 ) { -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->link_update, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->link_update, -ENOTSUP ); (*dev->dev_ops->link_update)(dev,0 ); }return 0 ;
@@ -1151,15 +1152,15 @@ rte_eth_dev_stop(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_RET (); +RTE_PROC_PRIMARY_OR_RET (); -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->dev_stop); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->dev_stop);if (dev->data->dev_started ==0 ) { -PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8 +RTE_PMD_DEBUG_TRACE ("Device with port_id=%" PRIu8" already stopped\n" , port_id);return ;
@@ -1176,13 +1177,13 @@ rte_eth_dev_set_link_up(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_up, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_up, -ENOTSUP );return (*dev->dev_ops->dev_set_link_up)(dev); }
@@ -1193,13 +1194,13 @@ rte_eth_dev_set_link_down(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_down, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_set_link_down, -ENOTSUP );return (*dev->dev_ops->dev_set_link_down)(dev); }
@@ -1210,12 +1211,12 @@ rte_eth_dev_close(uint8_t port_id)/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_RET (); +RTE_PROC_PRIMARY_OR_RET (); -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->dev_close); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->dev_close); dev->data->dev_started =0 ; (*dev->dev_ops->dev_close)(dev);
@@ -1238,24 +1239,24 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id,/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , rx_queue_id);return -EINVAL ; }if (dev->data->dev_started) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("port %d must be stopped to allow configuration\n" , port_id);return -EBUSY ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_setup, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_setup, -ENOTSUP );/* * Check the size of the mbuf data buffer.
@@ -1264,7 +1265,7 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id,*/ rte_eth_dev_info_get (port_id, &dev_info);if (mp->private_data_size <sizeof (struct rte_pktmbuf_pool_private )) { -PMD_DEBUG_TRACE ("%s private_data_size %d < %d\n" , +RTE_PMD_DEBUG_TRACE ("%s private_data_size %d < %d\n" , mp->name, (int ) mp->private_data_size, (int )sizeof (struct rte_pktmbuf_pool_private ));return -ENOSPC ;
@@ -1272,7 +1273,7 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id, mbp_buf_size =rte_pktmbuf_data_room_size (mp);if ((mbp_buf_size -RTE_PKTMBUF_HEADROOM ) < dev_info.min_rx_bufsize) { - PMD_DEBUG_TRACE("%s mbuf_data_room_size %d < %d " + RTE_PMD_DEBUG_TRACE("%s mbuf_data_room_size %d < %d " "(RTE_PKTMBUF_HEADROOM=%d + min_rx_bufsize(dev)" "=%d)\n", mp->name,
@@ -1288,7 +1289,7 @@ rte_eth_rx_queue_setup(uint8_t port_id, uint16_t rx_queue_id, nb_rx_desc < dev_info.rx_desc_lim.nb_min || nb_rx_desc % dev_info.rx_desc_lim.nb_align != 0) { - PMD_DEBUG_TRACE("Invalid value for nb_rx_desc(=%hu), " + RTE_PMD_DEBUG_TRACE("Invalid value for nb_rx_desc(=%hu), " "should be: <= %hu, = %hu, and a product of %hu\n", nb_rx_desc, dev_info.rx_desc_lim.nb_max,
@@ -1321,24 +1322,24 @@ rte_eth_tx_queue_setup(uint8_t port_id, uint16_t tx_queue_id,/* This function is only safe when called from the primary process * in a multi-process setup*/ -PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); +RTE_PROC_PRIMARY_OR_ERR_RET (-E_RTE_SECONDARY ); -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];if (tx_queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , tx_queue_id);return -EINVAL ; }if (dev->data->dev_started) { -PMD_DEBUG_TRACE ( +RTE_PMD_DEBUG_TRACE ("port %d must be stopped to allow configuration\n" , port_id);return -EBUSY ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_setup, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_infos_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->tx_queue_setup, -ENOTSUP );rte_eth_dev_info_get (port_id, &dev_info);
@@ -1354,10 +1355,10 @@ rte_eth_promiscuous_enable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_enable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_enable); (*dev->dev_ops->promiscuous_enable)(dev); dev->data->promiscuous =1 ; }
@@ -1367,10 +1368,10 @@ rte_eth_promiscuous_disable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_disable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->promiscuous_disable); dev->data->promiscuous =0 ; (*dev->dev_ops->promiscuous_disable)(dev); }
@@ -1380,7 +1381,7 @@ rte_eth_promiscuous_get(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];return dev->data->promiscuous;
@@ -1391,10 +1392,10 @@ rte_eth_allmulticast_enable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_enable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_enable); (*dev->dev_ops->allmulticast_enable)(dev); dev->data->all_multicast =1 ; }
@@ -1404,10 +1405,10 @@ rte_eth_allmulticast_disable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_disable); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->allmulticast_disable); dev->data->all_multicast =0 ; (*dev->dev_ops->allmulticast_disable)(dev); }
@@ -1417,7 +1418,7 @@ rte_eth_allmulticast_get(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];return dev->data->all_multicast;
@@ -1442,13 +1443,13 @@ rte_eth_link_get(uint8_t port_id, struct rte_eth_link *eth_link) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];if (dev->data->dev_conf.intr_conf.lsc !=0 )rte_eth_dev_atomic_read_link_status (dev, eth_link);else { -FUNC_PTR_OR_RET (*dev->dev_ops->link_update); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->link_update); (*dev->dev_ops->link_update)(dev,1 ); *eth_link = dev->data->dev_link; }
@@ -1459,13 +1460,13 @@ rte_eth_link_get_nowait(uint8_t port_id, struct rte_eth_link *eth_link) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];if (dev->data->dev_conf.intr_conf.lsc !=0 )rte_eth_dev_atomic_read_link_status (dev, eth_link);else { -FUNC_PTR_OR_RET (*dev->dev_ops->link_update); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->link_update); (*dev->dev_ops->link_update)(dev,0 ); *eth_link = dev->data->dev_link; }
@@ -1476,12 +1477,12 @@ rte_eth_stats_get(uint8_t port_id, struct rte_eth_stats *stats) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];memset (stats,0 ,sizeof (*stats)); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->stats_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->stats_get, -ENOTSUP ); (*dev->dev_ops->stats_get)(dev, stats); stats->rx_nombuf = dev->data->rx_mbuf_alloc_failed;return 0 ;
@@ -1492,10 +1493,10 @@ rte_eth_stats_reset(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_RET (*dev->dev_ops->stats_reset); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->stats_reset); (*dev->dev_ops->stats_reset)(dev); }
@@ -1510,7 +1511,7 @@ rte_eth_xstats_get(uint8_t port_id, struct rte_eth_xstats *xstats,signed xcount =0 ;uint64_t val, *stats_ptr; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];
@@ -1590,7 +1591,7 @@ rte_eth_xstats_reset(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];/* implemented by the driver */
@@ -1609,11 +1610,11 @@ set_queue_stats_mapping(uint8_t port_id, uint16_t queue_id, uint8_t stat_idx, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->queue_stats_mapping_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->queue_stats_mapping_set, -ENOTSUP );return (*dev->dev_ops->queue_stats_mapping_set) (dev, queue_id, stat_idx, is_rx); }
@@ -1647,14 +1648,14 @@ rte_eth_dev_info_get(uint8_t port_id, struct rte_eth_dev_info *dev_info) .nb_align = 1, }; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];memset (dev_info,0 ,sizeof (struct rte_eth_dev_info )); dev_info->rx_desc_lim = lim; dev_info->tx_desc_lim = lim; -FUNC_PTR_OR_RET (*dev->dev_ops->dev_infos_get); +RTE_FUNC_PTR_OR_RET (*dev->dev_ops->dev_infos_get); (*dev->dev_ops->dev_infos_get)(dev, dev_info); dev_info->pci_dev = dev->pci_dev; dev_info->driver_name = dev->data->drv_name;
@@ -1665,7 +1666,7 @@ rte_eth_macaddr_get(uint8_t port_id, struct ether_addr *mac_addr) {struct rte_eth_dev *dev; -VALID_PORTID_OR_RET (port_id); +RTE_ETH_VALID_PORTID_OR_RET (port_id); dev = &rte_eth_devices[port_id];ether_addr_copy (&dev->data->mac_addrs[0 ], mac_addr); }
@@ -1676,7 +1677,7 @@ rte_eth_dev_get_mtu(uint8_t port_id, uint16_t *mtu) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; *mtu = dev->data->mtu;
@@ -1689,9 +1690,9 @@ rte_eth_dev_set_mtu(uint8_t port_id, uint16_t mtu)int ret;struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mtu_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mtu_set, -ENOTSUP ); ret = (*dev->dev_ops->mtu_set)(dev, mtu);if (!ret)
@@ -1705,19 +1706,19 @@ rte_eth_dev_vlan_filter(uint8_t port_id, uint16_t vlan_id, int on) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (!(dev->data->dev_conf.rxmode.hw_vlan_filter)) { -PMD_DEBUG_TRACE ("port %d: vlan-filtering disabled\n" , port_id); +RTE_PMD_DEBUG_TRACE ("port %d: vlan-filtering disabled\n" , port_id);return -ENOSYS ; }if (vlan_id >4095 ) { -PMD_DEBUG_TRACE ("(port_id=%d) invalid vlan_id=%u > 4095\n" , +RTE_PMD_DEBUG_TRACE ("(port_id=%d) invalid vlan_id=%u > 4095\n" , port_id, (unsigned ) vlan_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_filter_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_filter_set, -ENOTSUP );return (*dev->dev_ops->vlan_filter_set)(dev, vlan_id, on); }
@@ -1727,14 +1728,14 @@ rte_eth_dev_set_vlan_strip_on_queue(uint8_t port_id, uint16_t rx_queue_id, int o {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (rx_queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid rx_queue_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid rx_queue_id=%d\n" , port_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_strip_queue_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_strip_queue_set, -ENOTSUP ); (*dev->dev_ops->vlan_strip_queue_set)(dev, rx_queue_id, on);return 0 ;
@@ -1745,9 +1746,9 @@ rte_eth_dev_set_vlan_ether_type(uint8_t port_id, uint16_t tpid) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_tpid_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_tpid_set, -ENOTSUP ); (*dev->dev_ops->vlan_tpid_set)(dev, tpid);return 0 ;
@@ -1761,7 +1762,7 @@ rte_eth_dev_set_vlan_offload(uint8_t port_id, int offload_mask)int mask =0 ;int cur, org =0 ; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];/*check which option changed by application*/
@@ -1790,7 +1791,7 @@ rte_eth_dev_set_vlan_offload(uint8_t port_id, int offload_mask)if (mask ==0 )return ret; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_offload_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_offload_set, -ENOTSUP ); (*dev->dev_ops->vlan_offload_set)(dev, mask);return ret;
@@ -1802,7 +1803,7 @@ rte_eth_dev_get_vlan_offload(uint8_t port_id)struct rte_eth_dev *dev;int ret =0 ; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (dev->data->dev_conf.rxmode.hw_vlan_strip)
@@ -1822,9 +1823,9 @@ rte_eth_dev_set_vlan_pvid(uint8_t port_id, uint16_t pvid, int on) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_pvid_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->vlan_pvid_set, -ENOTSUP ); (*dev->dev_ops->vlan_pvid_set)(dev, pvid, on);return 0 ;
@@ -1835,9 +1836,9 @@ rte_eth_dev_flow_ctrl_get(uint8_t port_id, struct rte_eth_fc_conf *fc_conf) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_get, -ENOTSUP );memset (fc_conf,0 ,sizeof (*fc_conf));return (*dev->dev_ops->flow_ctrl_get)(dev, fc_conf); }
@@ -1847,14 +1848,14 @@ rte_eth_dev_flow_ctrl_set(uint8_t port_id, struct rte_eth_fc_conf *fc_conf) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if ((fc_conf->send_xon !=0 ) && (fc_conf->send_xon !=1 )) { -PMD_DEBUG_TRACE ("Invalid send_xon, only 0/1 allowed\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid send_xon, only 0/1 allowed\n" );return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->flow_ctrl_set, -ENOTSUP );return (*dev->dev_ops->flow_ctrl_set)(dev, fc_conf); }
@@ -1863,9 +1864,9 @@ rte_eth_dev_priority_flow_ctrl_set(uint8_t port_id, struct rte_eth_pfc_conf *pfc {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (pfc_conf->priority > (ETH_DCB_NUM_USER_PRIORITIES -1 )) { -PMD_DEBUG_TRACE ("Invalid priority, only 0-7 allowed\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid priority, only 0-7 allowed\n" );return -EINVAL ; }
@@ -1886,7 +1887,7 @@ rte_eth_check_reta_mask(struct rte_eth_rss_reta_entry64 *reta_conf,return -EINVAL ;if (reta_size !=RTE_ALIGN (reta_size,RTE_RETA_GROUP_SIZE )) { -PMD_DEBUG_TRACE ("Invalid reta size, should be %u aligned\n" , +RTE_PMD_DEBUG_TRACE ("Invalid reta size, should be %u aligned\n" ,RTE_RETA_GROUP_SIZE );return -EINVAL ; }
@@ -1911,7 +1912,7 @@ rte_eth_check_reta_entry(struct rte_eth_rss_reta_entry64 *reta_conf,return -EINVAL ;if (max_rxq ==0 ) { -PMD_DEBUG_TRACE ("No receive queue is available\n" ); +RTE_PMD_DEBUG_TRACE ("No receive queue is available\n" );return -EINVAL ; }
@@ -1920,7 +1921,7 @@ rte_eth_check_reta_entry(struct rte_eth_rss_reta_entry64 *reta_conf, shift = i %RTE_RETA_GROUP_SIZE ;if ((reta_conf[idx].mask & (1ULL << shift)) && (reta_conf[idx].reta[shift] >= max_rxq)) { -PMD_DEBUG_TRACE ("reta_conf[%u]->reta[%u]: %u exceeds " +RTE_PMD_DEBUG_TRACE ("reta_conf[%u]->reta[%u]: %u exceeds " "the maximum rxq index: %u\n" , idx, shift, reta_conf[idx].reta[shift], max_rxq);return -EINVAL ;
@@ -1938,7 +1939,7 @@ rte_eth_dev_rss_reta_update(uint8_t port_id,struct rte_eth_dev *dev;int ret; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );/* Check mask bits */ ret =rte_eth_check_reta_mask (reta_conf, reta_size);if (ret <0 )
@@ -1952,7 +1953,7 @@ rte_eth_dev_rss_reta_update(uint8_t port_id,if (ret <0 )return ret; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_update, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_update, -ENOTSUP );return (*dev->dev_ops->reta_update)(dev, reta_conf, reta_size); }
@@ -1965,7 +1966,7 @@ rte_eth_dev_rss_reta_query(uint8_t port_id,int ret;if (port_id >= nb_ports) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; }
@@ -1975,7 +1976,7 @@ rte_eth_dev_rss_reta_query(uint8_t port_id,return ret; dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_query, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->reta_query, -ENOTSUP );return (*dev->dev_ops->reta_query)(dev, reta_conf, reta_size); }
@@ -1985,16 +1986,16 @@ rte_eth_dev_rss_hash_update(uint8_t port_id, struct rte_eth_rss_conf *rss_conf)struct rte_eth_dev *dev;uint16_t rss_hash_protos; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); rss_hash_protos = rss_conf->rss_hf;if ((rss_hash_protos !=0 ) && ((rss_hash_protos Ð_RSS_PROTO_MASK ) ==0 )) { -PMD_DEBUG_TRACE ("Invalid rss_hash_protos=0x%x\n" , +RTE_PMD_DEBUG_TRACE ("Invalid rss_hash_protos=0x%x\n" , rss_hash_protos);return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_update, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_update, -ENOTSUP );return (*dev->dev_ops->rss_hash_update)(dev, rss_conf); }
@@ -2004,9 +2005,9 @@ rte_eth_dev_rss_hash_conf_get(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_conf_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rss_hash_conf_get, -ENOTSUP );return (*dev->dev_ops->rss_hash_conf_get)(dev, rss_conf); }
@@ -2016,19 +2017,19 @@ rte_eth_dev_udp_tunnel_add(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (udp_tunnel ==NULL ) { -PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" );return -EINVAL ; }if (udp_tunnel->prot_type >=RTE_TUNNEL_TYPE_MAX ) { -PMD_DEBUG_TRACE ("Invalid tunnel type\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid tunnel type\n" );return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_add, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_add, -ENOTSUP );return (*dev->dev_ops->udp_tunnel_add)(dev, udp_tunnel); }
@@ -2038,20 +2039,20 @@ rte_eth_dev_udp_tunnel_delete(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (udp_tunnel ==NULL ) { -PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid udp_tunnel parameter\n" );return -EINVAL ; }if (udp_tunnel->prot_type >=RTE_TUNNEL_TYPE_MAX ) { -PMD_DEBUG_TRACE ("Invalid tunnel type\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid tunnel type\n" );return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_del, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->udp_tunnel_del, -ENOTSUP );return (*dev->dev_ops->udp_tunnel_del)(dev, udp_tunnel); }
@@ -2060,9 +2061,9 @@ rte_eth_led_on(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_on, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_on, -ENOTSUP );return (*dev->dev_ops->dev_led_on)(dev); }
@@ -2071,9 +2072,9 @@ rte_eth_led_off(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_off, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->dev_led_off, -ENOTSUP );return (*dev->dev_ops->dev_led_off)(dev); }
@@ -2107,17 +2108,17 @@ rte_eth_dev_mac_addr_add(uint8_t port_id, struct ether_addr *addr,int index;uint64_t pool_mask; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_add, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_add, -ENOTSUP );if (is_zero_ether_addr (addr)) { -PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , +RTE_PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , port_id);return -EINVAL ; }if (pool >=ETH_64_POOLS ) { -PMD_DEBUG_TRACE ("pool id must be 0-%d\n" ,ETH_64_POOLS -1 ); +RTE_PMD_DEBUG_TRACE ("pool id must be 0-%d\n" ,ETH_64_POOLS -1 );return -EINVAL ; }
@@ -2125,7 +2126,7 @@ rte_eth_dev_mac_addr_add(uint8_t port_id, struct ether_addr *addr,if (index <0 ) { index =get_mac_addr_index (port_id, &null_mac_addr);if (index <0 ) { -PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , +RTE_PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , port_id);return -ENOSPC ; }
@@ -2155,13 +2156,13 @@ rte_eth_dev_mac_addr_remove(uint8_t port_id, struct ether_addr *addr)struct rte_eth_dev *dev;int index; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_remove, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_remove, -ENOTSUP ); index =get_mac_addr_index (port_id, addr);if (index ==0 ) { -PMD_DEBUG_TRACE ("port %d: Cannot remove default MAC address\n" , port_id); +RTE_PMD_DEBUG_TRACE ("port %d: Cannot remove default MAC address\n" , port_id);return -EADDRINUSE ; }else if (index <0 )return 0 ;/* Do nothing if address wasn't found */
@@ -2183,13 +2184,13 @@ rte_eth_dev_default_mac_addr_set(uint8_t port_id, struct ether_addr *addr) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (!is_valid_assigned_ether_addr (addr))return -EINVAL ; dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mac_addr_set, -ENOTSUP );/* Update default address in NIC data structure */ ether_addr_copy (addr, &dev->data->mac_addrs[0 ]);
@@ -2207,22 +2208,22 @@ rte_eth_dev_set_vf_rxmode(uint8_t port_id, uint16_t vf,struct rte_eth_dev *dev;struct rte_eth_dev_info dev_info; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); num_vfs = dev_info.max_vfs;if (vf > num_vfs) { -PMD_DEBUG_TRACE ("set VF RX mode:invalid VF id %d\n" , vf); +RTE_PMD_DEBUG_TRACE ("set VF RX mode:invalid VF id %d\n" , vf);return -EINVAL ; }if (rx_mode ==0 ) { -PMD_DEBUG_TRACE ("set VF RX mode:mode mask ca not be zero\n" ); +RTE_PMD_DEBUG_TRACE ("set VF RX mode:mode mask ca not be zero\n" );return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx_mode, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx_mode, -ENOTSUP );return (*dev->dev_ops->set_vf_rx_mode)(dev, vf, rx_mode, on); }
@@ -2257,11 +2258,11 @@ rte_eth_dev_uc_hash_table_set(uint8_t port_id, struct ether_addr *addr,int ret;struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (is_zero_ether_addr (addr)) { -PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , +RTE_PMD_DEBUG_TRACE ("port %d: Cannot add NULL MAC address\n" , port_id);return -EINVAL ; }
@@ -2273,20 +2274,20 @@ rte_eth_dev_uc_hash_table_set(uint8_t port_id, struct ether_addr *addr,if (index <0 ) {if (!on) { -PMD_DEBUG_TRACE ("port %d: the MAC address was not " +RTE_PMD_DEBUG_TRACE ("port %d: the MAC address was not " "set in UTA\n" , port_id);return -EINVAL ; } index =get_hash_mac_addr_index (port_id, &null_mac_addr);if (index <0 ) { -PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , +RTE_PMD_DEBUG_TRACE ("port %d: MAC address array full\n" , port_id);return -ENOSPC ; } } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_hash_table_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_hash_table_set, -ENOTSUP ); ret = (*dev->dev_ops->uc_hash_table_set)(dev, addr, on);if (ret ==0 ) {/* Update address in NIC data structure */
@@ -2306,11 +2307,11 @@ rte_eth_dev_uc_all_hash_table_set(uint8_t port_id, uint8_t on) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_all_hash_table_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->uc_all_hash_table_set, -ENOTSUP );return (*dev->dev_ops->uc_all_hash_table_set)(dev, on); }
@@ -2321,18 +2322,18 @@ rte_eth_dev_set_vf_rx(uint8_t port_id, uint16_t vf, uint8_t on)struct rte_eth_dev *dev;struct rte_eth_dev_info dev_info; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); num_vfs = dev_info.max_vfs;if (vf > num_vfs) { -PMD_DEBUG_TRACE ("port %d: invalid vf id\n" , port_id); +RTE_PMD_DEBUG_TRACE ("port %d: invalid vf id\n" , port_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rx, -ENOTSUP );return (*dev->dev_ops->set_vf_rx)(dev, vf, on); }
@@ -2343,18 +2344,18 @@ rte_eth_dev_set_vf_tx(uint8_t port_id, uint16_t vf, uint8_t on)struct rte_eth_dev *dev;struct rte_eth_dev_info dev_info; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); num_vfs = dev_info.max_vfs;if (vf > num_vfs) { -PMD_DEBUG_TRACE ("set pool tx:invalid pool id=%d\n" , vf); +RTE_PMD_DEBUG_TRACE ("set pool tx:invalid pool id=%d\n" , vf);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_tx, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_tx, -ENOTSUP );return (*dev->dev_ops->set_vf_tx)(dev, vf, on); }
@@ -2364,22 +2365,22 @@ rte_eth_dev_set_vf_vlan_filter(uint8_t port_id, uint16_t vlan_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];if (vlan_id >ETHER_MAX_VLAN_ID ) { -PMD_DEBUG_TRACE ("VF VLAN filter:invalid VLAN id=%d\n" , +RTE_PMD_DEBUG_TRACE ("VF VLAN filter:invalid VLAN id=%d\n" , vlan_id);return -EINVAL ; }if (vf_mask ==0 ) { -PMD_DEBUG_TRACE ("VF VLAN filter:pool_mask can not be 0\n" ); +RTE_PMD_DEBUG_TRACE ("VF VLAN filter:pool_mask can not be 0\n" );return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_vlan_filter, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_vlan_filter, -ENOTSUP );return (*dev->dev_ops->set_vf_vlan_filter)(dev, vlan_id, vf_mask, vlan_on); }
@@ -2391,26 +2392,26 @@ int rte_eth_set_queue_rate_limit(uint8_t port_id, uint16_t queue_idx,struct rte_eth_dev_info dev_info;struct rte_eth_link link; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); link = dev->data->dev_link;if (queue_idx > dev_info.max_tx_queues) { -PMD_DEBUG_TRACE ("set queue rate limit:port %d: " +RTE_PMD_DEBUG_TRACE ("set queue rate limit:port %d: " "invalid queue id=%d\n" , port_id, queue_idx);return -EINVAL ; }if (tx_rate > link.link_speed) { -PMD_DEBUG_TRACE ("set queue rate limit:invalid tx_rate=%d, " +RTE_PMD_DEBUG_TRACE ("set queue rate limit:invalid tx_rate=%d, " "bigger than link speed= %d\n" , tx_rate, link.link_speed);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_queue_rate_limit, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_queue_rate_limit, -ENOTSUP );return (*dev->dev_ops->set_queue_rate_limit)(dev, queue_idx, tx_rate); }
@@ -2424,26 +2425,26 @@ int rte_eth_set_vf_rate_limit(uint8_t port_id, uint16_t vf, uint16_t tx_rate,if (q_msk ==0 )return 0 ; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id];rte_eth_dev_info_get (port_id, &dev_info); link = dev->data->dev_link;if (vf > dev_info.max_vfs) { -PMD_DEBUG_TRACE ("set VF rate limit:port %d: " +RTE_PMD_DEBUG_TRACE ("set VF rate limit:port %d: " "invalid vf id=%d\n" , port_id, vf);return -EINVAL ; }if (tx_rate > link.link_speed) { -PMD_DEBUG_TRACE ("set VF rate limit:invalid tx_rate=%d, " +RTE_PMD_DEBUG_TRACE ("set VF rate limit:invalid tx_rate=%d, " "bigger than link speed= %d\n" , tx_rate, link.link_speed);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rate_limit, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_vf_rate_limit, -ENOTSUP );return (*dev->dev_ops->set_vf_rate_limit)(dev, vf, tx_rate, q_msk); }
@@ -2454,14 +2455,14 @@ rte_eth_mirror_rule_set(uint8_t port_id, {struct rte_eth_dev *dev = &rte_eth_devices[port_id]; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (mirror_conf->rule_type ==0 ) { -PMD_DEBUG_TRACE ("mirror rule type can not be 0.\n" ); +RTE_PMD_DEBUG_TRACE ("mirror rule type can not be 0.\n" );return -EINVAL ; }if (mirror_conf->dst_pool >=ETH_64_POOLS ) { -PMD_DEBUG_TRACE ("Invalid dst pool, pool id must be 0-%d\n" , +RTE_PMD_DEBUG_TRACE ("Invalid dst pool, pool id must be 0-%d\n" ,ETH_64_POOLS -1 );return -EINVAL ; }
@@ -2469,18 +2470,18 @@ rte_eth_mirror_rule_set(uint8_t port_id,if ((mirror_conf->rule_type & (ETH_MIRROR_VIRTUAL_POOL_UP |ETH_MIRROR_VIRTUAL_POOL_DOWN )) && (mirror_conf->pool_mask ==0 )) { -PMD_DEBUG_TRACE ("Invalid mirror pool, pool mask can not be 0.\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid mirror pool, pool mask can not be 0.\n" );return -EINVAL ; }if ((mirror_conf->rule_type Ð_MIRROR_VLAN ) && mirror_conf->vlan.vlan_mask ==0 ) { -PMD_DEBUG_TRACE ("Invalid vlan mask, vlan mask can not be 0.\n" ); +RTE_PMD_DEBUG_TRACE ("Invalid vlan mask, vlan mask can not be 0.\n" );return -EINVAL ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_set, -ENOTSUP );return (*dev->dev_ops->mirror_rule_set)(dev, mirror_conf, rule_id, on); }
@@ -2490,10 +2491,10 @@ rte_eth_mirror_rule_reset(uint8_t port_id, uint8_t rule_id) {struct rte_eth_dev *dev = &rte_eth_devices[port_id]; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_reset, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->mirror_rule_reset, -ENOTSUP );return (*dev->dev_ops->mirror_rule_reset)(dev, rule_id); }
@@ -2505,12 +2506,12 @@ rte_eth_rx_burst(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id,0 ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id,0 ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->rx_pkt_burst,0 ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->rx_pkt_burst,0 );if (queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id);return 0 ; } return (*dev->rx_pkt_burst)(dev->data->rx_queues[queue_id],
@@ -2523,13 +2524,13 @@ rte_eth_tx_burst(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id,0 ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id,0 ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->tx_pkt_burst,0 ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->tx_pkt_burst,0 );if (queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id);return 0 ; } return (*dev->tx_pkt_burst)(dev->data->tx_queues[queue_id],
@@ -2541,10 +2542,10 @@ rte_eth_rx_queue_count(uint8_t port_id, uint16_t queue_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id,0 ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id,0 ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_count,0 ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_count,0 );return (*dev->dev_ops->rx_queue_count)(dev, queue_id); }
@@ -2553,10 +2554,10 @@ rte_eth_rx_descriptor_done(uint8_t port_id, uint16_t queue_id, uint16_t offset) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_descriptor_done, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_descriptor_done, -ENOTSUP );return (*dev->dev_ops->rx_descriptor_done)(dev->data->rx_queues[queue_id], offset); }
@@ -2573,7 +2574,7 @@ rte_eth_dev_callback_register(uint8_t port_id,if (!cb_fn)return -EINVAL ; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];rte_spinlock_lock (&rte_eth_dev_cb_lock);
@@ -2613,7 +2614,7 @@ rte_eth_dev_callback_unregister(uint8_t port_id,if (!cb_fn)return -EINVAL ; -VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -EINVAL ); dev = &rte_eth_devices[port_id];rte_spinlock_lock (&rte_eth_dev_cb_lock);
@@ -2676,14 +2677,14 @@ rte_eth_dev_rx_intr_ctl(uint8_t port_id, int epfd, int op, void *data)int rc;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id]; intr_handle = &dev->pci_dev->intr_handle;if (!intr_handle->intr_vec) { -PMD_DEBUG_TRACE ("RX Intr vector unset\n" ); +RTE_PMD_DEBUG_TRACE ("RX Intr vector unset\n" );return -EPERM ; }
@@ -2691,7 +2692,7 @@ rte_eth_dev_rx_intr_ctl(uint8_t port_id, int epfd, int op, void *data) vec = intr_handle->intr_vec[qid]; rc =rte_intr_rx_ctl (intr_handle, epfd, op, vec, data);if (rc && rc != -EEXIST ) { -PMD_DEBUG_TRACE ("p %u q %u rx ctl error" +RTE_PMD_DEBUG_TRACE ("p %u q %u rx ctl error" " op %d epfd %d vec %u\n" , port_id, qid, op, epfd, vec); }
@@ -2710,26 +2711,26 @@ rte_eth_dev_rx_intr_ctl_q(uint8_t port_id, uint16_t queue_id,int rc;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%u\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id];if (queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%u\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%u\n" , queue_id);return -EINVAL ; } intr_handle = &dev->pci_dev->intr_handle;if (!intr_handle->intr_vec) { -PMD_DEBUG_TRACE ("RX Intr vector unset\n" ); +RTE_PMD_DEBUG_TRACE ("RX Intr vector unset\n" );return -EPERM ; } vec = intr_handle->intr_vec[queue_id]; rc =rte_intr_rx_ctl (intr_handle, epfd, op, vec, data);if (rc && rc != -EEXIST ) { -PMD_DEBUG_TRACE ("p %u q %u rx ctl error" +RTE_PMD_DEBUG_TRACE ("p %u q %u rx ctl error" " op %d epfd %d vec %u\n" , port_id, queue_id, op, epfd, vec);return rc;
@@ -2745,13 +2746,13 @@ rte_eth_dev_rx_intr_enable(uint8_t port_id,struct rte_eth_dev *dev;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_enable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_enable, -ENOTSUP );return (*dev->dev_ops->rx_queue_intr_enable)(dev, queue_id); }
@@ -2762,13 +2763,13 @@ rte_eth_dev_rx_intr_disable(uint8_t port_id,struct rte_eth_dev *dev;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_disable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rx_queue_intr_disable, -ENOTSUP );return (*dev->dev_ops->rx_queue_intr_disable)(dev, queue_id); }
@@ -2777,10 +2778,10 @@ int rte_eth_dev_bypass_init(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_init, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_init, -ENOTSUP ); (*dev->dev_ops->bypass_init)(dev);return 0 ; }
@@ -2790,10 +2791,10 @@ rte_eth_dev_bypass_state_show(uint8_t port_id, uint32_t *state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); (*dev->dev_ops->bypass_state_show)(dev, state);return 0 ; }
@@ -2803,10 +2804,10 @@ rte_eth_dev_bypass_state_set(uint8_t port_id, uint32_t *new_state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_set, -ENOTSUP ); (*dev->dev_ops->bypass_state_set)(dev, new_state);return 0 ; }
@@ -2816,10 +2817,10 @@ rte_eth_dev_bypass_event_show(uint8_t port_id, uint32_t event, uint32_t *state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_state_show, -ENOTSUP ); (*dev->dev_ops->bypass_event_show)(dev, event, state);return 0 ; }
@@ -2829,11 +2830,11 @@ rte_eth_dev_bypass_event_store(uint8_t port_id, uint32_t event, uint32_t state) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_event_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_event_set, -ENOTSUP ); (*dev->dev_ops->bypass_event_set)(dev, event, state);return 0 ; }
@@ -2843,11 +2844,11 @@ rte_eth_dev_wd_timeout_store(uint8_t port_id, uint32_t timeout) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_set, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_set, -ENOTSUP ); (*dev->dev_ops->bypass_wd_timeout_set)(dev, timeout);return 0 ; }
@@ -2857,11 +2858,11 @@ rte_eth_dev_bypass_ver_show(uint8_t port_id, uint32_t *ver) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_ver_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_ver_show, -ENOTSUP ); (*dev->dev_ops->bypass_ver_show)(dev, ver);return 0 ; }
@@ -2871,11 +2872,11 @@ rte_eth_dev_bypass_wd_timeout_show(uint8_t port_id, uint32_t *wd_timeout) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_show, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_timeout_show, -ENOTSUP ); (*dev->dev_ops->bypass_wd_timeout_show)(dev, wd_timeout);return 0 ; }
@@ -2885,11 +2886,11 @@ rte_eth_dev_bypass_wd_reset(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_reset, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->bypass_wd_reset, -ENOTSUP ); (*dev->dev_ops->bypass_wd_reset)(dev);return 0 ; }
@@ -2900,10 +2901,10 @@ rte_eth_dev_filter_supported(uint8_t port_id, enum rte_filter_type filter_type) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP );return (*dev->dev_ops->filter_ctrl)(dev, filter_type,RTE_ETH_FILTER_NOP ,NULL ); }
@@ -2914,10 +2915,10 @@ rte_eth_dev_filter_ctrl(uint8_t port_id, enum rte_filter_type filter_type, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->filter_ctrl, -ENOTSUP );return (*dev->dev_ops->filter_ctrl)(dev, filter_type, filter_op, arg); }
@@ -3087,18 +3088,18 @@ rte_eth_rx_queue_info_get(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (qinfo ==NULL )return -EINVAL ; dev = &rte_eth_devices[port_id];if (queue_id >= dev->data->nb_rx_queues) { -PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid RX queue_id=%d\n" , queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rxq_info_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->rxq_info_get, -ENOTSUP );memset (qinfo,0 ,sizeof (*qinfo)); dev->dev_ops->rxq_info_get (dev, queue_id, qinfo);
@@ -3111,18 +3112,18 @@ rte_eth_tx_queue_info_get(uint8_t port_id, uint16_t queue_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV );if (qinfo ==NULL )return -EINVAL ; dev = &rte_eth_devices[port_id];if (queue_id >= dev->data->nb_tx_queues) { -PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id); +RTE_PMD_DEBUG_TRACE ("Invalid TX queue_id=%d\n" , queue_id);return -EINVAL ; } -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->txq_info_get, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->txq_info_get, -ENOTSUP );memset (qinfo,0 ,sizeof (*qinfo)); dev->dev_ops->txq_info_get (dev, queue_id, qinfo);
@@ -3136,10 +3137,10 @@ rte_eth_dev_set_mc_addr_list(uint8_t port_id, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_mc_addr_list, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_mc_addr_list, -ENOTSUP );return dev->dev_ops->set_mc_addr_list (dev, mc_addr_set, nb_mc_addr); }
@@ -3148,10 +3149,10 @@ rte_eth_timesync_enable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_enable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_enable, -ENOTSUP );return (*dev->dev_ops->timesync_enable)(dev); }
@@ -3160,10 +3161,10 @@ rte_eth_timesync_disable(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_disable, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_disable, -ENOTSUP );return (*dev->dev_ops->timesync_disable)(dev); }
@@ -3173,10 +3174,10 @@ rte_eth_timesync_read_rx_timestamp(uint8_t port_id, struct timespec *timestamp, {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_rx_timestamp, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_rx_timestamp, -ENOTSUP );return (*dev->dev_ops->timesync_read_rx_timestamp)(dev, timestamp, flags); }
@@ -3185,10 +3186,10 @@ rte_eth_timesync_read_tx_timestamp(uint8_t port_id, struct timespec *timestamp) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_tx_timestamp, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->timesync_read_tx_timestamp, -ENOTSUP );return (*dev->dev_ops->timesync_read_tx_timestamp)(dev, timestamp); }
@@ -3197,10 +3198,10 @@ rte_eth_dev_get_reg_length(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg_length, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg_length, -ENOTSUP );return (*dev->dev_ops->get_reg_length)(dev); }
@@ -3209,10 +3210,10 @@ rte_eth_dev_get_reg_info(uint8_t port_id, struct rte_dev_reg_info *info) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_reg, -ENOTSUP );return (*dev->dev_ops->get_reg)(dev, info); }
@@ -3221,10 +3222,10 @@ rte_eth_dev_get_eeprom_length(uint8_t port_id) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom_length, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom_length, -ENOTSUP );return (*dev->dev_ops->get_eeprom_length)(dev); }
@@ -3233,10 +3234,10 @@ rte_eth_dev_get_eeprom(uint8_t port_id, struct rte_dev_eeprom_info *info) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_eeprom, -ENOTSUP );return (*dev->dev_ops->get_eeprom)(dev, info); }
@@ -3245,10 +3246,10 @@ rte_eth_dev_set_eeprom(uint8_t port_id, struct rte_dev_eeprom_info *info) {struct rte_eth_dev *dev; -VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); +RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, -ENODEV ); dev = &rte_eth_devices[port_id]; -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_eeprom, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->set_eeprom, -ENOTSUP );return (*dev->dev_ops->set_eeprom)(dev, info); }
@@ -3259,14 +3260,14 @@ rte_eth_dev_get_dcb_info(uint8_t port_id,struct rte_eth_dev *dev;if (!rte_eth_dev_is_valid_port (port_id)) { -PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id); +RTE_PMD_DEBUG_TRACE ("Invalid port_id=%d\n" , port_id);return -ENODEV ; } dev = &rte_eth_devices[port_id];memset (dcb_info,0 ,sizeof (struct rte_eth_dcb_info )); -FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_dcb_info, -ENOTSUP ); +RTE_FUNC_PTR_OR_ERR_RET (*dev->dev_ops->get_dcb_info, -ENOTSUP );return (*dev->dev_ops->get_dcb_info)(dev, dcb_info); }
@@ -3274,7 +3275,7 @@ void rte_eth_copy_pci_info(struct rte_eth_dev *eth_dev, struct rte_pci_device *pci_dev) {if ((eth_dev ==NULL ) || (pci_dev ==NULL )) { -PMD_DEBUG_TRACE ("NULL pointer eth_dev=%p pci_dev=%p\n" , +RTE_PMD_DEBUG_TRACE ("NULL pointer eth_dev=%p pci_dev=%p\n" , eth_dev, pci_dev); }
Signature · 1 line
2.4.3
PATCH v6 2/10 ethdev: make error checking macros public
In reply to Declan DohertyMove the function pointer and port id checking macros to rte_ethdev and rte_dev header files, so that they can be used in the static inline functions there. Also replace the RTE_LOG call within RTE_PMD_DEBUG_TRACE so this macro can be built with the -pedantic flag
--- lib/librte_eal/common/include/rte_dev.h | 53 ++++++++++++++++++++++++++++++++ lib/librte_ether/rte_ethdev.c | 54 --------------------------------- lib/librte_ether/rte_ethdev.h | 26 ++++++++++++++++ 3 files changed, 79 insertions(+), 54 deletions(-)
lib/librte_eal/common/include/rte_dev.h +53 -0
@@ -46,8 +46,61 @@extern "C" {#endif +#include <stdio.h> #include <sys/queue.h> +#include <rte_log.h> + +__attribute__((format (printf,2 ,0 ))) +static inline void +rte_pmd_debug_trace (const char *func_name,const char *fmt, ...) +{ +va_list ap; + +va_start (ap, fmt); + +char buffer[vsnprintf (NULL ,0 , fmt, ap) +1 ]; + +va_end (ap); + +va_start (ap, fmt); +vsnprintf (buffer,sizeof (buffer), fmt, ap); +va_end (ap); + +rte_log (RTE_LOG_ERR ,RTE_LOGTYPE_PMD ,"%s: %s" , func_name, buffer); +} + +/* Macros for checking for restricting functions to primary instance only */ +#define RTE_PROC_PRIMARY_OR_ERR_RET (retval) do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_PROC_PRIMARY_OR_RET () do { \ + if (rte_eal_process_type() != RTE_PROC_PRIMARY) { \ + RTE_PMD_DEBUG_TRACE("Cannot run in secondary processes\n"); \ + return; \ + } \ +} while (0) + +/* Macros to check for invalid function pointers */ +#define RTE_FUNC_PTR_OR_ERR_RET (func, retval) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return retval; \ + } \ +} while (0) + +#define RTE_FUNC_PTR_OR_RET (func) do { \ + if ((func) == NULL) { \ + RTE_PMD_DEBUG_TRACE("Function not supported\n"); \ + return; \ + } \ +} while (0) + +/** Double linked list of device drivers. */ TAILQ_HEAD (rte_driver_list, rte_driver);
lib/librte_ether/rte_ethdev.c +0 -54
60 lines not on this page · raw message
lib/librte_ether/rte_ethdev.h +26 -0
@@ -172,6 +172,8 @@ extern "C" {#include <stdint.h> +#include <rte_dev.h> +/* Use this macro to check if LRO API is supported */ #define RTE_ETHDEV_HAS_LRO_SUPPORT
@@ -931,6 +933,30 @@ struct rte_eth_dev_callback;/** @internal Structure to keep track of registered callbacks */ TAILQ_HEAD (rte_eth_dev_cb_list, rte_eth_dev_callback); + +#ifdef RTE_LIBRTE_ETHDEV_DEBUG +#define RTE_PMD_DEBUG_TRACE (...) \ + rte_pmd_debug_trace(__func__, __VA_ARGS__) +#else +#define RTE_PMD_DEBUG_TRACE(fmt, args...) +#endif + + +/* Macros to check for valid port */ +#define RTE_ETH_VALID_PORTID_OR_ERR_RET (port_id, retval) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return retval; \ + } \ +} while (0) + +#define RTE_ETH_VALID_PORTID_OR_RET (port_id) do { \ + if (!rte_eth_dev_is_valid_port(port_id)) { \ + RTE_PMD_DEBUG_TRACE("Invalid port_id=%d\n", port_id); \ + return; \ + } \ +} while (0) +/* * Definitions of all functions exported by an Ethernet driver through the * the generic structure of type *eth_dev_ops* supplied in the *rte_eth_dev*
Signature · 1 line
2.4.3
Re: [PATCH v6 02/10] ethdev: make error checking macros public
Quoted 6 lines · Declan Doherty
Move the function pointer and port id checking macros to
rte_ethdevandrte_devheader files, so that they can be used in the static inline functions there. Also replace theRTE_LOGcall withinRTE_PMD_DEBUG_TRACEso this macro can be built with the -pedantic flagSigned-off-by Declan Doherty <[email protected]>
Signature · 2 lines
Adrien Mazarguil 6WIND
PATCH v6 3/10 eal: add __rte_packed /__rte_aligned macros
In reply to Declan DohertyAdding a new marco for specifing __aligned__ attribute, and updating the current __rte_cache_aligned macro to use it.
Also adding a new macro to specify the __packed__ attribute
--- lib/librte_eal/common/include/rte_memory.h | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-)
lib/librte_eal/common/include/rte_memory.h +12 -2
@@ -76,9 +76,19 @@ enum rte_page_sizes {/**< Return the first cache-aligned value greater or equal to size. */ /** +* Force alignment +*/ +#define __rte_aligned (a) __attribute__((__aligned__(a))) + +/** * Force alignment to cache line. */ -#define __rte_cache_aligned __attribute__((__aligned__(RTE_CACHE_LINE_SIZE))) +#define __rte_cache_aligned __rte_aligned(RTE_CACHE_LINE_SIZE) + +/** +* Force a structure to be packed +*/ +#define __rte_packed __attribute__((__packed__))typedef uint64_t phys_addr_t ;/**< Physical address definition. */ #define RTE_BAD_PHYS_ADDR ((phys_addr_t)-1)
@@ -104,7 +114,7 @@ struct rte_memseg {/**< store segment MFNs */ uint64_t mfn[DOM0_NUM_MEMBLOCK ];#endif -} __attribute__((__packed__)); +} __rte_packed;/** * Lock page in physical memory and prevent from swapping.
Signature · 1 line
2.4.3
Re: [PATCH v6 03/10] eal: add __rte_packed /__rte_aligned macros
2015-11-10 17:32, Declan Doherty:
Quoted 1 line
Adding a new marco for specifing
__aligned__attribute, and updating the
2 typos spotted on this line ;)
I wonder why the "marco" typo is so common.
Re: [PATCH v6 03/10] eal: add __rte_packed /__rte_aligned macros
Quoted 6 lines · Thomas Monjalon
2015-11-10 17:32, Declan Doherty:
Quoted 1 line
Adding a new marco for specifing
__aligned__attribute, and updating the2 typos spotted on this line ;)
I wonder why the "marco" typo is so common.
oops, I didn't have my spell-check plugin enabled in vim :(
PATCH v6 4/10 mbuf: add new marcos to get the physical address of data
In reply to Declan Doherty--- lib/librte_mbuf/rte_mbuf.h | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)
lib/librte_mbuf/rte_mbuf.h +23 -0
@@ -1622,6 +1622,29 @@ static inline struct rte_mbuf *rte_pktmbuf_lastseg(struct rte_mbuf *m)#define rte_pktmbuf_mtod (m, t) rte_pktmbuf_mtod_offset(m, t, 0)/** +* A macro that returns the physical address that points to an offset of the +* start of the data in the mbuf +* +* @param m +* The packet mbuf. +* @param o +* The offset into the data to calculate address from. +*/ +#define rte_pktmbuf_mtophys_offset (m, o) \ + (phys_addr_t)((m)->buf_physaddr + (m)->data_off + (o)) + +/** +* A macro that returns the physical address that points to the start of the +* data in the mbuf +* +* @param m +* The packet mbuf. +* @param o +* The offset into the data to calculate address from. +*/ +#define rte_pktmbuf_mtophys (m) rte_pktmbuf_mtophys_offset(m, 0) + +/** * A macro that returns the length of the packet. * * The value can be read or assigned.
Signature · 1 line
2.4.3
PATCH v6 5/10 cryptodev: Initial DPDK Crypto APIs and device framework release
In reply to Declan DohertyThis patch contains the initial proposed APIs and device framework for integrating crypto packet processing into DPDK.
features include:
- Crypto device configuration / management APIs
- Definitions of supported cipher algorithms and operations.
- Definitions of supported hash/authentication algorithms and operations.
- Crypto session management APIs
- Crypto operation data structures and APIs allocation of crypto operation structure used to specify the crypto operations to be performed on a particular mbuf.
- Extension of mbuf to contain crypto operation data pointer and extra flags.
- Burst enqueue / dequeue APIs for processing of crypto operations.
changes from RFC:
- Session management API changes to support specification of crypto transform(xform) chains using linked list of xforms.
- Changes to the crypto operation struct as a result of session management changes.
- Some movement of common MACROS shared by cryptodevs and ethdevs to common headers
--- MAINTAINERS | 4 + config/common_bsdapp | 10 +- config/common_linuxapp | 10 +- doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf | 1 + lib/Makefile | 1 + lib/librte_cryptodev/Makefile | 60 ++ lib/librte_cryptodev/rte_crypto.h | 613 +++++++++++++ lib/librte_cryptodev/rte_cryptodev.c | 1092 ++++++++++++++++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 649 ++++++++++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 549 ++++++++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 41 + lib/librte_eal/common/include/rte_log.h | 1 + mk/rte.app.mk | 1 + 14 files changed, 3031 insertions(+), 2 deletions(-) create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map
MAINTAINERS +4 -0
@@ -196,6 +196,10 @@ M: Thomas Monjalon <[email protected]> F: lib/librte_ether/ F: scripts/test-null.sh +Crypto API +M: Declan Doherty <[email protected]> +F: lib/librte_cryptodev +F: docs/guides/cryptodevs Drivers -------
config/common_bsdapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -147,6 +147,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +9 -1
@@ -1,6 +1,6 @@ # BSD LICENSE # -# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. # All rights reserved. # # Redistribution and use in source and binary forms, with or without
@@ -145,6 +145,14 @@ CONFIG_RTE_ETHDEV_QUEUE_STAT_CNTRS=16 CONFIG_RTE_ETHDEV_RXTX_CALLBACKS=y # +# Compile generic Crypto device library +# +CONFIG_RTE_LIBRTE_CRYPTODEV=y +CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=n +CONFIG_RTE_CRYPTO_MAX_DEVS=64 +CONFIG_RTE_CRYPTODEV_NAME_LEN=64 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/api/doxy-api-index.md +1 -0
@@ -39,6 +39,7 @@ There are many libraries, so their headers may be grouped by topics: [dev] (@ref rte_dev.h), [ethdev] (@ref rte_ethdev.h), [ethctrl] (@ref rte_eth_ctrl.h), + [cryptodev] (@ref rte_cryptodev.h), [devargs] (@ref rte_devargs.h), [bond] (@ref rte_eth_bond.h), [vhost] (@ref rte_virtio_net.h),
doc/api/doxy-api.conf +1 -0
@@ -37,6 +37,7 @@ INPUT = doc/api/doxy-api-index.md \ lib/librte_cfgfile \ lib/librte_cmdline \ lib/librte_compat \ + lib/librte_cryptodev \ lib/librte_distributor \ lib/librte_ether \ lib/librte_hash \
lib/Makefile +1 -0
@@ -40,6 +40,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline DIRS-$(CONFIG_RTE_LIBRTE_ETHER) += librte_ether +DIRS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += librte_cryptodev DIRS-$(CONFIG_RTE_LIBRTE_VHOST) += librte_vhost DIRS-$(CONFIG_RTE_LIBRTE_HASH) += librte_hash DIRS-$(CONFIG_RTE_LIBRTE_LPM) += librte_lpm
lib/librte_cryptodev/Makefile new file +60 -0
61 lines not on this page · raw message
lib/librte_cryptodev/rte_crypto.h new file +613 -0
613 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.c new file +1092 -0
1,092 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev.h new file +649 -0
649 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_pmd.h new file +549 -0
512 lines not on this page · raw message
lib/librte_cryptodev/rte_cryptodev_version.map new file +41 -0
41 lines not on this page · raw message
lib/librte_eal/common/include/rte_log.h +1 -0
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
Re: [PATCH v6 05/10] cryptodev: Initial DPDK Crypto APIs and device framework release
2015-11-10 17:32, Declan Doherty:
Quoted 28 lines
lib/librte_cryptodev/rte_cryptodev_version.map new file +28
-0+DPDK_2.2 { + global: + + rte_cryptodevs; + rte_cryptodev_callback_register; + rte_cryptodev_callback_unregister; + rte_cryptodev_close; + rte_cryptodev_count; + rte_cryptodev_count_devtype; + rte_cryptodev_configure; + rte_cryptodev_create_vdev; + rte_cryptodev_enqueue_burst; + rte_cryptodev_dequeue_burst; + rte_cryptodev_get_dev_id; + rte_cryptodev_info_get; + rte_cryptodev_session_create; + rte_cryptodev_session_free; + rte_cryptodev_socket_id; + rte_cryptodev_start; + rte_cryptodev_stats_get; + rte_cryptodev_stats_reset; + rte_cryptodev_stop; + rte_cryptodev_queue_pair_setup; + rte_cryptodev_queue_pair_start; + rte_cryptodev_queue_pair_stop; + rte_cryptodev_queue_pair_count; + + rte_cryptodev_pmd_allocate;
lib/librte_cryptodev/rte_cryptodev_version.map line 38
Quoted 10 lines
lib/librte_cryptodev/rte_cryptodev_version.map new file +10
-0+ rte_cryptodev_pmd_attach; + rte_cryptodev_pmd_callback_process; + rte_cryptodev_pmd_detach; + rte_cryptodev_pmd_driver_register; + rte_cryptodev_pmd_get_dev; + rte_cryptodev_pmd_get_named_dev; + rte_cryptodev_pmd_is_valid_dev; + rte_cryptodev_pmd_release_device; + rte_cryptodev_pmd_socket_id; + rte_cryptodev_pmd_virtual_dev_init;
Why do you split symbold in 2 parts?
Some of them are not implemented, e.g. attach() so should be removed. Please keep this list in alphabetical order.
PATCH v6 6/10 mbuf_offload: library to support attaching offloads to a mbuf
In reply to Declan DohertyThis library add support for adding a chain of offload operations to a mbuf. It contains the definition of the rte_mbuf_offload structure as well as helper functions for attaching offloads to mbufs and a mempool management functions.
This initial implementation supports attaching multiple offload operations to a single mbuf, but only a single offload operation of a specific type can be attach to that mbuf.
--- MAINTAINERS | 4 + config/common_bsdapp | 6 + config/common_linuxapp | 6 + lib/Makefile | 1 + lib/librte_mbuf/rte_mbuf.h | 6 + lib/librte_mbuf_offload/Makefile | 52 ++++ lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 +++++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 291 +++++++++++++++++++++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 1 + 10 files changed, 474 insertions(+) create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
MAINTAINERS +4 -0
@@ -191,6 +191,10 @@ F: lib/librte_mbuf/ F: doc/guides/prog_guide/mbuf_lib.rst F: app/test/test_mbuf.c +Packet buffer offload +M: Declan Doherty <[email protected]> +F: lib/librte_mbuf_offload/ + Ethernet API M: Thomas Monjalon <[email protected]> F: lib/librte_ether/
config/common_bsdapp +6 -0
@@ -332,6 +332,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
config/common_linuxapp +6 -0
@@ -340,6 +340,12 @@ CONFIG_RTE_MBUF_REFCNT_ATOMIC=y CONFIG_RTE_PKTMBUF_HEADROOM=128 # +# Compile librte_mbuf_offload +# +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD=y +CONFIG_RTE_LIBRTE_MBUF_OFFLOAD_DEBUG=n + +# # Compile librte_timer # CONFIG_RTE_LIBRTE_TIMER=y
lib/Makefile +1 -0
@@ -36,6 +36,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_EAL) += librte_eal DIRS-$(CONFIG_RTE_LIBRTE_RING) += librte_ring DIRS-$(CONFIG_RTE_LIBRTE_MEMPOOL) += librte_mempool DIRS-$(CONFIG_RTE_LIBRTE_MBUF) += librte_mbuf +DIRS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += librte_mbuf_offload DIRS-$(CONFIG_RTE_LIBRTE_TIMER) += librte_timer DIRS-$(CONFIG_RTE_LIBRTE_CFGFILE) += librte_cfgfile DIRS-$(CONFIG_RTE_LIBRTE_CMDLINE) += librte_cmdline
lib/librte_mbuf/rte_mbuf.h +6 -0
@@ -728,6 +728,9 @@ typedef uint8_t MARKER8[0]; /**< generic marker with 1B alignment */typedef uint64_t MARKER64 [0 ];/**< marker that allows us to overwrite 8 bytes * with a single assignment */ +/** Opaque rte_mbuf_offload structure declarations */ +struct rte_mbuf_offload ; +/** * The generic rte_mbuf, containing a packet mbuf. */
@@ -841,6 +844,9 @@ struct rte_mbuf {/** Timesync flags for use with IEEE1588. */ uint16_t timesync; + +/* Chain of off-load operations to perform on mbuf */ +struct rte_mbuf_offload *offload_ops; } __rte_cache_aligned;static inline uint16_t rte_pktmbuf_priv_size (struct rte_mempool *mp);
lib/librte_mbuf_offload/Makefile new file +52 -0
52 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.c new file +100 -0
100 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h new file +291 -0
291 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload_version.map new file +7 -0
@@ -0,0 +1,7 @@ +DPDK_2.2 { + global: + + rte_pktmbuf_offload_pool_create; + + local: *; +};
mk/rte.app.mk +1 -0
@@ -116,6 +116,7 @@ ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) _LDLIBS-$(CONFIG_RTE_LIBRTE_KVARGS) += -lrte_kvargs _LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF) += -lrte_mbuf +_LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) += -lrte_mbuf_offload _LDLIBS-$(CONFIG_RTE_LIBRTE_IP_FRAG) += -lrte_ip_frag _LDLIBS-$(CONFIG_RTE_LIBRTE_ETHER) += -lethdev _LDLIBS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += -lrte_cryptodev
Signature · 1 line
2.4.3
Re: [PATCH v6 06/10] mbuf_offload: library to support attaching offloads to a mbuf
2015-11-10 17:32, Declan Doherty:
lib/librte_mbuf/rte_mbuf.h struct rte_mbuf { · line 847
Quoted 5 lines
lib/librte_mbuf/rte_mbuf.h +3
-0@@ -841,6 +844,9 @@ struct rte_mbuf { + +/* Chain of off-load operations to perform on mbuf */ +struct rte_mbuf_offload *offload_ops; } __rte_cache_aligned;
Why is there a pointer in the mbuf structure? Can it be a metadata for the crypto layer instead?
More generally, I have the feeling that the idea behind this new API is not enough explained. How is it related to the ethernet offloads? Could you add a doxygen explanation starting with
/**
* @file
About doxygen, please think to integrate your new header.
Re: [PATCH v6 06/10] mbuf_offload: library to support attaching offloads to a mbuf
In reply to Declan Doherty2015-11-10 17:32, Declan Doherty:
Quoted 1 line
+DEPDIRS-$(CONFIG_RTE_LIBRTE_MBUF_OFFLOAD) +=
lib/librte_cryptodev
Why this lib depends on cryptodev?
Shoudn't be the reverse?
PATCH v6 7/10 qat_crypto_pmd: Addition of a new QAT DPDK PMD.
In reply to Declan DohertyThis patch adds a PMD for the Intel Quick Assist Technology DH895xxC hardware accelerator.
This patch depends on a QAT PF driver for device initialization. See the file docs/guides/cryptodevs/qat.rst for configuration details
This patch supports a limited subset of QAT device functionality, currently supporting chaining of cipher and hash operations for the following algorithmsd:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Some limitation on this patchset which shall be contributed in a subsequent release:
- Chained mbufs are not supported.
- Hash only is not supported.
- Cipher only is not supported.
- Only in-place is currently supported (destination address is the same as source address).
- Only supports session-oriented API implementation (session-less APIs are not supported).
--- config/common_bsdapp | 14 + config/common_linuxapp | 14 + doc/guides/cryptodevs/index.rst | 42 ++ doc/guides/cryptodevs/qat.rst | 194 +++++++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 37 ++ drivers/crypto/qat/Makefile | 63 +++ .../qat/qat_adf/adf_transport_access_macros.h | 174 ++++++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++++++++++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++++++++++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++++++++++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 +++++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 601 +++++++++++++++++++++ drivers/crypto/qat/qat_crypto.c | 561 +++++++++++++++++++ drivers/crypto/qat/qat_crypto.h | 124 +++++ drivers/crypto/qat/qat_logs.h | 78 +++ drivers/crypto/qat/qat_qp.c | 429 +++++++++++++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 137 +++++ lib/librte_mbuf_offload/rte_mbuf_offload.h | 9 +- mk/rte.app.mk | 3 + 22 files changed, 3628 insertions(+), 8 deletions(-) create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c
config/common_bsdapp +14 -0
@@ -155,6 +155,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
config/common_linuxapp +14 -0
@@ -153,6 +153,20 @@ CONFIG_RTE_CRYPTO_MAX_DEVS=64 CONFIG_RTE_CRYPTODEV_NAME_LEN=64 # +# Compile PMD for QuickAssist based devices +# +CONFIG_RTE_LIBRTE_PMD_QAT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_INIT=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_TX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_RX=n +CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n +# +# Number of sessions to create in the session memory pool +# on a single QuickAssist device. +# +CONFIG_RTE_QAT_PMD_MAX_NB_SESSIONS=2048 + +# # Support NIC bypass logic # CONFIG_RTE_NIC_BYPASS=n
doc/guides/cryptodevs/index.rst new file +42 -0
42 lines not on this page · raw message
doc/guides/cryptodevs/qat.rst new file +194 -0
194 lines not on this page · raw message
doc/guides/index.rst +1 -0
@@ -42,6 +42,7 @@ Contents: xen/index prog_guide/index nics/index + cryptodevs/index sample_app_ug/index testpmd_app_ug/index faq/index
drivers/Makefile +1 -0
@@ -32,5 +32,6 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-y += net +DIRS-y += crypto include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/Makefile new file +37 -0
@@ -0,0 +1,37 @@ +# BSD LICENSE +# +# Copyright(c) 2010-2015 Intel Corporation. All rights reserved. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +include $(RTE_SDK)/mk/rte.vars.mk + +DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat + +include $(RTE_SDK)/mk/rte.sharelib.mk +include $(RTE_SDK)/mk/rte.subdir.mk
drivers/crypto/qat/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/qat/qat_adf/adf_transport_access_macros.h new file +174 -0
174 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw.h new file +316 -0
316 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_fw_la.h new file +404 -0
404 lines not on this page · raw message
drivers/crypto/qat/qat_adf/icp_qat_hw.h new file +306 -0
306 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs.h new file +125 -0
125 lines not on this page · raw message
drivers/crypto/qat/qat_adf/qat_algs_build_desc.c new file +601 -0
601 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.c new file +561 -0
561 lines not on this page · raw message
drivers/crypto/qat/qat_crypto.h new file +124 -0
123 lines not on this page · raw message
drivers/crypto/qat/qat_logs.h new file +78 -0
78 lines not on this page · raw message
drivers/crypto/qat/qat_qp.c new file +429 -0
429 lines not on this page · raw message
drivers/crypto/qat/rte_pmd_qat_version.map new file +3 -0
Lines of this file are not shown. View the raw message.
drivers/crypto/qat/rte_qat_cryptodev.c new file +137 -0
137 lines not on this page · raw message
lib/librte_mbuf_offload/rte_mbuf_offload.h +1 -8
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
Re: [PATCH v6 07/10] qat_crypto_pmd: Addition of a new QAT DPDK PMD.
2015-11-10 17:32, Declan Doherty:
Quoted 10 lines
lib/librte_mbuf_offload/rte_mbuf_offload.h +0
-4@@ -123,17 +123,10 @@ rte_pktmbuf_offload_get(struct rte_mbuf *m, enum rte_mbuf_ol_op_type type) {struct rte_mbuf_offload *ol = m->offload_ops; -if (m->offload_ops !=NULL && m->offload_ops->type == type) -return ol; - - ol = m->offload_ops;
lib/librte_mbuf_offload/rte_mbuf_offload.h rte_pktmbuf_offload_get(struct rte_mbuf *m, enum rte_mbuf_ol_op_type type) · line 131
Quoted 10 lines
lib/librte_mbuf_offload/rte_mbuf_offload.h +1
-4-while (ol !=NULL ) { +for (ol = m->offload_ops; ol !=NULL ; ol = ol->next)if (ol->type == type)return ol; - ol = ol->next; - } -return ol; }
Strange: why changing the code of the previous patch?
Re: [PATCH v6 07/10] qat_crypto_pmd: Addition of a new QAT DPDK PMD.
Quoted 16 lines · Thomas Monjalon
2015-11-10 17:32, Declan Doherty:
Quoted 15 lines
lib/librte_mbuf_offload/rte_mbuf_offload.h +1
-5@@ -123,17 +123,10 @@ rte_pktmbuf_offload_get(struct rte_mbuf *m, enum rte_mbuf_ol_op_type type) {struct rte_mbuf_offload *ol = m->offload_ops; -if (m->offload_ops !=NULL && m->offload_ops->type == type) -return ol; - - ol = m->offload_ops; -while (ol !=NULL ) { +for (ol = m->offload_ops; ol !=NULL ; ol = ol->next)if (ol->type == type)return ol;
Quoted 8 lines
lib/librte_mbuf_offload/rte_mbuf_offload.h rte_pktmbuf_offload_get(struct rte_mbuf *m, enum rte_mbuf_ol_op_type type) · line 131
Quoted 5 lines
lib/librte_mbuf_offload/rte_mbuf_offload.h +0
-3- ol = ol->next; - } -return ol; }Strange: why changing the code of the previous patch?
I squashed this tidy up into the wrong patch. I'll fix in v7
PATCH v6 8/10 aesni_mb_pmd: Initial implementation of multi buffer based crypto device
In reply to Declan DohertyThis patch provides the initial implementation of the AES-NI multi-buffer based crypto poll mode driver using DPDK's new cryptodev framework.
This PMD is dependent on Intel's multibuffer library, see the whitepaper "Fast Multi-buffer IPsec Implementations on Intel® Architecture Processors", see ref 1 for details on the library's design and ref 2 to download the library itself. This initial implementation is limited to supporting the chained operations of "hash then cipher" or "cipher then hash" for the following cipher and hash algorithms:
Cipher algorithms:
- RTE_CRYPTO_CIPHER_AES128_CBC
- RTE_CRYPTO_CIPHER_AES256_CBC
- RTE_CRYPTO_CIPHER_AES512_CBC
Hash algorithms:
- RTE_CRYPTO_AUTH_SHA1_HMAC
- RTE_CRYPTO_AUTH_SHA256_HMAC
- RTE_CRYPTO_AUTH_SHA512_HMAC
- RTE_CRYPTO_AUTH_AES_XCBC_MAC
Important Note:
Due to the fact that the multi-buffer library is designed for accelerating IPsec crypto oepration, the digest's generated for the HMAC functions are truncated to lengths specified by IPsec RFC's, ie RFC2404 for using HMAC-SHA-1 with IPsec specifies that the digest is truncate from 20 to 12 bytes.
Build instructions:
To build DPKD with the AESNI_MB_PMD the user is required to download (ref 2) and compile the multi-buffer library on there user system before building DPDK. The environmental variable AESNI_MULTI_BUFFER_LIB_PATH must be exported with the path where you extracted and built the multi buffer library and finally set CONFIG_RTE_LIBRTE_PMD_AESNI_MB=y in config/common_linuxapp.
Current status: It's doesn't support crypto operation across chained mbufs, or cipher only or hash only operations.
ref 2: https://downloadcenter.intel.com/download/22972
--- MAINTAINERS | 3 + config/common_bsdapp | 7 + config/common_linuxapp | 7 + doc/guides/cryptodevs/aesni_mb.rst | 76 +++ doc/guides/cryptodevs/index.rst | 1 + drivers/crypto/Makefile | 1 + drivers/crypto/aesni_mb/Makefile | 63 ++ drivers/crypto/aesni_mb/aesni_mb_ops.h | 210 +++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 669 +++++++++++++++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 298 +++++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 229 +++++++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + mk/rte.app.mk | 4 + 13 files changed, 1571 insertions(+) create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map
MAINTAINERS +3 -0
@@ -303,6 +303,9 @@ Null PMD M: Tetsuya Mukawa <[email protected]> F: drivers/net/null/ +Crypto AES-NI Multi-Buffer PMD +M: Declan Doherty <[email protected]> +F: driver/crypto/aesni_mb Packet processing -----------------
config/common_bsdapp +7 -0
@@ -168,6 +168,13 @@ CONFIG_RTE_LIBRTE_QAT_DEBUG_DRIVER=n # CONFIG_RTE_MAX_QAT_SESSIONS=200 + +# +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_AESNI_MB_DEBUG=n + # # Support NIC bypass logic #
config/common_linuxapp +7 -0
@@ -166,6 +166,13 @@ CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=n # CONFIG_RTE_QAT_PMD_MAX_NB_SESSIONS=2048 +# Compile PMD for AESNI backed device +# +CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n +CONFIG_RTE_LIBRTE_PMD_AESNI_MB_DEBUG=n +CONFIG_RTE_AESNI_MB_PMD_MAX_NB_QUEUE_PAIRS=8 +CONFIG_RTE_AESNI_MB_PMD_MAX_NB_SESSIONS=2048 + # # Support NIC bypass logic #
doc/guides/cryptodevs/aesni_mb.rst new file +76 -0
76 lines not on this page · raw message
doc/guides/cryptodevs/index.rst +1 -0
@@ -39,4 +39,5 @@ Crypto Device Drivers :maxdepth: 2 :numbered: + aesni_mb qat
drivers/crypto/Makefile +1 -0
@@ -31,6 +31,7 @@ include $(RTE_SDK)/mk/rte.vars.mk +DIRS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += aesni_mb DIRS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += qat include $(RTE_SDK)/mk/rte.sharelib.mk
drivers/crypto/aesni_mb/Makefile new file +63 -0
63 lines not on this page · raw message
drivers/crypto/aesni_mb/aesni_mb_ops.h new file +210 -0
210 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c new file +669 -0
669 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c new file +298 -0
298 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h new file +229 -0
229 lines not on this page · raw message
drivers/crypto/aesni_mb/rte_pmd_aesni_version.map new file +3 -0
@@ -0,0 +1,3 @@ +DPDK_2.2 { + local: *; +};
mk/rte.app.mk +4 -0
@@ -153,6 +153,10 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_NULL) += -lrte_pmd_null # QAT PMD has a dependency on libcrypto (from openssl) for calculating HMAC precomputes _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_QAT) += -lrte_pmd_qat -lcrypto +# AESNI MULTI BUFFER is dependent on the IPSec_MB library +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -lrte_pmd_aesni_mb +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_AESNI_MB) += -L$(AESNI_MULTI_BUFFER_LIB_PATH) -lIPSec_MB + endif # ! $(CONFIG_RTE_BUILD_SHARED_LIB) endif # ! CONFIG_RTE_BUILD_COMBINE_LIBS
Signature · 1 line
2.4.3
PATCH v6 9/10 app/test: add cryptodev unit and performance tests
In reply to Declan Dohertyunit tests are run by using cryptodev_qat_autotest or cryptodev_aesni_autotest from the test apps interactive console.
performance tests are run by using the cryptodev_qat_perftest or cryptodev_aesni_mb_perftest command from the test apps interactive console.
If you which to run the tests on a QAT device there must be one bound to igb_uio kernel driver.
--- MAINTAINERS | 2 + app/test/Makefile | 4 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1986 ++++++++++++++++++++++++++++++++ app/test/test_cryptodev.h | 68 ++ app/test/test_cryptodev_perf.c | 2062 ++++++++++++++++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- app/test/test_link_bonding_rssconf.c | 7 +- 10 files changed, 4219 insertions(+), 49 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c
MAINTAINERS +2 -0
@@ -204,6 +204,8 @@ Crypto API M: Declan Doherty <[email protected]> F: lib/librte_cryptodev F: docs/guides/cryptodevs +F: app/test/test_cryptodev.c +F: app/test/test_cryptodev_perf.c Drivers -------
app/test/Makefile +4 -0
@@ -149,6 +149,10 @@ endif SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring.c SRCS-$(CONFIG_RTE_LIBRTE_PMD_RING) += test_pmd_ring_perf.c + +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev_perf.c +SRCS-$(CONFIG_RTE_LIBRTE_CRYPTODEV) += test_cryptodev.c + SRCS-$(CONFIG_RTE_LIBRTE_KVARGS) += test_kvargs.c CFLAGS += -O3
app/test/test.c +61 -31
112 lines not on this page · raw message
app/test/test.h +27 -7
@@ -33,7 +33,7 @@#ifndef _TEST_H_#define _TEST_H_ - +#include <stddef.h> #include <sys/queue.h> #define TEST_SUCCESS (0)
@@ -64,6 +64,17 @@ } \ } while (0) + +#define TEST_ASSERT_BUFFERS_ARE_EQUAL (a, b, len, msg, ...) do { \ + if (memcmp(a, b, len)) { \ + printf("TestCase %s() line %d failed: " \ + msg "\n", __func__, __LINE__, ##__VA_ARGS__); \ + TEST_TRACE_FAILURE(__FILE__, __LINE__, __func__); \ + return TEST_FAILED; \ + } \ +} while (0) + +#define TEST_ASSERT_NOT_EQUAL (a, b, msg, ...) do { \ if (!(a != b)) { \ printf("TestCase %s() line %d failed: " \
@@ -113,27 +124,36 @@struct unit_test_case {int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );int (*testcase)(void );const char *success_msg;const char *fail_msg; +unsigned enabled; }; -#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed"} +#define TEST_CASE (fn) { NULL, NULL, fn, #fn " succeeded", #fn " failed", 1 }#define TEST_CASE_NAMED (name, fn) { NULL, NULL, fn, name " succeeded", \ - name " failed"} + name " failed", 1 }#define TEST_CASE_ST (setup, teardown, testcase) \ { setup, teardown, testcase, #testcase " succeeded", \ - #testcase " failed "} + #testcase " failed ", 1 } + + +#define TEST_CASE_DISABLED (fn) { NULL, NULL, fn, #fn " succeeded", \ + #fn " failed", 0 } + +#define TEST_CASE_ST_DISABLED (setup, teardown, testcase) \ + { setup, teardown, testcase, #testcase " succeeded", \ + #testcase " failed ", 0 } -#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL } +#define TEST_CASES_END () { NULL, NULL, NULL, NULL, NULL, 0 }struct unit_test_suite {const char *suite_name;int (*setup)(void ); -int (*teardown)(void ); +void (*teardown)(void );struct unit_test_case unit_test_cases[]; };
app/test/test_cryptodev.c new file +1986 -0
1,986 lines not on this page · raw message
app/test/test_cryptodev.h new file +68 -0
68 lines not on this page · raw message
app/test/test_cryptodev_perf.c new file +2062 -0
749 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.4.3
Part of the diff is not shown here. View the raw message.
PATCH v6 10/10 l2fwd-crypto: crypto
In reply to Declan DohertyThis patch creates a new sample applicaiton based off the l2fwd application which performs specified crypto operations on IP packet payloads which are forwarding.
--- MAINTAINERS | 1 + examples/l2fwd-crypto/Makefile | 50 ++ examples/l2fwd-crypto/main.c | 1473 ++++++++++++++++++++++++++++++++++++++++ 3 files changed, 1524 insertions(+) create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c
MAINTAINERS +1 -0
@@ -206,6 +206,7 @@ F: lib/librte_cryptodev F: docs/guides/cryptodevs F: app/test/test_cryptodev.c F: app/test/test_cryptodev_perf.c +F: examples/l2fwd-crypto Drivers -------
examples/l2fwd-crypto/Makefile new file +50 -0
50 lines not on this page · raw message
examples/l2fwd-crypto/main.c new file +1473 -0
1,473 lines not on this page · raw message
Signature · 1 line
2.4.3
Re: [PATCH v6 10/10] l2fwd-crypto: crypto
2015-11-10 17:32, Declan Doherty:
Quoted 4 lines
MAINTAINERS | 1 + examples/l2fwd-crypto/Makefile | 50 ++ examples/l2fwd-crypto/main.c | 1473 ++++++++++++++++++++++++++++++++++++++++ 3 files changed, 1524 insertions(+)
I think you missed examples/Makefile
v7 cover Crypto API and device framework
In reply to Declan DohertyThis series of patches defines a set of application burst oriented APIs for asynchronous symmetric cryptographic functions within DPDK. It also contains a poll mode driver cryptographic device framework for the implementation of crypto devices within DPDK.
In the patch set we also have included 2 reference implementations of crypto PMDs. Currently both implementations support AES128-CBC with HMAC_SHA1/SHA256/SHA512 authentication operations. The first device is a purely
software PMD based on Intel's multi-buffer library, which utilises both
AES-NI instructions and vector operations to accelerate crypto operations and the second PMD utilises Intel's Quick Assist Technology (on DH895xxC) to provide hardware accelerated crypto operations.
The API set supports two functional modes of operation:
1, A session oriented mode. In this mode the user creates a crypto session which defines all the immutable data required to perform a particular crypto operation in advance, including cipher/hash algorithms and operations to be performed as well as the keys to used etc. The session is then referenced by the crypto operation data structure which is a data structure specific to each mbuf. It is contains all mutable data about the cryto operation to be performed, such as data offsets and lengths into the mbuf's data payload for cipher and hash operations to be performed.
2, A session-less mode. In this mode the user is able to provision crypto operations on an mbuf without the need to have a cached session created in advance, but at the cost of entailing the overhead of calculating authentication pre-computes and preforming key expansions in-line with the crypto operation. The crypto xform chain is directly attached to the op struct in this mode, so the op struct now contains all of the immutable crypto operation parameters that would be normally set within a session. Once all mutable and immutable parameters are set the crypto operation data structure can be attached to the specified mbuf and enqueued on a specified crypto device for processing.
The patch set contains the following features:
- Crypto device APIs and device framework
- Implementation of a software crypto PMD based on multi-buffer library
- Implementation of a hardware crypto PMD baed on Intel QAT(DH895xxC)
- Unit and performance test's which give and example of utilising the crypto API's.
- Sample application which performs crypto operations on the IP payload of the packets being forwarded
Current Status:
There is no support for chained mbuf's and as mentioned above the PMD's have currently implemented support for AES128-CBC/AES256-CBC/AES512-CBC and HMAC_SHA1/SHA256/SHA512.
v7:
- Fix typos in commit message of eal: add __rte_packed /__rte_aligned macros patch
- Include rte_mbuf_offload in doxygen build and updates file comments to clarify lib, usage. Also moved clean which was in wrong patch into this rte_mbuf_offload patch.
- Tidy up map file for cryptodev library.
- Add l2fwdc-crypto to main examples makefile.
v6:
- Fix 32-bit build issue caused by casting in new rte_pktmbuf_mtophys_offset macro
- Fix truncation of log message by new rte_pmd_debug_trace inline function
v5:
- Making ethdev marcos for function pointer and port id checking public and available for use in by the cryptodev. The intialise to patches combine changes from original cryptodev patch and discussion in
http://dpdk.org/ml/archives/dev/2015-November/027871.html
- Split out changes to create new __rte_packed and __rte_aligned macros into seperate patches form the main cryptodev patch set for clairty
- further code cleaning, removal of currently unsupported gcm code from aesni_mb pmd
v4:
- Some more EOF whitespace and checkpatch fixes
v3:
- Fixes a document build error, which I missed in the V2
- Fixes for remaining checkpatch errors
- Disables QAT and AESNI_MB PMD being build by default as they have external library dependences
v2:
- Introduces a new library to support attaching offload operations to a mbuf
- Remove unused APIs from cryptodev
- PMD code refactor due to new rte_mbuf_offload structure
- General bug fixes and code tidy up
Declan Doherty (10):
ethdev: rename macros to have RTE_ prefix
ethdev: make error checking macros public
eal: add __rte_packed /__rte_aligned macros
mbuf: add new marcos to get the physical address of data
cryptodev: Initial DPDK Crypto APIs and device framework release
mbuf_offload: library to support attaching offloads to a mbuf
qat_crypto_pmd: Addition of a new QAT DPDK PMD.
aesni_mb_pmd: Initial implementation of multi buffer based crypto
device
app/test: add cryptodev unit and performance tests
l2fwd-crypto: crypto
MAINTAINERS | 14 + app/test/Makefile | 4 + app/test/test.c | 92 +- app/test/test.h | 34 +- app/test/test_cryptodev.c | 1986 +++++++++++++++++++ app/test/test_cryptodev.h | 68 + app/test/test_cryptodev_perf.c | 2062 ++++++++++++++++++++ app/test/test_link_bonding.c | 6 +- app/test/test_link_bonding_mode4.c | 7 +- app/test/test_link_bonding_rssconf.c | 7 +- config/common_bsdapp | 37 +- config/common_linuxapp | 37 +- doc/api/doxy-api-index.md | 2 + doc/api/doxy-api.conf | 2 + doc/guides/cryptodevs/aesni_mb.rst | 76 + doc/guides/cryptodevs/index.rst | 43 + doc/guides/cryptodevs/qat.rst | 194 ++ doc/guides/index.rst | 1 + drivers/Makefile | 1 + drivers/crypto/Makefile | 38 + drivers/crypto/aesni_mb/Makefile | 63 + drivers/crypto/aesni_mb/aesni_mb_ops.h | 210 ++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c | 669 +++++++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c | 298 +++ drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h | 229 +++ drivers/crypto/aesni_mb/rte_pmd_aesni_version.map | 3 + drivers/crypto/qat/Makefile | 63 + .../qat/qat_adf/adf_transport_access_macros.h | 174 ++ drivers/crypto/qat/qat_adf/icp_qat_fw.h | 316 +++ drivers/crypto/qat/qat_adf/icp_qat_fw_la.h | 404 ++++ drivers/crypto/qat/qat_adf/icp_qat_hw.h | 306 +++ drivers/crypto/qat/qat_adf/qat_algs.h | 125 ++ drivers/crypto/qat/qat_adf/qat_algs_build_desc.c | 601 ++++++ drivers/crypto/qat/qat_crypto.c | 561 ++++++ drivers/crypto/qat/qat_crypto.h | 124 ++ drivers/crypto/qat/qat_logs.h | 78 + drivers/crypto/qat/qat_qp.c | 429 ++++ drivers/crypto/qat/rte_pmd_qat_version.map | 3 + drivers/crypto/qat/rte_qat_cryptodev.c | 137 ++ examples/Makefile | 1 + examples/l2fwd-crypto/Makefile | 50 + examples/l2fwd-crypto/main.c | 1473 ++++++++++++++ lib/Makefile | 2 + lib/librte_cryptodev/Makefile | 60 + lib/librte_cryptodev/rte_crypto.h | 613 ++++++ lib/librte_cryptodev/rte_cryptodev.c | 1092 +++++++++++ lib/librte_cryptodev/rte_cryptodev.h | 649 ++++++ lib/librte_cryptodev/rte_cryptodev_pmd.h | 549 ++++++ lib/librte_cryptodev/rte_cryptodev_version.map | 32 + lib/librte_eal/common/include/rte_dev.h | 53 + lib/librte_eal/common/include/rte_log.h | 1 + lib/librte_eal/common/include/rte_memory.h | 14 +- lib/librte_ether/rte_ethdev.c | 607 +++--- lib/librte_ether/rte_ethdev.h | 26 + lib/librte_mbuf/rte_mbuf.h | 29 + lib/librte_mbuf_offload/Makefile | 52 + lib/librte_mbuf_offload/rte_mbuf_offload.c | 100 + lib/librte_mbuf_offload/rte_mbuf_offload.h | 302 +++ .../rte_mbuf_offload_version.map | 7 + mk/rte.app.mk | 9 + 60 files changed, 14842 insertions(+), 383 deletions(-) create mode 100644 app/test/test_cryptodev.c create mode 100644 app/test/test_cryptodev.h create mode 100644 app/test/test_cryptodev_perf.c create mode 100644 doc/guides/cryptodevs/aesni_mb.rst create mode 100644 doc/guides/cryptodevs/index.rst create mode 100644 doc/guides/cryptodevs/qat.rst create mode 100644 drivers/crypto/Makefile create mode 100644 drivers/crypto/aesni_mb/Makefile create mode 100644 drivers/crypto/aesni_mb/aesni_mb_ops.h create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_ops.c create mode 100644 drivers/crypto/aesni_mb/rte_aesni_mb_pmd_private.h create mode 100644 drivers/crypto/aesni_mb/rte_pmd_aesni_version.map create mode 100644 drivers/crypto/qat/Makefile create mode 100644 drivers/crypto/qat/qat_adf/adf_transport_access_macros.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_fw_la.h create mode 100644 drivers/crypto/qat/qat_adf/icp_qat_hw.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs.h create mode 100644 drivers/crypto/qat/qat_adf/qat_algs_build_desc.c create mode 100644 drivers/crypto/qat/qat_crypto.c create mode 100644 drivers/crypto/qat/qat_crypto.h create mode 100644 drivers/crypto/qat/qat_logs.h create mode 100644 drivers/crypto/qat/qat_qp.c create mode 100644 drivers/crypto/qat/rte_pmd_qat_version.map create mode 100644 drivers/crypto/qat/rte_qat_cryptodev.c create mode 100644 examples/l2fwd-crypto/Makefile create mode 100644 examples/l2fwd-crypto/main.c create mode 100644 lib/librte_cryptodev/Makefile create mode 100644 lib/librte_cryptodev/rte_crypto.h create mode 100644 lib/librte_cryptodev/rte_cryptodev.c create mode 100644 lib/librte_cryptodev/rte_cryptodev.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_pmd.h create mode 100644 lib/librte_cryptodev/rte_cryptodev_version.map create mode 100644 lib/librte_mbuf_offload/Makefile create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.c create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload.h create mode 100644 lib/librte_mbuf_offload/rte_mbuf_offload_version.map
Signature · 1 line
2.5.0