Hexagon (target/hexagon) Use QEMU decodetree
v2 cover Hexagon (target/hexagon) Use QEMU decodetree
Replace the old Hexagon dectree.py with QEMU decodetree
**** Changes in v2 ****
Suggested Python improvements from Brian Cain <[email protected]>
Taylor Simpson (3):
Hexagon (target/hexagon) Use QEMU decodetree (32-bit instructions) Hexagon (target/hexagon) Use QEMU decodetree (16-bit instructions) Hexagon (target/hexagon) Remove old dectree.py
target/hexagon/decode.h | 5 +- target/hexagon/opcodes.h | 2 - target/hexagon/decode.c | 435 +++++++--------------------- target/hexagon/gen_dectree_import.c | 49 ---- target/hexagon/opcodes.c | 29 -- target/hexagon/translate.c | 4 +- target/hexagon/README | 14 +- target/hexagon/dectree.py | 403 -------------------------- target/hexagon/gen_decodetree.py | 198 +++++++++++++ target/hexagon/gen_trans_funcs.py | 124 ++++++++ target/hexagon/meson.build | 147 +++++++++- 11 files changed, 586 insertions(+), 824 deletions(-) delete mode 100755 target/hexagon/dectree.py create mode 100755 target/hexagon/gen_decodetree.py create mode 100755 target/hexagon/gen_trans_funcs.py
Signature · 1 line
2.34.1
PATCH v2 1/3 Hexagon (target/hexagon) Use QEMU decodetree (32-bit instructions)
The Decodetree Specification can be found here
https://www.qemu.org/docs/master/devel/decodetree.html
Covers all 32-bit instructions, including HVX
We generate separate decoders for each instruction class. The reason will be more apparent in the next patch in this series.
We add 2 new scripts
gen_decodetree.py Generate the input to decodetree.py
gen_trans_funcs.py Generate the trans_* functions used by the
output of decodetree.py
Since the functions generated by decodetree.py take DisasContext * as an argument, we add the argument to a couple of functions that didn't need it previously. We also set the insn field in DisasContext during decode because it is used by the trans_* functions.
There is a g_assert_not_reached() in decode_insns() in decode.c to verify we never try to use the old decoder on 32-bit instructions
--- target/hexagon/decode.h | 5 +- target/hexagon/decode.c | 54 ++++++++- target/hexagon/translate.c | 4 +- target/hexagon/README | 13 +- target/hexagon/gen_decodetree.py | 190 ++++++++++++++++++++++++++++++ target/hexagon/gen_trans_funcs.py | 132 +++++++++++++++++++++ target/hexagon/meson.build | 55 +++++++++ 7 files changed, 439 insertions(+), 14 deletions(-) create mode 100755 target/hexagon/gen_decodetree.py create mode 100755 target/hexagon/gen_trans_funcs.py
target/hexagon/decode.h +3 -2
@@ -21,12 +21,13 @@#include "cpu.h" #include "opcodes.h" #include "insn.h" +#include "translate.h" void decode_init (void );void decode_send_insn_to (Packet *packet,int start,int newloc); -int decode_packet (int max_words,const uint32_t *words,Packet *pkt, -bool disas_only); +int decode_packet (DisasContext *ctx,int max_words,const uint32_t *words, +Packet *pkt,bool disas_only);#endif
target/hexagon/decode.c +48 -6
99 lines not on this page · raw message
target/hexagon/translate.c +2 -2
@@ -1033,10 +1033,10 @@ static void decode_and_translate_packet(CPUHexagonState *env, DisasContext *ctx)return ; } -if (decode_packet (nwords, words, &pkt, false) >0 ) { + ctx->pkt = &pkt; +if (decode_packet (ctx, nwords, words, &pkt, false) >0 ) { pkt.pc = ctx->base.pc_next;HEX_DEBUG_PRINT_PKT (&pkt); - ctx->pkt = &pkt;gen_start_packet (ctx);for (i =0 ; i < pkt.num_insns; i++) { ctx->insn = &pkt.insn[i];
target/hexagon/README +9 -4
@@ -189,11 +189,16 @@ the packet, and we mark the implicit writes. After the analysis is performed, we initialize the result register for each of the predicated assignments. In addition to instruction semantics, we use a generator to create the decode -tree. This generation is also a two step process. The first step is to run -target/hexagon/gen_dectree_import.c to produce +tree. This generation is a four step process. +Step 1 is to run target/hexagon/gen_dectree_import.c to produce <BUILD_DIR>/target/hexagon/iset.py -This file is imported by target/hexagon/dectree.py to produce - <BUILD_DIR>/target/hexagon/dectree_generated.h.inc +Step 2 is to import iset.py into target/hexagon/gen_decodetree.py to produce + <BUILD_DIR>/target/hexagon/normal_decode_generated + <BUILD_DIR>/target/hexagon/hvx_decode_generated +Step 3 is to process the above files with QEMU's decodetree.py to produce + <BUILD_DIR>/target/hexagon/decode_*_generated.c.inc +Step 4 is to import iset.py into target/hexagon/gen_trans_funcs.py to produce + <BUILD_DIR>/target/hexagon/decodetree_trans_funcs_generated.c.inc *** Key Files ***
target/hexagon/gen_decodetree.py new file +190 -0
190 lines not on this page · raw message
target/hexagon/gen_trans_funcs.py new file +132 -0
132 lines not on this page · raw message
target/hexagon/meson.build +55 -0
61 lines not on this page · raw message
Signature · 1 line
2.34.1
PATCH v2 2/3 Hexagon (target/hexagon) Use QEMU decodetree (16-bit instructions)
In reply to Taylor SimpsonSection 10.3 of the Hexagon V73 Programmer's Reference Manual
A duplex is encoded as a 32-bit instruction with bits [15:14] set to 00. The sub-instructions that comprise a duplex are encoded as 13-bit fields in the duplex.
Create a decoder for each subinstruction class (a, l1, l2, s1, s2).
Extend gen_trans_funcs.py to handle all instructions rather than filter by instruction class.
There is a g_assert_not_reached() in decode_insns() in decode.c to verify we never try to use the old decoder on 16-bit instructions.
--- target/hexagon/decode.c | 85 +++++++++++++++++++++++++++++ target/hexagon/README | 1 + target/hexagon/gen_decodetree.py | 12 ++++- target/hexagon/gen_trans_funcs.py | 12 +---- target/hexagon/meson.build | 90 +++++++++++++++++++++++++++++++ 5 files changed, 188 insertions(+), 12 deletions(-)
target/hexagon/decode.c +85 -0
@@ -60,6 +60,7 @@ static int decode_mapped_reg_##NAME(DisasContext *ctx, int x) \ } DECODE_MAPPED(R_16) DECODE_MAPPED(R_8) +DECODE_MAPPED(R__8) /* Helper function for decodetree_trans_funcs_generated.c.inc */ static int shift_left(DisasContext *ctx, int x, int n, int immno)
@@ -77,6 +78,13 @@ static int shift_left(DisasContext *ctx, int x, int n, int immno)#include "decode_normal_generated.c.inc" #include "decode_hvx_generated.c.inc" +/* Include the generated decoder for 16 bit insn */ +#include "decode_subinsn_a_generated.c.inc" +#include "decode_subinsn_l1_generated.c.inc" +#include "decode_subinsn_l2_generated.c.inc" +#include "decode_subinsn_s1_generated.c.inc" +#include "decode_subinsn_s2_generated.c.inc" +/* Include the generated helpers for the decoder */ #include "decodetree_trans_funcs_generated.c.inc"
@@ -790,6 +798,63 @@ decode_insns_tablewalk(Insn *insn, const DectreeTable *table, } } +/* +* Section 10.3 of the Hexagon V73 Programmer's Reference Manual +* +* A duplex is encoded as a 32-bit instruction with bits [15:14] set to 00. +* The sub-instructions that comprise a duplex are encoded as 13-bit fields +* in the duplex. +* +* Per table 10-4, the 4-bit duplex iclass is encoded in bits 31:29, 13 +*/ +static uint32_t get_duplex_iclass (uint32_t encoding) +{ +uint32_t iclass =extract32 (encoding,13 ,1 ); + iclass =deposit32 (iclass,1 ,3 ,extract32 (encoding,29 ,3 )); +return iclass; +} + +/* +* Per table 10-5, the duplex ICLASS field values that specify the group of +* each sub-instruction in a duplex +* +* This table points to the decode instruction for each entry in the table +*/ +typedef bool (*subinsn_decode_func )(DisasContext *ctx,uint16_t insn); +typedef struct { +subinsn_decode_func decode_slot0_subinsn; +subinsn_decode_func decode_slot1_subinsn; +}subinsn_decode_groups ; + +static const subinsn_decode_groups decode_groups[16 ] = { + [0x0 ] = { decode_subinsn_l1, decode_subinsn_l1 }, + [0x1 ] = { decode_subinsn_l2, decode_subinsn_l1 }, + [0x2 ] = { decode_subinsn_l2, decode_subinsn_l2 }, + [0x3 ] = { decode_subinsn_a, decode_subinsn_a }, + [0x4 ] = { decode_subinsn_l1, decode_subinsn_a }, + [0x5 ] = { decode_subinsn_l2, decode_subinsn_a }, + [0x6 ] = { decode_subinsn_s1, decode_subinsn_a }, + [0x7 ] = { decode_subinsn_s2, decode_subinsn_a }, + [0x8 ] = { decode_subinsn_s1, decode_subinsn_l1 }, + [0x9 ] = { decode_subinsn_s1, decode_subinsn_l2 }, + [0xa ] = { decode_subinsn_s1, decode_subinsn_s1 }, + [0xb ] = { decode_subinsn_s2, decode_subinsn_s1 }, + [0xc ] = { decode_subinsn_s2, decode_subinsn_l1 }, + [0xd ] = { decode_subinsn_s2, decode_subinsn_l2 }, + [0xe ] = { decode_subinsn_s2, decode_subinsn_s2 }, + [0xf ] = {NULL ,NULL },/* Reserved */ +}; + +static uint16_t get_slot0_subinsn (uint32_t encoding) +{ +return extract32 (encoding,0 ,13 ); +} + +static uint16_t get_slot1_subinsn (uint32_t encoding) +{ +return extract32 (encoding,16 ,13 ); +} +static unsigned int decode_insns (DisasContext *ctx,Insn *insn,uint32_t encoding) {
@@ -805,8 +870,28 @@ decode_insns(DisasContext *ctx, Insn *insn, uint32_t encoding) table = &dectree_table_DECODE_ROOT_32;g_assert_not_reached (); }else { +uint32_t iclass =get_duplex_iclass (encoding); +unsigned int slot0_subinsn =get_slot0_subinsn (encoding); +unsigned int slot1_subinsn =get_slot1_subinsn (encoding); +subinsn_decode_func decode_slot0_subinsn = + decode_groups[iclass].decode_slot0_subinsn; +subinsn_decode_func decode_slot1_subinsn = + decode_groups[iclass].decode_slot1_subinsn; + +/* The slot1 subinsn needs to be in the packet first */ +if (decode_slot1_subinsn (ctx, slot1_subinsn)) { + insn->generate = opcode_genptr[insn->opcode]; + insn->iclass =iclass_bits (encoding); + ctx->insn = ++insn; +if (decode_slot0_subinsn (ctx, slot0_subinsn)) { + insn->generate = opcode_genptr[insn->opcode]; + insn->iclass =iclass_bits (encoding); +return 2 ; + } + }/* start with EE table - duplex instructions */ table = &dectree_table_DECODE_ROOT_EE; +g_assert_not_reached (); }return decode_insns_tablewalk (insn, table, encoding); }
target/hexagon/README +1 -0
@@ -195,6 +195,7 @@ Step 1 is to run target/hexagon/gen_dectree_import.c to produce Step 2 is to import iset.py into target/hexagon/gen_decodetree.py to produce <BUILD_DIR>/target/hexagon/normal_decode_generated <BUILD_DIR>/target/hexagon/hvx_decode_generated + <BUILD_DIR>/target/hexagon/subinsn_*_decode_generated Step 3 is to process the above files with QEMU's decodetree.py to produce <BUILD_DIR>/target/hexagon/decode_*_generated.c.inc Step 4 is to import iset.py into target/hexagon/gen_trans_funcs.py to produce
target/hexagon/gen_decodetree.py +10 -2
@@ -96,8 +96,10 @@ def skip_tag(tag, class_to_decode): ## A2_add ..................-.....---..... @A2_add ## def gen_decodetree_file(f, class_to_decode): + is_subinsn = class_to_decode.startswith("SUBINSN_") f.write(f"## DO NOT MODIFY - This file is generated by {sys.argv[0]}\n\n") - f.write("%PP\t14:2\n\n") + if not is_subinsn: + f.write("%PP\t14:2\n\n") for tag in sorted(encs.keys(), key=iset.tags.index): if skip_tag(tag, class_to_decode): continue
@@ -108,6 +110,10 @@ def gen_decodetree_file(f, class_to_decode): f"## {tag}:\t{enc_str}\n" "##\n") + # The subinstructions come with a 13-bit encoding, but + # decodetree.py needs 16 bits + if is_subinsn: + enc_str = "---" + enc_str regs = ordered_unique(regre.findall(iset.iset[tag]["syntax"])) imms = ordered_unique(immre.findall(iset.iset[tag]["syntax"]))
@@ -174,7 +180,9 @@ def gen_decodetree_file(f, class_to_decode): imm_letter = "i" if imm_type.islower() else "I" f.write(f" {imm_type}{imm_letter}=%{tag}_{imm_type}{imm_letter}") - f.write(" %PP\n") + if not is_subinsn: + f.write(" %PP") + f.write("\n") # Replace the 0s and 1s with . enc_str = enc_str.replace("0", ".").replace("1", ".")
target/hexagon/gen_trans_funcs.py +2 -10
@@ -40,11 +40,6 @@ def ordered_unique(l): return sorted(set(l), key=l.index) -def skip_tag(tag, classes): - enc_class = iset.iset[tag]["enc_class"] - return enc_class not in classes - - def code_fmt(txt): return textwrap.indent(textwrap.dedent(txt), " ")
@@ -76,12 +71,9 @@ def mark_which_imm_extended(f, tag): ## return true; ## } ## -def gen_trans_funcs(f, classes): +def gen_trans_funcs(f): f.write(f"/* DO NOT MODIFY - This file is generated by {sys.argv[0]} */\n\n") for tag in sorted(encs.keys(), key=iset.tags.index): - if skip_tag(tag, classes): - continue - regs = ordered_unique(regre.findall(iset.iset[tag]["syntax"])) imms = ordered_unique(immre.findall(iset.iset[tag]["syntax"]))
@@ -129,4 +121,4 @@ def gen_trans_funcs(f, classes): if __name__ == "__main__": hex_common.read_semantics_file(sys.argv[1]) with open(sys.argv[2], "w") as f: - gen_trans_funcs(f, { "NORMAL", "EXT_mmvec" }) + gen_trans_funcs(f)
target/hexagon/meson.build +90 -0
102 lines not on this page · raw message
Signature · 1 line
2.34.1
PATCH v2 3/3 Hexagon (target/hexagon) Remove old dectree.py
In reply to Taylor SimpsonNow that we are using QEMU decodetree.py, remove the old decoder
--- target/hexagon/opcodes.h | 2 - target/hexagon/decode.c | 344 ------------------------ target/hexagon/gen_dectree_import.c | 49 ---- target/hexagon/opcodes.c | 29 -- target/hexagon/dectree.py | 403 ---------------------------- target/hexagon/meson.build | 12 - 6 files changed, 839 deletions(-) delete mode 100755 target/hexagon/dectree.py
target/hexagon/opcodes.h +0 -2
@@ -53,6 +53,4 @@ extern const OpcodeEncoding opcode_encodings[XX_LAST_OPCODE];void opcode_init (void ); -int opcode_which_immediate_is_extended (Opcode opcode); -#endif
target/hexagon/decode.c +0 -344
382 lines not on this page · raw message
target/hexagon/gen_dectree_import.c +0 -49
73 lines not on this page · raw message
target/hexagon/opcodes.c +0 -29
@@ -111,33 +111,4 @@ void opcode_init(void)#include "op_attribs_generated.h.inc" #undef OP_ATTRIB#undef ATTRIBS - -decode_init (); -} - - -#define NEEDLE "IMMEXT(" - -int opcode_which_immediate_is_extended (Opcode opcode) -{ -const char *p; - -g_assert (opcode <XX_LAST_OPCODE ); -g_assert (GET_ATTRIB (opcode,A_EXTENDABLE )); - - p = opcode_short_semantics[opcode]; - p =strstr (p,NEEDLE ); -g_assert (p); - p +=strlen (NEEDLE ); -while (isspace (*p)) { - p++; - } -/* lower is always imm 0, upper always imm 1. */ -if (islower (*p)) { -return 0 ; - }else if (isupper (*p)) { -return 1 ; - }else { -g_assert_not_reached (); - } }
target/hexagon/dectree.py deleted +0 -403
403 lines not on this page · raw message
target/hexagon/meson.build +0 -12
@@ -122,18 +122,6 @@ hexagon_ss.add(iset_py) # # Step 4 -# We use the dectree.py script to generate the decode tree header file -# -dectree_generated = custom_target( - 'dectree_generated.h.inc', - output: 'dectree_generated.h.inc', - depends: [iset_py], - env: {'PYTHONPATH': meson.current_build_dir()}, - command: [python, files('dectree.py'), '@OUTPUT@'], -) -hexagon_ss.add(dectree_generated) - -# # Generate the input to the QEMU decodetree.py script # normal_decode_generated = custom_target(
Signature · 1 line
2.34.1
Brian Cain
AppliedQuoted 42 lines
-----Original Message-----
From: Taylor Simpson <[email protected]>
Sent: Monday, January 15, 2024 4:15 PM
To: [email protected]
Cc: Brian Cain <[email protected]>; Matheus Bernardino (QUIC) <[email protected]>; Sid Manning <[email protected]>; Marco Liebel (QUIC) <[email protected]>; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]
Subject: [PATCH v2 0/3] Hexagon (target/hexagon) Use QEMU decodetreeWARNING: This email originated from outside of Qualcomm. Please be wary of any links or attachments, and do not enable macros.
Replace the old Hexagon
dectree.pywith QEMU decodetree**** Changes in v2 ****
Suggested Python improvements from Brian Cain <[email protected]>Taylor Simpson (3):
Hexagon (target/hexagon) Use QEMU decodetree (32-bit instructions) Hexagon (target/hexagon) Use QEMU decodetree (16-bit instructions) Hexagon (target/hexagon) Remove olddectree.pytarget/hexagon/decode.h | 5 +- target/hexagon/opcodes.h | 2 - target/hexagon/decode.c | 435 +++++++--------------------- target/hexagon/gen_dectree_import.c | 49 ---- target/hexagon/opcodes.c | 29 -- target/hexagon/translate.c | 4 +- target/hexagon/README | 14 +- target/hexagon/dectree.py | 403 -------------------------- target/hexagon/gen_decodetree.py | 198 +++++++++++++ target/hexagon/gen_trans_funcs.py | 124 ++++++++ target/hexagon/meson.build | 147 +++++++++- 11 files changed, 586 insertions(+), 824 deletions(-) delete mode 100755 target/hexagon/dectree.py create mode 100755 target/hexagon/gen_decodetree.py create mode 100755 target/hexagon/gen_trans_funcs.py
Quoted 2 lines
--
2.34.1