LLVM 20.0.0git
ISDOpcodes.h
Go to the documentation of this file.
1//===-- llvm/CodeGen/ISDOpcodes.h - CodeGen opcodes -------------*- C++ -*-===//
2//
3// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
4// See https://llvm.org/LICENSE.txt for license information.
5// SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
6//
7//===----------------------------------------------------------------------===//
8//
9// This file declares codegen opcodes and related utilities.
10//
11//===----------------------------------------------------------------------===//
12
13#ifndef LLVM_CODEGEN_ISDOPCODES_H
14#define LLVM_CODEGEN_ISDOPCODES_H
15
17
18namespace llvm {
19
20/// ISD namespace - This namespace contains an enum which represents all of the
21/// SelectionDAG node types and value types.
22///
23namespace ISD {
24
25//===--------------------------------------------------------------------===//
26/// ISD::NodeType enum - This enum defines the target-independent operators
27/// for a SelectionDAG.
28///
29/// Targets may also define target-dependent operator codes for SDNodes. For
30/// example, on x86, these are the enum values in the X86ISD namespace.
31/// Targets should aim to use target-independent operators to model their
32/// instruction sets as much as possible, and only use target-dependent
33/// operators when they have special requirements.
34///
35/// Finally, during and after selection proper, SNodes may use special
36/// operator codes that correspond directly with MachineInstr opcodes. These
37/// are used to represent selected instructions. See the isMachineOpcode()
38/// and getMachineOpcode() member functions of SDNode.
39///
41
42 /// DELETED_NODE - This is an illegal value that is used to catch
43 /// errors. This opcode is not a legal opcode for any node.
45
46 /// EntryToken - This is the marker used to indicate the start of a region.
48
49 /// TokenFactor - This node takes multiple tokens as input and produces a
50 /// single token result. This is used to represent the fact that the operand
51 /// operators are independent of each other.
53
54 /// AssertSext, AssertZext - These nodes record if a register contains a
55 /// value that has already been zero or sign extended from a narrower type.
56 /// These nodes take two operands. The first is the node that has already
57 /// been extended, and the second is a value type node indicating the width
58 /// of the extension.
59 /// NOTE: In case of the source value (or any vector element value) is
60 /// poisoned the assertion will not be true for that value.
63
64 /// AssertAlign - These nodes record if a register contains a value that
65 /// has a known alignment and the trailing bits are known to be zero.
66 /// NOTE: In case of the source value (or any vector element value) is
67 /// poisoned the assertion will not be true for that value.
69
70 /// Various leaf nodes.
85
86 /// A ptrauth constant.
87 /// ptr, key, addr-disc, disc
88 /// Note that the addr-disc can be a non-constant value, to allow representing
89 /// a constant global address signed using address-diversification, in code.
91
92 /// The address of the GOT
94
95 /// FRAMEADDR, RETURNADDR - These nodes represent llvm.frameaddress and
96 /// llvm.returnaddress on the DAG. These nodes take one operand, the index
97 /// of the frame or return address to return. An index of zero corresponds
98 /// to the current function's frame or return address, an index of one to
99 /// the parent's frame or return address, and so on.
102
103 /// ADDROFRETURNADDR - Represents the llvm.addressofreturnaddress intrinsic.
104 /// This node takes no operand, returns a target-specific pointer to the
105 /// place in the stack frame where the return address of the current
106 /// function is stored.
108
109 /// SPONENTRY - Represents the llvm.sponentry intrinsic. Takes no argument
110 /// and returns the stack pointer value at the entry of the current
111 /// function calling this intrinsic.
113
114 /// LOCAL_RECOVER - Represents the llvm.localrecover intrinsic.
115 /// Materializes the offset from the local object pointer of another
116 /// function to a particular local object passed to llvm.localescape. The
117 /// operand is the MCSymbol label used to represent this offset, since
118 /// typically the offset is not known until after code generation of the
119 /// parent.
121
122 /// READ_REGISTER, WRITE_REGISTER - This node represents llvm.register on
123 /// the DAG, which implements the named register global variables extension.
126
127 /// FRAME_TO_ARGS_OFFSET - This node represents offset from frame pointer to
128 /// first (possible) on-stack argument. This is needed for correct stack
129 /// adjustment during unwind.
131
132 /// EH_DWARF_CFA - This node represents the pointer to the DWARF Canonical
133 /// Frame Address (CFA), generally the value of the stack pointer at the
134 /// call site in the previous frame.
136
137 /// OUTCHAIN = EH_RETURN(INCHAIN, OFFSET, HANDLER) - This node represents
138 /// 'eh_return' gcc dwarf builtin, which is used to return from
139 /// exception. The general meaning is: adjust stack by OFFSET and pass
140 /// execution to HANDLER. Many platform-related details also :)
142
143 /// RESULT, OUTCHAIN = EH_SJLJ_SETJMP(INCHAIN, buffer)
144 /// This corresponds to the eh.sjlj.setjmp intrinsic.
145 /// It takes an input chain and a pointer to the jump buffer as inputs
146 /// and returns an outchain.
148
149 /// OUTCHAIN = EH_SJLJ_LONGJMP(INCHAIN, buffer)
150 /// This corresponds to the eh.sjlj.longjmp intrinsic.
151 /// It takes an input chain and a pointer to the jump buffer as inputs
152 /// and returns an outchain.
154
155 /// OUTCHAIN = EH_SJLJ_SETUP_DISPATCH(INCHAIN)
156 /// The target initializes the dispatch table here.
158
159 /// TargetConstant* - Like Constant*, but the DAG does not do any folding,
160 /// simplification, or lowering of the constant. They are used for constants
161 /// which are known to fit in the immediate fields of their users, or for
162 /// carrying magic numbers which are not values which need to be
163 /// materialized in registers.
166
167 /// TargetGlobalAddress - Like GlobalAddress, but the DAG does no folding or
168 /// anything else with this node, and this is valid in the target-specific
169 /// dag, turning into a GlobalAddress operand.
177
179
180 /// TargetIndex - Like a constant pool entry, but with completely
181 /// target-dependent semantics. Holds target flags, a 32-bit index, and a
182 /// 64-bit index. Targets can use this however they like.
184
185 /// RESULT = INTRINSIC_WO_CHAIN(INTRINSICID, arg1, arg2, ...)
186 /// This node represents a target intrinsic function with no side effects.
187 /// The first operand is the ID number of the intrinsic from the
188 /// llvm::Intrinsic namespace. The operands to the intrinsic follow. The
189 /// node returns the result of the intrinsic.
191
192 /// RESULT,OUTCHAIN = INTRINSIC_W_CHAIN(INCHAIN, INTRINSICID, arg1, ...)
193 /// This node represents a target intrinsic function with side effects that
194 /// returns a result. The first operand is a chain pointer. The second is
195 /// the ID number of the intrinsic from the llvm::Intrinsic namespace. The
196 /// operands to the intrinsic follow. The node has two results, the result
197 /// of the intrinsic and an output chain.
199
200 /// OUTCHAIN = INTRINSIC_VOID(INCHAIN, INTRINSICID, arg1, arg2, ...)
201 /// This node represents a target intrinsic function with side effects that
202 /// does not return a result. The first operand is a chain pointer. The
203 /// second is the ID number of the intrinsic from the llvm::Intrinsic
204 /// namespace. The operands to the intrinsic follow.
206
207 /// CopyToReg - This node has three operands: a chain, a register number to
208 /// set to this value, and a value.
210
211 /// CopyFromReg - This node indicates that the input value is a virtual or
212 /// physical register that is defined outside of the scope of this
213 /// SelectionDAG. The register is available from the RegisterSDNode object.
214 /// Note that CopyFromReg is considered as also freezing the value.
216
217 /// UNDEF - An undefined node.
219
220 /// FREEZE - FREEZE(VAL) returns an arbitrary value if VAL is UNDEF (or
221 /// is evaluated to UNDEF), or returns VAL otherwise. Note that each
222 /// read of UNDEF can yield different value, but FREEZE(UNDEF) cannot.
224
225 /// EXTRACT_ELEMENT - This is used to get the lower or upper (determined by
226 /// a Constant, which is required to be operand #1) half of the integer or
227 /// float value specified as operand #0. This is only for use before
228 /// legalization, for values that will be broken into multiple registers.
230
231 /// BUILD_PAIR - This is the opposite of EXTRACT_ELEMENT in some ways.
232 /// Given two values of the same integer value type, this produces a value
233 /// twice as big. Like EXTRACT_ELEMENT, this can only be used before
234 /// legalization. The lower part of the composite value should be in
235 /// element 0 and the upper part should be in element 1.
237
238 /// MERGE_VALUES - This node takes multiple discrete operands and returns
239 /// them all as its individual results. This nodes has exactly the same
240 /// number of inputs and outputs. This node is useful for some pieces of the
241 /// code generator that want to think about a single node with multiple
242 /// results, not multiple nodes.
244
245 /// Simple integer binary arithmetic operators.
253
254 /// SMUL_LOHI/UMUL_LOHI - Multiply two integers of type iN, producing
255 /// a signed/unsigned value of type i[2*N], and return the full value as
256 /// two results, each of type iN.
259
260 /// SDIVREM/UDIVREM - Divide two integers and produce both a quotient and
261 /// remainder result.
264
265 /// CARRY_FALSE - This node is used when folding other nodes,
266 /// like ADDC/SUBC, which indicate the carry result is always false.
268
269 /// Carry-setting nodes for multiple precision addition and subtraction.
270 /// These nodes take two operands of the same value type, and produce two
271 /// results. The first result is the normal add or sub result, the second
272 /// result is the carry flag result.
273 /// FIXME: These nodes are deprecated in favor of UADDO_CARRY and USUBO_CARRY.
274 /// They are kept around for now to provide a smooth transition path
275 /// toward the use of UADDO_CARRY/USUBO_CARRY and will eventually be removed.
278
279 /// Carry-using nodes for multiple precision addition and subtraction. These
280 /// nodes take three operands: The first two are the normal lhs and rhs to
281 /// the add or sub, and the third is the input carry flag. These nodes
282 /// produce two results; the normal result of the add or sub, and the output
283 /// carry flag. These nodes both read and write a carry flag to allow them
284 /// to them to be chained together for add and sub of arbitrarily large
285 /// values.
288
289 /// Carry-using nodes for multiple precision addition and subtraction.
290 /// These nodes take three operands: The first two are the normal lhs and
291 /// rhs to the add or sub, and the third is a boolean value that is 1 if and
292 /// only if there is an incoming carry/borrow. These nodes produce two
293 /// results: the normal result of the add or sub, and a boolean value that is
294 /// 1 if and only if there is an outgoing carry/borrow.
295 ///
296 /// Care must be taken if these opcodes are lowered to hardware instructions
297 /// that use the inverse logic -- 0 if and only if there is an
298 /// incoming/outgoing carry/borrow. In such cases, you must preserve the
299 /// semantics of these opcodes by inverting the incoming carry/borrow, feeding
300 /// it to the add/sub hardware instruction, and then inverting the outgoing
301 /// carry/borrow.
302 ///
303 /// The use of these opcodes is preferable to ADDE/SUBE if the target supports
304 /// it, as the carry is a regular value rather than a glue, which allows
305 /// further optimisation.
306 ///
307 /// These opcodes are different from [US]{ADD,SUB}O in that
308 /// U{ADD,SUB}O_CARRY consume and produce a carry/borrow, whereas
309 /// [US]{ADD,SUB}O produce an overflow.
312
313 /// Carry-using overflow-aware nodes for multiple precision addition and
314 /// subtraction. These nodes take three operands: The first two are normal lhs
315 /// and rhs to the add or sub, and the third is a boolean indicating if there
316 /// is an incoming carry. They produce two results: the normal result of the
317 /// add or sub, and a boolean that indicates if an overflow occurred (*not*
318 /// flag, because it may be a store to memory, etc.). If the type of the
319 /// boolean is not i1 then the high bits conform to getBooleanContents.
322
323 /// RESULT, BOOL = [SU]ADDO(LHS, RHS) - Overflow-aware nodes for addition.
324 /// These nodes take two operands: the normal LHS and RHS to the add. They
325 /// produce two results: the normal result of the add, and a boolean that
326 /// indicates if an overflow occurred (*not* a flag, because it may be store
327 /// to memory, etc.). If the type of the boolean is not i1 then the high
328 /// bits conform to getBooleanContents.
329 /// These nodes are generated from llvm.[su]add.with.overflow intrinsics.
332
333 /// Same for subtraction.
336
337 /// Same for multiplication.
340
341 /// RESULT = [US]ADDSAT(LHS, RHS) - Perform saturation addition on 2
342 /// integers with the same bit width (W). If the true value of LHS + RHS
343 /// exceeds the largest value that can be represented by W bits, the
344 /// resulting value is this maximum value. Otherwise, if this value is less
345 /// than the smallest value that can be represented by W bits, the
346 /// resulting value is this minimum value.
349
350 /// RESULT = [US]SUBSAT(LHS, RHS) - Perform saturation subtraction on 2
351 /// integers with the same bit width (W). If the true value of LHS - RHS
352 /// exceeds the largest value that can be represented by W bits, the
353 /// resulting value is this maximum value. Otherwise, if this value is less
354 /// than the smallest value that can be represented by W bits, the
355 /// resulting value is this minimum value.
358
359 /// RESULT = [US]SHLSAT(LHS, RHS) - Perform saturation left shift. The first
360 /// operand is the value to be shifted, and the second argument is the amount
361 /// to shift by. Both must be integers of the same bit width (W). If the true
362 /// value of LHS << RHS exceeds the largest value that can be represented by
363 /// W bits, the resulting value is this maximum value, Otherwise, if this
364 /// value is less than the smallest value that can be represented by W bits,
365 /// the resulting value is this minimum value.
368
369 /// RESULT = [US]MULFIX(LHS, RHS, SCALE) - Perform fixed point multiplication
370 /// on 2 integers with the same width and scale. SCALE represents the scale
371 /// of both operands as fixed point numbers. This SCALE parameter must be a
372 /// constant integer. A scale of zero is effectively performing
373 /// multiplication on 2 integers.
376
377 /// Same as the corresponding unsaturated fixed point instructions, but the
378 /// result is clamped between the min and max values representable by the
379 /// bits of the first 2 operands.
382
383 /// RESULT = [US]DIVFIX(LHS, RHS, SCALE) - Perform fixed point division on
384 /// 2 integers with the same width and scale. SCALE represents the scale
385 /// of both operands as fixed point numbers. This SCALE parameter must be a
386 /// constant integer.
389
390 /// Same as the corresponding unsaturated fixed point instructions, but the
391 /// result is clamped between the min and max values representable by the
392 /// bits of the first 2 operands.
395
396 /// Simple binary floating point operators.
402
403 /// Constrained versions of the binary floating point operators.
404 /// These will be lowered to the simple operators before final selection.
405 /// They are used to limit optimizations while the DAG is being
406 /// optimized.
413
414 /// Constrained versions of libm-equivalent floating point intrinsics.
415 /// These will be lowered to the equivalent non-constrained pseudo-op
416 /// (or expanded to the equivalent library call) before final selection.
417 /// They are used to limit optimizations while the DAG is being optimized.
452
453 /// STRICT_FP_TO_[US]INT - Convert a floating point value to a signed or
454 /// unsigned integer. These have the same semantics as fptosi and fptoui
455 /// in IR.
456 /// They are used to limit optimizations while the DAG is being optimized.
459
460 /// STRICT_[US]INT_TO_FP - Convert a signed or unsigned integer to
461 /// a floating point value. These have the same semantics as sitofp and
462 /// uitofp in IR.
463 /// They are used to limit optimizations while the DAG is being optimized.
466
467 /// X = STRICT_FP_ROUND(Y, TRUNC) - Rounding 'Y' from a larger floating
468 /// point type down to the precision of the destination VT. TRUNC is a
469 /// flag, which is always an integer that is zero or one. If TRUNC is 0,
470 /// this is a normal rounding, if it is 1, this FP_ROUND is known to not
471 /// change the value of Y.
472 ///
473 /// The TRUNC = 1 case is used in cases where we know that the value will
474 /// not be modified by the node, because Y is not using any of the extra
475 /// precision of source type. This allows certain transformations like
476 /// STRICT_FP_EXTEND(STRICT_FP_ROUND(X,1)) -> X which are not safe for
477 /// STRICT_FP_EXTEND(STRICT_FP_ROUND(X,0)) because the extra bits aren't
478 /// removed.
479 /// It is used to limit optimizations while the DAG is being optimized.
481
482 /// X = STRICT_FP_EXTEND(Y) - Extend a smaller FP type into a larger FP
483 /// type.
484 /// It is used to limit optimizations while the DAG is being optimized.
486
487 /// STRICT_FSETCC/STRICT_FSETCCS - Constrained versions of SETCC, used
488 /// for floating-point operands only. STRICT_FSETCC performs a quiet
489 /// comparison operation, while STRICT_FSETCCS performs a signaling
490 /// comparison operation.
493
494 /// FPTRUNC_ROUND - This corresponds to the fptrunc_round intrinsic.
496
497 /// FMA - Perform a * b + c with no intermediate rounding step.
499
500 /// FMAD - Perform a * b + c, while getting the same result as the
501 /// separately rounded operations.
503
504 /// FCOPYSIGN(X, Y) - Return the value of X with the sign of Y. NOTE: This
505 /// DAG node does not require that X and Y have the same type, just that
506 /// they are both floating point. X and the result must have the same type.
507 /// FCOPYSIGN(f32, f64) is allowed.
509
510 /// INT = FGETSIGN(FP) - Return the sign bit of the specified floating point
511 /// value as an integer 0/1 value.
513
514 /// Returns platform specific canonical encoding of a floating point number.
516
517 /// Performs a check of floating point class property, defined by IEEE-754.
518 /// The first operand is the floating point value to check. The second operand
519 /// specifies the checked property and is a TargetConstant which specifies
520 /// test in the same way as intrinsic 'is_fpclass'.
521 /// Returns boolean value.
523
524 /// BUILD_VECTOR(ELT0, ELT1, ELT2, ELT3,...) - Return a fixed-width vector
525 /// with the specified, possibly variable, elements. The types of the
526 /// operands must match the vector element type, except that integer types
527 /// are allowed to be larger than the element type, in which case the
528 /// operands are implicitly truncated. The types of the operands must all
529 /// be the same.
531
532 /// INSERT_VECTOR_ELT(VECTOR, VAL, IDX) - Returns VECTOR with the element
533 /// at IDX replaced with VAL. If the type of VAL is larger than the vector
534 /// element type then VAL is truncated before replacement.
535 ///
536 /// If VECTOR is a scalable vector, then IDX may be larger than the minimum
537 /// vector width. IDX is not first scaled by the runtime scaling factor of
538 /// VECTOR.
540
541 /// EXTRACT_VECTOR_ELT(VECTOR, IDX) - Returns a single element from VECTOR
542 /// identified by the (potentially variable) element number IDX. If the return
543 /// type is an integer type larger than the element type of the vector, the
544 /// result is extended to the width of the return type. In that case, the high
545 /// bits are undefined.
546 ///
547 /// If VECTOR is a scalable vector, then IDX may be larger than the minimum
548 /// vector width. IDX is not first scaled by the runtime scaling factor of
549 /// VECTOR.
551
552 /// CONCAT_VECTORS(VECTOR0, VECTOR1, ...) - Given a number of values of
553 /// vector type with the same length and element type, this produces a
554 /// concatenated vector result value, with length equal to the sum of the
555 /// lengths of the input vectors. If VECTOR0 is a fixed-width vector, then
556 /// VECTOR1..VECTORN must all be fixed-width vectors. Similarly, if VECTOR0
557 /// is a scalable vector, then VECTOR1..VECTORN must all be scalable vectors.
559
560 /// INSERT_SUBVECTOR(VECTOR1, VECTOR2, IDX) - Returns a vector with VECTOR2
561 /// inserted into VECTOR1. IDX represents the starting element number at which
562 /// VECTOR2 will be inserted. IDX must be a constant multiple of T's known
563 /// minimum vector length. Let the type of VECTOR2 be T, then if T is a
564 /// scalable vector, IDX is first scaled by the runtime scaling factor of T.
565 /// The elements of VECTOR1 starting at IDX are overwritten with VECTOR2.
566 /// Elements IDX through (IDX + num_elements(T) - 1) must be valid VECTOR1
567 /// indices. If this condition cannot be determined statically but is false at
568 /// runtime, then the result vector is undefined. The IDX parameter must be a
569 /// vector index constant type, which for most targets will be an integer
570 /// pointer type.
571 ///
572 /// This operation supports inserting a fixed-width vector into a scalable
573 /// vector, but not the other way around.
575
576 /// EXTRACT_SUBVECTOR(VECTOR, IDX) - Returns a subvector from VECTOR.
577 /// Let the result type be T, then IDX represents the starting element number
578 /// from which a subvector of type T is extracted. IDX must be a constant
579 /// multiple of T's known minimum vector length. If T is a scalable vector,
580 /// IDX is first scaled by the runtime scaling factor of T. Elements IDX
581 /// through (IDX + num_elements(T) - 1) must be valid VECTOR indices. If this
582 /// condition cannot be determined statically but is false at runtime, then
583 /// the result vector is undefined. The IDX parameter must be a vector index
584 /// constant type, which for most targets will be an integer pointer type.
585 ///
586 /// This operation supports extracting a fixed-width vector from a scalable
587 /// vector, but not the other way around.
589
590 /// VECTOR_DEINTERLEAVE(VEC1, VEC2) - Returns two vectors with all input and
591 /// output vectors having the same type. The first output contains the even
592 /// indices from CONCAT_VECTORS(VEC1, VEC2), with the second output
593 /// containing the odd indices. The relative order of elements within an
594 /// output match that of the concatenated input.
596
597 /// VECTOR_INTERLEAVE(VEC1, VEC2) - Returns two vectors with all input and
598 /// output vectors having the same type. The first output contains the
599 /// result of interleaving the low half of CONCAT_VECTORS(VEC1, VEC2), with
600 /// the second output containing the result of interleaving the high half.
602
603 /// VECTOR_REVERSE(VECTOR) - Returns a vector, of the same type as VECTOR,
604 /// whose elements are shuffled using the following algorithm:
605 /// RESULT[i] = VECTOR[VECTOR.ElementCount - 1 - i]
607
608 /// VECTOR_SHUFFLE(VEC1, VEC2) - Returns a vector, of the same type as
609 /// VEC1/VEC2. A VECTOR_SHUFFLE node also contains an array of constant int
610 /// values that indicate which value (or undef) each result element will
611 /// get. These constant ints are accessible through the
612 /// ShuffleVectorSDNode class. This is quite similar to the Altivec
613 /// 'vperm' instruction, except that the indices must be constants and are
614 /// in terms of the element size of VEC1/VEC2, not in terms of bytes.
616
617 /// VECTOR_SPLICE(VEC1, VEC2, IMM) - Returns a subvector of the same type as
618 /// VEC1/VEC2 from CONCAT_VECTORS(VEC1, VEC2), based on the IMM in two ways.
619 /// Let the result type be T, if IMM is positive it represents the starting
620 /// element number (an index) from which a subvector of type T is extracted
621 /// from CONCAT_VECTORS(VEC1, VEC2). If IMM is negative it represents a count
622 /// specifying the number of trailing elements to extract from VEC1, where the
623 /// elements of T are selected using the following algorithm:
624 /// RESULT[i] = CONCAT_VECTORS(VEC1,VEC2)[VEC1.ElementCount - ABS(IMM) + i]
625 /// If IMM is not in the range [-VL, VL-1] the result vector is undefined. IMM
626 /// is a constant integer.
628
629 /// SCALAR_TO_VECTOR(VAL) - This represents the operation of loading a
630 /// scalar value into element 0 of the resultant vector type. The top
631 /// elements 1 to N-1 of the N-element vector are undefined. The type
632 /// of the operand must match the vector element type, except when they
633 /// are integer types. In this case the operand is allowed to be wider
634 /// than the vector element type, and is implicitly truncated to it.
636
637 /// SPLAT_VECTOR(VAL) - Returns a vector with the scalar value VAL
638 /// duplicated in all lanes. The type of the operand must match the vector
639 /// element type, except when they are integer types. In this case the
640 /// operand is allowed to be wider than the vector element type, and is
641 /// implicitly truncated to it.
643
644 /// SPLAT_VECTOR_PARTS(SCALAR1, SCALAR2, ...) - Returns a vector with the
645 /// scalar values joined together and then duplicated in all lanes. This
646 /// represents a SPLAT_VECTOR that has had its scalar operand expanded. This
647 /// allows representing a 64-bit splat on a target with 32-bit integers. The
648 /// total width of the scalars must cover the element width. SCALAR1 contains
649 /// the least significant bits of the value regardless of endianness and all
650 /// scalars should have the same type.
652
653 /// STEP_VECTOR(IMM) - Returns a scalable vector whose lanes are comprised
654 /// of a linear sequence of unsigned values starting from 0 with a step of
655 /// IMM, where IMM must be a TargetConstant with type equal to the vector
656 /// element type. The arithmetic is performed modulo the bitwidth of the
657 /// element.
658 ///
659 /// The operation does not support returning fixed-width vectors or
660 /// non-constant operands.
662
663 /// VECTOR_COMPRESS(Vec, Mask, Passthru)
664 /// consecutively place vector elements based on mask
665 /// e.g., vec = {A, B, C, D} and mask = {1, 0, 1, 0}
666 /// --> {A, C, ?, ?} where ? is undefined
667 /// If passthru is defined, ?s are replaced with elements from passthru.
668 /// If passthru is undef, ?s remain undefined.
670
671 /// MULHU/MULHS - Multiply high - Multiply two integers of type iN,
672 /// producing an unsigned/signed value of type i[2*N], then return the top
673 /// part.
676
677 /// AVGFLOORS/AVGFLOORU - Averaging add - Add two integers using an integer of
678 /// type i[N+1], halving the result by shifting it one bit right.
679 /// shr(add(ext(X), ext(Y)), 1)
682 /// AVGCEILS/AVGCEILU - Rounding averaging add - Add two integers using an
683 /// integer of type i[N+2], add 1 and halve the result by shifting it one bit
684 /// right. shr(add(ext(X), ext(Y), 1), 1)
687
688 /// ABDS/ABDU - Absolute difference - Return the absolute difference between
689 /// two numbers interpreted as signed/unsigned.
690 /// i.e trunc(abs(sext(Op0) - sext(Op1))) becomes abds(Op0, Op1)
691 /// or trunc(abs(zext(Op0) - zext(Op1))) becomes abdu(Op0, Op1)
694
695 /// [US]{MIN/MAX} - Binary minimum or maximum of signed or unsigned
696 /// integers.
701
702 /// [US]CMP - 3-way comparison of signed or unsigned integers. Returns -1, 0,
703 /// or 1 depending on whether Op0 <, ==, or > Op1. The operands can have type
704 /// different to the result.
707
708 /// Bitwise operators - logical and, logical or, logical xor.
712
713 /// ABS - Determine the unsigned absolute value of a signed integer value of
714 /// the same bitwidth.
715 /// Note: A value of INT_MIN will return INT_MIN, no saturation or overflow
716 /// is performed.
718
719 /// Shift and rotation operations. After legalization, the type of the
720 /// shift amount is known to be TLI.getShiftAmountTy(). Before legalization
721 /// the shift amount can be any type, but care must be taken to ensure it is
722 /// large enough. TLI.getShiftAmountTy() is i8 on some targets, but before
723 /// legalization, types like i1024 can occur and i8 doesn't have enough bits
724 /// to represent the shift amount.
725 /// When the 1st operand is a vector, the shift amount must be in the same
726 /// type. (TLI.getShiftAmountTy() will return the same type when the input
727 /// type is a vector.)
728 /// For rotates and funnel shifts, the shift amount is treated as an unsigned
729 /// amount modulo the element size of the first operand.
730 ///
731 /// Funnel 'double' shifts take 3 operands, 2 inputs and the shift amount.
732 ///
733 /// fshl(X,Y,Z): (X << (Z % BW)) | (Y >> (BW - (Z % BW)))
734 /// fshr(X,Y,Z): (X << (BW - (Z % BW))) | (Y >> (Z % BW))
742
743 /// Byte Swap and Counting operators.
750
751 /// Bit counting operators with an undefined result for zero inputs.
754
755 /// Select(COND, TRUEVAL, FALSEVAL). If the type of the boolean COND is not
756 /// i1 then the high bits must conform to getBooleanContents.
758
759 /// Select with a vector condition (op #0) and two vector operands (ops #1
760 /// and #2), returning a vector result. All vectors have the same length.
761 /// Much like the scalar select and setcc, each bit in the condition selects
762 /// whether the corresponding result element is taken from op #1 or op #2.
763 /// At first, the VSELECT condition is of vXi1 type. Later, targets may
764 /// change the condition type in order to match the VSELECT node using a
765 /// pattern. The condition follows the BooleanContent format of the target.
767
768 /// Select with condition operator - This selects between a true value and
769 /// a false value (ops #2 and #3) based on the boolean result of comparing
770 /// the lhs and rhs (ops #0 and #1) of a conditional expression with the
771 /// condition code in op #4, a CondCodeSDNode.
773
774 /// SetCC operator - This evaluates to a true value iff the condition is
775 /// true. If the result value type is not i1 then the high bits conform
776 /// to getBooleanContents. The operands to this are the left and right
777 /// operands to compare (ops #0, and #1) and the condition code to compare
778 /// them with (op #2) as a CondCodeSDNode. If the operands are vector types
779 /// then the result type must also be a vector type.
781
782 /// Like SetCC, ops #0 and #1 are the LHS and RHS operands to compare, but
783 /// op #2 is a boolean indicating if there is an incoming carry. This
784 /// operator checks the result of "LHS - RHS - Carry", and can be used to
785 /// compare two wide integers:
786 /// (setcccarry lhshi rhshi (usubo_carry lhslo rhslo) cc).
787 /// Only valid for integers.
789
790 /// SHL_PARTS/SRA_PARTS/SRL_PARTS - These operators are used for expanded
791 /// integer shift operations. The operation ordering is:
792 ///
793 /// [Lo,Hi] = op [LoLHS,HiLHS], Amt
797
798 /// Conversion operators. These are all single input single output
799 /// operations. For all of these, the result type must be strictly
800 /// wider or narrower (depending on the operation) than the source
801 /// type.
802
803 /// SIGN_EXTEND - Used for integer types, replicating the sign bit
804 /// into new bits.
806
807 /// ZERO_EXTEND - Used for integer types, zeroing the new bits. Can carry
808 /// the NonNeg SDNodeFlag to indicate that the input is known to be
809 /// non-negative. If the flag is present and the input is negative, the result
810 /// is poison.
812
813 /// ANY_EXTEND - Used for integer types. The high bits are undefined.
815
816 /// TRUNCATE - Completely drop the high bits.
818 /// TRUNCATE_[SU]SAT_[SU] - Truncate for saturated operand
819 /// [SU] located in middle, prefix for `SAT` means indicates whether
820 /// existing truncate target was a signed operation. For examples,
821 /// If `truncate(smin(smax(x, C), C))` was saturated then become `S`.
822 /// If `truncate(umin(x, C))` was saturated then become `U`.
823 /// [SU] located in last indicates whether range of truncated values is
824 /// sign-saturated. For example, if `truncate(smin(smax(x, C), C))` is a
825 /// truncation to `i8`, then if value of C ranges from `-128 to 127`, it will
826 /// be saturated against signed values, resulting in `S`, which will combine
827 /// to `TRUNCATE_SSAT_S`. If the value of C ranges from `0 to 255`, it will
828 /// be saturated against unsigned values, resulting in `U`, which will
829 /// combine to `TRUNCATE_SSAT_U`. Similarly, in `truncate(umin(x, C))`, if
830 /// value of C ranges from `0 to 255`, it becomes `U` because it is saturated
831 /// for unsigned values. As a result, it combines to `TRUNCATE_USAT_U`.
832 TRUNCATE_SSAT_S, // saturate signed input to signed result -
833 // truncate(smin(smax(x, C), C))
834 TRUNCATE_SSAT_U, // saturate signed input to unsigned result -
835 // truncate(smin(smax(x, 0), C))
836 TRUNCATE_USAT_U, // saturate unsigned input to unsigned result -
837 // truncate(umin(x, C))
838
839 /// [SU]INT_TO_FP - These operators convert integers (whose interpreted sign
840 /// depends on the first letter) to floating point.
843
844 /// SIGN_EXTEND_INREG - This operator atomically performs a SHL/SRA pair to
845 /// sign extend a small value in a large integer register (e.g. sign
846 /// extending the low 8 bits of a 32-bit register to fill the top 24 bits
847 /// with the 7th bit). The size of the smaller type is indicated by the 1th
848 /// operand, a ValueType node.
850
851 /// ANY_EXTEND_VECTOR_INREG(Vector) - This operator represents an
852 /// in-register any-extension of the low lanes of an integer vector. The
853 /// result type must have fewer elements than the operand type, and those
854 /// elements must be larger integer types such that the total size of the
855 /// operand type is less than or equal to the size of the result type. Each
856 /// of the low operand elements is any-extended into the corresponding,
857 /// wider result elements with the high bits becoming undef.
858 /// NOTE: The type legalizer prefers to make the operand and result size
859 /// the same to allow expansion to shuffle vector during op legalization.
861
862 /// SIGN_EXTEND_VECTOR_INREG(Vector) - This operator represents an
863 /// in-register sign-extension of the low lanes of an integer vector. The
864 /// result type must have fewer elements than the operand type, and those
865 /// elements must be larger integer types such that the total size of the
866 /// operand type is less than or equal to the size of the result type. Each
867 /// of the low operand elements is sign-extended into the corresponding,
868 /// wider result elements.
869 /// NOTE: The type legalizer prefers to make the operand and result size
870 /// the same to allow expansion to shuffle vector during op legalization.
872
873 /// ZERO_EXTEND_VECTOR_INREG(Vector) - This operator represents an
874 /// in-register zero-extension of the low lanes of an integer vector. The
875 /// result type must have fewer elements than the operand type, and those
876 /// elements must be larger integer types such that the total size of the
877 /// operand type is less than or equal to the size of the result type. Each
878 /// of the low operand elements is zero-extended into the corresponding,
879 /// wider result elements.
880 /// NOTE: The type legalizer prefers to make the operand and result size
881 /// the same to allow expansion to shuffle vector during op legalization.
883
884 /// FP_TO_[US]INT - Convert a floating point value to a signed or unsigned
885 /// integer. These have the same semantics as fptosi and fptoui in IR. If
886 /// the FP value cannot fit in the integer type, the results are undefined.
889
890 /// FP_TO_[US]INT_SAT - Convert floating point value in operand 0 to a
891 /// signed or unsigned scalar integer type given in operand 1 with the
892 /// following semantics:
893 ///
894 /// * If the value is NaN, zero is returned.
895 /// * If the value is larger/smaller than the largest/smallest integer,
896 /// the largest/smallest integer is returned (saturation).
897 /// * Otherwise the result of rounding the value towards zero is returned.
898 ///
899 /// The scalar width of the type given in operand 1 must be equal to, or
900 /// smaller than, the scalar result type width. It may end up being smaller
901 /// than the result width as a result of integer type legalization.
902 ///
903 /// After converting to the scalar integer type in operand 1, the value is
904 /// extended to the result VT. FP_TO_SINT_SAT sign extends and FP_TO_UINT_SAT
905 /// zero extends.
908
909 /// X = FP_ROUND(Y, TRUNC) - Rounding 'Y' from a larger floating point type
910 /// down to the precision of the destination VT. TRUNC is a flag, which is
911 /// always an integer that is zero or one. If TRUNC is 0, this is a
912 /// normal rounding, if it is 1, this FP_ROUND is known to not change the
913 /// value of Y.
914 ///
915 /// The TRUNC = 1 case is used in cases where we know that the value will
916 /// not be modified by the node, because Y is not using any of the extra
917 /// precision of source type. This allows certain transformations like
918 /// FP_EXTEND(FP_ROUND(X,1)) -> X which are not safe for
919 /// FP_EXTEND(FP_ROUND(X,0)) because the extra bits aren't removed.
921
922 /// Returns current rounding mode:
923 /// -1 Undefined
924 /// 0 Round to 0
925 /// 1 Round to nearest, ties to even
926 /// 2 Round to +inf
927 /// 3 Round to -inf
928 /// 4 Round to nearest, ties to zero
929 /// Other values are target dependent.
930 /// Result is rounding mode and chain. Input is a chain.
932
933 /// Set rounding mode.
934 /// The first operand is a chain pointer. The second specifies the required
935 /// rounding mode, encoded in the same way as used in '``GET_ROUNDING``'.
937
938 /// X = FP_EXTEND(Y) - Extend a smaller FP type into a larger FP type.
940
941 /// BITCAST - This operator converts between integer, vector and FP
942 /// values, as if the value was stored to memory with one type and loaded
943 /// from the same address with the other type (or equivalently for vector
944 /// format conversions, etc). The source and result are required to have
945 /// the same bit size (e.g. f32 <-> i32). This can also be used for
946 /// int-to-int or fp-to-fp conversions, but that is a noop, deleted by
947 /// getNode().
948 ///
949 /// This operator is subtly different from the bitcast instruction from
950 /// LLVM-IR since this node may change the bits in the register. For
951 /// example, this occurs on big-endian NEON and big-endian MSA where the
952 /// layout of the bits in the register depends on the vector type and this
953 /// operator acts as a shuffle operation for some vector type combinations.
955
956 /// ADDRSPACECAST - This operator converts between pointers of different
957 /// address spaces.
959
960 /// FP16_TO_FP, FP_TO_FP16 - These operators are used to perform promotions
961 /// and truncation for half-precision (16 bit) floating numbers. These nodes
962 /// form a semi-softened interface for dealing with f16 (as an i16), which
963 /// is often a storage-only type but has native conversions.
968
969 /// BF16_TO_FP, FP_TO_BF16 - These operators are used to perform promotions
970 /// and truncation for bfloat16. These nodes form a semi-softened interface
971 /// for dealing with bf16 (as an i16), which is often a storage-only type but
972 /// has native conversions.
977
978 /// Perform various unary floating-point operations inspired by libm. For
979 /// FPOWI, the result is undefined if the integer operand doesn't fit into
980 /// sizeof(int).
996 /// FLDEXP - ldexp, inspired by libm (op0 * 2**op1).
998 /// FATAN2 - atan2, inspired by libm.
1000
1001 /// FFREXP - frexp, extract fractional and exponent component of a
1002 /// floating-point value. Returns the two components as separate return
1003 /// values.
1005
1023
1024 /// FMINNUM/FMAXNUM - Perform floating-point minimum or maximum on two
1025 /// values.
1026 ///
1027 /// In the case where a single input is a NaN (either signaling or quiet),
1028 /// the non-NaN input is returned.
1029 ///
1030 /// The return value of (FMINNUM 0.0, -0.0) could be either 0.0 or -0.0.
1033
1034 /// FMINNUM_IEEE/FMAXNUM_IEEE - Perform floating-point minimumNumber or
1035 /// maximumNumber on two values, following IEEE-754 definitions. This differs
1036 /// from FMINNUM/FMAXNUM in the handling of signaling NaNs, and signed zero.
1037 ///
1038 /// If one input is a signaling NaN, returns a quiet NaN. This matches
1039 /// IEEE-754 2008's minnum/maxnum behavior for signaling NaNs (which differs
1040 /// from 2019).
1041 ///
1042 /// These treat -0 as ordered less than +0, matching the behavior of IEEE-754
1043 /// 2019's minimumNumber/maximumNumber.
1046
1047 /// FMINIMUM/FMAXIMUM - NaN-propagating minimum/maximum that also treat -0.0
1048 /// as less than 0.0. While FMINNUM_IEEE/FMAXNUM_IEEE follow IEEE 754-2008
1049 /// semantics, FMINIMUM/FMAXIMUM follow IEEE 754-2019 semantics.
1052
1053 /// FMINIMUMNUM/FMAXIMUMNUM - minimumnum/maximumnum that is same with
1054 /// FMINNUM_IEEE and FMAXNUM_IEEE besides if either operand is sNaN.
1057
1058 /// FSINCOS - Compute both fsin and fcos as a single operation.
1060
1061 /// Gets the current floating-point environment. The first operand is a token
1062 /// chain. The results are FP environment, represented by an integer value,
1063 /// and a token chain.
1065
1066 /// Sets the current floating-point environment. The first operand is a token
1067 /// chain, the second is FP environment, represented by an integer value. The
1068 /// result is a token chain.
1070
1071 /// Set floating-point environment to default state. The first operand and the
1072 /// result are token chains.
1074
1075 /// Gets the current floating-point environment. The first operand is a token
1076 /// chain, the second is a pointer to memory, where FP environment is stored
1077 /// to. The result is a token chain.
1079
1080 /// Sets the current floating point environment. The first operand is a token
1081 /// chain, the second is a pointer to memory, where FP environment is loaded
1082 /// from. The result is a token chain.
1084
1085 /// Reads the current dynamic floating-point control modes. The operand is
1086 /// a token chain.
1088
1089 /// Sets the current dynamic floating-point control modes. The first operand
1090 /// is a token chain, the second is control modes set represented as integer
1091 /// value.
1093
1094 /// Sets default dynamic floating-point control modes. The operand is a
1095 /// token chain.
1097
1098 /// LOAD and STORE have token chains as their first operand, then the same
1099 /// operands as an LLVM load/store instruction, then an offset node that
1100 /// is added / subtracted from the base pointer to form the address (for
1101 /// indexed memory ops).
1104
1105 /// DYNAMIC_STACKALLOC - Allocate some number of bytes on the stack aligned
1106 /// to a specified boundary. This node always has two return values: a new
1107 /// stack pointer value and a chain. The first operand is the token chain,
1108 /// the second is the number of bytes to allocate, and the third is the
1109 /// alignment boundary. The size is guaranteed to be a multiple of the
1110 /// stack alignment, and the alignment is guaranteed to be bigger than the
1111 /// stack alignment (if required) or 0 to get standard stack alignment.
1113
1114 /// Control flow instructions. These all have token chains.
1115
1116 /// BR - Unconditional branch. The first operand is the chain
1117 /// operand, the second is the MBB to branch to.
1119
1120 /// BRIND - Indirect branch. The first operand is the chain, the second
1121 /// is the value to branch to, which must be of the same type as the
1122 /// target's pointer type.
1124
1125 /// BR_JT - Jumptable branch. The first operand is the chain, the second
1126 /// is the jumptable index, the last one is the jumptable entry index.
1128
1129 /// JUMP_TABLE_DEBUG_INFO - Jumptable debug info. The first operand is the
1130 /// chain, the second is the jumptable index.
1132
1133 /// BRCOND - Conditional branch. The first operand is the chain, the
1134 /// second is the condition, the third is the block to branch to if the
1135 /// condition is true. If the type of the condition is not i1, then the
1136 /// high bits must conform to getBooleanContents. If the condition is undef,
1137 /// it nondeterministically jumps to the block.
1138 /// TODO: Its semantics w.r.t undef requires further discussion; we need to
1139 /// make it sure that it is consistent with optimizations in MIR & the
1140 /// meaning of IMPLICIT_DEF. See https://reviews.llvm.org/D92015
1142
1143 /// BR_CC - Conditional branch. The behavior is like that of SELECT_CC, in
1144 /// that the condition is represented as condition code, and two nodes to
1145 /// compare, rather than as a combined SetCC node. The operands in order
1146 /// are chain, cc, lhs, rhs, block to branch to if condition is true. If
1147 /// condition is undef, it nondeterministically jumps to the block.
1149
1150 /// INLINEASM - Represents an inline asm block. This node always has two
1151 /// return values: a chain and a flag result. The inputs are as follows:
1152 /// Operand #0 : Input chain.
1153 /// Operand #1 : a ExternalSymbolSDNode with a pointer to the asm string.
1154 /// Operand #2 : a MDNodeSDNode with the !srcloc metadata.
1155 /// Operand #3 : HasSideEffect, IsAlignStack bits.
1156 /// After this, it is followed by a list of operands with this format:
1157 /// ConstantSDNode: Flags that encode whether it is a mem or not, the
1158 /// of operands that follow, etc. See InlineAsm.h.
1159 /// ... however many operands ...
1160 /// Operand #last: Optional, an incoming flag.
1161 ///
1162 /// The variable width operands are required to represent target addressing
1163 /// modes as a single "operand", even though they may have multiple
1164 /// SDOperands.
1166
1167 /// INLINEASM_BR - Branching version of inline asm. Used by asm-goto.
1169
1170 /// EH_LABEL - Represents a label in mid basic block used to track
1171 /// locations needed for debug and exception handling tables. These nodes
1172 /// take a chain as input and return a chain.
1174
1175 /// ANNOTATION_LABEL - Represents a mid basic block label used by
1176 /// annotations. This should remain within the basic block and be ordered
1177 /// with respect to other call instructions, but loads and stores may float
1178 /// past it.
1180
1181 /// CATCHRET - Represents a return from a catch block funclet. Used for
1182 /// MSVC compatible exception handling. Takes a chain operand and a
1183 /// destination basic block operand.
1185
1186 /// CLEANUPRET - Represents a return from a cleanup block funclet. Used for
1187 /// MSVC compatible exception handling. Takes only a chain operand.
1189
1190 /// STACKSAVE - STACKSAVE has one operand, an input chain. It produces a
1191 /// value, the same type as the pointer type for the system, and an output
1192 /// chain.
1194
1195 /// STACKRESTORE has two operands, an input chain and a pointer to restore
1196 /// to it returns an output chain.
1198
1199 /// CALLSEQ_START/CALLSEQ_END - These operators mark the beginning and end
1200 /// of a call sequence, and carry arbitrary information that target might
1201 /// want to know. The first operand is a chain, the rest are specified by
1202 /// the target and not touched by the DAG optimizers.
1203 /// Targets that may use stack to pass call arguments define additional
1204 /// operands:
1205 /// - size of the call frame part that must be set up within the
1206 /// CALLSEQ_START..CALLSEQ_END pair,
1207 /// - part of the call frame prepared prior to CALLSEQ_START.
1208 /// Both these parameters must be constants, their sum is the total call
1209 /// frame size.
1210 /// CALLSEQ_START..CALLSEQ_END pairs may not be nested.
1211 CALLSEQ_START, // Beginning of a call sequence
1212 CALLSEQ_END, // End of a call sequence
1213
1214 /// VAARG - VAARG has four operands: an input chain, a pointer, a SRCVALUE,
1215 /// and the alignment. It returns a pair of values: the vaarg value and a
1216 /// new chain.
1218
1219 /// VACOPY - VACOPY has 5 operands: an input chain, a destination pointer,
1220 /// a source pointer, a SRCVALUE for the destination, and a SRCVALUE for the
1221 /// source.
1223
1224 /// VAEND, VASTART - VAEND and VASTART have three operands: an input chain,
1225 /// pointer, and a SRCVALUE.
1228
1229 /// PREALLOCATED_SETUP - This has 2 operands: an input chain and a SRCVALUE
1230 /// with the preallocated call Value.
1232 /// PREALLOCATED_ARG - This has 3 operands: an input chain, a SRCVALUE
1233 /// with the preallocated call Value, and a constant int.
1235
1236 /// SRCVALUE - This is a node type that holds a Value* that is used to
1237 /// make reference to a value in the LLVM IR.
1239
1240 /// MDNODE_SDNODE - This is a node that holdes an MDNode*, which is used to
1241 /// reference metadata in the IR.
1243
1244 /// PCMARKER - This corresponds to the pcmarker intrinsic.
1246
1247 /// READCYCLECOUNTER - This corresponds to the readcyclecounter intrinsic.
1248 /// It produces a chain and one i64 value. The only operand is a chain.
1249 /// If i64 is not legal, the result will be expanded into smaller values.
1250 /// Still, it returns an i64, so targets should set legality for i64.
1251 /// The result is the content of the architecture-specific cycle
1252 /// counter-like register (or other high accuracy low latency clock source).
1254
1255 /// READSTEADYCOUNTER - This corresponds to the readfixedcounter intrinsic.
1256 /// It has the same semantics as the READCYCLECOUNTER implementation except
1257 /// that the result is the content of the architecture-specific fixed
1258 /// frequency counter suitable for measuring elapsed time.
1260
1261 /// HANDLENODE node - Used as a handle for various purposes.
1263
1264 /// INIT_TRAMPOLINE - This corresponds to the init_trampoline intrinsic. It
1265 /// takes as input a token chain, the pointer to the trampoline, the pointer
1266 /// to the nested function, the pointer to pass for the 'nest' parameter, a
1267 /// SRCVALUE for the trampoline and another for the nested function
1268 /// (allowing targets to access the original Function*).
1269 /// It produces a token chain as output.
1271
1272 /// ADJUST_TRAMPOLINE - This corresponds to the adjust_trampoline intrinsic.
1273 /// It takes a pointer to the trampoline and produces a (possibly) new
1274 /// pointer to the same trampoline with platform-specific adjustments
1275 /// applied. The pointer it returns points to an executable block of code.
1277
1278 /// TRAP - Trapping instruction
1280
1281 /// DEBUGTRAP - Trap intended to get the attention of a debugger.
1283
1284 /// UBSANTRAP - Trap with an immediate describing the kind of sanitizer
1285 /// failure.
1287
1288 /// PREFETCH - This corresponds to a prefetch intrinsic. The first operand
1289 /// is the chain. The other operands are the address to prefetch,
1290 /// read / write specifier, locality specifier and instruction / data cache
1291 /// specifier.
1293
1294 /// ARITH_FENCE - This corresponds to a arithmetic fence intrinsic. Both its
1295 /// operand and output are the same floating type.
1297
1298 /// MEMBARRIER - Compiler barrier only; generate a no-op.
1300
1301 /// OUTCHAIN = ATOMIC_FENCE(INCHAIN, ordering, scope)
1302 /// This corresponds to the fence instruction. It takes an input chain, and
1303 /// two integer constants: an AtomicOrdering and a SynchronizationScope.
1305
1306 /// Val, OUTCHAIN = ATOMIC_LOAD(INCHAIN, ptr)
1307 /// This corresponds to "load atomic" instruction.
1309
1310 /// OUTCHAIN = ATOMIC_STORE(INCHAIN, val, ptr)
1311 /// This corresponds to "store atomic" instruction.
1313
1314 /// Val, OUTCHAIN = ATOMIC_CMP_SWAP(INCHAIN, ptr, cmp, swap)
1315 /// For double-word atomic operations:
1316 /// ValLo, ValHi, OUTCHAIN = ATOMIC_CMP_SWAP(INCHAIN, ptr, cmpLo, cmpHi,
1317 /// swapLo, swapHi)
1318 /// This corresponds to the cmpxchg instruction.
1320
1321 /// Val, Success, OUTCHAIN
1322 /// = ATOMIC_CMP_SWAP_WITH_SUCCESS(INCHAIN, ptr, cmp, swap)
1323 /// N.b. this is still a strong cmpxchg operation, so
1324 /// Success == "Val == cmp".
1326
1327 /// Val, OUTCHAIN = ATOMIC_SWAP(INCHAIN, ptr, amt)
1328 /// Val, OUTCHAIN = ATOMIC_LOAD_[OpName](INCHAIN, ptr, amt)
1329 /// For double-word atomic operations:
1330 /// ValLo, ValHi, OUTCHAIN = ATOMIC_SWAP(INCHAIN, ptr, amtLo, amtHi)
1331 /// ValLo, ValHi, OUTCHAIN = ATOMIC_LOAD_[OpName](INCHAIN, ptr, amtLo, amtHi)
1332 /// These correspond to the atomicrmw instruction.
1353
1354 /// Masked load and store - consecutive vector load and store operations
1355 /// with additional mask operand that prevents memory accesses to the
1356 /// masked-off lanes.
1357 ///
1358 /// Val, OutChain = MLOAD(BasePtr, Mask, PassThru)
1359 /// OutChain = MSTORE(Value, BasePtr, Mask)
1362
1363 /// Masked gather and scatter - load and store operations for a vector of
1364 /// random addresses with additional mask operand that prevents memory
1365 /// accesses to the masked-off lanes.
1366 ///
1367 /// Val, OutChain = GATHER(InChain, PassThru, Mask, BasePtr, Index, Scale)
1368 /// OutChain = SCATTER(InChain, Value, Mask, BasePtr, Index, Scale)
1369 ///
1370 /// The Index operand can have more vector elements than the other operands
1371 /// due to type legalization. The extra elements are ignored.
1374
1375 /// This corresponds to the llvm.lifetime.* intrinsics. The first operand
1376 /// is the chain and the second operand is the alloca pointer.
1379
1380 /// FAKE_USE represents a use of the operand but does not do anything.
1381 /// Its purpose is the extension of the operand's lifetime mainly for
1382 /// debugging purposes.
1384
1385 /// GC_TRANSITION_START/GC_TRANSITION_END - These operators mark the
1386 /// beginning and end of GC transition sequence, and carry arbitrary
1387 /// information that target might need for lowering. The first operand is
1388 /// a chain, the rest are specified by the target and not touched by the DAG
1389 /// optimizers. GC_TRANSITION_START..GC_TRANSITION_END pairs may not be
1390 /// nested.
1393
1394 /// GET_DYNAMIC_AREA_OFFSET - get offset from native SP to the address of
1395 /// the most recent dynamic alloca. For most targets that would be 0, but
1396 /// for some others (e.g. PowerPC, PowerPC64) that would be compile-time
1397 /// known nonzero constant. The only operand here is the chain.
1399
1400 /// Pseudo probe for AutoFDO, as a place holder in a basic block to improve
1401 /// the sample counts quality.
1403
1404 /// VSCALE(IMM) - Returns the runtime scaling factor used to calculate the
1405 /// number of elements within a scalable vector. IMM is a constant integer
1406 /// multiplier that is applied to the runtime value.
1408
1409 /// Generic reduction nodes. These nodes represent horizontal vector
1410 /// reduction operations, producing a scalar result.
1411 /// The SEQ variants perform reductions in sequential order. The first
1412 /// operand is an initial scalar accumulator value, and the second operand
1413 /// is the vector to reduce.
1414 /// E.g. RES = VECREDUCE_SEQ_FADD f32 ACC, <4 x f32> SRC_VEC
1415 /// ... is equivalent to
1416 /// RES = (((ACC + SRC_VEC[0]) + SRC_VEC[1]) + SRC_VEC[2]) + SRC_VEC[3]
1419
1420 /// These reductions have relaxed evaluation order semantics, and have a
1421 /// single vector operand. The order of evaluation is unspecified. For
1422 /// pow-of-2 vectors, one valid legalizer expansion is to use a tree
1423 /// reduction, i.e.:
1424 /// For RES = VECREDUCE_FADD <8 x f16> SRC_VEC
1425 ///
1426 /// PART_RDX = FADD SRC_VEC[0:3], SRC_VEC[4:7]
1427 /// PART_RDX2 = FADD PART_RDX[0:1], PART_RDX[2:3]
1428 /// RES = FADD PART_RDX2[0], PART_RDX2[1]
1429 ///
1430 /// For non-pow-2 vectors, this can be computed by extracting each element
1431 /// and performing the operation as if it were scalarized.
1434 /// FMIN/FMAX nodes can have flags, for NaN/NoNaN variants.
1437 /// FMINIMUM/FMAXIMUM nodes propatate NaNs and signed zeroes using the
1438 /// llvm.minimum and llvm.maximum semantics.
1441 /// Integer reductions may have a result type larger than the vector element
1442 /// type. However, the reduction is performed using the vector element type
1443 /// and the value in the top bits is unspecified.
1453
1454 // The `llvm.experimental.stackmap` intrinsic.
1455 // Operands: input chain, glue, <id>, <numShadowBytes>, [live0[, live1...]]
1456 // Outputs: output chain, glue
1458
1459 // The `llvm.experimental.patchpoint.*` intrinsic.
1460 // Operands: input chain, [glue], reg-mask, <id>, <numShadowBytes>, callee,
1461 // <numArgs>, cc, ...
1462 // Outputs: [rv], output chain, glue
1464
1465// Vector Predication
1466#define BEGIN_REGISTER_VP_SDNODE(VPSDID, ...) VPSDID,
1467#include "llvm/IR/VPIntrinsics.def"
1468
1469 // The `llvm.experimental.convergence.*` intrinsics.
1473 // This does not correspond to any convergence control intrinsic. It is used
1474 // to glue a convergence control token to a convergent operation in the DAG,
1475 // which is later translated to an implicit use in the MIR.
1477
1478 // Experimental vector histogram intrinsic
1479 // Operands: Input Chain, Inc, Mask, Base, Index, Scale, ID
1480 // Output: Output Chain
1482
1483 // llvm.clear_cache intrinsic
1484 // Operands: Input Chain, Start Addres, End Address
1485 // Outputs: Output Chain
1487
1488 /// BUILTIN_OP_END - This must be the last enum value in this list.
1489 /// The target-specific pre-isel opcode values start here.
1492
1493/// FIRST_TARGET_STRICTFP_OPCODE - Target-specific pre-isel operations
1494/// which cannot raise FP exceptions should be less than this value.
1495/// Those that do must not be less than this value.
1497
1498/// FIRST_TARGET_MEMORY_OPCODE - Target-specific pre-isel operations
1499/// which do not reference a specific memory location should be less than
1500/// this value. Those that do must not be less than this value, and can
1501/// be used with SelectionDAG::getMemIntrinsicNode.
1503
1504/// Whether this is bitwise logic opcode.
1505inline bool isBitwiseLogicOp(unsigned Opcode) {
1506 return Opcode == ISD::AND || Opcode == ISD::OR || Opcode == ISD::XOR;
1507}
1508
1509/// Get underlying scalar opcode for VECREDUCE opcode.
1510/// For example ISD::AND for ISD::VECREDUCE_AND.
1511NodeType getVecReduceBaseOpcode(unsigned VecReduceOpcode);
1512
1513/// Whether this is a vector-predicated Opcode.
1514bool isVPOpcode(unsigned Opcode);
1515
1516/// Whether this is a vector-predicated binary operation opcode.
1517bool isVPBinaryOp(unsigned Opcode);
1518
1519/// Whether this is a vector-predicated reduction opcode.
1520bool isVPReduction(unsigned Opcode);
1521
1522/// The operand position of the vector mask.
1523std::optional<unsigned> getVPMaskIdx(unsigned Opcode);
1524
1525/// The operand position of the explicit vector length parameter.
1526std::optional<unsigned> getVPExplicitVectorLengthIdx(unsigned Opcode);
1527
1528/// Translate this VP Opcode to its corresponding non-VP Opcode.
1529std::optional<unsigned> getBaseOpcodeForVP(unsigned Opcode, bool hasFPExcept);
1530
1531/// Translate this non-VP Opcode to its corresponding VP Opcode.
1532std::optional<unsigned> getVPForBaseOpcode(unsigned Opcode);
1533
1534//===--------------------------------------------------------------------===//
1535/// MemIndexedMode enum - This enum defines the load / store indexed
1536/// addressing modes.
1537///
1538/// UNINDEXED "Normal" load / store. The effective address is already
1539/// computed and is available in the base pointer. The offset
1540/// operand is always undefined. In addition to producing a
1541/// chain, an unindexed load produces one value (result of the
1542/// load); an unindexed store does not produce a value.
1543///
1544/// PRE_INC Similar to the unindexed mode where the effective address is
1545/// PRE_DEC the value of the base pointer add / subtract the offset.
1546/// It considers the computation as being folded into the load /
1547/// store operation (i.e. the load / store does the address
1548/// computation as well as performing the memory transaction).
1549/// The base operand is always undefined. In addition to
1550/// producing a chain, pre-indexed load produces two values
1551/// (result of the load and the result of the address
1552/// computation); a pre-indexed store produces one value (result
1553/// of the address computation).
1554///
1555/// POST_INC The effective address is the value of the base pointer. The
1556/// POST_DEC value of the offset operand is then added to / subtracted
1557/// from the base after memory transaction. In addition to
1558/// producing a chain, post-indexed load produces two values
1559/// (the result of the load and the result of the base +/- offset
1560/// computation); a post-indexed store produces one value (the
1561/// the result of the base +/- offset computation).
1563
1564static const int LAST_INDEXED_MODE = POST_DEC + 1;
1565
1566//===--------------------------------------------------------------------===//
1567/// MemIndexType enum - This enum defines how to interpret MGATHER/SCATTER's
1568/// index parameter when calculating addresses.
1569///
1570/// SIGNED_SCALED Addr = Base + ((signed)Index * Scale)
1571/// UNSIGNED_SCALED Addr = Base + ((unsigned)Index * Scale)
1572///
1573/// NOTE: The value of Scale is typically only known to the node owning the
1574/// IndexType, with a value of 1 the equivalent of being unscaled.
1576
1578
1579inline bool isIndexTypeSigned(MemIndexType IndexType) {
1580 return IndexType == SIGNED_SCALED;
1581}
1582
1583//===--------------------------------------------------------------------===//
1584/// LoadExtType enum - This enum defines the three variants of LOADEXT
1585/// (load with extension).
1586///
1587/// SEXTLOAD loads the integer operand and sign extends it to a larger
1588/// integer result type.
1589/// ZEXTLOAD loads the integer operand and zero extends it to a larger
1590/// integer result type.
1591/// EXTLOAD is used for two things: floating point extending loads and
1592/// integer extending loads [the top bits are undefined].
1594
1595static const int LAST_LOADEXT_TYPE = ZEXTLOAD + 1;
1596
1598
1599//===--------------------------------------------------------------------===//
1600/// ISD::CondCode enum - These are ordered carefully to make the bitfields
1601/// below work out, when considering SETFALSE (something that never exists
1602/// dynamically) as 0. "U" -> Unsigned (for integer operands) or Unordered
1603/// (for floating point), "L" -> Less than, "G" -> Greater than, "E" -> Equal
1604/// to. If the "N" column is 1, the result of the comparison is undefined if
1605/// the input is a NAN.
1606///
1607/// All of these (except for the 'always folded ops') should be handled for
1608/// floating point. For integer, only the SETEQ,SETNE,SETLT,SETLE,SETGT,
1609/// SETGE,SETULT,SETULE,SETUGT, and SETUGE opcodes are used.
1610///
1611/// Note that these are laid out in a specific order to allow bit-twiddling
1612/// to transform conditions.
1614 // Opcode N U L G E Intuitive operation
1615 SETFALSE, // 0 0 0 0 Always false (always folded)
1616 SETOEQ, // 0 0 0 1 True if ordered and equal
1617 SETOGT, // 0 0 1 0 True if ordered and greater than
1618 SETOGE, // 0 0 1 1 True if ordered and greater than or equal
1619 SETOLT, // 0 1 0 0 True if ordered and less than
1620 SETOLE, // 0 1 0 1 True if ordered and less than or equal
1621 SETONE, // 0 1 1 0 True if ordered and operands are unequal
1622 SETO, // 0 1 1 1 True if ordered (no nans)
1623 SETUO, // 1 0 0 0 True if unordered: isnan(X) | isnan(Y)
1624 SETUEQ, // 1 0 0 1 True if unordered or equal
1625 SETUGT, // 1 0 1 0 True if unordered or greater than
1626 SETUGE, // 1 0 1 1 True if unordered, greater than, or equal
1627 SETULT, // 1 1 0 0 True if unordered or less than
1628 SETULE, // 1 1 0 1 True if unordered, less than, or equal
1629 SETUNE, // 1 1 1 0 True if unordered or not equal
1630 SETTRUE, // 1 1 1 1 Always true (always folded)
1631 // Don't care operations: undefined if the input is a nan.
1632 SETFALSE2, // 1 X 0 0 0 Always false (always folded)
1633 SETEQ, // 1 X 0 0 1 True if equal
1634 SETGT, // 1 X 0 1 0 True if greater than
1635 SETGE, // 1 X 0 1 1 True if greater than or equal
1636 SETLT, // 1 X 1 0 0 True if less than
1637 SETLE, // 1 X 1 0 1 True if less than or equal
1638 SETNE, // 1 X 1 1 0 True if not equal
1639 SETTRUE2, // 1 X 1 1 1 Always true (always folded)
1640
1641 SETCC_INVALID // Marker value.
1643
1644/// Return true if this is a setcc instruction that performs a signed
1645/// comparison when used with integer operands.
1646inline bool isSignedIntSetCC(CondCode Code) {
1647 return Code == SETGT || Code == SETGE || Code == SETLT || Code == SETLE;
1648}
1649
1650/// Return true if this is a setcc instruction that performs an unsigned
1651/// comparison when used with integer operands.
1652inline bool isUnsignedIntSetCC(CondCode Code) {
1653 return Code == SETUGT || Code == SETUGE || Code == SETULT || Code == SETULE;
1654}
1655
1656/// Return true if this is a setcc instruction that performs an equality
1657/// comparison when used with integer operands.
1658inline bool isIntEqualitySetCC(CondCode Code) {
1659 return Code == SETEQ || Code == SETNE;
1660}
1661
1662/// Return true if this is a setcc instruction that performs an equality
1663/// comparison when used with floating point operands.
1664inline bool isFPEqualitySetCC(CondCode Code) {
1665 return Code == SETOEQ || Code == SETONE || Code == SETUEQ || Code == SETUNE;
1666}
1667
1668/// Return true if the specified condition returns true if the two operands to
1669/// the condition are equal. Note that if one of the two operands is a NaN,
1670/// this value is meaningless.
1671inline bool isTrueWhenEqual(CondCode Cond) { return ((int)Cond & 1) != 0; }
1672
1673/// This function returns 0 if the condition is always false if an operand is
1674/// a NaN, 1 if the condition is always true if the operand is a NaN, and 2 if
1675/// the condition is undefined if the operand is a NaN.
1677 return ((int)Cond >> 3) & 3;
1678}
1679
1680/// Return the operation corresponding to !(X op Y), where 'op' is a valid
1681/// SetCC operation.
1683
1684inline bool isExtOpcode(unsigned Opcode) {
1685 return Opcode == ISD::ANY_EXTEND || Opcode == ISD::ZERO_EXTEND ||
1686 Opcode == ISD::SIGN_EXTEND;
1687}
1688
1689inline bool isExtVecInRegOpcode(unsigned Opcode) {
1690 return Opcode == ISD::ANY_EXTEND_VECTOR_INREG ||
1693}
1694
1695namespace GlobalISel {
1696/// Return the operation corresponding to !(X op Y), where 'op' is a valid
1697/// SetCC operation. The U bit of the condition code has different meanings
1698/// between floating point and integer comparisons and LLT's don't provide
1699/// this distinction. As such we need to be told whether the comparison is
1700/// floating point or integer-like. Pointers should use integer-like
1701/// comparisons.
1702CondCode getSetCCInverse(CondCode Operation, bool isIntegerLike);
1703} // end namespace GlobalISel
1704
1705/// Return the operation corresponding to (Y op X) when given the operation
1706/// for (X op Y).
1708
1709/// Return the result of a logical OR between different comparisons of
1710/// identical values: ((X op1 Y) | (X op2 Y)). This function returns
1711/// SETCC_INVALID if it is not possible to represent the resultant comparison.
1713
1714/// Return the result of a logical AND between different comparisons of
1715/// identical values: ((X op1 Y) & (X op2 Y)). This function returns
1716/// SETCC_INVALID if it is not possible to represent the resultant comparison.
1718
1719} // namespace ISD
1720
1721} // namespace llvm
1722
1723#endif
PowerPC Reduce CR logical Operation
const SmallVectorImpl< MachineOperand > & Cond
The instances of the Type class are immutable: once they are created, they are never changed.
Definition: Type.h:45
CondCode getSetCCInverse(CondCode Operation, bool isIntegerLike)
Return the operation corresponding to !(X op Y), where 'op' is a valid SetCC operation.
CondCode getSetCCAndOperation(CondCode Op1, CondCode Op2, EVT Type)
Return the result of a logical AND between different comparisons of identical values: ((X op1 Y) & (X...
NodeType
ISD::NodeType enum - This enum defines the target-independent operators for a SelectionDAG.
Definition: ISDOpcodes.h:40
@ SETCC
SetCC operator - This evaluates to a true value iff the condition is true.
Definition: ISDOpcodes.h:780
@ MERGE_VALUES
MERGE_VALUES - This node takes multiple discrete operands and returns them all as its individual resu...
Definition: ISDOpcodes.h:243
@ STACKRESTORE
STACKRESTORE has two operands, an input chain and a pointer to restore to it returns an output chain.
Definition: ISDOpcodes.h:1197
@ STACKSAVE
STACKSAVE - STACKSAVE has one operand, an input chain.
Definition: ISDOpcodes.h:1193
@ CTLZ_ZERO_UNDEF
Definition: ISDOpcodes.h:753
@ TargetConstantPool
Definition: ISDOpcodes.h:174
@ CONVERGENCECTRL_ANCHOR
Definition: ISDOpcodes.h:1470
@ MDNODE_SDNODE
MDNODE_SDNODE - This is a node that holdes an MDNode*, which is used to reference metadata in the IR.
Definition: ISDOpcodes.h:1242
@ STRICT_FSETCC
STRICT_FSETCC/STRICT_FSETCCS - Constrained versions of SETCC, used for floating-point operands only.
Definition: ISDOpcodes.h:491
@ ATOMIC_LOAD_FMAX
Definition: ISDOpcodes.h:1347
@ DELETED_NODE
DELETED_NODE - This is an illegal value that is used to catch errors.
Definition: ISDOpcodes.h:44
@ SET_FPENV
Sets the current floating-point environment.
Definition: ISDOpcodes.h:1069
@ VECREDUCE_SEQ_FADD
Generic reduction nodes.
Definition: ISDOpcodes.h:1417
@ MLOAD
Masked load and store - consecutive vector load and store operations with additional mask operand tha...
Definition: ISDOpcodes.h:1360
@ VECREDUCE_SMIN
Definition: ISDOpcodes.h:1450
@ EH_SJLJ_LONGJMP
OUTCHAIN = EH_SJLJ_LONGJMP(INCHAIN, buffer) This corresponds to the eh.sjlj.longjmp intrinsic.
Definition: ISDOpcodes.h:153
@ FGETSIGN
INT = FGETSIGN(FP) - Return the sign bit of the specified floating point value as an integer 0/1 valu...
Definition: ISDOpcodes.h:512
@ SMUL_LOHI
SMUL_LOHI/UMUL_LOHI - Multiply two integers of type iN, producing a signed/unsigned value of type i[2...
Definition: ISDOpcodes.h:257
@ ATOMIC_LOAD_NAND
Definition: ISDOpcodes.h:1340
@ INSERT_SUBVECTOR
INSERT_SUBVECTOR(VECTOR1, VECTOR2, IDX) - Returns a vector with VECTOR2 inserted into VECTOR1.
Definition: ISDOpcodes.h:574
@ JUMP_TABLE_DEBUG_INFO
JUMP_TABLE_DEBUG_INFO - Jumptable debug info.
Definition: ISDOpcodes.h:1131
@ BSWAP
Byte Swap and Counting operators.
Definition: ISDOpcodes.h:744
@ SMULFIX
RESULT = [US]MULFIX(LHS, RHS, SCALE) - Perform fixed point multiplication on 2 integers with the same...
Definition: ISDOpcodes.h:374
@ VAEND
VAEND, VASTART - VAEND and VASTART have three operands: an input chain, pointer, and a SRCVALUE.
Definition: ISDOpcodes.h:1226
@ TargetBlockAddress
Definition: ISDOpcodes.h:176
@ ConstantFP
Definition: ISDOpcodes.h:77
@ STRICT_FATAN2
Definition: ISDOpcodes.h:428
@ ATOMIC_LOAD_MAX
Definition: ISDOpcodes.h:1342
@ ATOMIC_STORE
OUTCHAIN = ATOMIC_STORE(INCHAIN, val, ptr) This corresponds to "store atomic" instruction.
Definition: ISDOpcodes.h:1312
@ STRICT_FCEIL
Definition: ISDOpcodes.h:441
@ ATOMIC_LOAD_UMIN
Definition: ISDOpcodes.h:1343
@ ADDC
Carry-setting nodes for multiple precision addition and subtraction.
Definition: ISDOpcodes.h:276
@ FRAME_TO_ARGS_OFFSET
FRAME_TO_ARGS_OFFSET - This node represents offset from frame pointer to first (possible) on-stack ar...
Definition: ISDOpcodes.h:130
@ RESET_FPENV
Set floating-point environment to default state.
Definition: ISDOpcodes.h:1073
@ FMAD
FMAD - Perform a * b + c, while getting the same result as the separately rounded operations.
Definition: ISDOpcodes.h:502
@ STRICT_FTANH
Definition: ISDOpcodes.h:431
@ ADD
Simple integer binary arithmetic operators.
Definition: ISDOpcodes.h:246
@ LOAD
LOAD and STORE have token chains as their first operand, then the same operands as an LLVM load/store...
Definition: ISDOpcodes.h:1102
@ SMULFIXSAT
Same as the corresponding unsaturated fixed point instructions, but the result is clamped between the...
Definition: ISDOpcodes.h:380
@ SET_FPMODE
Sets the current dynamic floating-point control modes.
Definition: ISDOpcodes.h:1092
@ ANY_EXTEND
ANY_EXTEND - Used for integer types. The high bits are undefined.
Definition: ISDOpcodes.h:814
@ ATOMIC_LOAD_USUB_COND
Definition: ISDOpcodes.h:1351
@ FMA
FMA - Perform a * b + c with no intermediate rounding step.
Definition: ISDOpcodes.h:498
@ FATAN2
FATAN2 - atan2, inspired by libm.
Definition: ISDOpcodes.h:999
@ INTRINSIC_VOID
OUTCHAIN = INTRINSIC_VOID(INCHAIN, INTRINSICID, arg1, arg2, ...) This node represents a target intrin...
Definition: ISDOpcodes.h:205
@ EH_SJLJ_SETUP_DISPATCH
OUTCHAIN = EH_SJLJ_SETUP_DISPATCH(INCHAIN) The target initializes the dispatch table here.
Definition: ISDOpcodes.h:157
@ GlobalAddress
Definition: ISDOpcodes.h:78
@ ATOMIC_CMP_SWAP_WITH_SUCCESS
Val, Success, OUTCHAIN = ATOMIC_CMP_SWAP_WITH_SUCCESS(INCHAIN, ptr, cmp, swap) N.b.
Definition: ISDOpcodes.h:1325
@ STRICT_FMINIMUM
Definition: ISDOpcodes.h:451
@ SINT_TO_FP
[SU]INT_TO_FP - These operators convert integers (whose interpreted sign depends on the first letter)...
Definition: ISDOpcodes.h:841
@ CONCAT_VECTORS
CONCAT_VECTORS(VECTOR0, VECTOR1, ...) - Given a number of values of vector type with the same length ...
Definition: ISDOpcodes.h:558
@ VECREDUCE_FMAX
FMIN/FMAX nodes can have flags, for NaN/NoNaN variants.
Definition: ISDOpcodes.h:1435
@ FADD
Simple binary floating point operators.
Definition: ISDOpcodes.h:397
@ VECREDUCE_FMAXIMUM
FMINIMUM/FMAXIMUM nodes propatate NaNs and signed zeroes using the llvm.minimum and llvm....
Definition: ISDOpcodes.h:1439
@ ABS
ABS - Determine the unsigned absolute value of a signed integer value of the same bitwidth.
Definition: ISDOpcodes.h:717
@ MEMBARRIER
MEMBARRIER - Compiler barrier only; generate a no-op.
Definition: ISDOpcodes.h:1299
@ ATOMIC_FENCE
OUTCHAIN = ATOMIC_FENCE(INCHAIN, ordering, scope) This corresponds to the fence instruction.
Definition: ISDOpcodes.h:1304
@ RESET_FPMODE
Sets default dynamic floating-point control modes.
Definition: ISDOpcodes.h:1096
@ SIGN_EXTEND_VECTOR_INREG
SIGN_EXTEND_VECTOR_INREG(Vector) - This operator represents an in-register sign-extension of the low ...
Definition: ISDOpcodes.h:871
@ SDIVREM
SDIVREM/UDIVREM - Divide two integers and produce both a quotient and remainder result.
Definition: ISDOpcodes.h:262
@ VECREDUCE_SMAX
Definition: ISDOpcodes.h:1449
@ STRICT_FSETCCS
Definition: ISDOpcodes.h:492
@ FP16_TO_FP
FP16_TO_FP, FP_TO_FP16 - These operators are used to perform promotions and truncation for half-preci...
Definition: ISDOpcodes.h:964
@ STRICT_FLOG2
Definition: ISDOpcodes.h:436
@ FPTRUNC_ROUND
FPTRUNC_ROUND - This corresponds to the fptrunc_round intrinsic.
Definition: ISDOpcodes.h:495
@ FAKE_USE
FAKE_USE represents a use of the operand but does not do anything.
Definition: ISDOpcodes.h:1383
@ ATOMIC_LOAD_OR
Definition: ISDOpcodes.h:1338
@ BITCAST
BITCAST - This operator converts between integer, vector and FP values, as if the value was stored to...
Definition: ISDOpcodes.h:954
@ BUILD_PAIR
BUILD_PAIR - This is the opposite of EXTRACT_ELEMENT in some ways.
Definition: ISDOpcodes.h:236
@ ATOMIC_LOAD_XOR
Definition: ISDOpcodes.h:1339
@ INIT_TRAMPOLINE
INIT_TRAMPOLINE - This corresponds to the init_trampoline intrinsic.
Definition: ISDOpcodes.h:1270
@ FLDEXP
FLDEXP - ldexp, inspired by libm (op0 * 2**op1).
Definition: ISDOpcodes.h:997
@ SDIVFIX
RESULT = [US]DIVFIX(LHS, RHS, SCALE) - Perform fixed point division on 2 integers with the same width...
Definition: ISDOpcodes.h:387
@ STRICT_FSQRT
Constrained versions of libm-equivalent floating point intrinsics.
Definition: ISDOpcodes.h:418
@ BUILTIN_OP_END
BUILTIN_OP_END - This must be the last enum value in this list.
Definition: ISDOpcodes.h:1490
@ ATOMIC_LOAD_FADD
Definition: ISDOpcodes.h:1345
@ GlobalTLSAddress
Definition: ISDOpcodes.h:79
@ SRCVALUE
SRCVALUE - This is a node type that holds a Value* that is used to make reference to a value in the L...
Definition: ISDOpcodes.h:1238
@ FrameIndex
Definition: ISDOpcodes.h:80
@ EH_LABEL
EH_LABEL - Represents a label in mid basic block used to track locations needed for debug and excepti...
Definition: ISDOpcodes.h:1173
@ ATOMIC_LOAD_USUB_SAT
Definition: ISDOpcodes.h:1352
@ EH_RETURN
OUTCHAIN = EH_RETURN(INCHAIN, OFFSET, HANDLER) - This node represents 'eh_return' gcc dwarf builtin,...
Definition: ISDOpcodes.h:141
@ ANNOTATION_LABEL
ANNOTATION_LABEL - Represents a mid basic block label used by annotations.
Definition: ISDOpcodes.h:1179
@ SET_ROUNDING
Set rounding mode.
Definition: ISDOpcodes.h:936
@ CONVERGENCECTRL_GLUE
Definition: ISDOpcodes.h:1476
@ SIGN_EXTEND
Conversion operators.
Definition: ISDOpcodes.h:805
@ STRICT_FASIN
Definition: ISDOpcodes.h:425
@ AVGCEILS
AVGCEILS/AVGCEILU - Rounding averaging add - Add two integers using an integer of type i[N+2],...
Definition: ISDOpcodes.h:685
@ STRICT_UINT_TO_FP
Definition: ISDOpcodes.h:465
@ SCALAR_TO_VECTOR
SCALAR_TO_VECTOR(VAL) - This represents the operation of loading a scalar value into element 0 of the...
Definition: ISDOpcodes.h:635
@ PREALLOCATED_SETUP
PREALLOCATED_SETUP - This has 2 operands: an input chain and a SRCVALUE with the preallocated call Va...
Definition: ISDOpcodes.h:1231
@ READSTEADYCOUNTER
READSTEADYCOUNTER - This corresponds to the readfixedcounter intrinsic.
Definition: ISDOpcodes.h:1259
@ ADDROFRETURNADDR
ADDROFRETURNADDR - Represents the llvm.addressofreturnaddress intrinsic.
Definition: ISDOpcodes.h:107
@ TargetExternalSymbol
Definition: ISDOpcodes.h:175
@ CONVERGENCECTRL_ENTRY
Definition: ISDOpcodes.h:1471
@ BR
Control flow instructions. These all have token chains.
Definition: ISDOpcodes.h:1118
@ VECREDUCE_FADD
These reductions have relaxed evaluation order semantics, and have a single vector operand.
Definition: ISDOpcodes.h:1432
@ STRICT_FATAN
Definition: ISDOpcodes.h:427
@ CTTZ_ZERO_UNDEF
Bit counting operators with an undefined result for zero inputs.
Definition: ISDOpcodes.h:752
@ TargetJumpTable
Definition: ISDOpcodes.h:173
@ TargetIndex
TargetIndex - Like a constant pool entry, but with completely target-dependent semantics.
Definition: ISDOpcodes.h:183
@ WRITE_REGISTER
Definition: ISDOpcodes.h:125
@ PREFETCH
PREFETCH - This corresponds to a prefetch intrinsic.
Definition: ISDOpcodes.h:1292
@ TRUNCATE_SSAT_U
Definition: ISDOpcodes.h:834
@ VECREDUCE_FMIN
Definition: ISDOpcodes.h:1436
@ FSINCOS
FSINCOS - Compute both fsin and fcos as a single operation.
Definition: ISDOpcodes.h:1059
@ SETCCCARRY
Like SetCC, ops #0 and #1 are the LHS and RHS operands to compare, but op #2 is a boolean indicating ...
Definition: ISDOpcodes.h:788
@ STRICT_LROUND
Definition: ISDOpcodes.h:446
@ FNEG
Perform various unary floating-point operations inspired by libm.
Definition: ISDOpcodes.h:981
@ ATOMIC_LOAD_FSUB
Definition: ISDOpcodes.h:1346
@ BR_CC
BR_CC - Conditional branch.
Definition: ISDOpcodes.h:1148
@ SSUBO
Same for subtraction.
Definition: ISDOpcodes.h:334
@ ATOMIC_LOAD_MIN
Definition: ISDOpcodes.h:1341
@ PREALLOCATED_ARG
PREALLOCATED_ARG - This has 3 operands: an input chain, a SRCVALUE with the preallocated call Value,...
Definition: ISDOpcodes.h:1234
@ BRIND
BRIND - Indirect branch.
Definition: ISDOpcodes.h:1123
@ BR_JT
BR_JT - Jumptable branch.
Definition: ISDOpcodes.h:1127
@ GC_TRANSITION_START
GC_TRANSITION_START/GC_TRANSITION_END - These operators mark the beginning and end of GC transition s...
Definition: ISDOpcodes.h:1391
@ VECTOR_INTERLEAVE
VECTOR_INTERLEAVE(VEC1, VEC2) - Returns two vectors with all input and output vectors having the same...
Definition: ISDOpcodes.h:601
@ STEP_VECTOR
STEP_VECTOR(IMM) - Returns a scalable vector whose lanes are comprised of a linear sequence of unsign...
Definition: ISDOpcodes.h:661
@ FCANONICALIZE
Returns platform specific canonical encoding of a floating point number.
Definition: ISDOpcodes.h:515
@ IS_FPCLASS
Performs a check of floating point class property, defined by IEEE-754.
Definition: ISDOpcodes.h:522
@ SSUBSAT
RESULT = [US]SUBSAT(LHS, RHS) - Perform saturation subtraction on 2 integers with the same bit width ...
Definition: ISDOpcodes.h:356
@ SELECT
Select(COND, TRUEVAL, FALSEVAL).
Definition: ISDOpcodes.h:757
@ STRICT_FPOWI
Definition: ISDOpcodes.h:420
@ ATOMIC_LOAD
Val, OUTCHAIN = ATOMIC_LOAD(INCHAIN, ptr) This corresponds to "load atomic" instruction.
Definition: ISDOpcodes.h:1308
@ UNDEF
UNDEF - An undefined node.
Definition: ISDOpcodes.h:218
@ VECREDUCE_UMAX
Definition: ISDOpcodes.h:1451
@ RegisterMask
Definition: ISDOpcodes.h:75
@ EXTRACT_ELEMENT
EXTRACT_ELEMENT - This is used to get the lower or upper (determined by a Constant,...
Definition: ISDOpcodes.h:229
@ SPLAT_VECTOR
SPLAT_VECTOR(VAL) - Returns a vector with the scalar value VAL duplicated in all lanes.
Definition: ISDOpcodes.h:642
@ AssertAlign
AssertAlign - These nodes record if a register contains a value that has a known alignment and the tr...
Definition: ISDOpcodes.h:68
@ VACOPY
VACOPY - VACOPY has 5 operands: an input chain, a destination pointer, a source pointer,...
Definition: ISDOpcodes.h:1222
@ ATOMIC_LOAD_FMIN
Definition: ISDOpcodes.h:1348
@ BasicBlock
Various leaf nodes.
Definition: ISDOpcodes.h:71
@ CopyFromReg
CopyFromReg - This node indicates that the input value is a virtual or physical register that is defi...
Definition: ISDOpcodes.h:215
@ SADDO
RESULT, BOOL = [SU]ADDO(LHS, RHS) - Overflow-aware nodes for addition.
Definition: ISDOpcodes.h:330
@ TargetGlobalAddress
TargetGlobalAddress - Like GlobalAddress, but the DAG does no folding or anything else with this node...
Definition: ISDOpcodes.h:170
@ STRICT_FTRUNC
Definition: ISDOpcodes.h:445
@ ARITH_FENCE
ARITH_FENCE - This corresponds to a arithmetic fence intrinsic.
Definition: ISDOpcodes.h:1296
@ VECREDUCE_ADD
Integer reductions may have a result type larger than the vector element type.
Definition: ISDOpcodes.h:1444
@ GET_ROUNDING
Returns current rounding mode: -1 Undefined 0 Round to 0 1 Round to nearest, ties to even 2 Round to ...
Definition: ISDOpcodes.h:931
@ STRICT_FP_TO_FP16
Definition: ISDOpcodes.h:967
@ MULHU
MULHU/MULHS - Multiply high - Multiply two integers of type iN, producing an unsigned/signed value of...
Definition: ISDOpcodes.h:674
@ CLEANUPRET
CLEANUPRET - Represents a return from a cleanup block funclet.
Definition: ISDOpcodes.h:1188
@ GET_FPMODE
Reads the current dynamic floating-point control modes.
Definition: ISDOpcodes.h:1087
@ STRICT_FP16_TO_FP
Definition: ISDOpcodes.h:966
@ GET_FPENV
Gets the current floating-point environment.
Definition: ISDOpcodes.h:1064
@ SHL
Shift and rotation operations.
Definition: ISDOpcodes.h:735
@ ATOMIC_LOAD_CLR
Definition: ISDOpcodes.h:1337
@ VECTOR_SHUFFLE
VECTOR_SHUFFLE(VEC1, VEC2) - Returns a vector, of the same type as VEC1/VEC2.
Definition: ISDOpcodes.h:615
@ PtrAuthGlobalAddress
A ptrauth constant.
Definition: ISDOpcodes.h:90
@ ATOMIC_LOAD_AND
Definition: ISDOpcodes.h:1336
@ EXTRACT_SUBVECTOR
EXTRACT_SUBVECTOR(VECTOR, IDX) - Returns a subvector from VECTOR.
Definition: ISDOpcodes.h:588
@ FMINNUM_IEEE
FMINNUM_IEEE/FMAXNUM_IEEE - Perform floating-point minimumNumber or maximumNumber on two values,...
Definition: ISDOpcodes.h:1044
@ STRICT_FMAXIMUM
Definition: ISDOpcodes.h:450
@ EntryToken
EntryToken - This is the marker used to indicate the start of a region.
Definition: ISDOpcodes.h:47
@ STRICT_FMAXNUM
Definition: ISDOpcodes.h:439
@ READ_REGISTER
READ_REGISTER, WRITE_REGISTER - This node represents llvm.register on the DAG, which implements the n...
Definition: ISDOpcodes.h:124
@ EXTRACT_VECTOR_ELT
EXTRACT_VECTOR_ELT(VECTOR, IDX) - Returns a single element from VECTOR identified by the (potentially...
Definition: ISDOpcodes.h:550
@ CopyToReg
CopyToReg - This node has three operands: a chain, a register number to set to this value,...
Definition: ISDOpcodes.h:209
@ ZERO_EXTEND
ZERO_EXTEND - Used for integer types, zeroing the new bits.
Definition: ISDOpcodes.h:811
@ TargetConstantFP
Definition: ISDOpcodes.h:165
@ DEBUGTRAP
DEBUGTRAP - Trap intended to get the attention of a debugger.
Definition: ISDOpcodes.h:1282
@ FP_TO_UINT_SAT
Definition: ISDOpcodes.h:907
@ STRICT_FMINNUM
Definition: ISDOpcodes.h:440
@ SELECT_CC
Select with condition operator - This selects between a true value and a false value (ops #2 and #3) ...
Definition: ISDOpcodes.h:772
@ STRICT_FSINH
Definition: ISDOpcodes.h:429
@ VSCALE
VSCALE(IMM) - Returns the runtime scaling factor used to calculate the number of elements within a sc...
Definition: ISDOpcodes.h:1407
@ ATOMIC_CMP_SWAP
Val, OUTCHAIN = ATOMIC_CMP_SWAP(INCHAIN, ptr, cmp, swap) For double-word atomic operations: ValLo,...
Definition: ISDOpcodes.h:1319
@ ATOMIC_LOAD_UMAX
Definition: ISDOpcodes.h:1344
@ LOCAL_RECOVER
LOCAL_RECOVER - Represents the llvm.localrecover intrinsic.
Definition: ISDOpcodes.h:120
@ FMINNUM
FMINNUM/FMAXNUM - Perform floating-point minimum or maximum on two values.
Definition: ISDOpcodes.h:1031
@ UBSANTRAP
UBSANTRAP - Trap with an immediate describing the kind of sanitizer failure.
Definition: ISDOpcodes.h:1286
@ SSHLSAT
RESULT = [US]SHLSAT(LHS, RHS) - Perform saturation left shift.
Definition: ISDOpcodes.h:366
@ SMULO
Same for multiplication.
Definition: ISDOpcodes.h:338
@ DYNAMIC_STACKALLOC
DYNAMIC_STACKALLOC - Allocate some number of bytes on the stack aligned to a specified boundary.
Definition: ISDOpcodes.h:1112
@ STRICT_LRINT
Definition: ISDOpcodes.h:448
@ TargetFrameIndex
Definition: ISDOpcodes.h:172
@ ConstantPool
Definition: ISDOpcodes.h:82
@ ANY_EXTEND_VECTOR_INREG
ANY_EXTEND_VECTOR_INREG(Vector) - This operator represents an in-register any-extension of the low la...
Definition: ISDOpcodes.h:860
@ SIGN_EXTEND_INREG
SIGN_EXTEND_INREG - This operator atomically performs a SHL/SRA pair to sign extend a small value in ...
Definition: ISDOpcodes.h:849
@ SMIN
[US]{MIN/MAX} - Binary minimum or maximum of signed or unsigned integers.
Definition: ISDOpcodes.h:697
@ VECTOR_REVERSE
VECTOR_REVERSE(VECTOR) - Returns a vector, of the same type as VECTOR, whose elements are shuffled us...
Definition: ISDOpcodes.h:606
@ LIFETIME_START
This corresponds to the llvm.lifetime.
Definition: ISDOpcodes.h:1377
@ SDIVFIXSAT
Same as the corresponding unsaturated fixed point instructions, but the result is clamped between the...
Definition: ISDOpcodes.h:393
@ FP_EXTEND
X = FP_EXTEND(Y) - Extend a smaller FP type into a larger FP type.
Definition: ISDOpcodes.h:939
@ GLOBAL_OFFSET_TABLE
The address of the GOT.
Definition: ISDOpcodes.h:93
@ STRICT_FROUND
Definition: ISDOpcodes.h:443
@ VSELECT
Select with a vector condition (op #0) and two vector operands (ops #1 and #2), returning a vector re...
Definition: ISDOpcodes.h:766
@ UADDO_CARRY
Carry-using nodes for multiple precision addition and subtraction.
Definition: ISDOpcodes.h:310
@ STRICT_SINT_TO_FP
STRICT_[US]INT_TO_FP - Convert a signed or unsigned integer to a floating point value.
Definition: ISDOpcodes.h:464
@ MGATHER
Masked gather and scatter - load and store operations for a vector of random addresses with additiona...
Definition: ISDOpcodes.h:1372
@ HANDLENODE
HANDLENODE node - Used as a handle for various purposes.
Definition: ISDOpcodes.h:1262
@ STRICT_BF16_TO_FP
Definition: ISDOpcodes.h:975
@ VECREDUCE_UMIN
Definition: ISDOpcodes.h:1452
@ PCMARKER
PCMARKER - This corresponds to the pcmarker intrinsic.
Definition: ISDOpcodes.h:1245
@ STRICT_FFLOOR
Definition: ISDOpcodes.h:442
@ STRICT_FROUNDEVEN
Definition: ISDOpcodes.h:444
@ INLINEASM_BR
INLINEASM_BR - Branching version of inline asm. Used by asm-goto.
Definition: ISDOpcodes.h:1168
@ EH_DWARF_CFA
EH_DWARF_CFA - This node represents the pointer to the DWARF Canonical Frame Address (CFA),...
Definition: ISDOpcodes.h:135
@ BF16_TO_FP
BF16_TO_FP, FP_TO_BF16 - These operators are used to perform promotions and truncation for bfloat16.
Definition: ISDOpcodes.h:973
@ FRAMEADDR
FRAMEADDR, RETURNADDR - These nodes represent llvm.frameaddress and llvm.returnaddress on the DAG.
Definition: ISDOpcodes.h:100
@ ATOMIC_LOAD_UDEC_WRAP
Definition: ISDOpcodes.h:1350
@ ATOMIC_LOAD_ADD
Definition: ISDOpcodes.h:1334
@ STRICT_FP_TO_UINT
Definition: ISDOpcodes.h:458
@ STRICT_FP_ROUND
X = STRICT_FP_ROUND(Y, TRUNC) - Rounding 'Y' from a larger floating point type down to the precision ...
Definition: ISDOpcodes.h:480
@ STRICT_FP_TO_SINT
STRICT_FP_TO_[US]INT - Convert a floating point value to a signed or unsigned integer.
Definition: ISDOpcodes.h:457
@ FMINIMUM
FMINIMUM/FMAXIMUM - NaN-propagating minimum/maximum that also treat -0.0 as less than 0....
Definition: ISDOpcodes.h:1050
@ ATOMIC_LOAD_SUB
Definition: ISDOpcodes.h:1335
@ FP_TO_SINT
FP_TO_[US]INT - Convert a floating point value to a signed or unsigned integer.
Definition: ISDOpcodes.h:887
@ READCYCLECOUNTER
READCYCLECOUNTER - This corresponds to the readcyclecounter intrinsic.
Definition: ISDOpcodes.h:1253
@ TargetConstant
TargetConstant* - Like Constant*, but the DAG does not do any folding, simplification,...
Definition: ISDOpcodes.h:164
@ STRICT_FP_EXTEND
X = STRICT_FP_EXTEND(Y) - Extend a smaller FP type into a larger FP type.
Definition: ISDOpcodes.h:485
@ AND
Bitwise operators - logical and, logical or, logical xor.
Definition: ISDOpcodes.h:709
@ TRAP
TRAP - Trapping instruction.
Definition: ISDOpcodes.h:1279
@ INTRINSIC_WO_CHAIN
RESULT = INTRINSIC_WO_CHAIN(INTRINSICID, arg1, arg2, ...) This node represents a target intrinsic fun...
Definition: ISDOpcodes.h:190
@ GET_FPENV_MEM
Gets the current floating-point environment.
Definition: ISDOpcodes.h:1078
@ PSEUDO_PROBE
Pseudo probe for AutoFDO, as a place holder in a basic block to improve the sample counts quality.
Definition: ISDOpcodes.h:1402
@ STRICT_FCOSH
Definition: ISDOpcodes.h:430
@ STRICT_FP_TO_BF16
Definition: ISDOpcodes.h:976
@ SCMP
[US]CMP - 3-way comparison of signed or unsigned integers.
Definition: ISDOpcodes.h:705
@ CARRY_FALSE
CARRY_FALSE - This node is used when folding other nodes, like ADDC/SUBC, which indicate the carry re...
Definition: ISDOpcodes.h:267
@ AVGFLOORS
AVGFLOORS/AVGFLOORU - Averaging add - Add two integers using an integer of type i[N+1],...
Definition: ISDOpcodes.h:680
@ VECREDUCE_FMUL
Definition: ISDOpcodes.h:1433
@ ADDE
Carry-using nodes for multiple precision addition and subtraction.
Definition: ISDOpcodes.h:286
@ STRICT_FADD
Constrained versions of the binary floating point operators.
Definition: ISDOpcodes.h:407
@ STRICT_FLOG10
Definition: ISDOpcodes.h:435
@ SPLAT_VECTOR_PARTS
SPLAT_VECTOR_PARTS(SCALAR1, SCALAR2, ...) - Returns a vector with the scalar values joined together a...
Definition: ISDOpcodes.h:651
@ FREEZE
FREEZE - FREEZE(VAL) returns an arbitrary value if VAL is UNDEF (or is evaluated to UNDEF),...
Definition: ISDOpcodes.h:223
@ INSERT_VECTOR_ELT
INSERT_VECTOR_ELT(VECTOR, VAL, IDX) - Returns VECTOR with the element at IDX replaced with VAL.
Definition: ISDOpcodes.h:539
@ TokenFactor
TokenFactor - This node takes multiple tokens as input and produces a single token result.
Definition: ISDOpcodes.h:52
@ STRICT_LLRINT
Definition: ISDOpcodes.h:449
@ VECTOR_SPLICE
VECTOR_SPLICE(VEC1, VEC2, IMM) - Returns a subvector of the same type as VEC1/VEC2 from CONCAT_VECTOR...
Definition: ISDOpcodes.h:627
@ STRICT_FEXP2
Definition: ISDOpcodes.h:433
@ ATOMIC_SWAP
Val, OUTCHAIN = ATOMIC_SWAP(INCHAIN, ptr, amt) Val, OUTCHAIN = ATOMIC_LOAD_[OpName](INCHAIN,...
Definition: ISDOpcodes.h:1333
@ ExternalSymbol
Definition: ISDOpcodes.h:83
@ FFREXP
FFREXP - frexp, extract fractional and exponent component of a floating-point value.
Definition: ISDOpcodes.h:1004
@ FP_ROUND
X = FP_ROUND(Y, TRUNC) - Rounding 'Y' from a larger floating point type down to the precision of the ...
Definition: ISDOpcodes.h:920
@ VECTOR_COMPRESS
VECTOR_COMPRESS(Vec, Mask, Passthru) consecutively place vector elements based on mask e....
Definition: ISDOpcodes.h:669
@ SPONENTRY
SPONENTRY - Represents the llvm.sponentry intrinsic.
Definition: ISDOpcodes.h:112
@ STRICT_FLDEXP
Definition: ISDOpcodes.h:421
@ STRICT_LLROUND
Definition: ISDOpcodes.h:447
@ CONVERGENCECTRL_LOOP
Definition: ISDOpcodes.h:1472
@ ZERO_EXTEND_VECTOR_INREG
ZERO_EXTEND_VECTOR_INREG(Vector) - This operator represents an in-register zero-extension of the low ...
Definition: ISDOpcodes.h:882
@ ADDRSPACECAST
ADDRSPACECAST - This operator converts between pointers of different address spaces.
Definition: ISDOpcodes.h:958
@ EXPERIMENTAL_VECTOR_HISTOGRAM
Definition: ISDOpcodes.h:1481
@ INLINEASM
INLINEASM - Represents an inline asm block.
Definition: ISDOpcodes.h:1165
@ STRICT_FNEARBYINT
Definition: ISDOpcodes.h:438
@ FP_TO_SINT_SAT
FP_TO_[US]INT_SAT - Convert floating point value in operand 0 to a signed or unsigned scalar integer ...
Definition: ISDOpcodes.h:906
@ VECREDUCE_FMINIMUM
Definition: ISDOpcodes.h:1440
@ EH_SJLJ_SETJMP
RESULT, OUTCHAIN = EH_SJLJ_SETJMP(INCHAIN, buffer) This corresponds to the eh.sjlj....
Definition: ISDOpcodes.h:147
@ TRUNCATE
TRUNCATE - Completely drop the high bits.
Definition: ISDOpcodes.h:817
@ VAARG
VAARG - VAARG has four operands: an input chain, a pointer, a SRCVALUE, and the alignment.
Definition: ISDOpcodes.h:1217
@ BRCOND
BRCOND - Conditional branch.
Definition: ISDOpcodes.h:1141
@ BlockAddress
Definition: ISDOpcodes.h:84
@ VECREDUCE_SEQ_FMUL
Definition: ISDOpcodes.h:1418
@ SHL_PARTS
SHL_PARTS/SRA_PARTS/SRL_PARTS - These operators are used for expanded integer shift operations.
Definition: ISDOpcodes.h:794
@ CATCHRET
CATCHRET - Represents a return from a catch block funclet.
Definition: ISDOpcodes.h:1184
@ GC_TRANSITION_END
Definition: ISDOpcodes.h:1392
@ AssertSext
AssertSext, AssertZext - These nodes record if a register contains a value that has already been zero...
Definition: ISDOpcodes.h:61
@ ATOMIC_LOAD_UINC_WRAP
Definition: ISDOpcodes.h:1349
@ FCOPYSIGN
FCOPYSIGN(X, Y) - Return the value of X with the sign of Y.
Definition: ISDOpcodes.h:508
@ SADDSAT
RESULT = [US]ADDSAT(LHS, RHS) - Perform saturation addition on 2 integers with the same bit width (W)...
Definition: ISDOpcodes.h:347
@ AssertZext
Definition: ISDOpcodes.h:62
@ CALLSEQ_START
CALLSEQ_START/CALLSEQ_END - These operators mark the beginning and end of a call sequence,...
Definition: ISDOpcodes.h:1211
@ STRICT_FRINT
Definition: ISDOpcodes.h:437
@ VECTOR_DEINTERLEAVE
VECTOR_DEINTERLEAVE(VEC1, VEC2) - Returns two vectors with all input and output vectors having the sa...
Definition: ISDOpcodes.h:595
@ GET_DYNAMIC_AREA_OFFSET
GET_DYNAMIC_AREA_OFFSET - get offset from native SP to the address of the most recent dynamic alloca.
Definition: ISDOpcodes.h:1398
@ SET_FPENV_MEM
Sets the current floating point environment.
Definition: ISDOpcodes.h:1083
@ FMINIMUMNUM
FMINIMUMNUM/FMAXIMUMNUM - minimumnum/maximumnum that is same with FMINNUM_IEEE and FMAXNUM_IEEE besid...
Definition: ISDOpcodes.h:1055
@ TRUNCATE_SSAT_S
TRUNCATE_[SU]SAT_[SU] - Truncate for saturated operand [SU] located in middle, prefix for SAT means i...
Definition: ISDOpcodes.h:832
@ ABDS
ABDS/ABDU - Absolute difference - Return the absolute difference between two numbers interpreted as s...
Definition: ISDOpcodes.h:692
@ ADJUST_TRAMPOLINE
ADJUST_TRAMPOLINE - This corresponds to the adjust_trampoline intrinsic.
Definition: ISDOpcodes.h:1276
@ TRUNCATE_USAT_U
Definition: ISDOpcodes.h:836
@ SADDO_CARRY
Carry-using overflow-aware nodes for multiple precision addition and subtraction.
Definition: ISDOpcodes.h:320
@ INTRINSIC_W_CHAIN
RESULT,OUTCHAIN = INTRINSIC_W_CHAIN(INCHAIN, INTRINSICID, arg1, ...) This node represents a target in...
Definition: ISDOpcodes.h:198
@ STRICT_FACOS
Definition: ISDOpcodes.h:426
@ TargetGlobalTLSAddress
Definition: ISDOpcodes.h:171
@ BUILD_VECTOR
BUILD_VECTOR(ELT0, ELT1, ELT2, ELT3,...) - Return a fixed-width vector with the specified,...
Definition: ISDOpcodes.h:530
bool isIndexTypeSigned(MemIndexType IndexType)
Definition: ISDOpcodes.h:1579
bool isExtVecInRegOpcode(unsigned Opcode)
Definition: ISDOpcodes.h:1689
NodeType getExtForLoadExtType(bool IsFP, LoadExtType)
bool isFPEqualitySetCC(CondCode Code)
Return true if this is a setcc instruction that performs an equality comparison when used with floati...
Definition: ISDOpcodes.h:1664
static const int FIRST_TARGET_MEMORY_OPCODE
FIRST_TARGET_MEMORY_OPCODE - Target-specific pre-isel operations which do not reference a specific me...
Definition: ISDOpcodes.h:1502
bool isExtOpcode(unsigned Opcode)
Definition: ISDOpcodes.h:1684
static const int LAST_LOADEXT_TYPE
Definition: ISDOpcodes.h:1595
bool isVPBinaryOp(unsigned Opcode)
Whether this is a vector-predicated binary operation opcode.
CondCode getSetCCInverse(CondCode Operation, EVT Type)
Return the operation corresponding to !(X op Y), where 'op' is a valid SetCC operation.
std::optional< unsigned > getBaseOpcodeForVP(unsigned Opcode, bool hasFPExcept)
Translate this VP Opcode to its corresponding non-VP Opcode.
bool isBitwiseLogicOp(unsigned Opcode)
Whether this is bitwise logic opcode.
Definition: ISDOpcodes.h:1505
bool isTrueWhenEqual(CondCode Cond)
Return true if the specified condition returns true if the two operands to the condition are equal.
Definition: ISDOpcodes.h:1671
std::optional< unsigned > getVPMaskIdx(unsigned Opcode)
The operand position of the vector mask.
static const int LAST_MEM_INDEX_TYPE
Definition: ISDOpcodes.h:1577
unsigned getUnorderedFlavor(CondCode Cond)
This function returns 0 if the condition is always false if an operand is a NaN, 1 if the condition i...
Definition: ISDOpcodes.h:1676
std::optional< unsigned > getVPExplicitVectorLengthIdx(unsigned Opcode)
The operand position of the explicit vector length parameter.
CondCode getSetCCSwappedOperands(CondCode Operation)
Return the operation corresponding to (Y op X) when given the operation for (X op Y).
std::optional< unsigned > getVPForBaseOpcode(unsigned Opcode)
Translate this non-VP Opcode to its corresponding VP Opcode.
MemIndexType
MemIndexType enum - This enum defines how to interpret MGATHER/SCATTER's index parameter when calcula...
Definition: ISDOpcodes.h:1575
@ UNSIGNED_SCALED
Definition: ISDOpcodes.h:1575
bool isSignedIntSetCC(CondCode Code)
Return true if this is a setcc instruction that performs a signed comparison when used with integer o...
Definition: ISDOpcodes.h:1646
bool isVPReduction(unsigned Opcode)
Whether this is a vector-predicated reduction opcode.
MemIndexedMode
MemIndexedMode enum - This enum defines the load / store indexed addressing modes.
Definition: ISDOpcodes.h:1562
static const int FIRST_TARGET_STRICTFP_OPCODE
FIRST_TARGET_STRICTFP_OPCODE - Target-specific pre-isel operations which cannot raise FP exceptions s...
Definition: ISDOpcodes.h:1496
CondCode
ISD::CondCode enum - These are ordered carefully to make the bitfields below work out,...
Definition: ISDOpcodes.h:1613
NodeType getVecReduceBaseOpcode(unsigned VecReduceOpcode)
Get underlying scalar opcode for VECREDUCE opcode.
LoadExtType
LoadExtType enum - This enum defines the three variants of LOADEXT (load with extension).
Definition: ISDOpcodes.h:1593
bool isUnsignedIntSetCC(CondCode Code)
Return true if this is a setcc instruction that performs an unsigned comparison when used with intege...
Definition: ISDOpcodes.h:1652
static const int LAST_INDEXED_MODE
Definition: ISDOpcodes.h:1564
bool isVPOpcode(unsigned Opcode)
Whether this is a vector-predicated Opcode.
CondCode getSetCCOrOperation(CondCode Op1, CondCode Op2, EVT Type)
Return the result of a logical OR between different comparisons of identical values: ((X op1 Y) | (X ...
bool isIntEqualitySetCC(CondCode Code)
Return true if this is a setcc instruction that performs an equality comparison when used with intege...
Definition: ISDOpcodes.h:1658
This is an optimization pass for GlobalISel generic memory operations.
Definition: AddressRanges.h:18
Extended Value Type.
Definition: ValueTypes.h:35