llvm::VPPartialReductionRecipe Class Reference
A recipe for forming partial reductions. More...
#include "Transforms/Vectorize/VPlan.h"
Inheritance diagram for llvm::VPPartialReductionRecipe:
Public Member Functions | |
| VPPartialReductionRecipe (Instruction *ReductionInst, VPValue *Op0, VPValue *Op1, VPValue *Cond, unsigned VFScaleFactor) | |
| VPPartialReductionRecipe (unsigned Opcode, VPValue *Op0, VPValue *Op1, VPValue *Cond, unsigned ScaleFactor, Instruction *ReductionInst=nullptr) | |
| ~VPPartialReductionRecipe () override=default | |
| VPPartialReductionRecipe * | clone () override |
| Clone the current recipe. | |
| void | execute (VPTransformState &State) override |
| Generate the reduction in the loop. | |
| InstructionCost | computeCost (ElementCount VF, VPCostContext &Ctx) const override |
| Return the cost of this VPPartialReductionRecipe. | |
| unsigned | getOpcode () const |
| Get the binary op's opcode. | |
| unsigned | getVFScaleFactor () const |
| Get the factor that the VF of this recipe's output should be scaled by. | |
| void | print (raw_ostream &O, const Twine &Indent, VPSlotTracker &SlotTracker) const override |
| Print the recipe. | |
| Public Member Functions inherited from llvm::VPReductionRecipe | |
| VPReductionRecipe (RecurKind RdxKind, FastMathFlags FMFs, Instruction *I, VPValue *ChainOp, VPValue *VecOp, VPValue *CondOp, bool IsOrdered, DebugLoc DL=DebugLoc::getUnknown()) | |
| VPReductionRecipe (const RecurKind RdxKind, FastMathFlags FMFs, VPValue *ChainOp, VPValue *VecOp, VPValue *CondOp, bool IsOrdered, DebugLoc DL=DebugLoc::getUnknown()) | |
| ~VPReductionRecipe () override=default | |
| VPReductionRecipe * | clone () override |
| Clone the current recipe. | |
| void | execute (VPTransformState &State) override |
| Generate the reduction in the loop. | |
| InstructionCost | computeCost (ElementCount VF, VPCostContext &Ctx) const override |
| Return the cost of VPReductionRecipe. | |
| void | print (raw_ostream &O, const Twine &Indent, VPSlotTracker &SlotTracker) const override |
| Print the recipe. | |
| RecurKind | getRecurrenceKind () const |
| Return the recurrence kind for the in-loop reduction. | |
| bool | isOrdered () const |
| Return true if the in-loop reduction is ordered. | |
| bool | isConditional () const |
| Return true if the in-loop reduction is conditional. | |
| VPValue * | getChainOp () const |
| The VPValue of the scalar Chain being accumulated. | |
| VPValue * | getVecOp () const |
| The VPValue of the vector value to be reduced. | |
| VPValue * | getCondOp () const |
| The VPValue of the condition for the block. | |
| Public Member Functions inherited from llvm::VPRecipeWithIRFlags | |
| VPRecipeWithIRFlags (const unsigned char SC, ArrayRef< VPValue * > Operands, DebugLoc DL=DebugLoc::getUnknown()) | |
| VPRecipeWithIRFlags (const unsigned char SC, ArrayRef< VPValue * > Operands, Instruction &I) | |
| VPRecipeWithIRFlags (const unsigned char SC, ArrayRef< VPValue * > Operands, const VPIRFlags &Flags, DebugLoc DL=DebugLoc::getUnknown()) | |
| std::optional< InstructionCost > | getCostForRecipeWithOpcode (unsigned Opcode, ElementCount VF, VPCostContext &Ctx) const |
Compute the cost for this recipe for VF, using Opcode and Ctx. | |
| Public Member Functions inherited from llvm::VPSingleDefRecipe | |
| VPSingleDefRecipe (const unsigned char SC, ArrayRef< VPValue * > Operands, DebugLoc DL=DebugLoc::getUnknown()) | |
| VPSingleDefRecipe (const unsigned char SC, ArrayRef< VPValue * > Operands, Value *UV, DebugLoc DL=DebugLoc::getUnknown()) | |
| Instruction * | getUnderlyingInstr () |
| Returns the underlying instruction. | |
| const Instruction * | getUnderlyingInstr () const |
| LLVM_DUMP_METHOD void | dump () const |
| Print this VPSingleDefRecipe to dbgs() (for debugging). | |
| Public Member Functions inherited from llvm::VPRecipeBase | |
| VPRecipeBase (const unsigned char SC, ArrayRef< VPValue * > Operands, DebugLoc DL=DebugLoc::getUnknown()) | |
| virtual | ~VPRecipeBase ()=default |
| VPBasicBlock * | getParent () |
| const VPBasicBlock * | getParent () const |
| InstructionCost | cost (ElementCount VF, VPCostContext &Ctx) |
| Return the cost of this recipe, taking into account if the cost computation should be skipped and the ForceTargetInstructionCost flag. | |
| void | insertBefore (VPRecipeBase *InsertPos) |
| Insert an unlinked recipe into a basic block immediately before the specified recipe. | |
| void | insertBefore (VPBasicBlock &BB, iplist< VPRecipeBase >::iterator IP) |
Insert an unlinked recipe into BB immediately before the insertion point IP;. | |
| void | insertAfter (VPRecipeBase *InsertPos) |
| Insert an unlinked Recipe into a basic block immediately after the specified Recipe. | |
| void | moveAfter (VPRecipeBase *MovePos) |
| Unlink this recipe from its current VPBasicBlock and insert it into the VPBasicBlock that MovePos lives in, right after MovePos. | |
| void | moveBefore (VPBasicBlock &BB, iplist< VPRecipeBase >::iterator I) |
| Unlink this recipe and insert into BB before I. | |
| void | removeFromParent () |
| This method unlinks 'this' from the containing basic block, but does not delete it. | |
| iplist< VPRecipeBase >::iterator | eraseFromParent () |
| This method unlinks 'this' from the containing basic block and deletes it. | |
| bool | mayHaveSideEffects () const |
| Returns true if the recipe may have side-effects. | |
| bool | isPhi () const |
| Returns true for PHI-like recipes. | |
| bool | mayReadFromMemory () const |
| Returns true if the recipe may read from memory. | |
| bool | mayWriteToMemory () const |
| Returns true if the recipe may write to memory. | |
| bool | mayReadOrWriteMemory () const |
| Returns true if the recipe may read from or write to memory. | |
| DebugLoc | getDebugLoc () const |
| Returns the debug location of the recipe. | |
| bool | isScalarCast () const |
| Return true if the recipe is a scalar cast. | |
| void | setDebugLoc (DebugLoc NewDL) |
Set the recipe's debug location to NewDL. | |
| Public Member Functions inherited from llvm::ilist_node_with_parent< VPRecipeBase, VPBasicBlock > | |
| VPRecipeBase * | getPrevNode () |
| VPRecipeBase * | getNextNode () |
Get the next node, or nullptr for the list tail. | |
| Public Member Functions inherited from llvm::ilist_node_impl< ilist_detail::compute_node_options< VPRecipeBase, Options... >::type > | |
| self_iterator | getIterator () |
| reverse_self_iterator | getReverseIterator () |
| std::enable_if_t< T::is_sentinel_tracking_explicit, bool > | isSentinel () const |
| Check whether this is the sentinel node. | |
| Public Member Functions inherited from llvm::ilist_detail::node_parent_access< ilist_node_impl< ilist_detail::compute_node_options< VPRecipeBase, Options... >::type >, ilist_detail::compute_node_options< VPRecipeBase, Options... >::type::parent_ty > | |
| const ilist_detail::compute_node_options< VPRecipeBase, Options... >::type::parent_ty * | getParent () const |
| void | setParent (ilist_detail::compute_node_options< VPRecipeBase, Options... >::type::parent_ty *Parent) |
| Public Member Functions inherited from llvm::VPDef | |
| VPDef (const unsigned char SC) | |
| virtual | ~VPDef () |
| VPValue * | getVPSingleValue () |
| Returns the only VPValue defined by the VPDef. | |
| const VPValue * | getVPSingleValue () const |
| VPValue * | getVPValue (unsigned I) |
Returns the VPValue with index I defined by the VPDef. | |
| const VPValue * | getVPValue (unsigned I) const |
| ArrayRef< VPValue * > | definedValues () |
| Returns an ArrayRef of the values defined by the VPDef. | |
| ArrayRef< VPValue * > | definedValues () const |
| Returns an ArrayRef of the values defined by the VPDef. | |
| unsigned | getNumDefinedValues () const |
| Returns the number of values defined by the VPDef. | |
| unsigned | getVPDefID () const |
| void | dump () const |
| Dump the VPDef to stderr (for debugging). | |
| Public Member Functions inherited from llvm::VPUser | |
| VPUser ()=delete | |
| VPUser (const VPUser &)=delete | |
| VPUser & | operator= (const VPUser &)=delete |
| virtual | ~VPUser () |
| void | addOperand (VPValue *Operand) |
| unsigned | getNumOperands () const |
| VPValue * | getOperand (unsigned N) const |
| void | setOperand (unsigned I, VPValue *New) |
| void | swapOperands () |
| Swap operands of the VPUser. It must have exactly 2 operands. | |
| void | replaceUsesOfWith (VPValue *From, VPValue *To) |
Replaces all uses of From in the VPUser with To. | |
| operand_iterator | op_begin () |
| const_operand_iterator | op_begin () const |
| operand_iterator | op_end () |
| const_operand_iterator | op_end () const |
| operand_range | operands () |
| const_operand_range | operands () const |
| virtual bool | usesScalars (const VPValue *Op) const |
Returns true if the VPUser uses scalars of operand Op. | |
| virtual bool | onlyFirstLaneUsed (const VPValue *Op) const |
Returns true if the VPUser only uses the first lane of operand Op. | |
| virtual bool | onlyFirstPartUsed (const VPValue *Op) const |
Returns true if the VPUser only uses the first part of operand Op. | |
| Public Member Functions inherited from llvm::VPValue | |
| Value * | getUnderlyingValue () const |
| Return the underlying Value attached to this VPValue. | |
| VPValue (const VPValue &)=delete | |
| VPValue & | operator= (const VPValue &)=delete |
| virtual | ~VPValue () |
| unsigned | getVPValueID () const |
| void | printAsOperand (raw_ostream &OS, VPSlotTracker &Tracker) const |
| void | print (raw_ostream &OS, VPSlotTracker &Tracker) const |
| void | dump () const |
| Dump the value to stderr (for debugging). | |
| unsigned | getNumUsers () const |
| void | addUser (VPUser &User) |
| void | removeUser (VPUser &User) |
Remove a single User from the list of users. | |
| user_iterator | user_begin () |
| const_user_iterator | user_begin () const |
| user_iterator | user_end () |
| const_user_iterator | user_end () const |
| user_range | users () |
| const_user_range | users () const |
| bool | hasMoreThanOneUniqueUser () const |
| Returns true if the value has more than one unique user. | |
| void | replaceAllUsesWith (VPValue *New) |
| void | replaceUsesWithIf (VPValue *New, llvm::function_ref< bool(VPUser &U, unsigned Idx)> ShouldReplace) |
Go through the uses list for this VPValue and make each use point to New if the callback ShouldReplace returns true for the given use specified by a pair of (VPUser, the use index). | |
| VPRecipeBase * | getDefiningRecipe () |
| Returns the recipe defining this VPValue or nullptr if it is not defined by a recipe, i.e. | |
| const VPRecipeBase * | getDefiningRecipe () const |
| bool | hasDefiningRecipe () const |
| Returns true if this VPValue is defined by a recipe. | |
| bool | isLiveIn () const |
| Returns true if this VPValue is a live-in, i.e. defined outside the VPlan. | |
| Value * | getLiveInIRValue () const |
| Returns the underlying IR value, if this VPValue is defined outside the scope of VPlan. | |
| bool | isDefinedOutsideLoopRegions () const |
| Returns true if the VPValue is defined outside any loop. | |
| void | setUnderlyingValue (Value *Val) |
| Public Member Functions inherited from llvm::VPIRFlags | |
| VPIRFlags () | |
| VPIRFlags (Instruction &I) | |
| VPIRFlags (CmpInst::Predicate Pred) | |
| VPIRFlags (WrapFlagsTy WrapFlags) | |
| VPIRFlags (FastMathFlags FMFs) | |
| VPIRFlags (DisjointFlagsTy DisjointFlags) | |
| VPIRFlags (NonNegFlagsTy NonNegFlags) | |
| VPIRFlags (GEPNoWrapFlags GEPFlags) | |
| void | transferFlags (VPIRFlags &Other) |
| void | dropPoisonGeneratingFlags () |
| Drop all poison-generating flags. | |
| void | applyFlags (Instruction &I) const |
Apply the IR flags to I. | |
| CmpInst::Predicate | getPredicate () const |
| void | setPredicate (CmpInst::Predicate Pred) |
| GEPNoWrapFlags | getGEPNoWrapFlags () const |
| bool | hasPredicate () const |
| Returns true if the recipe has a comparison predicate. | |
| bool | hasFastMathFlags () const |
| Returns true if the recipe has fast-math flags. | |
| LLVM_ABI_FOR_TEST FastMathFlags | getFastMathFlags () const |
| bool | hasNonNegFlag () const |
| Returns true if the recipe has non-negative flag. | |
| bool | isNonNeg () const |
| bool | hasNoUnsignedWrap () const |
| bool | hasNoSignedWrap () const |
| bool | isDisjoint () const |
| bool | flagsValidForOpcode (unsigned Opcode) const |
Returns true if the set flags are valid for Opcode. | |
| void | printFlags (raw_ostream &O) const |
Additional Inherited Members | |
| Public Types inherited from llvm::VPDef | |
| using | VPRecipeTy |
| An enumeration for keeping track of the concrete subclass of VPRecipeBase that is actually instantiated. | |
| Public Types inherited from llvm::VPUser | |
| typedef SmallVectorImpl< VPValue * >::iterator | operand_iterator |
| typedef SmallVectorImpl< VPValue * >::const_iterator | const_operand_iterator |
| typedef iterator_range< operand_iterator > | operand_range |
| typedef iterator_range< const_operand_iterator > | const_operand_range |
| Public Types inherited from llvm::VPValue | |
| enum | { VPValueSC , VPVRecipeSC } |
| An enumeration for keeping track of the concrete subclass of VPValue that are actually instantiated. More... | |
| typedef SmallVectorImpl< VPUser * >::iterator | user_iterator |
| typedef SmallVectorImpl< VPUser * >::const_iterator | const_user_iterator |
| typedef iterator_range< user_iterator > | user_range |
| typedef iterator_range< const_user_iterator > | const_user_range |
| Static Public Member Functions inherited from llvm::VPReductionRecipe | |
| static bool | classof (const VPRecipeBase *R) |
| static bool | classof (const VPUser *U) |
| Static Public Member Functions inherited from llvm::VPRecipeWithIRFlags | |
| static bool | classof (const VPRecipeBase *R) |
| static bool | classof (const VPUser *U) |
| static bool | classof (const VPValue *V) |
| static bool | classof (const VPSingleDefRecipe *U) |
| Static Public Member Functions inherited from llvm::VPSingleDefRecipe | |
| static bool | classof (const VPRecipeBase *R) |
| static bool | classof (const VPUser *U) |
| Static Public Member Functions inherited from llvm::VPRecipeBase | |
| static bool | classof (const VPDef *D) |
| Method to support type inquiry through isa, cast, and dyn_cast. | |
| static bool | classof (const VPUser *U) |
| Protected Types inherited from llvm::ilist_node_impl< ilist_detail::compute_node_options< VPRecipeBase, Options... >::type > | |
| using | self_iterator |
| using | const_self_iterator |
| using | reverse_self_iterator |
| using | const_reverse_self_iterator |
| Protected Member Functions inherited from llvm::VPReductionRecipe | |
| VPReductionRecipe (const unsigned char SC, RecurKind RdxKind, FastMathFlags FMFs, Instruction *I, ArrayRef< VPValue * > Operands, VPValue *CondOp, bool IsOrdered, DebugLoc DL) | |
| Protected Member Functions inherited from llvm::ilist_node_with_parent< VPRecipeBase, VPBasicBlock > | |
| ilist_node_with_parent ()=default | |
| Protected Member Functions inherited from llvm::ilist_node_impl< ilist_detail::compute_node_options< VPRecipeBase, Options... >::type > | |
| ilist_node_impl ()=default | |
| Protected Member Functions inherited from llvm::VPUser | |
| void | printOperands (raw_ostream &O, VPSlotTracker &SlotTracker) const |
Print the operands to O. | |
| VPUser (ArrayRef< VPValue * > Operands) | |
| Protected Member Functions inherited from llvm::VPValue | |
| VPValue (const unsigned char SC, Value *UV=nullptr, VPDef *Def=nullptr) | |
| VPValue (Value *UV=nullptr) | |
| Create a live-in VPValue. | |
| VPValue (VPDef *Def, Value *UV=nullptr) | |
Create a VPValue for a Def which is a subclass of VPValue. | |
| VPValue (Value *UV, VPDef *Def) | |
Create a VPValue for a Def which defines multiple values. | |
| Protected Attributes inherited from llvm::VPValue | |
| Value * | UnderlyingVal |
| VPDef * | Def |
| Pointer to the VPDef that defines this VPValue. | |
Detailed Description
A recipe for forming partial reductions.
In the loop, an accumulator and vector operand are added together and passed to the next iteration as the next accumulator. After the loop body, the accumulator is reduced to a scalar value.
Constructor & Destructor Documentation
◆ VPPartialReductionRecipe() [1/2]
|
inline |
Definition at line 2747 of file VPlan.h.
References Cond, getOpcode(), and VPPartialReductionRecipe().
Referenced by clone(), and VPPartialReductionRecipe().
◆ VPPartialReductionRecipe() [2/2]
|
inline |
Definition at line 2751 of file VPlan.h.
References llvm::Add, Cond, and llvm::VPReductionRecipe::VPReductionRecipe().
◆ ~VPPartialReductionRecipe()
|
overridedefault |
Member Function Documentation
◆ clone()
|
inlineoverridevirtual |
Clone the current recipe.
Implements llvm::VPSingleDefRecipe.
Definition at line 2766 of file VPlan.h.
References llvm::VPReductionRecipe::getCondOp(), llvm::VPUser::getOperand(), llvm::VPSingleDefRecipe::getUnderlyingInstr(), and VPPartialReductionRecipe().
◆ computeCost()
|
overridevirtual |
Return the cost of this VPPartialReductionRecipe.
Reimplemented from llvm::VPRecipeBase.
Definition at line 299 of file VPlanRecipes.cpp.
References llvm::dyn_cast(), llvm::VPValue::getDefiningRecipe(), getOpcode(), llvm::VPUser::getOperand(), llvm::isa(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_Sub(), llvm::VPlanPatternMatch::m_VPValue(), llvm::PatternMatch::match(), llvm::TargetTransformInfo::PR_None, llvm::TargetTransformInfo::PR_SignExtend, llvm::TargetTransformInfo::PR_ZeroExtend, and Widen().
◆ execute()
|
overridevirtual |
Generate the reduction in the loop.
Implements llvm::VPRecipeWithIRFlags.
Definition at line 366 of file VPlanRecipes.cpp.
References assert(), getOpcode(), llvm::VPUser::getOperand(), and llvm::Value::getType().
◆ getOpcode()
|
inline |
Get the binary op's opcode.
Definition at line 2782 of file VPlan.h.
Referenced by computeCost(), execute(), print(), and VPPartialReductionRecipe().
◆ getVFScaleFactor()
|
inline |
◆ print()
|
overridevirtual |
Print the recipe.
Implements llvm::VPDef.
Definition at line 386 of file VPlanRecipes.cpp.
References getOpcode(), llvm::Instruction::getOpcodeName(), llvm::VPValue::printAsOperand(), and llvm::VPUser::printOperands().
The documentation for this class was generated from the following files:
- lib/Transforms/Vectorize/VPlan.h
- lib/Transforms/Vectorize/VPlanRecipes.cpp
Generated on for LLVM by
1.14.0