Merges shuffle masks and emits final shuffle instruction, if required. More...
Public Member Functions | |
| ShuffleCostEstimator (Type *ScalarTy, TargetTransformInfo &TTI, ArrayRef< Value * > VectorizedVals, BoUpSLP &R, SmallPtrSetImpl< Value * > &CheckedExtracts) | |
| Value * | adjustExtracts (const TreeEntry *E, MutableArrayRef< int > Mask, ArrayRef< std::optional< TTI::ShuffleKind > > ShuffleKinds, unsigned NumParts, bool &UseVecBaseAsInput) |
| std::optional< InstructionCost > | needToDelay (const TreeEntry *, ArrayRef< SmallVector< const TreeEntry * > >) const |
Checks if the specified entry E needs to be delayed because of its dependency nodes. | |
| void | add (const TreeEntry &E1, const TreeEntry &E2, ArrayRef< int > Mask) |
| void | add (const TreeEntry &E1, ArrayRef< int > Mask) |
| void | add (Value *V1, Value *V2, ArrayRef< int > Mask) |
| Adds 2 input vectors and the mask for their shuffling. | |
| void | add (Value *V1, ArrayRef< int > Mask, bool ForExtracts=false) |
| Adds another one input vector and the mask for the shuffling. | |
| Value * | gather (ArrayRef< Value * > VL, unsigned MaskVF=0, Value *Root=nullptr) |
| InstructionCost | createFreeze (InstructionCost Cost) |
| InstructionCost | finalize (ArrayRef< int > ExtMask, ArrayRef< std::pair< const TreeEntry *, unsigned > > SubVectors, ArrayRef< int > SubVectorsMask, unsigned VF=0, function_ref< void(Value *&, SmallVectorImpl< int > &)> Action={}) |
| Finalize emission of the shuffles. | |
| ~ShuffleCostEstimator () | |
Detailed Description
Merges shuffle masks and emits final shuffle instruction, if required.
It supports shuffling of 2 input vectors. It implements lazy shuffles emission, when the actual shuffle instruction is generated only if this is actually required. Otherwise, the shuffle instruction emission is delayed till the end of the process, to reduce the number of emitted instructions and further analysis/transformations.
Definition at line 10001 of file SLPVectorizer.cpp.
Constructor & Destructor Documentation
◆ ShuffleCostEstimator()
|
inline |
Definition at line 10543 of file SLPVectorizer.cpp.
◆ ~ShuffleCostEstimator()
|
inline |
Definition at line 10911 of file SLPVectorizer.cpp.
References assert(), and llvm::SmallVectorBase< Size_T >::empty().
Member Function Documentation
◆ add() [1/4]
|
inline |
Definition at line 10689 of file SLPVectorizer.cpp.
References assert(), llvm::SmallVectorImpl< T >::assign(), llvm::SmallVectorImpl< T >::emplace_back(), llvm::SmallVectorBase< Size_T >::empty(), llvm::find_if(), llvm::TargetTransformInfo::getNumberOfParts(), getPartNumElems(), getWidenedType(), llvm::hasFullVectorsOrPowerOf2(), Idx, llvm::PoisonMaskElem, and llvm::SmallVectorBase< Size_T >::size().
◆ add() [2/4]
|
inline |
Definition at line 10660 of file SLPVectorizer.cpp.
References llvm::all_of(), assert(), llvm::SmallVectorImpl< T >::assign(), llvm::SmallVectorBase< Size_T >::empty(), llvm::find_if(), llvm::TargetTransformInfo::getNumberOfParts(), getPartNumElems(), getWidenedType(), llvm::hasFullVectorsOrPowerOf2(), Idx, and llvm::PoisonMaskElem.
◆ add() [3/4]
|
inline |
Adds another one input vector and the mask for the shuffling.
Definition at line 10729 of file SLPVectorizer.cpp.
References llvm::all_of(), assert(), llvm::SmallVectorImpl< T >::assign(), llvm::SmallVectorTemplateCommon< T, typename >::back(), llvm::SmallVectorBase< Size_T >::empty(), llvm::enumerate(), llvm::SmallVectorTemplateCommon< T, typename >::front(), Idx, if(), P, llvm::PoisonMaskElem, llvm::SmallVectorTemplateBase< T, bool >::push_back(), and llvm::SmallVectorBase< Size_T >::size().
◆ add() [4/4]
|
inline |
Adds 2 input vectors and the mask for their shuffling.
Definition at line 10712 of file SLPVectorizer.cpp.
References llvm::all_of(), assert(), llvm::enumerate(), llvm::SmallVectorTemplateCommon< T, typename >::front(), P, llvm::PoisonMaskElem, and llvm::SmallVectorBase< Size_T >::size().
◆ adjustExtracts()
|
inline |
Definition at line 10549 of file SLPVectorizer.cpp.
References llvm::any_of(), llvm::reorderScalars(), and llvm::ArrayRef< T >::take_front().
◆ createFreeze()
|
inline |
Definition at line 10821 of file SLPVectorizer.cpp.
◆ finalize()
|
inline |
Finalize emission of the shuffles.
Definition at line 10824 of file SLPVectorizer.cpp.
◆ gather()
|
inline |
Definition at line 10778 of file SLPVectorizer.cpp.
References assert(), llvm::SmallVectorTemplateCommon< T, typename >::begin(), llvm::enumerate(), llvm::SmallVectorTemplateCommon< T, typename >::front(), llvm::ConstantVector::get(), llvm::UndefValue::get(), llvm::PoisonValue::get(), llvm::ElementCount::getFixed(), llvm::Constant::getNullValue(), llvm::FixedVectorType::getNumElements(), llvm::Type::getScalarType(), llvm::ConstantVector::getSplat(), llvm::Value::getType(), I, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::ArrayRef< T >::size(), SLPReVec, llvm::SmallVectorImpl< T >::swap(), and llvm::ArrayRef< T >::take_front().
◆ needToDelay()
|
inline |
Checks if the specified entry E needs to be delayed because of its dependency nodes.
Definition at line 10655 of file SLPVectorizer.cpp.
The documentation for this class was generated from the following file:
- lib/Transforms/Vectorize/SLPVectorizer.cpp
