LLVM
15.0.0git
|
#include "Transforms/InstCombine/InstCombineInternal.h"
Additional Inherited Members | |
![]() | |
using | BuilderTy = IRBuilder< TargetFolder, IRBuilderCallbackInserter > |
An IRBuilder that automatically inserts new instructions into the worklist. More... | |
![]() | |
static Value * | peekThroughBitcast (Value *V, bool OneUseOnly=false) |
Return the source operand of a potentially bitcasted value while optionally checking if it has one use. More... | |
static unsigned | getComplexity (Value *V) |
Assign a complexity or rank value to LLVM Values. More... | |
static bool | isCanonicalPredicate (CmpInst::Predicate Pred) |
Predicate canonicalization reduces the number of patterns that need to be matched by other transforms. More... | |
static bool | isSignBitCheck (ICmpInst::Predicate Pred, const APInt &RHS, bool &TrueIfSigned) |
Given an exploded icmp instruction, return true if the comparison only checks the sign bit. More... | |
static Constant * | AddOne (Constant *C) |
Add one to a Constant. More... | |
static Constant * | SubOne (Constant *C) |
Subtract one from a Constant. More... | |
static llvm::Optional< std::pair< CmpInst::Predicate, Constant * > > | getFlippedStrictnessPredicateAndConstant (CmpInst::Predicate Pred, Constant *C) |
static bool | shouldAvoidAbsorbingNotIntoSelect (const SelectInst &SI) |
static bool | isFreeToInvert (Value *V, bool WillInvertAllUses) |
Return true if the specified value is free to invert (apply ~ to). More... | |
static bool | canFreelyInvertAllUsersOf (Value *V, Value *IgnoredUser) |
Given i1 V, can every user of V be freely adapted if V is changed to !V ? InstCombine's freelyInvertAllUsersOf() must be kept in sync with this fn. More... | |
static Constant * | getSafeVectorConstantForBinop (BinaryOperator::BinaryOps Opcode, Constant *In, bool IsRHSConstant) |
Some binary operators require special handling to avoid poison and undefined behavior. More... | |
![]() | |
uint64_t | MaxArraySizeForCombine = 0 |
Maximum size of array considered when transforming. More... | |
BuilderTy & | Builder |
![]() | |
InstructionWorklist & | Worklist |
A worklist of the instructions that need to be simplified. More... | |
const bool | MinimizeSize |
AAResults * | AA |
AssumptionCache & | AC |
TargetLibraryInfo & | TLI |
DominatorTree & | DT |
const DataLayout & | DL |
const SimplifyQuery | SQ |
OptimizationRemarkEmitter & | ORE |
BlockFrequencyInfo * | BFI |
ProfileSummaryInfo * | PSI |
LoopInfo * | LI |
bool | MadeIRChange = false |
Definition at line 61 of file InstCombineInternal.h.
|
inline |
Definition at line 65 of file InstCombineInternal.h.
|
virtualdefault |
Instruction * InstCombinerImpl::canonicalizeCondSignextOfHighBitExtractToSignextHighBitExtract | ( | BinaryOperator & | I | ) |
Definition at line 1136 of file InstCombineAddSub.cpp.
References llvm::MCID::Add, assert(), Builder, llvm::CastInst::CreateTruncOrBitCast(), llvm::Value::getName(), I, llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_CombineAnd(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_SExtOrSelf(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt_ICMP(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_TruncOrSelf(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::m_ZExtOrSelf(), llvm::PatternMatch::match(), llvm::MCID::Select, std::swap(), and X.
If we have a comparison with a non-canonical predicate, if we can update all the users, invert the predicate and adjust all the users.
Definition at line 5795 of file InstCombineCompares.cpp.
References llvm::InstCombiner::canFreelyInvertAllUsersOf(), llvm::CmpInst::getInversePredicate(), I, and llvm::InstCombiner::isCanonicalPredicate().
LoadInst * InstCombinerImpl::combineLoadToNewType | ( | LoadInst & | LI, |
Type * | NewTy, | ||
const Twine & | Suffix = "" |
||
) |
Helper to combine a load to a new type.
This just does the work of combining a load to a new type. It handles metadata, etc., and returns the new instruction. The NewTy
should be the loaded value type. This will convert it to a pointer, cast the operand to that pointer type, load it, etc.
Note that this will create all of the instructions with whatever insert point the InstCombinerImpl
currently is using.
Definition at line 460 of file InstCombineLoadStoreAlloca.cpp.
References assert(), Builder, llvm::copyMetadataForLoad(), llvm::LoadInst::getAlign(), llvm::Value::getName(), llvm::LoadInst::getOrdering(), llvm::LoadInst::getPointerAddressSpace(), llvm::LoadInst::getPointerOperand(), llvm::Type::getPointerTo(), llvm::LoadInst::getSyncScopeID(), llvm::Value::getType(), llvm::Instruction::isAtomic(), isSupportedAtomicType(), llvm::LoadInst::isVolatile(), llvm::PatternMatch::m_BitCast(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), and llvm::LoadInst::setAtomic().
Referenced by combineLoadToOperationType(), removeBitcastsFromLoadStoreOnMinMax(), and unpackLoadToAggregate().
Instruction * InstCombinerImpl::commonCastTransforms | ( | CastInst & | CI | ) |
Implement the transforms common to all CastInst visitors.
Definition at line 280 of file InstCombineCasts.cpp.
References Builder, llvm::CastInst::Create(), llvm::CastInst::getOpcode(), llvm::User::getOperand(), llvm::Type::getPrimitiveSizeInBits(), llvm::CastInst::getSrcTy(), llvm::Value::getType(), llvm::Type::isIntegerTy(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Shuffle(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), llvm::replaceAllDbgUsesWith(), and X.
Instruction * InstCombinerImpl::commonIDivTransforms | ( | BinaryOperator & | I | ) |
This function implements the transforms common to both integer division instructions (udiv and sdiv).
It is called by the visitors to those integer division instructions. Common integer divide transforms
Definition at line 773 of file InstCombineMulDivRem.cpp.
References assert(), Builder, C1, llvm::BinaryOperator::Create(), llvm::SelectInst::Create(), llvm::ConstantInt::get(), llvm::APInt::getOneBitSet(), I, llvm::Type::isIntOrIntVectorTy(), isMultiple(), llvm::APInt::isZero(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_c_Mul(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_NSWMul(), llvm::PatternMatch::m_NSWShl(), llvm::PatternMatch::m_NUWMul(), llvm::PatternMatch::m_NUWShl(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_SDiv(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SRem(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_UDiv(), llvm::PatternMatch::m_URem(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), Mul, multiplyOverflows(), llvm::Instruction::setHasNoSignedWrap(), llvm::Instruction::setHasNoUnsignedWrap(), simplifyValueKnownNonZero(), X, and Y.
Instruction * InstCombinerImpl::commonIRemTransforms | ( | BinaryOperator & | I | ) |
This function implements the transforms common to both integer remainder instructions (urem and srem).
It is called by the visitors to those integer remainder instructions. Common integer remainder transforms
Definition at line 1435 of file InstCombineMulDivRem.cpp.
References I, llvm::APInt::isMinSignedValue(), llvm::APInt::isMinValue(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), SI, and simplifyValueKnownNonZero().
Instruction * InstCombinerImpl::commonPointerCastTransforms | ( | CastInst & | CI | ) |
Implement the transforms for cast of pointer (bitcast/ptrtoint)
Definition at line 2054 of file InstCombineCasts.cpp.
References GEP, and llvm::User::getOperand().
Instruction * InstCombinerImpl::commonShiftTransforms | ( | BinaryOperator & | I | ) |
Definition at line 370 of file InstCombineShifts.cpp.
References llvm::APInt::ashr(), assert(), llvm::BitWidth, Builder, C1, llvm::BinaryOperator::Create(), llvm::APInt::eq(), foldShiftOfShiftedLogic(), llvm::ConstantInt::get(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getSub(), llvm::Value::getType(), I, llvm::APInt::isNegative(), llvm::APInt::isZero(), llvm::APInt::lshr(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_NUWAdd(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Power2(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_SRem(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), llvm::Instruction::setHasNoUnsignedWrap(), llvm::Instruction::setIsExact(), llvm::APInt::shl(), SI, and Y.
|
inline |
Definition at line 470 of file InstCombineInternal.h.
References llvm::computeKnownBits(), llvm::Depth, and DL.
Referenced by canReplaceGEPIdxWithZero(), foldCtpop(), foldCttzCtlz(), isKnownExactCastIntToFP(), and matchFunnelShift().
|
inline |
Definition at line 475 of file InstCombineInternal.h.
References llvm::computeKnownBits(), llvm::Depth, and DL.
|
inline |
Definition at line 491 of file InstCombineInternal.h.
References llvm::ComputeNumSignBits(), llvm::Depth, and DL.
Referenced by canEvaluateTruncated().
OverflowResult InstCombinerImpl::computeOverflow | ( | Instruction::BinaryOps | BinaryOp, |
bool | IsSigned, | ||
Value * | LHS, | ||
Value * | RHS, | ||
Instruction * | CxtI | ||
) | const |
Definition at line 4964 of file InstCombineCompares.cpp.
References llvm::MCID::Add, llvm::computeOverflowForSignedAdd(), llvm::computeOverflowForSignedMul(), llvm::computeOverflowForSignedSub(), llvm::computeOverflowForUnsignedAdd(), llvm::computeOverflowForUnsignedMul(), llvm::computeOverflowForUnsignedSub(), LHS, llvm_unreachable, Mul, and RHS.
|
inline |
Definition at line 514 of file InstCombineInternal.h.
References llvm::computeOverflowForSignedAdd(), DL, LHS, and RHS.
|
inline |
Definition at line 502 of file InstCombineInternal.h.
References llvm::computeOverflowForSignedMul(), DL, LHS, and RHS.
|
inline |
Definition at line 526 of file InstCombineInternal.h.
References llvm::computeOverflowForSignedSub(), DL, LHS, and RHS.
|
inline |
Definition at line 508 of file InstCombineInternal.h.
References llvm::computeOverflowForUnsignedAdd(), DL, LHS, and RHS.
|
inline |
Definition at line 496 of file InstCombineInternal.h.
References llvm::computeOverflowForUnsignedMul(), DL, LHS, and RHS.
|
inline |
Definition at line 520 of file InstCombineInternal.h.
References llvm::computeOverflowForUnsignedSub(), DL, LHS, and RHS.
|
inline |
Create and insert the idiom we use to indicate a block is unreachable without having to rewrite the CFG from within InstCombine.
Definition at line 440 of file InstCombineInternal.h.
References llvm::PoisonValue::get(), llvm::Value::getContext(), llvm::Type::getInt1PtrTy(), and llvm::ConstantInt::getTrue().
Returns a value X such that Val = X * Scale, or null if none.
Return a value X such that Val = X * Scale, or null if none.
If the multiplication is known not to overflow then NoSignedWrap is set.
If the multiplication is known not to overflow, then NoSignedWrap is set.
Definition at line 1396 of file InstructionCombining.cpp.
References assert(), llvm::APInt::exactLogBase2(), llvm::ConstantInt::get(), llvm::APInt::getBitWidth(), llvm::Instruction::getOpcode(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Value::getType(), llvm::Instruction::hasNoSignedWrap(), hasOneUse(), llvm::Value::hasOneUse(), llvm::APInt::isMinValue(), LHS, llvm::PatternMatch::m_Zero(), llvm::PatternMatch::match(), Mul, RHS, llvm::APInt::sdivrem(), llvm::Instruction::setHasNoSignedWrap(), llvm::APInt::sext(), llvm::APInt::trunc(), and llvm::Instruction::user_back().
bool InstCombinerImpl::dominatesAllUses | ( | const Instruction * | DI, |
const Instruction * | UI, | ||
const BasicBlock * | DB | ||
) | const |
True when DB dominates all uses of DI except UI.
Check that one use is in the same block as the definition and all other uses are in blocks dominated by a given block.
UI must be in the same block as DI. The routine checks that the DI parent and DB are different.
DI | Definition |
UI | Use |
DB | Block that must dominate all uses of DI outside the parent block |
UI
is the only use of DI
in the parent block and all other uses of DI
are in blocks dominated by DB
. Definition at line 5333 of file InstCombineCompares.cpp.
References assert(), llvm::Instruction::getParent(), llvm::BasicBlock::getParent(), and llvm::Value::users().
|
inlineoverridevirtual |
Combiner aware instruction erasure.
When dealing with an instruction that has side effects or produces a void value, we can't rely on DCE to delete the instruction. Instead, visit methods should return the value returned by this function.
Implements llvm::InstCombiner.
Definition at line 453 of file InstCombineInternal.h.
References assert(), llvm::dbgs(), I, LLVM_DEBUG, and llvm::salvageDebugInfo().
Referenced by combineLoadToOperationType(), processUGT_ADDCST_ADD(), removeBitcastsFromLoadStoreOnMinMax(), removeTriviallyEmptyRange(), and visitAtomicRMWInst().
Given an expression that CanEvaluateTruncated or CanEvaluateSExtd returns true for, actually insert the code to evaluate the expression.
Definition at line 182 of file InstCombineCasts.cpp.
References llvm::MCID::Add, llvm::PHINode::addIncoming(), llvm::ConstantFoldConstant(), llvm::BinaryOperator::Create(), llvm::SelectInst::Create(), llvm::PHINode::Create(), llvm::CastInst::CreateIntegerCast(), DL, llvm::numbers::e, llvm::PHINode::getIncomingBlock(), llvm::PHINode::getIncomingValue(), llvm::ConstantExpr::getIntegerCast(), llvm::PHINode::getNumIncomingValues(), i, I, LHS, llvm_unreachable, Mul, RHS, llvm::MCID::Select, and llvm::Value::takeName().
Instruction * InstCombinerImpl::foldAddWithConstant | ( | BinaryOperator & | Add | ) |
Definition at line 850 of file InstCombineAddSub.cpp.
References llvm::InstCombiner::AddOne(), llvm::BitWidth, Builder, llvm::computeKnownBits(), llvm::CastInst::Create(), llvm::SelectInst::Create(), CreateAdd(), DL, llvm::ConstantInt::get(), llvm::ConstantExpr::getAdd(), llvm::APInt::getHighBitsSet(), llvm::Type::getScalarSizeInBits(), llvm::Value::hasOneUse(), llvm::haveNoCommonBitsSet(), llvm::APInt::isMask(), llvm::APInt::isMinSignedValue(), llvm::APInt::isNegative(), llvm::APInt::isPowerOf2(), llvm::APInt::isShiftedMask(), llvm::APInt::isSignMask(), llvm::APInt::logBase2(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::m_ZExt(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), llvm::APInt::sext(), llvm::InstCombiner::SubOne(), X, Y, and llvm::KnownBits::Zero.
Instruction * InstCombinerImpl::foldAggregateConstructionIntoAggregateReuse | ( | InsertValueInst & | OrigIVI | ) |
Look for chain of insertvalue's that fully define an aggregate, and trace back the values inserted, see if they are all were extractvalue'd from the same source aggregate from the exact same element indexes.
If they were, just reuse the source aggregate. This potentially deals with PHI indirections.
When analyzing the value that was inserted into an aggregate, we did not manage to find defining extractvalue
instruction to analyze.
When analyzing the value that was inserted into an aggregate, we did manage to find defining extractvalue
instruction[s], and everything matched perfectly - aggregate type, element insertion/extraction index.
When analyzing the value that was inserted into an aggregate, we did manage to find defining extractvalue
instruction, but there was a mismatch: either the source type from which the extraction was didn't match the aggregate type into which the insertion was, or the extraction/insertion channels mismatched, or different elements had different source aggregates.
Definition at line 819 of file InstCombineVectorOps.cpp.
References llvm::all_of(), llvm::Type::ArrayTyID, assert(), BB, Builder, llvm::Depth, llvm::Value::DoPHITranslation(), llvm::SmallVectorImpl< T >::emplace_back(), llvm::enumerate(), llvm::ArrayRef< T >::front(), llvm::Type::getArrayNumElements(), llvm::BasicBlock::getFirstNonPHI(), llvm::Value::getName(), llvm::Type::getStructNumElements(), llvm::Value::getType(), llvm::Type::getTypeID(), I, llvm::DenseMapBase< SmallDenseMap< KeyT, ValueT, 4, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >, KeyT, ValueT, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >::insert(), IV, llvm_unreachable, llvm::None, llvm::LegacyLegalizeActions::NotFound, llvm::pred_empty(), llvm::predecessors(), llvm::ArrayRef< T >::size(), llvm::Type::StructTyID, and llvm::Optional< T >::value_or().
Instruction * InstCombinerImpl::foldAllocaCmp | ( | ICmpInst & | ICI, |
const AllocaInst * | Alloca | ||
) |
Definition at line 1010 of file InstCombineCompares.cpp.
References assert(), llvm::ConstantInt::get(), llvm::CmpInst::getPredicate(), llvm::Value::getType(), llvm::ICmpInst::isEquality(), llvm::CmpInst::isTrueWhenEqual(), memcpy(), llvm::SmallVectorImpl< T >::pop_back_val(), SI, and llvm::Value::uses().
Instruction * InstCombinerImpl::foldBinOpIntoSelectOrPhi | ( | BinaryOperator & | I | ) |
This is a convenience wrapper function for the above two functions.
Definition at line 1348 of file InstructionCombining.cpp.
References I.
Instruction * InstCombinerImpl::foldBinopWithPhiOperands | ( | BinaryOperator & | BO | ) |
For a binary operator with 2 phi operands, try to hoist the binary operation before the phi.
This can result in fewer instructions in patterns where at least one set of phi operands simplifies. Example: BB3: binop (phi [X, BB1], [C1, BB2]), (phi [Y, BB1], [C2, BB2]) --> BB1: BO = binop X, Y BB3: phi [BO, BB1], [(binop C1, C2), BB2]
Definition at line 1282 of file InstructionCombining.cpp.
References llvm::PHINode::addIncoming(), llvm::BasicBlock::begin(), Builder, C1, llvm::ConstantFoldBinaryOpOperands(), llvm::PHINode::Create(), DL, llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::BasicBlock::getParent(), llvm::BasicBlock::getTerminator(), llvm::Value::getType(), llvm::isGuaranteedToTransferExecutionToSuccessor(), llvm::PatternMatch::m_ImmConstant(), and llvm::PatternMatch::match().
Instruction * InstCombinerImpl::foldCmpLoadFromIndexedGlobal | ( | LoadInst * | LI, |
GetElementPtrInst * | GEP, | ||
GlobalVariable * | GV, | ||
CmpInst & | ICI, | ||
ConstantInt * | AndCst = nullptr |
||
) |
This is called when we see this pattern: cmp pred (load (gep GV, ...)), cmpcst where GV is a global variable with a constant initializer.
Try to simplify this into some simple computation that does not need the load. For example we can optimize "icmp eq (load (gep "foo", 0, i)), 0" into "icmp eq i, 3".
If AndCst is non-null, then the loaded value is masked with that constant before doing the comparison. This handles cases like "A[i]&4 == 0".
TrueRangeEnd/FalseRangeEnd - In conjunction with First*Element, these define a state machine that triggers for ranges of values that the index is true or false for. This triggers on things like "abbbbc"[i] == 'b'. This is -2 when undefined, -3 when overdefined, and otherwise the last index in the range (inclusive). We use -2 for undefined here because we use relative comparisons and don't want 0-1 to match -1.
Definition at line 106 of file InstCombineCompares.cpp.
References assert(), Builder, C1, llvm::ConstantFoldCompareInstOperands(), llvm::ConstantFoldExtractValueInstruction(), llvm::countTrailingZeros(), DL, llvm::numbers::e, GEP, llvm::ConstantInt::get(), llvm::ConstantExpr::getAnd(), llvm::TypeSize::getFixedSize(), llvm::GlobalVariable::getInitializer(), llvm::Type::getIntegerBitWidth(), llvm::User::getOperand(), llvm::CmpInst::getPredicate(), llvm::Type::getPrimitiveSizeInBits(), llvm::Value::getType(), llvm::GlobalValue::getValueType(), llvm::ConstantInt::getZExtValue(), llvm::GlobalVariable::hasDefinitiveInitializer(), i, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::GlobalVariable::isConstant(), llvm::LoadInst::isVolatile(), and llvm::BitmaskEnumDetail::Mask().
Instruction * InstCombinerImpl::foldFCmpIntToFPConst | ( | FCmpInst & | I, |
Instruction * | LHSI, | ||
Constant * | RHSC | ||
) |
Fold fcmp ([us]itofp x, cst) if possible.
Definition at line 6337 of file InstCombineCompares.cpp.
References assert(), Builder, llvm::object::Equal, llvm::CmpInst::FCMP_OEQ, llvm::CmpInst::FCMP_OGE, llvm::CmpInst::FCMP_OGT, llvm::CmpInst::FCMP_OLE, llvm::CmpInst::FCMP_OLT, llvm::CmpInst::FCMP_ONE, llvm::CmpInst::FCMP_ORD, llvm::CmpInst::FCMP_UEQ, llvm::CmpInst::FCMP_UGE, llvm::CmpInst::FCMP_UGT, llvm::CmpInst::FCMP_ULE, llvm::CmpInst::FCMP_ULT, llvm::CmpInst::FCMP_UNE, llvm::CmpInst::FCMP_UNO, llvm::IntegerType::getBitWidth(), llvm::Type::getFPMantissaWidth(), llvm::ConstantExpr::getFPToSI(), llvm::ConstantExpr::getFPToUI(), llvm::APFloat::getLargest(), llvm::APInt::getMaxValue(), llvm::APInt::getMinValue(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::APInt::getSignedMaxValue(), llvm::APInt::getSignedMinValue(), llvm::ConstantExpr::getSIToFP(), llvm::Value::getType(), llvm::ConstantExpr::getUIToFP(), I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLE, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, llvm::APFloatBase::IEK_Inf, llvm::detail::ilogb(), llvm_unreachable, P, RHS, llvm::APFloatBase::rmNearestTiesToEven, llvm::APFloat::roundToIntegral(), llvm::SMax, llvm::SMin, llvm::UMax, and llvm::UMin.
Instruction * InstCombinerImpl::foldFreezeIntoRecurrence | ( | FreezeInst & | I, |
PHINode * | PN | ||
) |
Definition at line 3778 of file InstructionCombining.cpp.
References llvm::append_range(), Builder, llvm::canCreateUndefOrPoison(), llvm::PHINode::getIncomingBlock(), llvm::Value::getName(), llvm::Instruction::getParent(), llvm::BasicBlock::getTerminator(), I, llvm::PHINode::incoming_values(), llvm::SmallPtrSetImpl< PtrType >::insert(), llvm::isGuaranteedNotToBeUndefOrPoison(), llvm::SmallVectorImpl< T >::pop_back_val(), and llvm::SmallPtrSetImplBase::size().
Instruction * InstCombinerImpl::foldGEPICmp | ( | GEPOperator * | GEPLHS, |
Value * | RHS, | ||
ICmpInst::Predicate | Cond, | ||
Instruction & | I | ||
) |
Fold comparisons between a GEP instruction and something else.
At this point we know that the GEP is on the LHS of the comparison.
Definition at line 827 of file InstCombineCompares.cpp.
References llvm::sampleprof::Base, Builder, Cond, DL, llvm::numbers::e, llvm::EmitGEPOffset(), evaluateGEPOffsetExpression(), llvm::ConstantInt::get(), llvm::TypeSize::getFixedSize(), llvm::Constant::getNullValue(), llvm::User::getNumOperands(), llvm::User::getOperand(), llvm::Type::getPointerAddressSpace(), llvm::ConstantExpr::getPointerBitCastOrAddrSpaceCast(), llvm::GEPOperator::getPointerOperand(), llvm::Type::getPrimitiveSizeInBits(), llvm::ICmpInst::getSignedPredicate(), llvm::GEPOperator::getSourceElementType(), llvm::CmpInst::getSwappedPredicate(), llvm::Value::getType(), llvm::GEPOperator::hasAllConstantIndices(), llvm::GEPOperator::hasAllZeroIndices(), llvm::Value::hasOneUse(), i, I, llvm::ICmpInst::isEquality(), llvm::GEPOperator::isInBounds(), llvm::CmpInst::isSigned(), llvm::CmpInst::isTrueWhenEqual(), llvm::Type::isVectorTy(), llvm::CmpInst::makeCmpResultType(), llvm::NullPointerIsDefined(), RHS, llvm::Value::stripPointerCasts(), and transformToIndexedCompare().
Instruction * InstCombinerImpl::foldICmpAddConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Add, | ||
const APInt & | C | ||
) |
Fold icmp (add X, Y), C.
Definition at line 2723 of file InstCombineCompares.cpp.
References Builder, llvm::ConstantInt::get(), llvm::ConstantExpr::getNeg(), llvm::Type::getScalarSizeInBits(), llvm::APInt::getSignedMaxValue(), llvm::APInt::getSignedMinValue(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::PatternMatch::m_APInt(), llvm::ConstantRange::makeExactICmpRegion(), llvm::PatternMatch::match(), llvm::SMax, llvm::SMin, llvm::ConstantRange::subtract(), llvm::Upper, X, and Y.
Instruction * InstCombinerImpl::foldICmpAddOpConst | ( | Value * | X, |
const APInt & | C, | ||
ICmpInst::Predicate | Pred | ||
) |
Fold "icmp pred (X+C), X".
Definition at line 1086 of file InstCombineCompares.cpp.
References assert(), llvm::ConstantInt::get(), llvm::APInt::getMaxValue(), llvm::APInt::getSignedMaxValue(), llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLE, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, llvm::SMax, and X.
Instruction * InstCombinerImpl::foldICmpAndConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | And, | ||
const APInt & | C | ||
) |
Fold icmp (and X, Y), C.
Definition at line 1863 of file InstCombineCompares.cpp.
References llvm::And, GEP, llvm::Constant::getNullValue(), I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), X, and Y.
Instruction * InstCombinerImpl::foldICmpAndConstConst | ( | ICmpInst & | Cmp, |
BinaryOperator * | And, | ||
const APInt & | C1 | ||
) |
Fold icmp (and X, C2), C1.
Definition at line 1750 of file InstCombineCompares.cpp.
References llvm::And, B, Builder, C1, llvm::computeKnownBits(), llvm::KnownBits::countMinLeadingZeros(), llvm::ConstantInt::get(), llvm::APInt::getBitWidth(), llvm::APInt::getHighBitsSet(), llvm::Value::getName(), llvm::Constant::getNullValue(), llvm::ConstantExpr::getNUWShl(), llvm::ConstantExpr::getOr(), llvm::Type::getScalarSizeInBits(), llvm::Value::hasOneUse(), I, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_ULT, llvm::APInt::isNegatedPowerOf2(), llvm::APInt::isNegative(), llvm::APInt::isSignMask(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::Or, llvm::RISCVFenceField::W, X, and llvm::APInt::zext().
Instruction * InstCombinerImpl::foldICmpAndShift | ( | ICmpInst & | Cmp, |
BinaryOperator * | And, | ||
const APInt & | C1, | ||
const APInt & | C2 | ||
) |
Fold icmp (and (sh X, Y), C2), C1.
Definition at line 1664 of file InstCombineCompares.cpp.
References llvm::And, llvm::APInt::ashr(), assert(), Builder, C1, llvm::ConstantInt::get(), llvm::ConstantInt::getFalse(), llvm::ConstantInt::getTrue(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::APInt::isNegative(), llvm::APInt::lshr(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), Shift, and llvm::APInt::shl().
Instruction * InstCombinerImpl::foldICmpBinOp | ( | ICmpInst & | I, |
const SimplifyQuery & | SQ | ||
) |
Try to fold icmp (binop), X or icmp X, (binop).
TODO: A large part of this logic is duplicated in InstSimplify's simplifyICmpWithBinOp(). We should be able to share that and avoid the code duplication.
Definition at line 4025 of file InstCombineCompares.cpp.
References llvm::APInt::abs(), llvm::SimplifyQuery::AC, llvm::MCID::Add, assert(), B, Builder, llvm::SimplifyQuery::CxtI, D, llvm::SimplifyQuery::DL, llvm::SimplifyQuery::DT, foldICmpWithLowBitMaskedVal(), foldICmpWithTruncSignExtendedVal(), foldICmpXNegX(), foldShiftIntoShiftInAnotherHandOfAndInICmp(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::ConstantInt::getFalse(), llvm::CmpInst::getFlippedStrictnessPredicate(), llvm::Constant::getIntegerValue(), llvm::APInt::getLowBitsSet(), llvm::ConstantExpr::getNeg(), llvm::ConstantExpr::getNot(), llvm::Constant::getNullValue(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::ConstantExpr::getSub(), llvm::CmpInst::getSwappedPredicate(), llvm::ConstantInt::getTrue(), llvm::Value::getType(), llvm::SimplifyQuery::getWithInstruction(), llvm::Instruction::hasNoSignedWrap(), llvm::Instruction::hasNoUnsignedWrap(), llvm::Value::hasOneUse(), I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLE, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, llvm::ICmpInst::isEquality(), llvm::Instruction::isExact(), llvm::isKnownNonZero(), llvm::APInt::isNegative(), llvm::CmpInst::isSigned(), llvm::CmpInst::isUnsigned(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_APIntAllowUndef(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_c_Add(), llvm::PatternMatch::m_c_And(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_LowBitMask(), llvm::PatternMatch::m_Mul(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_SpecificIntAllowUndef(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), Mul, llvm::APInt::uge(), llvm::APInt::ule(), X, and Y.
Instruction * InstCombinerImpl::foldICmpBinOpEqualityWithConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | BO, | ||
const APInt & | C | ||
) |
Fold an icmp equality instruction with binary operator LHS and constant RHS: icmp eq/ne BO, C.
Definition at line 3107 of file InstCombineCompares.cpp.
References llvm::MCID::Add, llvm::And, Builder, llvm::Value::getName(), llvm::ConstantExpr::getNot(), llvm::Constant::getNullValue(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::ConstantExpr::getSub(), llvm::Value::getType(), llvm::ConstantExpr::getXor(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::APInt::isPowerOf2(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), RHS, llvm::APInt::sgt(), and llvm::Value::takeName().
Instruction * InstCombinerImpl::foldICmpBinOpWithConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | BO, | ||
const APInt & | C | ||
) |
Fold an icmp with BinaryOp and constant operand: icmp Pred BO, C.
Definition at line 3355 of file InstCombineCompares.cpp.
References llvm::MCID::Add, llvm::BinaryOperator::getOpcode(), I, LLVM_FALLTHROUGH, and Mul.
Instruction * InstCombinerImpl::foldICmpBitCast | ( | ICmpInst & | Cmp | ) |
Definition at line 2924 of file InstCombineCompares.cpp.
References llvm::LegacyLegalizeActions::Bitcast, Builder, llvm::ConstantInt::get(), llvm::VectorType::get(), llvm::Constant::getAllOnesValue(), llvm::Constant::getNullValue(), llvm::Type::getScalarSizeInBits(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::is_splat(), llvm::Type::isIntegerTy(), llvm::Type::isIntOrIntVectorTy(), llvm::Type::isPointerTy(), llvm::Type::isPPC_FP128Ty(), llvm::InstCombiner::isSignBitCheck(), llvm::Type::isVectorTy(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_FPExt(), llvm::PatternMatch::m_FPTrunc(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_Shuffle(), llvm::PatternMatch::m_SIToFP(), llvm::PatternMatch::m_UIToFP(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::m_ZExtOrSExt(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), and X.
Instruction * InstCombinerImpl::foldICmpDivConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Div, | ||
const APInt & | C | ||
) |
Fold icmp ({su}div X, Y), C.
Definition at line 2456 of file InstCombineCompares.cpp.
References addWithOverflow(), Builder, llvm::BinaryOperator::Create(), llvm::ConstantInt::get(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::CmpInst::getSwappedPredicate(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::APInt::isAllOnes(), llvm::Instruction::isExact(), llvm::APInt::isOne(), llvm::APInt::isZero(), llvm_unreachable, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), llvm::APInt::negate(), llvm::APInt::sdiv(), subWithOverflow(), llvm::APInt::udiv(), X, and Y.
Instruction * InstCombinerImpl::foldICmpEqIntrinsicWithConstant | ( | ICmpInst & | ICI, |
IntrinsicInst * | II, | ||
const APInt & | C | ||
) |
Fold an equality icmp with LLVM intrinsic and constant operand.
Definition at line 3199 of file InstCombineCompares.cpp.
References llvm::abs(), llvm::BitWidth, Builder, llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::CallBase::getArgOperand(), llvm::APInt::getHighBitsSet(), llvm::IntrinsicInst::getIntrinsicID(), llvm::APInt::getLowBitsSet(), llvm::Constant::getNullValue(), llvm::APInt::getOneBitSet(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), and llvm::Or.
Instruction * InstCombinerImpl::foldICmpEquality | ( | ICmpInst & | Cmp | ) |
Definition at line 4548 of file InstCombineCompares.cpp.
References llvm::And, B, llvm::BitWidth, Builder, C1, D, foldICmpIntrinsicWithIntrinsic(), llvm::ConstantInt::get(), llvm::ConstantInt::getBitWidth(), llvm::APInt::getBitWidth(), llvm::ConstantInt::getLimitedValue(), llvm::APInt::getLimitedValue(), llvm::APInt::getLowBitsSet(), llvm::ConstantExpr::getNot(), llvm::Constant::getNullValue(), llvm::APInt::getOneBitSet(), llvm::Type::getPrimitiveSizeInBits(), llvm::Type::getScalarSizeInBits(), llvm::ConstantInt::getType(), llvm::Value::getType(), llvm::ConstantInt::getValue(), llvm::Value::hasOneUse(), I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::APInt::isPowerOf2(), llvm::APInt::logBase2(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APIntAllowUndef(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_c_And(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::m_ZeroInt(), llvm::PatternMatch::m_ZExt(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), NC, X, llvm::Xor, Y, and llvm::APInt::zext().
Instruction * InstCombinerImpl::foldICmpInstWithConstant | ( | ICmpInst & | Cmp | ) |
Try to fold integer comparisons with a constant operand: icmp Pred X, C where X is some kind of instruction.
Definition at line 3074 of file InstCombineCompares.cpp.
References I, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_APIntAllowUndef(), llvm::PatternMatch::match(), and SI.
Instruction * InstCombinerImpl::foldICmpInstWithConstantAllowUndef | ( | ICmpInst & | Cmp, |
const APInt & | C | ||
) |
Try to fold integer comparisons with a constant operand: icmp Pred X, C where X is some kind of instruction and C is AllowUndef.
TODO: Move more folds which allow undef to this function.
Definition at line 3333 of file InstCombineCompares.cpp.
Instruction * InstCombinerImpl::foldICmpInstWithConstantNotInt | ( | ICmpInst & | Cmp | ) |
Handle icmp with constant (but not simple integer constant) RHS.
Definition at line 3483 of file InstCombineCompares.cpp.
References DL, GEP, llvm::Constant::getNullValue(), llvm::Instruction::getOpcode(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::Value::getType(), I, llvm::Constant::isNullValue(), and llvm::SPII::Load.
Instruction * InstCombinerImpl::foldICmpIntrinsicWithConstant | ( | ICmpInst & | ICI, |
IntrinsicInst * | II, | ||
const APInt & | C | ||
) |
Fold an icmp with LLVM intrinsic and constant operand: icmp Pred II, C.
Definition at line 3413 of file InstCombineCompares.cpp.
References llvm::BitWidth, Builder, llvm::CmpInst::Create(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::CallBase::getArgOperand(), llvm::IntrinsicInst::getIntrinsicID(), llvm::APInt::getLowBitsSet(), llvm::Constant::getNullValue(), llvm::APInt::getOneBitSet(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::BitmaskEnumDetail::Mask(), and X.
Instruction * InstCombinerImpl::foldICmpMulConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Mul, | ||
const APInt & | C | ||
) |
Fold icmp (mul X, Y), C.
Definition at line 1988 of file InstCombineCompares.cpp.
References llvm::ConstantInt::get(), llvm::Constant::getNullValue(), llvm::User::getOperand(), llvm::CmpInst::getSwappedPredicate(), llvm::Value::getType(), llvm::Instruction::hasNoSignedWrap(), llvm::Instruction::hasNoUnsignedWrap(), llvm::APInt::isNegative(), isSignTest(), llvm::APInt::isZero(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), and Mul.
Instruction * InstCombinerImpl::foldICmpOrConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Or, | ||
const APInt & | C | ||
) |
Fold icmp (or X, Y), C.
Definition at line 1911 of file InstCombineCompares.cpp.
References llvm::And, Builder, llvm::BinaryOperator::Create(), llvm::ConstantInt::get(), llvm::Constant::getNullValue(), llvm::Value::getType(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_PtrToInt(), llvm::PatternMatch::m_Signum(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::match(), llvm::Or, P, and X.
Instruction * InstCombinerImpl::foldICmpSelectConstant | ( | ICmpInst & | Cmp, |
SelectInst * | Select, | ||
ConstantInt * | C | ||
) |
Definition at line 2873 of file InstCombineCompares.cpp.
References assert(), Builder, Cond, llvm::ConstantExpr::getCompare(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::Constant::isAllOnesValue(), and llvm::MCID::Select.
Instruction * InstCombinerImpl::foldICmpShlConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Shl, | ||
const APInt & | C | ||
) |
Fold icmp (shl X, Y), C.
Definition at line 2086 of file InstCombineCompares.cpp.
References llvm::And, llvm::APInt::ashr(), assert(), Builder, DL, foldICmpShlOne(), llvm::IntegerType::get(), llvm::ConstantInt::get(), llvm::VectorType::get(), llvm::APInt::getLimitedValue(), llvm::APInt::getLowBitsSet(), llvm::Value::getName(), llvm::Constant::getNullValue(), llvm::APInt::getOneBitSet(), llvm::User::getOperand(), llvm::Value::getType(), llvm::APInt::getZExtValue(), llvm::Instruction::hasNoSignedWrap(), llvm::Instruction::hasNoUnsignedWrap(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, isSignTest(), lshr, llvm::APInt::lshr(), llvm::PatternMatch::m_APInt(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), llvm::APInt::uge(), and X.
Instruction * InstCombinerImpl::foldICmpShlConstConst | ( | ICmpInst & | I, |
Value * | ShAmt, | ||
const APInt & | C1, | ||
const APInt & | C2 | ||
) |
Handle "(icmp eq/ne (shl AP2, A), AP1)" -> (icmp eq/ne A, TrailingZeros(AP1) - TrailingZeros(AP2)).
Definition at line 1195 of file InstCombineCompares.cpp.
References assert(), llvm::APInt::countTrailingZeros(), llvm::ConstantInt::get(), llvm::APInt::getBitWidth(), llvm::CmpInst::getInversePredicate(), llvm::Constant::getNullValue(), I, llvm::APInt::isZero(), LHS, RHS, Shift, and llvm::APInt::shl().
Instruction * InstCombinerImpl::foldICmpShrConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Shr, | ||
const APInt & | C | ||
) |
Fold icmp ({al}shr X, Y), C.
Definition at line 2226 of file InstCombineCompares.cpp.
References llvm::And, llvm::APInt::ashr(), assert(), Builder, llvm::countLeadingZeros(), llvm::APInt::countLeadingZeros(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::APInt::getBitWidth(), llvm::APInt::getHighBitsSet(), llvm::APInt::getLimitedValue(), llvm::Value::getName(), llvm::Constant::getNullValue(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::Instruction::isExact(), llvm::APInt::isPowerOf2(), llvm::APInt::lshr(), llvm::PatternMatch::m_APInt(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), llvm::APInt::shl(), shl, llvm::APInt::uge(), and X.
Instruction * InstCombinerImpl::foldICmpShrConstConst | ( | ICmpInst & | I, |
Value * | ShAmt, | ||
const APInt & | C1, | ||
const APInt & | C2 | ||
) |
Handle "(icmp eq/ne (ashr/lshr AP2, A), AP1)" -> (icmp eq/ne A, Log2(AP2/AP1)) -> (icmp eq/ne A, Log2(AP2) - Log2(AP1)).
Definition at line 1136 of file InstCombineCompares.cpp.
References llvm::APInt::ashr(), assert(), llvm::APInt::countLeadingOnes(), llvm::APInt::countLeadingZeros(), llvm::ConstantInt::get(), llvm::CmpInst::getInversePredicate(), llvm::Constant::getNullValue(), I, llvm::APInt::isAllOnes(), llvm::APInt::isNegative(), llvm::APInt::isPowerOf2(), llvm::APInt::isZero(), LHS, llvm::APInt::logBase2(), llvm::APInt::lshr(), RHS, llvm::APInt::sgt(), and Shift.
Instruction * InstCombinerImpl::foldICmpSRemConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | UDiv, | ||
const APInt & | C | ||
) |
Definition at line 2372 of file InstCombineCompares.cpp.
References llvm::And, Builder, llvm::ConstantInt::get(), llvm::Constant::getNullValue(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::APInt::getSignMask(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGT, llvm::PatternMatch::m_Power2(), and llvm::PatternMatch::match().
Instruction * InstCombinerImpl::foldICmpSubConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Sub, | ||
const APInt & | C | ||
) |
Fold icmp (sub X, Y), C.
Definition at line 2638 of file InstCombineCompares.cpp.
References Builder, llvm::ConstantInt::get(), llvm::User::getOperand(), llvm::ConstantExpr::getSub(), llvm::Value::getType(), llvm::Instruction::hasNoSignedWrap(), llvm::Instruction::hasNoUnsignedWrap(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLE, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::match(), llvm::none_of(), subWithOverflow(), llvm::Value::users(), X, and Y.
Instruction * InstCombinerImpl::foldICmpTruncConstant | ( | ICmpInst & | Cmp, |
TruncInst * | Trunc, | ||
const APInt & | C | ||
) |
Fold icmp (trunc X), C.
Definition at line 1538 of file InstCombineCompares.cpp.
References llvm::And, Builder, llvm::computeKnownBits(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::APInt::getHighBitsSet(), llvm::APInt::getLowBitsSet(), llvm::Constant::getNullValue(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::Value::getType(), llvm::APInt::getZExtValue(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_Shr(), llvm::PatternMatch::m_Signum(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), llvm::KnownBits::One, X, llvm::KnownBits::Zero, and llvm::APInt::zext().
Instruction * InstCombinerImpl::foldICmpUDivConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | UDiv, | ||
const APInt & | C | ||
) |
Fold icmp (udiv X, Y), C.
Definition at line 2423 of file InstCombineCompares.cpp.
References assert(), llvm::ConstantInt::get(), llvm::User::getOperand(), llvm::Value::getType(), llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), llvm::APInt::udiv(), X, and Y.
Instruction * InstCombinerImpl::foldICmpUsingKnownBits | ( | ICmpInst & | Cmp | ) |
Try to fold the comparison based on range information we can get by checking whether bits are known to be zero or one in the inputs.
Definition at line 5436 of file InstCombineCompares.cpp.
References assert(), B, llvm::BitWidth, C1, llvm::APInt::ceilLogBase2(), llvm::KnownBits::countMinTrailingZeros(), llvm::APInt::countTrailingZeros(), DL, llvm::SelectPatternResult::Flavor, llvm::ConstantInt::get(), llvm::APInt::getActiveBits(), llvm::APInt::getAllOnes(), llvm::ConstantInt::getBool(), getDemandedBitsLHSMask(), llvm::ConstantInt::getFalse(), llvm::Constant::getIntegerValue(), llvm::KnownBits::getMaxValue(), llvm::KnownBits::getMinValue(), llvm::Constant::getNullValue(), llvm::Type::getScalarSizeInBits(), llvm::Type::getScalarType(), llvm::KnownBits::getSignedMaxValue(), llvm::KnownBits::getSignedMinValue(), llvm::ConstantInt::getTrue(), llvm::Value::getType(), I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLE, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, llvm::Type::isIntOrIntVectorTy(), llvm::SelectPatternResult::isMinOrMax(), llvm::APInt::isNegative(), llvm::APInt::isPowerOf2(), llvm::KnownBits::isZero(), LHS, llvm_unreachable, llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_MaxOrMin(), llvm::PatternMatch::m_Power2(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::matchSelectPattern(), llvm::KnownBits::One, llvm::APInt::sle(), llvm::APInt::slt(), llvm::APInt::ule(), llvm::APInt::ult(), X, and llvm::KnownBits::Zero.
Instruction * InstCombinerImpl::foldICmpWithCastOp | ( | ICmpInst & | ICmp | ) |
Handle icmp (cast x), (cast or constant).
Definition at line 4895 of file InstCombineCompares.cpp.
References Builder, DL, foldICmpWithTrunc(), llvm::Type::getIntegerBitWidth(), llvm::ConstantExpr::getIntToPtr(), llvm::User::getOperand(), llvm::Type::getPointerAddressSpace(), llvm::CmpInst::getPredicate(), and llvm::Value::getType().
Instruction * InstCombinerImpl::foldICmpWithConstant | ( | ICmpInst & | Cmp | ) |
Fold icmp Pred X, C.
TODO: This code structure does not make sense. The saturating add fold should be moved to some other helper and extended as noted below (it is also possible that code has been made unnecessary - do we canonicalize IR to overflow/saturating intrinsics or not?).
Definition at line 1416 of file InstCombineCompares.cpp.
References llvm::PHINode::addIncoming(), llvm::all_of(), B, Builder, llvm::ConstantExpr::getCompare(), llvm::CmpInst::ICMP_UGT, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::predecessors(), processUGT_ADDCST_ADD(), and llvm::Value::takeName().
Instruction * InstCombinerImpl::foldICmpWithDominatingICmp | ( | ICmpInst & | Cmp | ) |
Canonicalize icmp instructions based on dominating conditions.
Definition at line 1462 of file InstCombineCompares.cpp.
References assert(), Builder, llvm::ConstantRange::difference(), DL, llvm::ConstantInt::get(), llvm::CmpInst::getInversePredicate(), llvm::ConstantRange::getSingleElement(), llvm::BasicBlock::getSinglePredecessor(), llvm::BasicBlock::getTerminator(), hasBranchUse(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::ConstantRange::intersectWith(), llvm::ConstantRange::isEmptySet(), llvm::isImpliedCondition(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_Br(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_MaxOrMin(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Value(), llvm::ConstantRange::makeExactICmpRegion(), llvm::PatternMatch::match(), X, and Y.
Instruction * InstCombinerImpl::foldICmpWithZero | ( | ICmpInst & | Cmp | ) |
Definition at line 1376 of file InstCombineCompares.cpp.
References B, llvm::computeKnownBits(), llvm::KnownBits::countMaxPopulation(), llvm::KnownBits::countMinPopulation(), DL, llvm::CmpInst::ICMP_SGT, llvm::ICmpInst::isEquality(), llvm::isKnownPositive(), llvm::PatternMatch::m_SMin(), llvm::PatternMatch::m_URem(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::match(), X, and Y.
Instruction * InstCombinerImpl::foldICmpWithZextOrSext | ( | ICmpInst & | ICmp | ) |
Definition at line 4791 of file InstCombineCompares.cpp.
References assert(), Builder, DL, llvm::Constant::getAllOnesValue(), llvm::ConstantExpr::getCast(), llvm::Constant::getNullValue(), llvm::User::getOperand(), llvm::CmpInst::getPredicate(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getTrunc(), llvm::ICmpInst::getUnsignedPredicate(), llvm::Value::hasOneUse(), llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::ICmpInst::isEquality(), llvm::isKnownNonNegative(), llvm::CmpInst::isSigned(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExtOrSExt(), llvm::PatternMatch::match(), X, and Y.
Instruction * InstCombinerImpl::foldICmpXorConstant | ( | ICmpInst & | Cmp, |
BinaryOperator * | Xor, | ||
const APInt & | C | ||
) |
Fold icmp (xor X, Y), C.
Definition at line 1597 of file InstCombineCompares.cpp.
References llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::Constant::getNullValue(), llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::APInt::isMaxSignedValue(), llvm::APInt::isNegative(), llvm::APInt::isPowerOf2(), llvm::APInt::isSignMask(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), X, llvm::Xor, and Y.
Instruction * InstCombinerImpl::foldIntegerTypedPHI | ( | PHINode & | PN | ) |
If an integer typed PHI has only one use which is an IntToPtr operation, replace the PHI with an existing pointer typed PHI if it exists.
Otherwise insert a new pointer typed PHI and replace the original one.
Definition at line 105 of file InstCombinePHI.cpp.
References llvm::PHINode::addIncoming(), llvm::all_of(), llvm::any_of(), Arg, assert(), BB, llvm::PHINode::blocks(), llvm::PHINode::Create(), llvm::CastInst::CreateBitOrPointerCast(), DL, llvm::SmallVectorImpl< T >::emplace_back(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::Value::getType(), llvm::Value::hasOneUse(), if(), llvm::PHINode::incoming_values(), llvm::Type::isIntegerTy(), MaxNumPhis, SI, llvm::Instruction::user_back(), llvm::Value::users(), and llvm::zip().
Instruction * InstCombinerImpl::foldIRemByPowerOfTwoToBitTest | ( | ICmpInst & | I | ) |
If we have: icmp eq/ne (urem/srem x, y), 0 iff y is a power-of-two, we can replace this with a bit test: icmp eq/ne (and x, (add y, -1)), 0.
Definition at line 1326 of file InstCombineCompares.cpp.
References Builder, llvm::CmpInst::Create(), llvm::Constant::getAllOnesValue(), I, llvm::isKnownToBeAPowerOfTwo(), llvm::PatternMatch::m_CombineAnd(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_IRem(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), X, and Y.
Instruction * InstCombinerImpl::foldItoFPtoI | ( | CastInst & | FI | ) |
fpto{s/u}i({u/s}itofp(X)) --> X or zext(X) or sext(X) or trunc(X) This is safe if the intermediate type has enough bits in its mantissa to accurately represent all values of X.
For example, this won't work with i64 -> float -> i64.
Definition at line 1972 of file InstCombineCasts.cpp.
References assert(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::Value::getType(), int, isKnownExactCastIntToFP(), and X.
Fold (-1 u/ x) u< y ((x * y) ?/ x) != y to @llvm.
?mul.with.overflow(x, y) plus extraction of overflow bit Note that the comparison is commutative, while inverted (u>=, ==) predicate will mean that we are looking for the opposite answer.
Definition at line 3934 of file InstCombineCompares.cpp.
References Builder, F, llvm::Intrinsic::getDeclaration(), llvm::Instruction::getOpcode(), llvm::Value::hasOneUse(), I, llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_c_ICmp(), llvm::PatternMatch::m_c_Mul(), llvm::PatternMatch::m_CombineAnd(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_IDiv(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_UDiv(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), Mul, X, and Y.
Instruction * InstCombinerImpl::foldOpIntoPhi | ( | Instruction & | I, |
PHINode * | PN | ||
) |
Given a binary operator, cast instruction, or select which has a PHI node as operand #0, see if we can fold the instruction into the PHI (which is only possible if all operands to the PHI are constants).
Definition at line 1124 of file InstructionCombining.cpp.
References llvm::PHINode::addIncoming(), Builder, llvm::PHINode::Create(), llvm::Value::DoPHITranslation(), foldOperationIntoPhiValue(), llvm::ConstantExpr::getCast(), llvm::ConstantExpr::getCompare(), llvm::PHINode::getIncomingBlock(), llvm::PHINode::getIncomingValue(), llvm::PHINode::getNumIncomingValues(), llvm::CastInst::getOpcode(), llvm::Instruction::getParent(), getParent(), llvm::BasicBlock::getTerminator(), llvm::Value::getType(), llvm::Value::hasOneUse(), i, I, llvm::isGuaranteedNotToBeUndefOrPoison(), llvm::Constant::isNullValue(), llvm::isPotentiallyReachable(), llvm::BranchInst::isUnconditional(), llvm::PatternMatch::m_ImmConstant(), llvm::make_early_inc_range(), llvm::PatternMatch::match(), SI, llvm::Value::takeName(), and llvm::Value::users().
Instruction * InstCombinerImpl::FoldOpIntoSelect | ( | Instruction & | Op, |
SelectInst * | SI, | ||
bool | FoldWithMultiUse = false |
||
) |
Given an instruction with a select as one operand and a constant as the other operand, try to fold the binary operator into the select arguments.
This also works for Cast instructions, which obviously do not have a second operand.
Definition at line 1034 of file InstructionCombining.cpp.
References B, Builder, llvm::SelectInst::Create(), foldOperationIntoSelectOperand(), llvm::ConstantExpr::getCompare(), llvm::VectorType::getElementCount(), llvm::CmpInst::ICMP_EQ, llvm::PatternMatch::m_APIntAllowUndef(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::match(), and SI.
Referenced by foldCtpop(), and foldCttzCtlz().
Instruction * InstCombinerImpl::foldPHIArgBinOpIntoPHI | ( | PHINode & | PN | ) |
If we have something like phi [add (a,b), add(a,c)] and if a/b/c and the adds all have a single user, turn this into a phi and a single binop.
Definition at line 400 of file InstCombinePHI.cpp.
References llvm::PHINode::addIncoming(), llvm::Instruction::andIRFlags(), assert(), llvm::PHINode::blocks(), llvm::Instruction::copyIRFlags(), llvm::BinaryOperator::Create(), llvm::CmpInst::Create(), llvm::PHINode::Create(), llvm::drop_begin(), llvm::PHINode::getIncomingBlock(), llvm::PHINode::getIncomingValue(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), llvm::Instruction::getOpcode(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Value::getType(), I, llvm::PHINode::incoming_values(), and llvm::zip().
Instruction * InstCombinerImpl::foldPHIArgExtractValueInstructionIntoPHI | ( | PHINode & | PN | ) |
If we have something like phi [extractvalue(a,0), extractvalue(b,0)], turn this into a phi[a,b] and a single extractvalue.
Definition at line 364 of file InstCombinePHI.cpp.
References llvm::PHINode::blocks(), llvm::ExtractValueInst::Create(), llvm::PHINode::Create(), llvm::drop_begin(), llvm::PHINode::getIncomingValue(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), I, llvm::PHINode::incoming_values(), and llvm::zip().
Instruction * InstCombinerImpl::foldPHIArgGEPIntoPHI | ( | PHINode & | PN | ) |
Definition at line 495 of file InstCombinePHI.cpp.
References llvm::PHINode::addIncoming(), llvm::sampleprof::Base, llvm::PHINode::blocks(), llvm::GetElementPtrInst::Create(), llvm::PHINode::Create(), llvm::drop_begin(), E, GEP, llvm::PHINode::getIncomingBlock(), llvm::PHINode::getIncomingValue(), llvm::Value::getName(), llvm::User::getNumOperands(), llvm::User::getOperand(), llvm::GetElementPtrInst::getSourceElementType(), llvm::Value::getType(), I, llvm::PHINode::incoming_values(), llvm::makeArrayRef(), llvm::User::op_begin(), llvm::User::op_end(), llvm::GetElementPtrInst::setIsInBounds(), and llvm::zip().
Instruction * InstCombinerImpl::foldPHIArgInsertValueInstructionIntoPHI | ( | PHINode & | PN | ) |
If we have something like phi [insertvalue(a,b,0), insertvalue(c,d,0)], turn this into a phi[a,c] and phi[b,d] and a single insertvalue.
Definition at line 324 of file InstCombinePHI.cpp.
References llvm::PHINode::blocks(), llvm::InsertValueInst::Create(), llvm::PHINode::Create(), llvm::drop_begin(), llvm::PHINode::getIncomingValue(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), I, llvm::PHINode::incoming_values(), and llvm::zip().
Instruction * InstCombinerImpl::foldPHIArgIntToPtrToPHI | ( | PHINode & | PN | ) |
Definition at line 300 of file InstCombinePHI.cpp.
References llvm::all_of(), llvm::PHINode::getIncomingValue(), llvm::PHINode::getNumIncomingValues(), llvm::PHINode::setIncomingValue(), and llvm::Value::users().
Instruction * InstCombinerImpl::foldPHIArgLoadIntoPHI | ( | PHINode & | PN | ) |
Definition at line 658 of file InstCombinePHI.cpp.
References llvm::PHINode::addIncoming(), BB, llvm::PHINode::blocks(), llvm::combineMetadata(), llvm::PHINode::Create(), llvm::drop_begin(), llvm::LoadInst::getAlign(), llvm::PHINode::getIncomingBlock(), llvm::PHINode::getIncomingValue(), llvm::Instruction::getMetadata(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), llvm::Instruction::getNumSuccessors(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::LoadInst::getPointerAddressSpace(), llvm::BasicBlock::getTerminator(), llvm::Value::getType(), llvm::Value::hasOneUser(), llvm::PHINode::incoming_values(), llvm::Instruction::isAtomic(), isSafeAndProfitableToSinkLoad(), llvm::Value::isSwiftError(), llvm::AMDGPU::HSAMD::Kernel::Arg::Key::IsVolatile, llvm::LoadInst::isVolatile(), llvm::min(), llvm::Instruction::setMetadata(), llvm::User::setOperand(), and llvm::zip().
Instruction * InstCombinerImpl::foldPHIArgOpIntoPHI | ( | PHINode & | PN | ) |
Try to rotate an operation below a PHI node, using PHI nodes for its operands.
If all operands to a PHI node are the same "unary" operator and they all are only used by the PHI, PHI together their inputs, and do the operation once, to the result of the PHI.
Definition at line 855 of file InstCombinePHI.cpp.
References llvm::PHINode::addIncoming(), BB, llvm::PHINode::blocks(), llvm::BinaryOperator::Create(), llvm::CastInst::Create(), llvm::CmpInst::Create(), llvm::PHINode::Create(), llvm::drop_begin(), llvm::PHINode::getIncomingBlock(), llvm::PHINode::getIncomingValue(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), llvm::CmpInst::getOpcode(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::CmpInst::getPredicate(), llvm::BasicBlock::getTerminator(), llvm::Value::getType(), I, llvm::PHINode::incoming_values(), llvm::Type::isIntegerTy(), and llvm::zip().
Instruction * InstCombinerImpl::foldPHIArgZextsIntoPHI | ( | PHINode & | Phi | ) |
TODO: This function could handle other cast types, but then it might require special-casing a cast from the 'i1' type.
See the comment in FoldPHIArgOpIntoPHI() about pessimizing illegal integer types.
Definition at line 781 of file InstCombinePHI.cpp.
References llvm::PHINode::addIncoming(), llvm::PHINode::Create(), llvm::CastInst::CreateZExtOrBitCast(), llvm::PHINode::getIncomingBlock(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), llvm::Instruction::getParent(), llvm::BasicBlock::getTerminator(), llvm::ConstantExpr::getTrunc(), llvm::Value::getType(), llvm::ConstantExpr::getZExt(), I, and llvm::PHINode::incoming_values().
Instruction* llvm::InstCombinerImpl::foldSelectExtConst | ( | SelectInst & | Sel | ) |
Instruction * InstCombinerImpl::foldSelectICmp | ( | ICmpInst::Predicate | Pred, |
SelectInst * | SI, | ||
Value * | RHS, | ||
const ICmpInst & | I | ||
) |
Definition at line 3530 of file InstCombineCompares.cpp.
References Builder, llvm::SelectInst::Create(), DL, llvm::ConstantInt::get(), I, llvm::isImpliedCondition(), llvm::ConstantInt::isZero(), RHS, SI, and llvm::simplifyICmpInst().
Instruction* llvm::InstCombinerImpl::foldSelectInstWithICmp | ( | SelectInst & | SI, |
ICmpInst * | ICI | ||
) |
Instruction * InstCombinerImpl::foldSelectIntoOp | ( | SelectInst & | SI, |
Value * | TrueVal, | ||
Value * | FalseVal | ||
) |
Try to fold the select into one of the operands to allow further optimization.
Definition at line 438 of file InstCombineSelect.cpp.
References Builder, llvm::Instruction::copyIRFlags(), llvm::BinaryOperator::Create(), llvm::tgtok::FalseVal, llvm::ConstantExpr::getBinOpIdentity(), getSelectFoldableOperands(), isSelect01(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), llvm::FastMathFlags::noSignedZeros(), SI, llvm::Value::takeName(), and llvm::tgtok::TrueVal.
Instruction * InstCombinerImpl::foldSelectOpOp | ( | SelectInst & | SI, |
Instruction * | TI, | ||
Instruction * | FI | ||
) |
We have (select c, TI, FI), and we know that TI and FI have the same opcode.
Definition at line 263 of file InstCombineSelect.cpp.
References llvm::Instruction::andIRFlags(), Builder, Cond, llvm::Instruction::copyIRFlags(), llvm::BinaryOperator::Create(), llvm::CastInst::Create(), llvm::GetElementPtrInst::Create(), llvm::CallInst::Create(), llvm::GetElementPtrInst::CreateInBounds(), llvm::Instruction::getFastMathFlags(), llvm::User::getNumOperands(), llvm::Instruction::getOpcode(), llvm::User::getOperand(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::Instruction::isCast(), llvm::Instruction::isCommutative(), llvm::Instruction::isSameOperationAs(), llvm::Type::isVectorTy(), llvm_unreachable, llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_MaxOrMin(), llvm::PatternMatch::m_SMax(), llvm::PatternMatch::m_SMin(), llvm::PatternMatch::m_UMax(), llvm::PatternMatch::m_UMin(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::Instruction::setFastMathFlags(), SI, T1, TII, X, and Y.
Instruction * InstCombinerImpl::foldSelectShuffle | ( | ShuffleVectorInst & | Shuf | ) |
Try to fold shuffles that are the equivalent of a vector select.
Definition at line 2037 of file InstCombineVectorOps.cpp.
References assert(), Builder, C1, llvm::ShuffleVectorInst::commute(), DL, foldSelectShuffleWith1Binop(), getAlternateBinop(), llvm::ShuffleVectorInst::getMaskValue(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::InstCombiner::getSafeVectorConstantForBinop(), llvm::ShuffleVectorInst::getShuffleMask(), llvm::ConstantExpr::getShuffleVector(), llvm::ShuffleVectorInst::getType(), llvm::Value::hasOneUse(), I, llvm::is_contained(), llvm::Instruction::isIntDivRem(), llvm::ShuffleVectorInst::isSelect(), llvm::Instruction::isShift(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_CombineOr(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), llvm::UndefMaskElem, X, and Y.
Instruction* llvm::InstCombinerImpl::foldSelectValueEquivalence | ( | SelectInst & | SI, |
ICmpInst & | ICI | ||
) |
Instruction * InstCombinerImpl::FoldShiftByConstant | ( | Value * | Op0, |
Constant * | Op1, | ||
BinaryOperator & | I | ||
) |
Definition at line 705 of file InstCombineShifts.cpp.
References assert(), Builder, C1, canEvaluateShifted(), canShiftBinOpWithConstantRHS(), Cond, llvm::BinaryOperator::Create(), llvm::SelectInst::Create(), llvm::dbgs(), DL, llvm::tgtok::FalseVal, llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), getShiftedValue(), llvm::APInt::getZExtValue(), llvm::Value::hasOneUse(), I, LLVM_DEBUG, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::Value::takeName(), llvm::tgtok::TrueVal, llvm::APInt::uge(), and X.
Instruction * InstCombinerImpl::foldSignBitTest | ( | ICmpInst & | I | ) |
Fold equality-comparison between zero and any (maybe truncated) right-shift by one-less-than-bitwidth into a sign test on the original value.
Definition at line 1345 of file InstCombineCompares.cpp.
References llvm::CmpInst::Create(), llvm::Constant::getNullValue(), llvm::Type::getScalarSizeInBits(), I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SLT, llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_Shr(), llvm::PatternMatch::m_SpecificInt_ICMP(), llvm::PatternMatch::m_TruncOrSelf(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::match(), and X.
Instruction* llvm::InstCombinerImpl::foldSPFofSPF | ( | Instruction * | Inner, |
SelectPatternFlavor | SPF1, | ||
Value * | A, | ||
Value * | B, | ||
Instruction & | Outer, | ||
SelectPatternFlavor | SPF2, | ||
Value * | C | ||
) |
Instruction * InstCombinerImpl::foldVariableSignZeroExtensionOfVariableHighBitExtract | ( | BinaryOperator & | OldAShr | ) |
Definition at line 1281 of file InstCombineShifts.cpp.
References assert(), Builder, C1, llvm::Instruction::copyIRFlags(), llvm::BinaryOperator::Create(), llvm::CastInst::CreateTruncOrBitCast(), llvm::Instruction::getOpcode(), llvm::BinaryOperator::getOpcode(), llvm::Value::getType(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Shr(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt_ICMP(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_TruncOrSelf(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExtOrSelf(), llvm::PatternMatch::match(), and X.
Instruction * InstCombinerImpl::foldVectorBinop | ( | BinaryOperator & | Inst | ) |
Canonicalize the position of binops relative to shufflevector.
Definition at line 1636 of file InstructionCombining.cpp.
References assert(), Builder, llvm::Instruction::copyIRFlags(), llvm::BinaryOperator::Create(), llvm::ConstantVector::get(), llvm::ConstantExpr::get(), llvm::UndefValue::get(), llvm::Constant::getAggregateElement(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Type::getScalarType(), llvm::Value::getType(), llvm::Value::hasOneUse(), I, llvm::is_contained(), llvm::Instruction::isAssociative(), llvm::Instruction::isCommutative(), llvm::Instruction::isIntDivRem(), llvm::isSafeToSpeculativelyExecute(), llvm::Instruction::isShift(), llvm::isSplatValue(), LHS, M, llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Shuffle(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), RHS, llvm::ArrayRef< T >::size(), std::swap(), llvm::UndefMaskElem, llvm::NVPTX::PTXLdStInstCode::V2, X, and Y.
Instruction* llvm::InstCombinerImpl::foldVectorSelect | ( | SelectInst & | Sel | ) |
bool InstCombinerImpl::freezeOtherUses | ( | FreezeInst & | FI | ) |
Definition at line 3846 of file InstructionCombining.cpp.
References assert(), llvm::BasicBlock::front(), llvm::Function::getEntryBlock(), llvm::BasicBlock::getFirstNonPHI(), llvm::Instruction::getFunction(), llvm::ilist_node_with_parent< NodeTy, ParentTy, Options >::getNextNode(), llvm::User::getOperand(), llvm::Instruction::getParent(), I, and llvm::Instruction::moveBefore().
|
inline |
Inserts an instruction New
before instruction Old
.
Also adds the new instruction to the worklist and returns New
so that it is suitable for use as the return from the visitation patterns.
Definition at line 384 of file InstCombineInternal.h.
References assert(), BB, llvm::ilist_node_impl< OptionsT >::getIterator(), and llvm::Instruction::getParent().
Referenced by foldSelectZeroOrMul(), and simplifyAllocaArraySize().
|
inline |
Same as InsertNewInstBefore, but also sets the debug loc.
Definition at line 394 of file InstCombineInternal.h.
References llvm::Instruction::getDebugLoc().
Referenced by replaceExtractElements().
Value * InstCombinerImpl::insertRangeTest | ( | Value * | V, |
const APInt & | Lo, | ||
const APInt & | Hi, | ||
bool | isSigned, | ||
bool | Inside | ||
) |
Emit a computation of: (V >= Lo && V < Hi) if Inside is true, otherwise (V < Lo || V >= Hi).
This method expects that Lo < Hi. IsSigned indicates whether to treat V, Lo, and Hi as signed or not.
Definition at line 90 of file InstCombineAndOrXor.cpp.
References assert(), Builder, llvm::ConstantInt::get(), llvm::Value::getName(), llvm::ICmpInst::getSignedPredicate(), llvm::Value::getType(), llvm::CmpInst::ICMP_UGE, and llvm::CmpInst::ICMP_ULT.
|
inline |
Definition at line 480 of file InstCombineInternal.h.
References llvm::Depth, DL, and llvm::isKnownToBeAPowerOfTwo().
Referenced by simplifyValueKnownNonZero().
|
inline |
Definition at line 486 of file InstCombineInternal.h.
References llvm::Depth, DL, llvm::BitmaskEnumDetail::Mask(), and llvm::MaskedValueIsZero().
Referenced by canEvaluateShiftedShift(), canEvaluateTruncated(), and canEvaluateZExtd().
Instruction * InstCombinerImpl::matchBSwapOrBitReverse | ( | Instruction & | I, |
bool | MatchBSwaps, | ||
bool | MatchBitReversals | ||
) |
Given an initial instruction, check to see if it is the root of a bswap/bitreverse idiom.
If so, return the equivalent bswap/bitreverse intrinsic.
Definition at line 2187 of file InstCombineAndOrXor.cpp.
References I, llvm::SmallVectorImpl< T >::pop_back_val(), llvm::recognizeBSwapOrBitReverseIdiom(), and llvm::Instruction::removeFromParent().
bool InstCombinerImpl::matchThreeWayIntCompare | ( | SelectInst * | SI, |
Value *& | LHS, | ||
Value *& | RHS, | ||
ConstantInt *& | Less, | ||
ConstantInt *& | Equal, | ||
ConstantInt *& | Greater | ||
) |
Match a select chain which produces one of three values based on whether the LHS is less than, equal to, or greater than RHS respectively.
Return true if we matched a three way compare idiom. The LHS, RHS, Less, Equal and Greater values are saved in the matching process and returned to the caller.
Definition at line 2819 of file InstCombineCompares.cpp.
References assert(), llvm::object::Equal, llvm::InstCombiner::getFlippedStrictnessPredicateAndConstant(), llvm::CmpInst::getSwappedPredicate(), llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::ICmpInst::isEquality(), llvm::CodeGenOpt::Less, LHS, llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), RHS, SI, and std::swap().
bool InstCombinerImpl::mergeStoreIntoSuccessor | ( | StoreInst & | SI | ) |
Try to transform: if () { *P = v1; } else { *P = v2 } or: *P = v1; if () { *P = v2; } into a phi node with a store in the successor.
Definition at line 1451 of file InstCombineLoadStoreAlloca.cpp.
References llvm::PHINode::addIncoming(), llvm::BasicBlock::begin(), llvm::PHINode::Create(), llvm::BasicBlock::front(), llvm::Instruction::getAAMetadata(), llvm::Instruction::getDebugLoc(), llvm::BasicBlock::getFirstInsertionPt(), llvm::DILocation::getMergedLocation(), llvm::User::getOperand(), llvm::Instruction::getSuccessor(), llvm::BranchInst::getSuccessor(), llvm::BasicBlock::getTerminator(), llvm::Value::getType(), llvm::BasicBlock::hasNPredecessors(), I, llvm::BranchInst::isUnconditional(), llvm::AAMDNodes::merge(), llvm::pred_begin(), llvm::Instruction::setAAMetadata(), llvm::Instruction::setDebugLoc(), and SI.
Value * InstCombinerImpl::OptimizePointerDifference | ( | Value * | LHS, |
Value * | RHS, | ||
Type * | Ty, | ||
bool | IsNUW | ||
) |
Optimize pointer differences into the same array into a size.
Consider: &A[10] - &A[0]: we should compile this to "10". LHS/RHS are the pointer operands to the ptrtoint instructions for the LHS/RHS of the subtract.
Definition at line 1677 of file InstCombineAddSub.cpp.
References Builder, llvm::GEPOperator::countNonConstantIndices(), llvm::EmitGEPOffset(), llvm::Value::hasOneUse(), I, llvm::GEPOperator::isInBounds(), LHS, Mul, RHS, llvm::Value::stripPointerCasts(), and std::swap().
void InstCombinerImpl::PHIArgMergedDebugLoc | ( | Instruction * | Inst, |
PHINode & | PN | ||
) |
Helper function for FoldPHIArgXIntoPHI() to set debug location for the folded operation.
The PHI arguments will be folded into a single operation with a PHI node as input.
The debug location of the single operation will be the merged locations of the original PHI node arguments.
Definition at line 42 of file InstCombinePHI.cpp.
References llvm::Instruction::applyMergedLocation(), assert(), llvm::drop_begin(), llvm::Instruction::getDebugLoc(), llvm::PHINode::getIncomingValue(), I, llvm::PHINode::incoming_values(), and llvm::Instruction::setDebugLoc().
Instruction * InstCombinerImpl::PromoteCastOfAllocation | ( | BitCastInst & | CI, |
AllocaInst & | AI | ||
) |
If we find a cast of an allocation instruction, try to eliminate the cast by moving the type information into the alloc.
Definition at line 84 of file InstCombineCasts.cpp.
References assert(), Builder, decomposeSimpleLinearExpr(), DL, llvm::ConstantInt::get(), llvm::AllocaInst::getAddressSpace(), llvm::AllocaInst::getAlign(), llvm::AllocaInst::getAllocatedType(), llvm::AllocaInst::getArraySize(), llvm::Type::getNonOpaquePointerElementType(), llvm::User::getOperand(), llvm::AllocaInst::getType(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::PointerType::isOpaque(), llvm::Type::isSized(), and llvm::AllocaInst::isUsedWithInAlloca().
Value * InstCombinerImpl::pushFreezeToPreventPoisonFromPropagating | ( | FreezeInst & | FI | ) |
Definition at line 3720 of file InstructionCombining.cpp.
References Builder, llvm::canCreateUndefOrPoison(), llvm::Value::getName(), llvm::User::getOperand(), and llvm::isGuaranteedNotToBeUndefOrPoison().
Value * InstCombinerImpl::reassociateShiftAmtsOfTwoSameDirectionShifts | ( | BinaryOperator * | Sh0, |
const SimplifyQuery & | SQ, | ||
bool | AnalyzeForSignBitExtraction = false |
||
) |
Definition at line 58 of file InstCombineShifts.cpp.
References assert(), Builder, canTryToConstantAddTwoShiftAmounts(), llvm::BinaryOperator::Create(), llvm::CastInst::Create(), llvm::Instruction::getOpcode(), llvm::BinaryOperator::getOpcode(), llvm::Value::getType(), llvm::SimplifyQuery::getWithInstruction(), llvm::ConstantExpr::getZExtOrBitCast(), llvm::Instruction::hasNoSignedWrap(), llvm::Instruction::hasNoUnsignedWrap(), llvm::Instruction::isExact(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_CombineAnd(), llvm::PatternMatch::m_CombineOr(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Shift(), llvm::PatternMatch::m_Shr(), llvm::PatternMatch::m_SpecificInt_ICMP(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExtOrSelf(), llvm::PatternMatch::match(), llvm::MipsISD::Ret, llvm::Instruction::setHasNoSignedWrap(), llvm::Instruction::setHasNoUnsignedWrap(), llvm::Instruction::setIsExact(), llvm::simplifyAddInst(), and X.
bool InstCombinerImpl::replacedSelectWithOperand | ( | SelectInst * | SI, |
const ICmpInst * | Icmp, | ||
const unsigned | SIOpd | ||
) |
Try to replace select with select operand SIOpd in SI-ICmp sequence.
True when a select result is replaced by one of its operands in select-icmp sequence.
This will eventually result in the elimination of the select.
SI | Select instruction |
Icmp | Compare instruction |
SIOpd | Operand that replaces the select |
Notes:
Example:
entry: %4 = select i1 %3, C* %0, C* null %5 = icmp eq C* %4, null br i1 %5, label %9, label %7 ... ; <label>:7 ; preds = entry %8 = getelementptr inbounds C* %4, i64 0, i32 0 ...
can be transformed to
%5 = icmp eq C* %0, null %6 = select i1 %3, i1 %5, i1 true br i1 %6, label %9, label %7 ... ; <label>:7 ; preds = entry %8 = getelementptr inbounds C* %0, i64 0, i32 0 // replace by %0!
Similar when the first operand of the select is a constant or/and the compare is for not equal rather than equal.
NOTE: The function is only called when the select and compare constants are equal, the optimization can work only for EQ predicates. This is not a major restriction since a NE compare should be 'normalized' to an equal compare, which usually happens in the combiner and test case select-cmp-br.ll checks for it.
Definition at line 5408 of file InstCombineCompares.cpp.
References assert(), llvm::CmpInst::getPredicate(), llvm::BasicBlock::getSinglePredecessor(), llvm::CmpInst::ICMP_EQ, isChainSelectCmpBranch(), and SI.
|
inline |
A combiner-aware RAUW-like routine.
This method is to be used when an instruction is found to be dead, replaceable with another preexisting expression. Here we add all uses of I to the worklist, replace all uses of I with the new value, then return I, so that the inst combiner will know that I was modified.
Definition at line 405 of file InstCombineInternal.h.
References llvm::dbgs(), llvm::PoisonValue::get(), I, and LLVM_DEBUG.
Referenced by foldCtpop(), foldCttzCtlz(), foldSelectZeroOrMul(), processUGT_ADDCST_ADD(), processUMulZExtIdiom(), removeBitcastsFromLoadStoreOnMinMax(), replaceExtractElements(), simplifyAllocaArraySize(), and unpackLoadToAggregate().
|
inline |
Replace operand of instruction and add old operand to the worklist.
Definition at line 426 of file InstCombineInternal.h.
References I.
Referenced by foldCtpop(), foldCttzCtlz(), foldFabsWithFcmpZero(), foldSelectBinOpIdentity(), foldSelectZeroOrMul(), foldShuffleWithInsert(), simplifyAllocaArraySize(), simplifyAssocCastAssoc(), simplifyValueKnownNonZero(), and visitAtomicRMWInst().
Replace use and add the previously used value to the worklist.
Definition at line 433 of file InstCombineInternal.h.
bool InstCombinerImpl::run | ( | ) |
Run the combiner over the entire worklist until it is empty.
Definition at line 4115 of file InstructionCombining.cpp.
References assert(), BB, Builder, llvm::ConstantFoldInstruction(), llvm::dbgs(), DL, EnableCodeSinking, llvm::BasicBlock::getFirstInsertionPt(), llvm::BasicBlock::getFirstNonPHI(), llvm::BasicBlock::getInstList(), llvm::ilist_node_impl< OptionsT >::getIterator(), llvm::Instruction::getParent(), llvm::BasicBlock::getTerminator(), llvm::BasicBlock::getUniquePredecessor(), i, I, llvm::isInstructionTriviallyDead(), LLVM_DEBUG, MaxSinkNumUsers, llvm::None, llvm::DebugCounter::shouldExecute(), llvm::X86AS::SS, llvm::succ_empty(), llvm::M68kBeads::Term, and TryToSinkInstruction().
Referenced by combineInstructionsOverFunction().
Value * InstCombinerImpl::SimplifyAddWithRemainder | ( | BinaryOperator & | I | ) |
Tries to simplify add operations using the definition of remainder.
The definition of remainder is X % C = X - (X / C ) * C. The add expression X % C0 + (( X / C0 ) % C1) * C0 can be simplified to X % (C0 * C1)
Definition at line 1059 of file InstCombineAddSub.cpp.
References Builder, C1, llvm::ConstantInt::get(), I, LHS, MatchDiv(), MatchMul(), MatchRem(), MulWillOverflow(), RHS, and X.
Instruction * InstCombinerImpl::SimplifyAnyMemSet | ( | AnyMemSetInst * | MI | ) |
Definition at line 243 of file InstCombineCalls.cpp.
References assert(), Builder, DL, llvm::IntegerType::get(), llvm::ConstantInt::get(), llvm::PointerType::get(), llvm::getKnownAlignment(), llvm::ConstantInt::getLimitedValue(), llvm::Constant::getNullValue(), llvm::ConstantInt::getType(), llvm::Value::getType(), llvm::ConstantInt::getZExtValue(), llvm::Type::isIntegerTy(), llvm::isPowerOf2_32(), MI, S, and llvm::Unordered.
Instruction * InstCombinerImpl::SimplifyAnyMemTransfer | ( | AnyMemTransferInst * | MI | ) |
Definition at line 120 of file InstCombineCalls.cpp.
References assert(), Builder, DL, llvm::IntegerType::get(), llvm::PointerType::get(), llvm::getKnownAlignment(), llvm::ConstantInt::getLimitedValue(), llvm::Constant::getNullValue(), llvm::ConstantInt::getType(), hasUndefSource(), M, MI, S, llvm::LoadInst::setAlignment(), llvm::Instruction::setMetadata(), llvm::LoadInst::setOrdering(), llvm::LoadInst::setVolatile(), and llvm::Unordered.
bool InstCombinerImpl::SimplifyAssociativeOrCommutative | ( | BinaryOperator & | I | ) |
Performs a few simplifications for operators which are associative or commutative.
This performs a few simplifications for operators that are associative or commutative:
Commutative operators:
Associative operators:
Associative and commutative operators:
Definition at line 406 of file InstructionCombining.cpp.
References llvm::MCID::Add, B, C1, ClearSubclassDataAfterReassociation(), llvm::BinaryOperator::Create(), llvm::BinaryOperator::CreateNUW(), llvm::ConstantExpr::get(), llvm::Instruction::getFastMathFlags(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), hasNoSignedWrap(), hasNoUnsignedWrap(), I, llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Value(), maintainNoSignedWrap(), llvm::PatternMatch::match(), llvm::Instruction::setFastMathFlags(), simplifyAssocCastAssoc(), llvm::simplifyBinOp(), and llvm::Value::takeName().
|
overridevirtual |
This form of SimplifyDemandedBits simplifies the specified instruction operand if possible, updating it in place.
It returns true if it made any change and false otherwise.
Implements llvm::InstCombiner.
Definition at line 71 of file InstCombineSimplifyDemanded.cpp.
References llvm::Depth, llvm::Use::get(), I, and llvm::salvageDebugInfo().
bool InstCombinerImpl::SimplifyDemandedInstructionBits | ( | Instruction & | Inst | ) |
Tries to simplify operands to an integer instruction based on its demanded bits.
Inst is an integer instruction that SimplifyDemandedBits knows about.
See if the instruction has any properties that allow us to simplify its operands.
Definition at line 55 of file InstCombineSimplifyDemanded.cpp.
References llvm::BitWidth, llvm::APInt::getAllOnes(), llvm::Type::getScalarSizeInBits(), and llvm::Value::getType().
Value * InstCombinerImpl::SimplifyDemandedUseBits | ( | Value * | V, |
APInt | DemandedMask, | ||
KnownBits & | Known, | ||
unsigned | Depth, | ||
Instruction * | CxtI | ||
) |
Attempts to replace V with a simpler value based on the demanded bits.
This function attempts to replace V with a simpler value based on the demanded bits.
When this function is called, it is known that only the bits set in DemandedMask of the result of V are ever used downstream. Consequently, depending on the mask and V, it may be possible to replace V with a constant or one of its operands. In such cases, this function does the replacement and returns true. In all other cases, it returns false after analyzing the expression and setting KnownOne and known to be one in the expression. Known.Zero contains all the bits that are known to be zero in the expression. These are provided to potentially allow the caller (which might recursively be SimplifyDemandedBits itself) to simplify the expression. Known.One and Known.Zero always follow the invariant that: Known.One & Known.Zero == 0. That is, a bit can't be both 1 and 0. Note that the bits in Known.One and Known.Zero may only be accurate for those bits set in DemandedMask. Note also that the bitwidth of V, DemandedMask, Known.Zero and Known.One must all be the same.
This returns null if it did not change anything and it permits no simplification. This returns V itself if it did some simplification of V's operands based on the information about what bits are demanded. This returns some other non-null value if it found out that V is equal to another value in the context where the specified bits are demanded, but not for all users.
Definition at line 108 of file InstCombineSimplifyDemanded.cpp.
References llvm::abs(), llvm::APInt::abs(), llvm::MCID::Add, llvm::alignDown(), llvm::And, assert(), llvm::BitWidth, Builder, llvm::MCID::Call, llvm::KnownBits::commonBits(), llvm::KnownBits::computeForAddSub(), llvm::computeKnownBits(), llvm::ComputeNumSignBits(), llvm::APInt::countLeadingZeros(), llvm::KnownBits::countMinLeadingZeros(), llvm::APInt::countTrailingZeros(), llvm::CallInst::Create(), llvm::ISD::CTLZ, llvm::Depth, llvm::ConstantInt::get(), llvm::UndefValue::get(), llvm::APInt::getActiveBits(), llvm::APInt::getAllOnes(), llvm::Constant::getAllOnesValue(), llvm::KnownBits::getBitWidth(), llvm::APInt::getBitWidth(), llvm::Intrinsic::getDeclaration(), llvm::APInt::getHighBitsSet(), llvm::Constant::getIntegerValue(), llvm::APInt::getLimitedValue(), llvm::APInt::getLowBitsSet(), llvm::ConstantExpr::getLShr(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getShl(), llvm::APInt::getSignMask(), llvm::Value::getType(), llvm::ConstantInt::getValue(), llvm::Optional< T >::getValue(), llvm::KnownBits::hasConflict(), llvm::OverflowingBinaryOperator::hasNoSignedWrap(), llvm::OverflowingBinaryOperator::hasNoUnsignedWrap(), llvm::Value::hasOneUse(), I, llvm::APInt::intersects(), llvm::APInt::isAllOnes(), llvm::Type::isIntOrIntVectorTy(), llvm::KnownBits::isNonNegative(), llvm::APInt::isOne(), llvm::APInt::isPowerOf2(), llvm::APInt::isSignBitSet(), llvm::APInt::isSubsetOf(), llvm::APInt::isZero(), LHS, LLVM_FALLTHROUGH, llvm::APInt::lshr(), llvm::APInt::lshrInPlace(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_c_Add(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Shr(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExt(), llvm::KnownBits::makeNonNegative(), llvm::PatternMatch::match(), llvm::MaxAnalysisRecursionDepth, llvm::min(), Mul, llvm::KnownBits::One, llvm::Or, RA, llvm::KnownBits::resetAll(), RHS, llvm::MCID::Select, llvm::APInt::setAllBits(), llvm::APInt::setBit(), llvm::APInt::setHighBits(), llvm::Instruction::setIsExact(), llvm::APInt::setLowBits(), llvm::APInt::setSignBit(), llvm::KnownBits::sext(), llvm::APInt::shl(), ShrinkDemandedConstant(), llvm::Value::takeName(), llvm::APInt::trunc(), llvm::APInt::ult(), llvm::APIntOps::umax(), llvm::APIntOps::umin(), llvm::APInt::urem(), X, llvm::Xor, Y, llvm::KnownBits::Zero, llvm::KnownBits::zextOrTrunc(), and llvm::APInt::zextOrTrunc().
|
overridevirtual |
The specified value produces a vector with any number of elements.
This method analyzes which elements of the operand are undef or poison and returns that information in UndefElts.
DemandedElts contains the set of elements that are actually used by the caller, and by default (AllowMultipleUsers equals false) the value is simplified only if it has a single caller. If AllowMultipleUsers is set to true, DemandedElts refers to the union of sets of elements that are used by all callers.
If the information about demanded elements can be used to simplify the operation, the operation is simplified, then the resultant value is returned. This returns null if no change was made.
Implements llvm::InstCombiner.
Definition at line 1171 of file InstCombineSimplifyDemanded.cpp.
References llvm::all_of(), assert(), llvm::MCID::Call, llvm::APInt::clearAllBits(), llvm::APInt::clearBit(), llvm::APInt::countPopulation(), llvm::InsertElementInst::Create(), llvm::Depth, E, GEP, llvm::gep_type_begin(), llvm::gep_type_end(), llvm::ConstantInt::get(), llvm::ConstantVector::get(), llvm::UndefValue::get(), llvm::PoisonValue::get(), llvm::Constant::getAggregateElement(), llvm::APInt::getAllOnes(), llvm::SelectInst::getCondition(), llvm::Type::getInt32Ty(), llvm::IntrinsicInst::getIntrinsicID(), llvm::Value::getName(), llvm::User::getOperand(), llvm::Value::getType(), llvm::Optional< T >::getValue(), llvm::ConstantInt::getZExtValue(), llvm::Value::hasOneUse(), i, I, llvm::APInt::isAllOnes(), llvm::Constant::isAllOnesValue(), llvm::Instruction::isIntDivRem(), llvm::Constant::isNullValue(), llvm::Instruction::isShift(), llvm::Type::isVectorTy(), llvm::APInt::isZero(), llvm_unreachable, llvm::APInt::lshr(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_ExtractElt(), llvm::PatternMatch::m_Poison(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::MCID::Select, llvm::APInt::setBit(), llvm::RegState::Undef, llvm::UndefMaskElem, and llvm::APInt::zextOrTrunc().
bool InstCombinerImpl::simplifyDivRemOfSelectWithZeroOp | ( | BinaryOperator & | I | ) |
Fold a divide or remainder with a select instruction divisor when one of the select operands is zero.
In that case, we can use the other select operand because div/rem by zero is undefined.
Definition at line 673 of file InstCombineMulDivRem.cpp.
References llvm::ConstantInt::getFalse(), llvm::ConstantInt::getTrue(), llvm::Value::getType(), llvm::Value::hasOneUse(), I, llvm::isGuaranteedToTransferExecutionToSuccessor(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::match(), and SI.
Value * InstCombinerImpl::SimplifyMultipleUseDemandedBits | ( | Instruction * | I, |
const APInt & | DemandedMask, | ||
KnownBits & | Known, | ||
unsigned | Depth, | ||
Instruction * | CxtI | ||
) |
Helper routine of SimplifyDemandedUseBits.
It computes KnownZero/KnownOne bits. It also tries to handle simplifications that can be done based on DemandedMask, but without modifying the Instruction.
It computes Known bits. It also tries to handle simplifications that can be done based on DemandedMask, but without modifying the Instruction.
Definition at line 950 of file InstCombineSimplifyDemanded.cpp.
References llvm::BitWidth, llvm::computeKnownBits(), llvm::Depth, llvm::APInt::getBitWidth(), llvm::Constant::getIntegerValue(), llvm::APInt::getLowBitsSet(), llvm::APInt::getZExtValue(), I, llvm::APInt::isSubsetOf(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::KnownBits::One, llvm::APInt::ult(), X, and llvm::KnownBits::Zero.
Try to fold a signed range checked with lower bound 0 to an unsigned icmp.
Example: (icmp sge x, 0) & (icmp slt x, n) --> icmp ult x, n If Inverted
is true then the check is for the inverted range, e.g. (icmp slt x, 0) | (icmp sgt x, n) --> icmp ugt x, n
Definition at line 667 of file InstCombineAndOrXor.cpp.
References Builder, llvm::computeKnownBits(), llvm::CmpInst::getInversePredicate(), llvm::User::getOperand(), llvm::CmpInst::getPredicate(), llvm::CmpInst::getSwappedPredicate(), llvm::CmpInst::ICMP_SGE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLE, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, llvm::ConstantInt::isMinusOne(), llvm::KnownBits::isNonNegative(), and llvm::ConstantInt::isZero().
Value * InstCombinerImpl::SimplifySelectsFeedingBinaryOp | ( | BinaryOperator & | I, |
Value * | LHS, | ||
Value * | RHS | ||
) |
Definition at line 858 of file InstructionCombining.cpp.
References B, Builder, Cond, D, E, F, llvm::SimplifyQuery::getWithInstruction(), llvm::Value::hasOneUse(), I, LHS, llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), RHS, SI, and llvm::simplifyBinOp().
Value * InstCombinerImpl::simplifyShrShlDemandedBits | ( | Instruction * | Shr, |
const APInt & | ShrOp1, | ||
Instruction * | Shl, | ||
const APInt & | ShlOp1, | ||
const APInt & | DemandedMask, | ||
KnownBits & | Known | ||
) |
Helper routine of SimplifyDemandedUseBits.
It tries to simplify demanded bit for "r1 = shr x, c1; r2 = shl r1, c2" instruction sequence.
It tries to simplify "E1 = (X lsr C1) << C2", where the C1 and C2 are constant, into "E2 = X << (C2 - C1)" or "E2 = X >> (C1 - C2)", depending on the sign of "C2-C1".
Suppose E1 and E2 are generally different in bits S={bm, bm+1, ..., bn}, without considering the specific value X is holding. This transformation is legal iff one of following conditions is hold: 1) All the bit in S are 0, in this case E1 == E2. 2) We don't care those bits in S, per the input DemandedMask. 3) Combination of 1) and 2). Some bits in S are 0, and we don't care the rest bits.
Currently we only test condition 2).
As with SimplifyDemandedUseBits, it returns NULL if the simplification was not successful.
Definition at line 1096 of file InstCombineSimplifyDemanded.cpp.
References llvm::APInt::ashr(), llvm::BitWidth, llvm::APInt::clearAllBits(), llvm::ConstantInt::get(), llvm::APInt::getAllOnes(), llvm::Instruction::getOpcode(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::Value::getType(), llvm::APInt::getZExtValue(), llvm::Instruction::hasNoSignedWrap(), llvm::Instruction::hasNoUnsignedWrap(), llvm::Value::hasOneUse(), llvm::APInt::lshr(), llvm::KnownBits::One, llvm::APInt::setLowBits(), llvm::APInt::uge(), and llvm::KnownBits::Zero.
Value * InstCombinerImpl::SimplifyUsingDistributiveLaws | ( | BinaryOperator & | I | ) |
Tries to simplify binary operations which some other binary operation distributes over.
This tries to simplify binary operations which some other binary operation distributes over either by factorizing out common terms (eg "(A*B)+(A*C)" -> "A*(B+C)") or expanding out if this results in simplifications (eg: "A & (B | C) -> (A&B) | (A&C)" if this is a win).
It does this by either by factorizing out common terms (eg "(A*B)+(A*C)" -> "A*(B+C)") or expanding out if this results in simplifications (eg: "A & (B | C) -> (A&B) | (A&C)" if this is a win). Returns the simplified value, or null if it didn't simplify.
Returns the simplified value, or null if it didn't simplify.
Definition at line 740 of file InstructionCombining.cpp.
References B, Builder, D, llvm::ConstantExpr::getBinOpIdentity(), getBinOpsForFactorization(), getIdentityValue(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Value::getType(), I, leftDistributesOverRight(), LHS, RHS, rightDistributesOverLeft(), and llvm::simplifyBinOp().
bool InstCombinerImpl::sinkNotIntoOtherHandOfAndOrOr | ( | BinaryOperator & | I | ) |
Definition at line 3385 of file InstCombineAndOrXor.cpp.
References Builder, llvm::InstCombiner::canFreelyInvertAllUsersOf(), llvm::BinaryOperator::Create(), I, llvm::InstCombiner::isFreeToInvert(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), X, and Y.
Instruction * InstCombinerImpl::SliceUpIllegalIntegerPHI | ( | PHINode & | FirstPhi | ) |
This is an integer PHI and we know that it has an illegal type: see if it is only used by trunc or trunc(lshr) operations.
If so, we split the PHI into the various pieces being extracted. This sort of thing is introduced when SROA promotes an aggregate to large integer values.
TODO: The user of the trunc may be an bitcast to float/double/vector or an inttoptr. We should produce new PHIs in the right type.
Definition at line 1087 of file InstCombinePHI.cpp.
References llvm::PHINode::addIncoming(), llvm::array_pod_sort(), assert(), BB, llvm::PHINode::blocks(), Builder, llvm::DenseMapBase< DenseMap< KeyT, ValueT, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >, KeyT, ValueT, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >::clear(), llvm::SmallPtrSetImpl< PtrType >::count(), llvm::PHINode::Create(), llvm::dbgs(), llvm::drop_begin(), llvm::find(), llvm::ConstantInt::get(), llvm::PoisonValue::get(), llvm::Value::getName(), llvm::PHINode::getNumIncomingValues(), llvm::Instruction::getOpcode(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::Type::getScalarSizeInBits(), llvm::BasicBlock::getTerminator(), llvm::Value::getType(), llvm::Value::hasOneUse(), I, llvm::PHINode::incoming_values(), llvm::SmallPtrSetImpl< PtrType >::insert(), LLVM_DEBUG, Shift, llvm::Instruction::user_back(), llvm::Value::users(), and llvm::zip().
Value * InstCombinerImpl::tryFactorization | ( | BinaryOperator & | I, |
Instruction::BinaryOps | InnerOpcode, | ||
Value * | A, | ||
Value * | B, | ||
Value * | C, | ||
Value * | D | ||
) |
This tries to simplify binary operations by factorizing out common terms (e.
g. "(A*B)+(A*C)" -> "A*(B+C)").
Definition at line 634 of file InstructionCombining.cpp.
References llvm::MCID::Add, assert(), B, Builder, D, llvm::Value::getName(), llvm::Value::hasOneUse(), I, llvm::Instruction::isCommutative(), llvm::APInt::isMinSignedValue(), leftDistributesOverRight(), LHS, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::match(), Mul, RHS, rightDistributesOverLeft(), llvm::simplifyBinOp(), std::swap(), and llvm::Value::takeName().
Instruction * InstCombinerImpl::visitAdd | ( | BinaryOperator & | I | ) |
Definition at line 1273 of file InstCombineAddSub.cpp.
References B, Builder, C1, canonicalizeLowbitMask(), checkForNegativeOperand(), llvm::ComputeNumSignBits(), llvm::SelectInst::Create(), CreateAdd(), llvm::BinaryOperator::CreateNeg(), DL, llvm::MipsISD::Ext, factorizeMathWithShlOps(), foldNoWrapAdd(), foldToUnsignedSaturatedAdd(), llvm::ConstantInt::get(), llvm::ConstantExpr::getAdd(), llvm::APInt::getBitWidth(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::haveNoCommonBitsSet(), I, llvm::Type::isIntOrIntVectorTy(), LHS, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_c_Add(), llvm::PatternMatch::m_c_And(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_SDiv(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::match(), N, one, RHS, SI, llvm::simplifyAddInst(), llvm::APIntOps::umax(), and X.
Instruction * InstCombinerImpl::visitAddrSpaceCast | ( | AddrSpaceCastInst & | CI | ) |
Definition at line 2902 of file InstCombineCasts.cpp.
References Builder, llvm::VectorType::get(), llvm::PointerType::getAddressSpace(), llvm::User::getOperand(), llvm::Type::getScalarType(), llvm::Value::getType(), llvm::PointerType::getWithSamePointeeType(), and llvm::PointerType::hasSameElementTypeAs().
Instruction * InstCombinerImpl::visitAllocaInst | ( | AllocaInst & | AI | ) |
Definition at line 354 of file InstCombineLoadStoreAlloca.cpp.
References Builder, llvm::dbgs(), DL, llvm::ConstantInt::get(), llvm::PointerType::get(), llvm::PointerType::getAddressSpace(), llvm::AllocaInst::getAlign(), llvm::AllocaInst::getAllocatedType(), llvm::AllocaInst::getArraySize(), llvm::Function::getEntryBlock(), llvm::BasicBlock::getFirstNonPHIOrDbg(), llvm::getOrEnforceKnownAlignment(), llvm::Instruction::getParent(), llvm::BasicBlock::getParent(), llvm::Type::getPointerAddressSpace(), llvm::AllocaInst::getType(), llvm::Value::getType(), I, llvm::AllocaInst::isArrayAllocation(), isDereferenceableForAllocaSize(), isOnlyCopiedFromConstantMemory(), llvm::Type::isSized(), LLVM_DEBUG, llvm::max(), llvm::Instruction::moveBefore(), llvm::AllocaInst::setAlignment(), and simplifyAllocaArraySize().
Instruction * InstCombinerImpl::visitAllocSite | ( | Instruction & | FI | ) |
Definition at line 2805 of file InstructionCombining.cpp.
References assert(), llvm::ConvertDebugDeclareToDebugValue(), llvm::InvokeInst::Create(), DL, llvm::numbers::e, F, llvm::findDbgUsers(), llvm::ConstantInt::get(), llvm::PoisonValue::get(), llvm::Intrinsic::getDeclaration(), llvm::Type::getInt1Ty(), llvm::IntrinsicInst::getIntrinsicID(), llvm::Instruction::getModule(), llvm::Instruction::getParent(), i, I, llvm::isAllocRemovable(), isAllocSiteRemovable(), llvm::lowerObjectSizeCall(), M, MI, llvm::None, SI, and Users.
Instruction * InstCombinerImpl::visitAnd | ( | BinaryOperator & | I | ) |
Definition at line 1728 of file InstCombineAndOrXor.cpp.
References llvm::MCID::Add, llvm::And, assert(), B, Builder, C1, llvm::computeKnownBits(), llvm::APInt::countLeadingZeros(), llvm::APInt::countTrailingZeros(), llvm::BinaryOperator::Create(), llvm::SelectInst::Create(), llvm::APInt::exactLogBase2(), foldAndToXor(), foldComplexAndOrPatterns(), llvm::ConstantInt::get(), llvm::ConstantExpr::getAdd(), llvm::ConstantExpr::getCompare(), llvm::ConstantExpr::getExactLogBase2(), llvm::APInt::getLowBitsSet(), llvm::KnownBits::getMaxValue(), llvm::Value::getName(), llvm::Constant::getNullValue(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::Type::getScalarType(), llvm::ConstantExpr::getSub(), llvm::APInt::getZExtValue(), llvm::Value::hasOneUse(), I, llvm::CmpInst::ICMP_ULT, llvm::SystemZII::IsLogical, llvm::APInt::isPowerOf2(), isZero(), LHS, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_c_And(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_c_Xor(), llvm::PatternMatch::m_CombineAnd(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_LogicalAnd(), llvm::PatternMatch::m_LogicalShift(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_Power2(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_SignMask(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_SpecificInt_ICMP(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::m_ZExt(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), matchDeMorgansLaws(), llvm::matchSimpleRecurrence(), llvm::Constant::mergeUndefsWith(), Mul, reassociateFCmps(), llvm::Constant::replaceUndefsWith(), RHS, llvm::simplifyAndInst(), SimplifyBSwap(), llvm::APInt::ult(), X, llvm::Xor, Y, and llvm::APInt::zext().
Instruction * InstCombinerImpl::visitAShr | ( | BinaryOperator & | I | ) |
Definition at line 1349 of file InstCombineShifts.cpp.
References llvm::BitWidth, Builder, llvm::BinaryOperator::Create(), llvm::BinaryOperator::CreateNeg(), llvm::BinaryOperator::CreateNot(), llvm::ConstantInt::get(), llvm::APInt::getLowBitsSet(), llvm::Value::getName(), llvm::Type::getScalarSizeInBits(), llvm::APInt::getSignMask(), llvm::APInt::getZExtValue(), I, llvm::Type::isVectorTy(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_NSWShl(), llvm::PatternMatch::m_NSWSub(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificIntAllowUndef(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExt(), llvm::BitmaskEnumDetail::Mask(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), llvm::Constant::mergeUndefsWith(), llvm::min(), llvm::simplifyAShrInst(), llvm::APInt::ult(), X, and Y.
Instruction * InstCombinerImpl::visitAtomicRMWInst | ( | AtomicRMWInst & | SI | ) |
Definition at line 97 of file InstCombineAtomicRMW.cpp.
References llvm::Acquire, assert(), llvm::InstCombiner::DL, eraseInstFromFunction(), llvm::AtomicRMWInst::FAdd, llvm::ConstantInt::get(), llvm::DataLayout::getABITypeAlign(), llvm::ConstantFP::getNegativeZero(), llvm::AtomicRMWInst::getOperation(), llvm::AtomicRMWInst::getOrdering(), llvm::AtomicRMWInst::getPointerOperand(), llvm::AtomicRMWInst::getSyncScopeID(), llvm::Value::getType(), llvm::AtomicRMWInst::getValOperand(), llvm::Type::isFloatingPointTy(), llvm::Type::isIntegerTy(), llvm::AtomicRMWInst::isVolatile(), llvm::SPII::Load, llvm::Monotonic, llvm::NotAtomic, llvm::AtomicRMWInst::Or, llvm::Release, replaceOperand(), llvm::AtomicRMWInst::setOperation(), SI, llvm::Unordered, llvm::Value::use_empty(), and llvm::AtomicRMWInst::Xchg.
Instruction * InstCombinerImpl::visitBitCast | ( | BitCastInst & | CI | ) |
Definition at line 2742 of file InstCombineCasts.cpp.
References assert(), llvm::BitWidth, Builder, canonicalizeBitCastExtElt(), convertBitCastToGEP(), llvm::CastInst::Create(), llvm::CallInst::Create(), llvm::InsertElementInst::Create(), DL, foldBitCastBitwiseLogic(), foldBitCastSelect(), llvm::PoisonValue::get(), llvm::Value::getContext(), llvm::Intrinsic::getDeclaration(), llvm::APInt::getHighBitsSet(), llvm::Type::getInt32Ty(), llvm::Instruction::getModule(), llvm::Constant::getNullValue(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::Value::getType(), I, llvm::Type::isIntegerTy(), llvm::Type::isPointerTy(), llvm::Type::isVectorTy(), llvm::Type::isX86_MMXTy(), LHS, llvm::PatternMatch::m_BitCast(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_InsertElt(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), optimizeIntegerToVectorInsertions(), optimizeVectorResizeWithIntegerBitCasts(), RHS, X, and Y.
Instruction * InstCombinerImpl::visitBranchInst | ( | BranchInst & | BI | ) |
Definition at line 3138 of file InstructionCombining.cpp.
References Cond, llvm::BranchInst::getCondition(), llvm::ConstantInt::getFalse(), llvm::CmpInst::getInversePredicate(), llvm::BranchInst::getSuccessor(), llvm::Value::getType(), llvm::BranchInst::isUnconditional(), llvm::PatternMatch::m_BasicBlock(), llvm::PatternMatch::m_Br(), llvm::PatternMatch::m_FCmp(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::BranchInst::swapSuccessors(), and X.
Instruction * InstCombinerImpl::visitCallBrInst | ( | CallBrInst & | CBI | ) |
Definition at line 2732 of file InstCombineCalls.cpp.
Instruction * InstCombinerImpl::visitCallInst | ( | CallInst & | CI | ) |
CallInst simplification.
This mostly only handles folding of intrinsic instructions. For normal calls, it allows visitCallBase to do the heavy lifting.
This will remove the boolean Condition from the assume given as argument and remove the assume if it becomes useless. always returns nullptr for use as a return values.
Note: this doesn't preserve the offset information but merges offset and alignment. TODO: we can generate a GEP instead of merging the alignment with the offset.
Canonicalize Knowledge in operand bundles.
Definition at line 1136 of file InstCombineCalls.cpp.
References llvm::abs(), llvm::alignDown(), llvm::SmallBitVector::all(), llvm::AlwaysOverflowsHigh, llvm::AlwaysOverflowsLow, llvm::Instruction::andIRFlags(), Arg, llvm::RetainedKnowledge::ArgValue, assert(), llvm::RetainedKnowledge::AttrKind, B, llvm::BitWidth, llvm::buildAssumeFromKnowledge(), Builder, llvm::CallBase::bundle_op_info_begin(), C1, canonicalizeConstantArg0ToArg1(), ceil, llvm::computeKnownBits(), Cond, llvm::ConstantFoldBinaryOpOperands(), llvm::Constant::containsConstantExpression(), llvm::Instruction::copyFastMathFlags(), llvm::Instruction::copyIRFlags(), llvm::KnownBits::countMinLeadingZeros(), llvm::KnownBits::countMinTrailingZeros(), llvm::BinaryOperator::Create(), llvm::CastInst::Create(), llvm::CallInst::Create(), llvm::SelectInst::Create(), llvm::BinaryOperator::CreateFDivFMF(), llvm::BinaryOperator::CreateFMulFMF(), llvm::CastInst::CreateIntegerCast(), llvm::BinaryOperator::CreateNeg(), llvm::BinaryOperator::CreateNot(), llvm::BinaryOperator::CreateNSW(), llvm::BinaryOperator::CreateNSWNeg(), llvm::BinaryOperator::CreateNUW(), llvm::UnaryOperator::CreateWithCopiedFlags(), llvm::BinaryOperator::CreateWithCopiedFlags(), llvm::Data, DL, llvm::Function::doesNotThrow(), llvm::CallBase::doesNotThrow(), llvm::Value::dropDroppableUse(), llvm::EnableKnowledgeRetention, factorizeMinMaxTree(), llvm::FAdd, floor, foldClampRangeOfTwo(), foldCtpop(), foldCttzCtlz(), foldShuffledIntrinsicOperands(), llvm::ConstantInt::get(), llvm::ConstantFP::get(), llvm::ConstantAggregateZero::get(), llvm::MDNode::get(), llvm::APInt::getAllOnes(), llvm::Constant::getAllOnesValue(), llvm::CallBase::getArgOperand(), llvm::KnownBits::getBitWidth(), llvm::ConstantInt::getBool(), llvm::CallBase::getCalledFunction(), llvm::CallBase::getCalledOperand(), llvm::Value::getContext(), llvm::Intrinsic::getDeclaration(), llvm::Instruction::getFastMathFlags(), llvm::Instruction::getFunction(), llvm::CallBase::getFunctionType(), llvm::ConstantExpr::getICmp(), llvm::Type::getInt64Ty(), llvm::ConstantExpr::getIntegerCast(), llvm::IntrinsicInst::getIntrinsicID(), llvm::getInverseMinMaxIntrinsic(), llvm::getKnowledgeFromBundle(), getKnownSign(), llvm::APInt::getLowBitsSet(), llvm::APSInt::getMaxValue(), llvm::APSInt::getMinValue(), llvm::Instruction::getModule(), llvm::ConstantExpr::getMul(), llvm::Value::getName(), llvm::ConstantExpr::getNeg(), llvm::Instruction::getNextNonDebugInstruction(), llvm::Constant::getNullValue(), llvm::CallBase::getNumOperandBundles(), getOpcode(), llvm::CallBase::getOperandBundlesAsDefs(), llvm::User::getOperandUse(), llvm::Instruction::getParent(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getSExt(), llvm::ConstantExpr::getSub(), llvm::BasicBlock::getTerminator(), llvm::ConstantInt::getTrue(), llvm::ConstantExpr::getTrunc(), llvm::Value::getType(), llvm::Optional< T >::getValue(), llvm::ConstantExpr::getZExt(), GuardWideningWindow, llvm::Instruction::hasAllowReassoc(), llvm::Function::hasFnAttribute(), llvm::Value::hasOneUse(), llvm::CallBase::hasOperandBundles(), i, I, I1, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGT, llvm::KnownBits::isAllOnes(), llvm::isAssumeWithEmptyBundle(), llvm::IntrinsicInst::isCommutative(), llvm::Instruction::isFast(), llvm::isFreeCall(), llvm::isKnownNegation(), llvm::APInt::isNonNegative(), llvm::Type::isPointerTy(), llvm::isPowerOf2_32(), llvm::isPowerOf2_64(), llvm::isSafeToSpeculativelyExecute(), llvm::isSplatValue(), llvm::isValidAssumeForContext(), LHS, LLVM_FALLTHROUGH, llvm_unreachable, llvm::SPII::Load, llvm::Log2_32_Ceil(), llvm::lowerObjectSizeCall(), M, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APFloat(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_APIntAllowUndef(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_BSwap(), llvm::PatternMatch::m_Cmp(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_FAbs(), llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_FPExt(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_LogicalAnd(), llvm::PatternMatch::m_LogicalOr(), llvm::PatternMatch::m_LogicalShift(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_NegZeroFP(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_NSWAdd(), llvm::PatternMatch::m_NSWNeg(), llvm::PatternMatch::m_NUWAdd(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_PosZeroFP(), llvm::PatternMatch::m_PtrToInt(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shuffle(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_SRem(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_UnOp(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::m_ZeroInt(), llvm::PatternMatch::m_ZExt(), llvm::PatternMatch::m_ZExtOrSExtOrSelf(), llvm::CmpInst::makeCmpResultType(), llvm::BitmaskEnumDetail::Mask(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), maximum, llvm::maximum(), llvm::maxnum(), llvm::Instruction::mayHaveSideEffects(), llvm::MayOverflow, memcpy(), MI, llvm::MinAlign(), minimum, llvm::minimum(), llvm::minnum(), Mod, moveAddAfterMinMax(), llvm::Instruction::moveBefore(), Mul, llvm::NeverOverflows, llvm::None, llvm::FastMathFlags::noSignedZeros(), llvm::User::op_begin(), llvm::ISD::OR, Other, powi(), reassociateMinMaxWithConstantInOperand(), reassociateMinMaxWithConstants(), removeTriviallyEmptyRange(), round(), llvm::APInt::sadd_ov(), llvm::Use::set(), llvm::SmallBitVector::set(), llvm::CallBase::setCalledFunction(), llvm::CallBase::setDoesNotThrow(), llvm::Value::setMetadata(), SI, llvm::SignBitMustBeZero(), llvm::simplifyCall(), llvm::simplifyConstrainedFPCall(), llvm::simplifyFMAFMul(), llvm::simplifyFMulInst(), simplifyInvariantGroupIntrinsic(), simplifyNeonTbl1(), llvm::simplifyRetainedKnowledge(), llvm::APIntOps::smax(), llvm::APIntOps::smin(), llvm::X86AS::SS, std::swap(), llvm::SmallBitVector::test(), trunc, llvm::APInt::uadd_sat(), llvm::APIntOps::umax(), llvm::APIntOps::umin(), llvm::UndefMaskElem, llvm::Value::use_empty(), llvm::RetainedKnowledge::WasOn, X, and Y.
Instruction * InstCombinerImpl::visitExtractElementInst | ( | ExtractElementInst & | EI | ) |
Definition at line 377 of file InstCombineVectorOps.cpp.
References llvm::BitWidth, Builder, cheapToScalarize(), llvm::count_if(), llvm::CastInst::Create(), llvm::CmpInst::Create(), llvm::GetElementPtrInst::Create(), llvm::ExtractElementInst::Create(), llvm::UnaryOperator::CreateWithCopiedFlags(), llvm::BinaryOperator::CreateWithCopiedFlags(), E, findDemandedEltsByAllUsers(), GEP, llvm::ConstantInt::get(), llvm::UndefValue::get(), llvm::Value::getContext(), llvm::VectorType::getElementCount(), llvm::ExtractElementInst::getIndexOperand(), llvm::Type::getInt32Ty(), llvm::Type::getIntegerBitWidth(), llvm::UnaryOperator::getOpcode(), getOpcode(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), getPreferredVectorIndex(), llvm::Value::getType(), llvm::ExtractElementInst::getVectorOperand(), llvm::ExtractElementInst::getVectorOperandType(), llvm::Value::hasOneUse(), I, llvm::ARM_PROC::IE, Int32Ty, llvm::APInt::isAllOnes(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_Cmp(), llvm::PatternMatch::m_UnOp(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::Value::replaceAllUsesWith(), llvm::APInt::setBit(), llvm::GetElementPtrInst::setIsInBounds(), llvm::simplifyExtractElementInst(), X, and Y.
Instruction * InstCombinerImpl::visitExtractValueInst | ( | ExtractValueInst & | EV | ) |
Definition at line 3224 of file InstructionCombining.cpp.
References assert(), Builder, llvm::BinaryOperator::Create(), llvm::ExtractValueInst::Create(), llvm::InsertValueInst::Create(), llvm::BinaryOperator::CreateNeg(), GEP, llvm::ConstantInt::get(), llvm::PoisonValue::get(), llvm::ExtractValueInst::getAggregateOperand(), llvm::ConstantRange::getEquivalentICmp(), llvm::ExtractValueInst::getIndices(), llvm::CmpInst::getInversePredicate(), llvm::Value::getType(), llvm::ExtractValueInst::hasIndices(), llvm::ExtractValueInst::idx_begin(), llvm::ExtractValueInst::idx_end(), llvm::ExtractValueInst::indices(), IV, LHS, llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_APInt(), llvm::makeArrayRef(), llvm::ConstantRange::makeExactNoWrapRegion(), llvm::PatternMatch::match(), NL, RHS, and llvm::simplifyExtractValueInst().
Instruction * InstCombinerImpl::visitFAdd | ( | BinaryOperator & | I | ) |
Definition at line 1531 of file InstCombineAddSub.cpp.
References Builder, llvm::BinaryOperator::CreateFMulFMF(), llvm::BinaryOperator::CreateFSubFMF(), F, factorizeFAddFSub(), llvm::ConstantFP::get(), llvm::ConstantExpr::getFAdd(), llvm::Type::getFltSemantics(), llvm::ConstantExpr::getFPToSI(), llvm::Type::getIntegerBitWidth(), llvm::Type::getScalarType(), llvm::ConstantExpr::getSIToFP(), llvm::Value::getType(), I, LHS, llvm::PatternMatch::m_AnyZeroFP(), llvm::PatternMatch::m_APFloat(), llvm::PatternMatch::m_c_FAdd(), llvm::PatternMatch::m_c_FMul(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_FDiv(), llvm::PatternMatch::m_FMul(), llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), RHS, llvm::APFloatBase::semanticsPrecision(), simplify, llvm::simplifyFAddInst(), X, and Y.
Instruction * InstCombinerImpl::visitFCmpInst | ( | FCmpInst & | I | ) |
Orders the operands of the compare so that they are listed from most complex to least complex. This puts constants before unary operators, before binary operators.
Definition at line 6705 of file InstCombineCompares.cpp.
References assert(), B, Builder, llvm::APFloat::clearSign(), llvm::APFloat::convert(), llvm::CmpInst::FCMP_OEQ, llvm::CmpInst::FCMP_OGE, llvm::CmpInst::FCMP_OLE, llvm::CmpInst::FCMP_OLT, llvm::CmpInst::FCMP_ONE, llvm::CmpInst::FCMP_ORD, llvm::CmpInst::FCMP_UEQ, llvm::CmpInst::FCMP_UGT, llvm::CmpInst::FCMP_ULT, llvm::CmpInst::FCMP_UNE, llvm::CmpInst::FCMP_UNO, llvm::SelectPatternResult::Flavor, foldFabsWithFcmpZero(), foldFCmpFNegCommonOp(), foldFCmpReciprocalAndZero(), foldVectorCmp(), GEP, llvm::ConstantFP::get(), llvm::VectorType::get(), llvm::ConstantInt::getFalse(), llvm::ConstantExpr::getFNeg(), llvm::Constant::getNullValue(), llvm::Instruction::getOpcode(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::APFloat::getSmallestNormalized(), llvm::ConstantInt::getTrue(), llvm::Value::getType(), I, llvm::CmpInst::ICMP_SLT, llvm::isKnownNeverNaN(), llvm::APFloat::isZero(), llvm::SPII::Load, llvm::PatternMatch::m_AnyZeroFP(), llvm::PatternMatch::m_APFloat(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_FPExt(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_PosZeroFP(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::matchSelectPattern(), llvm::APFloatBase::rmNearestTiesToEven, SI, llvm::simplifyFCmpInst(), llvm::SPF_UNKNOWN, X, and Y.
Instruction * InstCombinerImpl::visitFDiv | ( | BinaryOperator & | I | ) |
Definition at line 1321 of file InstCombineMulDivRem.cpp.
References Attrs, B, Builder, llvm::BinaryOperator::CreateFDivFMF(), llvm::BinaryOperator::CreateFMulFMF(), llvm::emitUnaryFloatFnCall(), foldFDivConstantDividend(), foldFDivConstantDivisor(), foldFDivPowDivisor(), llvm::ConstantFP::get(), llvm::Function::getAttributes(), llvm::hasFloatFn(), llvm::Value::hasOneUse(), I, M, llvm::PatternMatch::m_c_FMul(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_FAbs(), llvm::PatternMatch::m_FDiv(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificFP(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), Mul, SI, llvm::simplifyFDivInst(), X, and Y.
Instruction * InstCombinerImpl::visitFenceInst | ( | FenceInst & | FI | ) |
Definition at line 2699 of file InstCombineCalls.cpp.
References llvm::Instruction::getNextNonDebugInstruction(), llvm::FenceInst::getOrdering(), llvm::Instruction::getPrevNonDebugInstruction(), llvm::FenceInst::getSyncScopeID(), llvm::isAtLeastOrStrongerThan(), llvm::Instruction::isIdenticalTo(), llvm::SyncScope::SingleThread, and llvm::SyncScope::System.
Instruction * InstCombinerImpl::visitFMul | ( | BinaryOperator & | I | ) |
Definition at line 462 of file InstCombineMulDivRem.cpp.
References Builder, C1, llvm::BinaryOperator::CreateFAddFMF(), llvm::BinaryOperator::CreateFDivFMF(), llvm::BinaryOperator::CreateFMulFMF(), llvm::UnaryOperator::CreateFNegFMF(), llvm::BinaryOperator::CreateFSubFMF(), foldMulSelectToNegate(), llvm::ConstantExpr::getFDiv(), llvm::ConstantExpr::getFMul(), llvm::ConstantExpr::getFNeg(), llvm::Value::hasNUses(), llvm::Value::hasOneUse(), I, llvm::Constant::isNormalFP(), llvm::Log2(), llvm::log2(), llvm::PatternMatch::m_c_FMul(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_FAdd(), llvm::PatternMatch::m_FDiv(), llvm::PatternMatch::m_FMul(), llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_FSub(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificFP(), llvm::PatternMatch::m_Sqrt(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), powi(), llvm::simplifyFMulInst(), X, llvm::SystemZISD::XC, and Y.
Instruction * InstCombinerImpl::visitFNeg | ( | UnaryOperator & | I | ) |
Definition at line 2296 of file InstCombineAddSub.cpp.
References Builder, Cond, llvm::SelectInst::Create(), llvm::BinaryOperator::CreateFSubFMF(), foldFNegIntoConstant(), hoistFNegAboveFMulFDiv(), I, llvm::isGuaranteedNotToBeUndefOrPoison(), llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_FSub(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), P, S, llvm::simplifyFNegInst(), X, and Y.
Instruction * InstCombinerImpl::visitFPExt | ( | CastInst & | CI | ) |
Definition at line 1954 of file InstCombineCasts.cpp.
References llvm::CastInst::Create(), llvm::User::getOperand(), llvm::Value::getType(), and isKnownExactCastIntToFP().
Instruction * InstCombinerImpl::visitFPToSI | ( | FPToSIInst & | FI | ) |
Definition at line 2019 of file InstCombineCasts.cpp.
References I.
Instruction * InstCombinerImpl::visitFPToUI | ( | FPToUIInst & | FI | ) |
Definition at line 2012 of file InstCombineCasts.cpp.
References I.
Instruction * InstCombinerImpl::visitFPTrunc | ( | FPTruncInst & | CI | ) |
Definition at line 1770 of file InstCombineCasts.cpp.
References Builder, ceil, Cond, llvm::Instruction::copyFastMathFlags(), llvm::BinaryOperator::Create(), llvm::CastInst::Create(), llvm::CallInst::Create(), llvm::BinaryOperator::CreateFDivFMF(), llvm::BinaryOperator::CreateFMulFMF(), llvm::UnaryOperator::CreateFNegFMF(), llvm::CastInst::CreateFPCast(), floor, llvm::Intrinsic::getDeclaration(), llvm::Type::getFPMantissaWidth(), getMinimumFPType(), llvm::Instruction::getModule(), llvm::User::getOperand(), llvm::CastInst::getSrcTy(), llvm::Value::getType(), I, isKnownExactCastIntToFP(), LHS, llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_FPExt(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::max(), RHS, round(), shrinkInsertElt(), trunc, X, and Y.
Instruction * InstCombinerImpl::visitFree | ( | CallInst & | FI | ) |
Definition at line 3008 of file InstructionCombining.cpp.
References DL, llvm::CallBase::getArgOperand(), I, llvm::isReallocLikeFn(), and tryToMoveFreeBeforeNullTest().
Instruction * InstCombinerImpl::visitFreeze | ( | FreezeInst & | I | ) |
Definition at line 3889 of file InstructionCombining.cpp.
References assert(), llvm::Constant::getAllOnesValue(), llvm::Constant::getNullValue(), llvm::ConstantInt::getTrue(), I, llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::Constant::replaceUndefsWith(), and llvm::simplifyFreezeInst().
Instruction * InstCombinerImpl::visitFRem | ( | BinaryOperator & | I | ) |
Definition at line 1611 of file InstCombineMulDivRem.cpp.
References I, llvm::simplifyFRemInst(), and X.
Instruction * InstCombinerImpl::visitFSub | ( | BinaryOperator & | I | ) |
Definition at line 2349 of file InstCombineAddSub.cpp.
References Builder, llvm::CannotBeNegativeZero(), llvm::BinaryOperator::CreateFAddFMF(), llvm::BinaryOperator::CreateFMulFMF(), llvm::UnaryOperator::CreateFNegFMF(), llvm::BinaryOperator::CreateFSubFMF(), F, factorizeFAddFSub(), llvm::FAdd, llvm::FMul, foldFNegIntoConstant(), llvm::ConstantFP::get(), llvm::ConstantExpr::getFNeg(), llvm::ConstantExpr::getFSub(), llvm::Value::getType(), hoistFNegAboveFMulFDiv(), I, llvm::PatternMatch::m_c_FAdd(), llvm::PatternMatch::m_c_FMul(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_FDiv(), llvm::PatternMatch::m_FMul(), llvm::PatternMatch::m_FNeg(), llvm::PatternMatch::m_FPExt(), llvm::PatternMatch::m_FPTrunc(), llvm::PatternMatch::m_FSub(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), SI, simplify, llvm::simplifyFSubInst(), X, and Y.
Instruction * InstCombinerImpl::visitGEPOfBitcast | ( | BitCastInst * | BCI, |
GetElementPtrInst & | GEP | ||
) |
Definition at line 2131 of file InstructionCombining.cpp.
References Builder, DL, findElementAtOffset(), GEP, llvm::Type::getArrayElementType(), llvm::Type::getArrayNumElements(), llvm::BasicBlock::getInstList(), llvm::ilist_node_impl< OptionsT >::getIterator(), llvm::Type::getNonOpaquePointerElementType(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::Type::getPointerAddressSpace(), llvm::CastInst::getSrcTy(), llvm::Value::getType(), I, llvm::isAllocationFn(), llvm::Type::isArrayTy(), llvm::PointerType::isOpaque(), and llvm::Value::takeName().
Instruction * InstCombinerImpl::visitGEPOfGEP | ( | GetElementPtrInst & | GEP, |
GEPOperator * | Src | ||
) |
Definition at line 1942 of file InstructionCombining.cpp.
References llvm::SmallVectorImpl< T >::append(), llvm::append_range(), Builder, llvm::GetElementPtrInst::Create(), llvm::GetElementPtrInst::CreateInBounds(), DL, llvm::drop_begin(), llvm::drop_end(), E, llvm::enumerate(), GEP, llvm::gep_type_begin(), llvm::gep_type_end(), llvm::ConstantInt::get(), llvm::generic_gep_type_iterator< ItTy >::getIndexedType(), llvm::Type::getInt32Ty(), llvm::Constant::getNullValue(), llvm::Value::getType(), I, llvm::isKnownNonNegative(), isMergedGEPInBounds(), llvm::Type::isOpaquePointerTy(), llvm::GetElementPtrInst::setIsInBounds(), shouldMergeGEPs(), and llvm::simplifyAddInst().
Instruction * InstCombinerImpl::visitGetElementPtrInst | ( | GetElementPtrInst & | GEP | ) |
Definition at line 2235 of file InstructionCombining.cpp.
References llvm::PHINode::addIncoming(), assert(), llvm::BitWidth, Builder, llvm::GetElementPtrInst::Create(), llvm::GetElementPtrInst::CreateInBounds(), llvm::CastInst::CreatePointerBitCastOrAddrSpaceCast(), DL, llvm::drop_begin(), E, F, foldSelectGEP(), GEP, llvm::gep_type_begin(), llvm::VectorType::get(), llvm::PointerType::getAddressSpace(), llvm::APInt::getAllOnes(), llvm::Type::getArrayElementType(), llvm::generic_gep_type_iterator< ItTy >::getIndexedType(), llvm::Type::getNonOpaquePointerElementType(), llvm::Constant::getNullValue(), llvm::Type::getPointerAddressSpace(), llvm::Type::getPrimitiveSizeInBits(), llvm::Value::getType(), llvm::GetElementPtrInst::getTypeAtIndex(), llvm::getUnderlyingObject(), I, llvm::Type::isArrayTy(), llvm::APInt::isNonNegative(), llvm::PointerType::isOpaque(), llvm::Type::isSized(), llvm::generic_gep_type_iterator< ItTy >::isStruct(), llvm::Type::isStructTy(), llvm::Type::isVectorTy(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_PtrToInt(), llvm::PatternMatch::m_SDiv(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::match(), llvm::GetElementPtrInst::setIsInBounds(), llvm::simplifyGEPInst(), llvm::Value::stripAndAccumulateInBoundsConstantOffsets(), llvm::Value::stripPointerCasts(), llvm::APInt::ule(), X, and Y.
Instruction * InstCombinerImpl::visitICmpInst | ( | ICmpInst & | I | ) |
Orders the operands of the compare so that they are listed from most complex to least complex. This puts constants before unary operators, before binary operators.
Definition at line 6078 of file InstCombineCompares.cpp.
References llvm::MCID::Add, assert(), B, Builder, canonicalizeCmpWithConstant(), canonicalizeICmpBool(), Cond, llvm::CmpInst::Create(), llvm::ExtractValueInst::Create(), DL, llvm::SelectPatternResult::Flavor, foldICmpInvariantGroup(), foldICmpOfUAddOv(), foldICmpUsingBoolRange(), foldICmpWithDominatingICmp(), foldICmpWithHighBitMask(), foldICmpWithMinMax(), foldReductionIdiom(), foldVectorCmp(), GEP, llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::Constant::getNullValue(), llvm::Instruction::getOpcode(), llvm::Value::getType(), llvm::getUnderlyingObject(), llvm::SimplifyQuery::getWithInstruction(), I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::Type::isIntOrIntVectorTy(), llvm::isKnownToBeAPowerOfTwo(), llvm::Type::isPointerTy(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_Mul(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_UAddWithOverflow(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::PatternMatch::m_ZExt(), llvm::PatternMatch::match(), llvm::matchSelectPattern(), processUMulZExtIdiom(), SI, llvm::simplifyICmpInst(), llvm::SPF_UNKNOWN, std::swap(), swapMayExposeCSEOpportunities(), and X.
Instruction * InstCombinerImpl::visitInsertElementInst | ( | InsertElementInst & | IE | ) |
Definition at line 1486 of file InstCombineVectorOps.cpp.
References Builder, collectShuffleElements(), llvm::MipsISD::Ext, foldConstantInsEltIntoShuffle(), foldInsEltIntoIdentityShuffle(), foldInsEltIntoSplat(), foldInsSequenceIntoSplat(), llvm::VectorType::get(), llvm::UndefValue::get(), llvm::APInt::getAllOnes(), getPreferredVectorIndex(), llvm::Value::getType(), llvm::Value::hasOneUse(), hoistInsEltConst(), llvm::ARM_PROC::IE, Insert, llvm::Type::isFloatingPointTy(), llvm::Type::isIntegerTy(), llvm::Type::isVectorTy(), llvm::PatternMatch::m_BitCast(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_ExtractElt(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), narrowInsElt(), and llvm::simplifyInsertElementInst().
Instruction * InstCombinerImpl::visitInsertValueInst | ( | InsertValueInst & | I | ) |
Try to find redundant insertvalue instructions, like the following ones: %0 = insertvalue { i8, i32 } undef, i8 x, 0 %1 = insertvalue { i8, i32 } %0, i8 y, 0 Here the second instruction inserts values at the same indices, as the first one, making the first one redundant.
It should be transformed to: %0 = insertvalue { i8, i32 } undef, i8 y, 0
Definition at line 1099 of file InstCombineVectorOps.cpp.
References llvm::Depth, llvm::User::getOperand(), llvm::Value::hasOneUse(), I, and llvm::Value::user_back().
|
inline |
Specify what to return for unhandled instructions.
Definition at line 180 of file InstCombineInternal.h.
Instruction * InstCombinerImpl::visitIntToPtr | ( | IntToPtrInst & | CI | ) |
Definition at line 2034 of file InstCombineCasts.cpp.
References Builder, DL, llvm::IntToPtrInst::getAddressSpace(), llvm::Value::getContext(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::Value::getType(), llvm::Type::getWithNewType(), I, and P.
Instruction * InstCombinerImpl::visitInvokeInst | ( | InvokeInst & | II | ) |
Definition at line 2727 of file InstCombineCalls.cpp.
Instruction * InstCombinerImpl::visitLandingPadInst | ( | LandingPadInst & | LI | ) |
Definition at line 3410 of file InstructionCombining.cpp.
References llvm::LandingPadInst::addClause(), assert(), llvm::classifyEHPersonality(), llvm::LandingPadInst::Create(), llvm::numbers::e, llvm::SmallVectorImpl< T >::erase(), f(), llvm::Filter, llvm::ArrayType::get(), llvm::ConstantArray::get(), llvm::LandingPadInst::getClause(), llvm::ArrayType::getElementType(), llvm::Constant::getNullValue(), llvm::LandingPadInst::getNumClauses(), llvm::ArrayType::getNumElements(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::BasicBlock::getParent(), llvm::Function::getPersonalityFn(), llvm::Intrinsic::getType(), llvm::Value::getType(), i, llvm::SmallPtrSetImpl< PtrType >::insert(), llvm::LandingPadInst::isCatch(), isCatchAll(), llvm::LandingPadInst::isCleanup(), llvm::LandingPadInst::isFilter(), j(), l, llvm::SmallVectorImpl< T >::reserve(), llvm::LandingPadInst::setCleanup(), shorter_filter(), llvm::stable_sort(), llvm::Constant::stripPointerCasts(), and llvm::Value::stripPointerCasts().
Instruction * InstCombinerImpl::visitLoadInst | ( | LoadInst & | LI | ) |
Definition at line 929 of file InstCombineLoadStoreAlloca.cpp.
References assert(), Builder, canSimplifyNullLoadOrGEP(), combineLoadToOperationType(), llvm::combineMetadataForCSE(), llvm::SelectInst::Create(), DL, llvm::FindAvailableLoadedValue(), llvm::PoisonValue::get(), llvm::LoadInst::getAlign(), llvm::Instruction::getDebugLoc(), llvm::Value::getName(), llvm::Constant::getNullValue(), llvm::User::getOperand(), llvm::LoadInst::getOrdering(), llvm::getOrEnforceKnownAlignment(), llvm::LoadInst::getPointerAddressSpace(), llvm::LoadInst::getSyncScopeID(), llvm::Value::getType(), llvm::isSafeToLoadUnconditionally(), llvm::LoadInst::isUnordered(), llvm::NullPointerIsDefined(), replaceGEPIdxWithZero(), llvm::LoadInst::setAlignment(), llvm::LoadInst::setAtomic(), SI, unpackLoadToAggregate(), and llvm::NVPTX::PTXLdStInstCode::V2.
Instruction * InstCombinerImpl::visitLShr | ( | BinaryOperator & | I | ) |
Definition at line 1040 of file InstCombineShifts.cpp.
References assert(), llvm::tgtok::Bits, llvm::BitWidth, Builder, C1, llvm::SelectInst::Create(), llvm::APInt::eq(), llvm::ConstantInt::get(), llvm::APInt::getAllOnes(), llvm::Constant::getAllOnesValue(), llvm::APInt::getLowBitsSet(), llvm::Constant::getNullValue(), llvm::Type::getScalarSizeInBits(), getScalarSizeInBits(), llvm::ConstantInt::getSigned(), llvm::Intrinsic::getType(), llvm::Instruction::hasNoSignedWrap(), hasNoUnsignedWrap(), llvm::Value::hasOneUse(), I, llvm::Type::isIntegerTy(), llvm::isPowerOf2_32(), llvm::Log2_32(), llvm::APInt::logBase2(), llvm::APInt::lshr(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_c_Add(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_Instruction(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_NSWSub(), llvm::PatternMatch::m_NUWMul(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_SRem(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExt(), llvm::BitmaskEnumDetail::Mask(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), llvm::min(), RHS, llvm::APInt::shl(), llvm::simplifyLShrInst(), X, and Y.
Instruction * InstCombinerImpl::visitMul | ( | BinaryOperator & | I | ) |
Definition at line 142 of file InstCombineMulDivRem.cpp.
References llvm::abs(), llvm::And, llvm::BitWidth, Builder, C1, llvm::CastInst::Create(), llvm::SelectInst::Create(), CreateAdd(), CreateMul(), llvm::BinaryOperator::CreateNeg(), llvm::MipsISD::Ext, llvm::SelectPatternResult::Flavor, foldMulSelectToNegate(), llvm::APInt::getBitWidth(), llvm::ConstantInt::getBool(), llvm::ConstantExpr::getExactLogBase2(), llvm::ConstantExpr::getNeg(), llvm::Constant::getNullValue(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::ConstantExpr::getShl(), llvm::Instruction::hasNoSignedWrap(), llvm::Instruction::hasNoUnsignedWrap(), llvm::Value::hasOneUse(), I, llvm::Instruction::isExact(), llvm::Type::isIntOrIntVectorTy(), llvm::Constant::isNotMinSignedValue(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_c_Mul(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_Mul(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_NegatedPower2(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_SpecificIntAllowUndef(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExt(), llvm::CmpInst::makeCmpResultType(), llvm::PatternMatch::match(), llvm::matchSelectPattern(), Mul, llvm::Negator::Negate(), llvm::Instruction::setHasNoSignedWrap(), llvm::Instruction::setHasNoUnsignedWrap(), llvm::simplifyMulInst(), llvm::SPF_ABS, llvm::SPF_NABS, llvm::Value::takeName(), X, and Y.
Instruction * InstCombinerImpl::visitOr | ( | BinaryOperator & | I | ) |
Definition at line 2699 of file InstCombineAndOrXor.cpp.
References B, Builder, C1, Concat, llvm::SelectInst::Create(), CreateMul(), llvm::BinaryOperator::CreateNot(), D, DL, foldComplexAndOrPatterns(), foldOrToXor(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::Value::getName(), llvm::Type::getScalarSizeInBits(), llvm::Value::hasOneUse(), llvm::haveNoCommonBitsSet(), I, llvm::CmpInst::ICMP_NE, llvm::APInt::isAllOnes(), llvm::Type::isIntOrIntVectorTy(), llvm::SystemZII::IsLogical, isZero(), LHS, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_c_And(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_c_Xor(), llvm::PatternMatch::m_CombineAnd(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_ICmp(), llvm::PatternMatch::m_LogicalOr(), llvm::PatternMatch::m_Mul(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_NSWSub(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::m_ZeroInt(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), matchDeMorgansLaws(), matchFunnelShift(), matchOrConcat(), llvm::matchSimpleRecurrence(), Mul, llvm::Or, reassociateFCmps(), RHS, SimplifyBSwap(), llvm::simplifyOrInst(), std::swap(), llvm::Value::takeName(), X, llvm::Xor, and Y.
Instruction * InstCombinerImpl::visitPHINode | ( | PHINode & | PN | ) |
Definition at line 1372 of file InstCombinePHI.cpp.
References llvm::all_of(), llvm::BasicBlock::begin(), llvm::CastInst::CreatePointerCast(), DL, E, llvm::BasicBlock::end(), llvm::PoisonValue::get(), getAnyNonZeroConstInt(), llvm::PHINode::getBasicBlockIndex(), llvm::BasicBlock::getFirstInsertionPt(), llvm::PHINode::getIncomingBlock(), llvm::PHINode::getIncomingValue(), llvm::PHINode::getNumIncomingValues(), llvm::User::getOperand(), llvm::Instruction::getParent(), llvm::Type::getPrimitiveSizeInBits(), llvm::BasicBlock::getTerminator(), llvm::Value::getType(), llvm::Value::hasOneUse(), llvm::Value::hasOneUser(), I, llvm::PHINode::incoming_values(), llvm::SmallPtrSetImpl< PtrType >::insert(), isDeadPHICycle(), llvm::CmpInst::isEquality(), llvm::Instruction::isIdenticalToWhenDefined(), llvm::Type::isIntegerTy(), llvm::isKnownNonZero(), llvm::Type::isPointerTy(), IV, llvm::PatternMatch::m_Zero(), llvm::PatternMatch::match(), llvm::BasicBlock::phis(), PHIsEqualValue(), llvm::PHINode::setIncomingBlock(), llvm::PHINode::setIncomingValue(), llvm::simplifyInstruction(), simplifyUsingControlFlow(), llvm::Value::stripPointerCasts(), llvm::Instruction::user_back(), and llvm::codeview::VB.
Instruction * InstCombinerImpl::visitPtrToInt | ( | PtrToIntInst & | CI | ) |
Definition at line 2076 of file InstCombineCasts.cpp.
References assert(), Builder, llvm::InsertElementInst::Create(), llvm::CastInst::CreateIntegerCast(), DL, llvm::EmitGEPOffset(), GEP, llvm::Value::getContext(), llvm::PtrToIntInst::getPointerAddressSpace(), llvm::PtrToIntInst::getPointerOperand(), llvm::Type::getScalarSizeInBits(), llvm::Type::getScalarType(), llvm::Value::getType(), llvm::Type::getWithNewType(), llvm::PatternMatch::m_InsertElt(), llvm::PatternMatch::m_IntToPtr(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), and P.
Instruction * InstCombinerImpl::visitReturnInst | ( | ReturnInst & | RI | ) |
Definition at line 3058 of file InstructionCombining.cpp.
References llvm::computeKnownBits(), llvm::KnownBits::getConstant(), llvm::Constant::getIntegerValue(), llvm::User::getNumOperands(), llvm::User::getOperand(), llvm::Value::getType(), llvm::KnownBits::isConstant(), llvm::Type::isIntegerTy(), and isMustTailCall().
Instruction * InstCombinerImpl::visitSDiv | ( | BinaryOperator & | I | ) |
Definition at line 1092 of file InstCombineMulDivRem.cpp.
References Builder, Cond, llvm::SelectInst::Create(), llvm::BinaryOperator::CreateNeg(), llvm::BinaryOperator::CreateNSWNeg(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::ConstantExpr::getExactLogBase2(), llvm::APInt::getMinSignedBits(), llvm::ConstantExpr::getNeg(), llvm::Type::getScalarSizeInBits(), llvm::APInt::getSignMask(), llvm::ConstantExpr::getTrunc(), llvm::Value::getType(), I, llvm::isKnownToBeAPowerOfTwo(), llvm::APInt::isMinSignedValue(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_c_BinOp(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_NegatedPower2(), llvm::PatternMatch::m_NonNegative(), llvm::PatternMatch::m_NSWSub(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Power2(), llvm::PatternMatch::m_SDiv(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_SignMask(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::BitmaskEnumDetail::Mask(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), llvm::Instruction::setIsExact(), llvm::simplifySDivInst(), X, and Y.
Instruction* llvm::InstCombinerImpl::visitSelectInst | ( | SelectInst & | SI | ) |
Instruction * InstCombinerImpl::visitSExt | ( | SExtInst & | CI | ) |
Definition at line 1499 of file InstCombineCasts.cpp.
References assert(), Builder, canEvaluateSExtd(), llvm::ComputeNumSignBits(), llvm::CastInst::Create(), llvm::CastInst::CreateIntegerCast(), llvm::dbgs(), DL, llvm::ConstantInt::get(), llvm::Function::getFnAttribute(), llvm::Instruction::getFunction(), llvm::Value::getName(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getSExt(), llvm::ConstantExpr::getSub(), llvm::Value::getType(), llvm::Attribute::getVScaleRangeMax(), llvm::Function::hasFnAttribute(), hasOneUse(), llvm::Value::hasOneUse(), I, llvm::Constant::isElementWiseEqual(), llvm::isKnownNonNegative(), LLVM_DEBUG, llvm::Log2_32(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_SpecificIntAllowUndef(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_VScale(), llvm::PatternMatch::match(), llvm::Constant::mergeUndefsWith(), llvm::Instruction::user_back(), X, and Y.
Instruction * InstCombinerImpl::visitShl | ( | BinaryOperator & | I | ) |
Definition at line 811 of file InstCombineShifts.cpp.
References llvm::MCID::Add, B, llvm::tgtok::Bits, llvm::BitWidth, Builder, C1, llvm::ComputeNumSignBits(), llvm::BinaryOperator::Create(), llvm::SelectInst::Create(), CreateMul(), dropRedundantMaskingOfLeftShiftInput(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::APInt::getHighBitsSet(), llvm::Value::getName(), llvm::Constant::getNullValue(), getOpcode(), llvm::BinaryOperator::getOpcode(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getShl(), llvm::APInt::getSignMask(), llvm::SimplifyQuery::getWithInstruction(), I, llvm::Instruction::isCommutative(), M, llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_BinOp(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_Exact(), llvm::PatternMatch::m_Mul(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Shr(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_ZExt(), llvm::BitmaskEnumDetail::Mask(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), llvm::APInt::shl(), llvm::simplifyShlInst(), std::swap(), X, and Y.
Instruction * InstCombinerImpl::visitShuffleVectorInst | ( | ShuffleVectorInst & | SVI | ) |
Definition at line 2532 of file InstCombineVectorOps.cpp.
References assert(), Builder, canEvaluateShuffled(), canonicalizeInsertSplat(), llvm::SmallVectorImpl< T >::clear(), llvm::ShuffleVectorInst::commute(), llvm::CastInst::Create(), llvm::createUnaryMask(), DL, E, llvm::DenseMapBase< DenseMap< KeyT, ValueT, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >, KeyT, ValueT, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >::end(), evaluateInDifferentElementOrder(), llvm::MipsISD::Ext, llvm::DenseMapBase< DenseMap< KeyT, ValueT, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >, KeyT, ValueT, DenseMapInfo< KeyT >, llvm::detail::DenseMapPair< KeyT, ValueT > >::find(), foldCastShuffle(), foldFNegShuffle(), foldIdentityExtractShuffle(), foldIdentityPaddedShuffles(), foldShuffleWithInsert(), foldTruncShuffle(), llvm::ConstantInt::get(), llvm::FixedVectorType::get(), llvm::UndefValue::get(), llvm::APInt::getAllOnes(), llvm::Value::getContext(), llvm::Type::getInt32Ty(), llvm::Value::getName(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), llvm::ShuffleVectorInst::getShuffleMask(), llvm::Value::getType(), llvm::ShuffleVectorInst::getType(), llvm::SimplifyQuery::getWithInstruction(), llvm::Value::hasOneUse(), i, I, Int32Ty, isShuffleExtractingFromLHS(), isSplat(), llvm::VectorType::isValidElementType(), LHS, llvm::PatternMatch::m_BitCast(), llvm::PatternMatch::m_Undef(), llvm::PatternMatch::m_Value(), llvm::BitmaskEnumDetail::Mask(), llvm::PatternMatch::match(), llvm::narrowShuffleMaskElts(), narrowVectorSelect(), RHS, llvm::simplifyShuffleVectorInst(), llvm::Value::users(), llvm::widenShuffleMaskElts(), X, and Y.
Instruction * InstCombinerImpl::visitSIToFP | ( | CastInst & | CI | ) |
Definition at line 2030 of file InstCombineCasts.cpp.
Instruction * InstCombinerImpl::visitSRem | ( | BinaryOperator & | I | ) |
Definition at line 1539 of file InstCombineMulDivRem.cpp.
References Builder, llvm::BinaryOperator::CreateNSWNeg(), llvm::ConstantInt::get(), llvm::ConstantVector::get(), llvm::Constant::getAggregateElement(), llvm::ConstantExpr::getNeg(), llvm::APInt::getSignMask(), i, I, llvm::PatternMatch::m_Negative(), llvm::PatternMatch::m_NSWSub(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_SRem(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Zero(), llvm::BitmaskEnumDetail::Mask(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), RHS, llvm::simplifySRemInst(), X, and Y.
Instruction * InstCombinerImpl::visitStoreInst | ( | StoreInst & | SI | ) |
Definition at line 1328 of file InstCombineLoadStoreAlloca.cpp.
References assert(), llvm::sys::path::begin(), canSimplifyNullStoreOrGEP(), combineStoreToValueType(), DL, equivalentAddressValues(), GEP, llvm::PoisonValue::get(), llvm::getOrEnforceKnownAlignment(), llvm::Value::getType(), llvm::Value::hasOneUse(), removeBitcastsFromLoadStoreOnMinMax(), replaceGEPIdxWithZero(), SI, and unpackStoreToAggregate().
Instruction * InstCombinerImpl::visitSub | ( | BinaryOperator & | I | ) |
Definition at line 1799 of file InstCombineAddSub.cpp.
References llvm::InstCombiner::AddOne(), assert(), B, llvm::BitWidth, Builder, llvm::computeKnownBits(), Cond, llvm::Instruction::copyMetadata(), llvm::APInt::countTrailingZeros(), llvm::SelectInst::Create(), CreateAdd(), llvm::BinaryOperator::CreateNeg(), llvm::BinaryOperator::CreateNot(), llvm::MipsISD::Ext, factorizeMathWithShlOps(), llvm::tgtok::FalseVal, foldSubOfMinMax(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::APInt::getHighBitsSet(), llvm::Constant::getNullValue(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getSub(), llvm::Value::getType(), I, llvm::APInt::isMask(), isZero(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_c_Add(), llvm::PatternMatch::m_c_And(), llvm::PatternMatch::m_c_MaxOrMin(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_c_UMax(), llvm::PatternMatch::m_c_UMin(), llvm::PatternMatch::m_c_Xor(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_Neg(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_PtrToInt(), llvm::PatternMatch::m_Select(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_SpecificInt(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::PatternMatch::m_ZeroInt(), llvm::PatternMatch::m_ZExt(), llvm::PatternMatch::match(), llvm::Negator::Negate(), llvm::none_of(), llvm::MCID::Select, llvm::Instruction::setHasNoSignedWrap(), SI, llvm::simplifySubInst(), llvm::InstCombiner::SubOne(), llvm::tgtok::TrueVal, llvm::APIntOps::umin(), X, Y, and llvm::KnownBits::Zero.
Instruction * InstCombinerImpl::visitSwitchInst | ( | SwitchInst & | SI | ) |
Definition at line 3174 of file InstructionCombining.cpp.
References assert(), Builder, llvm::computeKnownBits(), Cond, llvm::KnownBits::countMinLeadingOnes(), llvm::KnownBits::countMinLeadingZeros(), llvm::IntegerType::get(), llvm::ConstantInt::get(), llvm::KnownBits::getBitWidth(), llvm::ConstantExpr::getSub(), llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), llvm::max(), llvm::min(), SI, and llvm::APInt::trunc().
Instruction * InstCombinerImpl::visitTrunc | ( | TruncInst & | CI | ) |
Definition at line 772 of file InstCombineCasts.cpp.
References llvm::And, assert(), B, Builder, canEvaluateTruncated(), llvm::BinaryOperator::Create(), llvm::ExtractElementInst::Create(), CreateAdd(), llvm::CastInst::CreateIntegerCast(), llvm::dbgs(), DL, foldVecTruncToExtElt(), llvm::ConstantInt::get(), llvm::VectorType::get(), llvm::Function::getFnAttribute(), llvm::Instruction::getFunction(), llvm::Constant::getNullValue(), llvm::User::getOperand(), llvm::ConstantExpr::getOr(), llvm::Type::getScalarSizeInBits(), llvm::ConstantExpr::getShl(), llvm::ConstantExpr::getTrunc(), llvm::Value::getType(), llvm::ConstantExpr::getUMin(), llvm::Attribute::getVScaleRangeMax(), llvm::ConstantInt::getZExtValue(), llvm::Function::hasFnAttribute(), I, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_ULE, llvm::CmpInst::ICMP_ULT, llvm::Type::isIntegerTy(), llvm::Type::isVectorTy(), LHS, LLVM_DEBUG, llvm::Log2_32(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_ExtractElt(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Shr(), llvm::PatternMatch::m_SpecificInt_ICMP(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_VScale(), llvm::PatternMatch::m_ZExt(), llvm::PatternMatch::match(), llvm::matchSelectPattern(), llvm::max(), llvm::Constant::mergeUndefsWith(), RHS, Shift, shrinkInsertElt(), shrinkSplatShuffle(), llvm::SPF_UNKNOWN, and X.
Instruction * InstCombinerImpl::visitUDiv | ( | BinaryOperator & | I | ) |
Definition at line 1022 of file InstCombineMulDivRem.cpp.
References B, Builder, C1, llvm::CastInst::CreateZExtOrBitCast(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), I, llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_Exact(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_Negative(), llvm::PatternMatch::m_NUWMul(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), narrowUDivURem(), llvm::Instruction::setIsExact(), llvm::simplifyUDivInst(), takeLog2(), llvm::APInt::ushl_ov(), and X.
Instruction * InstCombinerImpl::visitUIToFP | ( | CastInst & | CI | ) |
Definition at line 2026 of file InstCombineCasts.cpp.
Instruction * InstCombinerImpl::visitUnconditionalBranchInst | ( | BranchInst & | BI | ) |
Definition at line 3109 of file InstructionCombining.cpp.
References assert(), llvm::BranchInst::isUnconditional(), and SI.
Instruction * InstCombinerImpl::visitUnreachableInst | ( | UnreachableInst & | I | ) |
Definition at line 3082 of file InstructionCombining.cpp.
References assert(), llvm::PoisonValue::get(), I, and llvm::isGuaranteedToTransferExecutionToSuccessor().
Instruction * InstCombinerImpl::visitURem | ( | BinaryOperator & | I | ) |
Definition at line 1486 of file InstCombineMulDivRem.cpp.
References Builder, llvm::SelectInst::Create(), llvm::CastInst::CreateZExtOrBitCast(), llvm::ConstantInt::get(), llvm::Constant::getAllOnesValue(), llvm::Value::getName(), llvm::Constant::getNullValue(), I, llvm::isKnownToBeAPowerOfTwo(), llvm::PatternMatch::m_Negative(), llvm::PatternMatch::m_One(), llvm::PatternMatch::m_SExt(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::match(), narrowUDivURem(), llvm::simplifyURemInst(), and X.
Instruction * InstCombinerImpl::visitVAEndInst | ( | VAEndInst & | I | ) |
Definition at line 775 of file InstCombineCalls.cpp.
References I, and removeTriviallyEmptyRange().
Instruction * InstCombinerImpl::visitXor | ( | BinaryOperator & | I | ) |
Definition at line 3600 of file InstCombineAndOrXor.cpp.
References llvm::And, assert(), B, Builder, C1, canonicalizeAbs(), llvm::SelectInst::Create(), CreateAdd(), llvm::BinaryOperator::CreateNot(), D, foldXorToXor(), llvm::ConstantInt::get(), llvm::APInt::getAllOnes(), llvm::Constant::getAllOnesValue(), llvm::ConstantExpr::getNot(), llvm::Type::getScalarSizeInBits(), llvm::Type::getScalarType(), llvm::Value::getType(), llvm::ConstantInt::getValue(), llvm::ConstantExpr::getXor(), llvm::Value::hasOneUse(), I, llvm::APInt::isSignMask(), LHS, llvm::APInt::lshr(), M, llvm::PatternMatch::m_Add(), llvm::PatternMatch::m_AllOnes(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_APInt(), llvm::PatternMatch::m_APIntAllowUndef(), llvm::PatternMatch::m_AShr(), llvm::PatternMatch::m_c_And(), llvm::PatternMatch::m_c_Or(), llvm::PatternMatch::m_c_Xor(), llvm::PatternMatch::m_CombineAnd(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_ConstantExpr(), llvm::PatternMatch::m_ConstantInt(), llvm::PatternMatch::m_Deferred(), llvm::PatternMatch::m_ImmConstant(), llvm::PatternMatch::m_LShr(), llvm::PatternMatch::m_Not(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Or(), llvm::PatternMatch::m_Shl(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Sub(), llvm::PatternMatch::m_TruncOrSelf(), llvm::PatternMatch::m_Unless(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_Xor(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), llvm::Constant::mergeUndefsWith(), llvm::Or, llvm::Constant::replaceUndefsWith(), RHS, llvm::APInt::shl(), SimplifyBSwap(), llvm::simplifyXorInst(), std::swap(), visitMaskedMerge(), X, llvm::Xor, and Y.
Instruction * InstCombinerImpl::visitZExt | ( | ZExtInst & | CI | ) |
Definition at line 1238 of file InstCombineCasts.cpp.
References llvm::And, assert(), Builder, canEvaluateZExtd(), llvm::dbgs(), DL, llvm::ConstantInt::get(), llvm::Function::getFnAttribute(), llvm::Instruction::getFunction(), llvm::APInt::getHighBitsSet(), llvm::APInt::getLowBitsSet(), llvm::Value::getName(), llvm::User::getOperand(), llvm::Type::getScalarSizeInBits(), getScalarSizeInBits(), llvm::Value::getType(), llvm::Attribute::getVScaleRangeMax(), llvm::ConstantExpr::getZExt(), llvm::Function::hasFnAttribute(), llvm::Value::hasOneUse(), LLVM_DEBUG, llvm::Log2_32(), llvm::PatternMatch::m_And(), llvm::PatternMatch::m_Constant(), llvm::PatternMatch::m_OneUse(), llvm::PatternMatch::m_Specific(), llvm::PatternMatch::m_Trunc(), llvm::PatternMatch::m_Value(), llvm::PatternMatch::m_VScale(), llvm::PatternMatch::m_Xor(), llvm::MaskedValueIsZero(), llvm::PatternMatch::match(), llvm::replaceAllDbgUsesWith(), llvm::Instruction::user_back(), and X.