LLVM 20.0.0git
|
A description of a memory reference used in the backend. More...
#include "llvm/CodeGen/MachineMemOperand.h"
Public Types | |
enum | Flags : uint16_t { MONone = 0 , MOLoad = 1u << 0 , MOStore = 1u << 1 , MOVolatile = 1u << 2 , MONonTemporal = 1u << 3 , MODereferenceable = 1u << 4 , MOInvariant = 1u << 5 , MOTargetFlag1 = 1u << 6 , MOTargetFlag2 = 1u << 7 , MOTargetFlag3 = 1u << 8 } |
Flags values. These may be or'd together. More... | |
Public Member Functions | |
MachineMemOperand (MachinePointerInfo PtrInfo, Flags flags, LocationSize TS, Align a, const AAMDNodes &AAInfo=AAMDNodes(), const MDNode *Ranges=nullptr, SyncScope::ID SSID=SyncScope::System, AtomicOrdering Ordering=AtomicOrdering::NotAtomic, AtomicOrdering FailureOrdering=AtomicOrdering::NotAtomic) | |
Construct a MachineMemOperand object with the specified PtrInfo, flags, size, and base alignment. | |
MachineMemOperand (MachinePointerInfo PtrInfo, Flags flags, LLT type, Align a, const AAMDNodes &AAInfo=AAMDNodes(), const MDNode *Ranges=nullptr, SyncScope::ID SSID=SyncScope::System, AtomicOrdering Ordering=AtomicOrdering::NotAtomic, AtomicOrdering FailureOrdering=AtomicOrdering::NotAtomic) | |
const MachinePointerInfo & | getPointerInfo () const |
const Value * | getValue () const |
Return the base address of the memory access. | |
const PseudoSourceValue * | getPseudoValue () const |
const void * | getOpaqueValue () const |
Flags | getFlags () const |
Return the raw flags of the source value,. | |
void | setFlags (Flags f) |
Bitwise OR the current flags with the given flags. | |
int64_t | getOffset () const |
For normal values, this is a byte offset added to the base address. | |
unsigned | getAddrSpace () const |
LLT | getMemoryType () const |
Return the memory type of the memory reference. | |
LocationSize | getSize () const |
Return the size in bytes of the memory reference. | |
LocationSize | getSizeInBits () const |
Return the size in bits of the memory reference. | |
LLT | getType () const |
Align | getAlign () const |
Return the minimum known alignment in bytes of the actual memory reference. | |
Align | getBaseAlign () const |
Return the minimum known alignment in bytes of the base address, without the offset. | |
AAMDNodes | getAAInfo () const |
Return the AA tags for the memory reference. | |
const MDNode * | getRanges () const |
Return the range tag for the memory reference. | |
SyncScope::ID | getSyncScopeID () const |
Returns the synchronization scope ID for this memory operation. | |
AtomicOrdering | getSuccessOrdering () const |
Return the atomic ordering requirements for this memory operation. | |
AtomicOrdering | getFailureOrdering () const |
For cmpxchg atomic operations, return the atomic ordering requirements when store does not occur. | |
AtomicOrdering | getMergedOrdering () const |
Return a single atomic ordering that is at least as strong as both the success and failure orderings for an atomic operation. | |
bool | isLoad () const |
bool | isStore () const |
bool | isVolatile () const |
bool | isNonTemporal () const |
bool | isDereferenceable () const |
bool | isInvariant () const |
bool | isAtomic () const |
Returns true if this operation has an atomic ordering requirement of unordered or higher, false otherwise. | |
bool | isUnordered () const |
Returns true if this memory operation doesn't have any ordering constraints other than normal aliasing. | |
void | refineAlignment (const MachineMemOperand *MMO) |
Update this MachineMemOperand to reflect the alignment of MMO, if it has a greater alignment. | |
void | setValue (const Value *NewSV) |
Change the SourceValue for this MachineMemOperand. | |
void | setValue (const PseudoSourceValue *NewSV) |
void | setOffset (int64_t NewOffset) |
void | setType (LLT NewTy) |
Reset the tracked memory type. | |
void | clearRanges () |
Unset the tracked range metadata. | |
void | print (raw_ostream &OS, ModuleSlotTracker &MST, SmallVectorImpl< StringRef > &SSNs, const LLVMContext &Context, const MachineFrameInfo *MFI, const TargetInstrInfo *TII) const |
Support for operator<<. | |
Friends | |
bool | operator== (const MachineMemOperand &LHS, const MachineMemOperand &RHS) |
bool | operator!= (const MachineMemOperand &LHS, const MachineMemOperand &RHS) |
A description of a memory reference used in the backend.
Instead of holding a StoreInst or LoadInst, this class holds the address Value of the reference along with a byte size and offset. This allows it to describe lowered loads and stores. Also, the special PseudoSourceValue objects can be used to represent loads and stores to memory locations that aren't explicit in the regular LLVM IR.
Definition at line 129 of file MachineMemOperand.h.
Flags values. These may be or'd together.
Definition at line 132 of file MachineMemOperand.h.
MachineMemOperand::MachineMemOperand | ( | MachinePointerInfo | PtrInfo, |
Flags | flags, | ||
LocationSize | TS, | ||
Align | a, | ||
const AAMDNodes & | AAInfo = AAMDNodes() , |
||
const MDNode * | Ranges = nullptr , |
||
SyncScope::ID | SSID = SyncScope::System , |
||
AtomicOrdering | Ordering = AtomicOrdering::NotAtomic , |
||
AtomicOrdering | FailureOrdering = AtomicOrdering::NotAtomic |
||
) |
Construct a MachineMemOperand object with the specified PtrInfo, flags, size, and base alignment.
For atomic operations the synchronization scope and atomic ordering requirements must also be specified. For cmpxchg atomic operations the atomic ordering requirements when store does not occur must also be specified.
Definition at line 1113 of file MachineOperand.cpp.
MachineMemOperand::MachineMemOperand | ( | MachinePointerInfo | PtrInfo, |
Flags | flags, | ||
LLT | type, | ||
Align | a, | ||
const AAMDNodes & | AAInfo = AAMDNodes() , |
||
const MDNode * | Ranges = nullptr , |
||
SyncScope::ID | SSID = SyncScope::System , |
||
AtomicOrdering | Ordering = AtomicOrdering::NotAtomic , |
||
AtomicOrdering | FailureOrdering = AtomicOrdering::NotAtomic |
||
) |
Definition at line 1093 of file MachineOperand.cpp.
References assert(), getFailureOrdering(), getSuccessOrdering(), getSyncScopeID(), isLoad(), llvm::PointerUnion< PTs >::isNull(), isStore(), and llvm::MachinePointerInfo::V.
|
inline |
Unset the tracked range metadata.
Definition at line 335 of file MachineMemOperand.h.
Referenced by llvm::LegalizerHelper::bitcast().
|
inline |
Return the AA tags for the memory reference.
Definition at line 265 of file MachineMemOperand.h.
Referenced by llvm::MemSDNode::getAAInfo(), llvm::MachineFunction::getMachineMemOperand(), MemOperandsHaveAlias(), and print().
|
inline |
Definition at line 232 of file MachineMemOperand.h.
Referenced by llvm::X86TargetLowering::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccessForAlignment(), llvm::AMDGPURegisterBankInfo::applyMappingLoad(), llvm::GIMatchTableExecutor::executeMatchTable(), llvm::AMDGPURegisterBankInfo::isScalarLoadLegal(), llvm::AMDGPUInstrInfo::isUniformMMO(), and print().
Align MachineMemOperand::getAlign | ( | ) | const |
Return the minimum known alignment in bytes of the actual memory reference.
getAlign - Return the minimum known alignment in bytes of the actual memory reference.
Definition at line 1145 of file MachineOperand.cpp.
References llvm::commonAlignment(), getBaseAlign(), and getOffset().
Referenced by llvm::X86TargetLowering::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccessForAlignment(), llvm::AMDGPURegisterBankInfo::applyMappingLoad(), llvm::GIMatchTableExecutor::executeMatchTable(), llvm::MemSDNode::getAlign(), isMemoryOp(), llvm::AMDGPURegisterBankInfo::isScalarLoadLegal(), llvm::AMDGPULegalizerInfo::legalizeLoad(), llvm::CombinerHelper::matchCombineExtractedVectorLoad(), and print().
|
inline |
Return the minimum known alignment in bytes of the base address, without the offset.
Definition at line 262 of file MachineMemOperand.h.
Referenced by getAlign(), llvm::MachineFunction::getMachineMemOperand(), llvm::MemSDNode::getOriginalAlign(), print(), and refineAlignment().
|
inline |
For cmpxchg atomic operations, return the atomic ordering requirements when store does not occur.
Definition at line 284 of file MachineMemOperand.h.
Referenced by llvm::AtomicSDNode::getFailureOrdering(), llvm::MachineFunction::getMachineMemOperand(), getMergedOrdering(), MachineMemOperand(), and print().
|
inline |
Return the raw flags of the source value,.
Definition at line 223 of file MachineMemOperand.h.
Referenced by AddNodeIDCustom(), llvm::X86TargetLowering::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccessForAlignment(), llvm::SIRegisterInfo::buildSpillLoadStore(), combineMOVDQ2Q(), combineStore(), combineTargetShuffle(), EltsFromConsecutiveLoads(), llvm::SelectionDAG::getAtomic(), llvm::SelectionDAG::getGatherVP(), llvm::SelectionDAG::getGetFPEnv(), llvm::SelectionDAG::getLoad(), llvm::SelectionDAG::getLoadVP(), llvm::MachineFunction::getMachineMemOperand(), llvm::SelectionDAG::getMaskedGather(), llvm::SelectionDAG::getMaskedHistogram(), llvm::SelectionDAG::getMaskedLoad(), llvm::SelectionDAG::getMaskedScatter(), llvm::SelectionDAG::getMaskedStore(), llvm::SelectionDAG::getMemIntrinsicNode(), llvm::SelectionDAG::getScatterVP(), llvm::SelectionDAG::getSetFPEnv(), llvm::SelectionDAG::getStore(), llvm::SelectionDAG::getStoreVP(), llvm::SelectionDAG::getTruncStore(), llvm::SelectionDAG::getTruncStoreVP(), llvm::SITargetLowering::isMemOpHasNoClobberedMemOperand(), llvm::AMDGPURegisterBankInfo::isScalarLoadLegal(), lowerFP_TO_SINT_STORE(), LowerLoad(), llvm::HexagonTargetLowering::LowerLoad(), LowerStore(), LowerSTORE(), narrowLoadToVZLoad(), PerformExtractFpToIntStores(), performIntToFpCombine(), llvm::AMDGPUTargetLowering::performLoadCombine(), PerformSplittingMVETruncToNarrowingStores(), PerformSplittingToNarrowingStores(), llvm::AMDGPUTargetLowering::performStoreCombine(), PerformSTORECombine(), PerformTruncatingStoreCombine(), print(), reduceMaskedStoreToScalarStore(), refineAlignment(), llvm::SparcTargetLowering::ReplaceNodeResults(), splitStores(), and splitStoreSplat().
|
inline |
Return the memory type of the memory reference.
This should only be relied on for GlobalISel G_* operation legalization.
Definition at line 236 of file MachineMemOperand.h.
Referenced by llvm::LegalizerHelper::bitcast(), llvm::GISelKnownBits::computeKnownBitsImpl(), llvm::AMDGPULegalizerInfo::legalizeBufferLoad(), llvm::AMDGPULegalizerInfo::legalizeBufferStore(), llvm::AMDGPULegalizerInfo::legalizeLoad(), llvm::LegalizerHelper::lowerLoad(), llvm::LegalizerHelper::lowerStore(), and print().
|
inline |
Return a single atomic ordering that is at least as strong as both the success and failure orderings for an atomic operation.
(For operations other than cmpxchg, this is equivalent to getSuccessOrdering().)
Definition at line 291 of file MachineMemOperand.h.
References getFailureOrdering(), llvm::getMergedAtomicOrdering(), and getSuccessOrdering().
Referenced by llvm::MemSDNode::getMergedOrdering().
|
inline |
For normal values, this is a byte offset added to the base address.
For PseudoSourceValue::FPRel values, this is the FrameIndex number.
Definition at line 230 of file MachineMemOperand.h.
Referenced by llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), llvm::PPCHazardRecognizer970::EmitInstruction(), getAlign(), llvm::PPCHazardRecognizer970::getHazardType(), llvm::MachineFunction::getMachineMemOperand(), llvm::MemSDNode::getSrcValueOffset(), MemOperandsHaveAlias(), and print().
|
inline |
Definition at line 220 of file MachineMemOperand.h.
Referenced by print().
|
inline |
Definition at line 203 of file MachineMemOperand.h.
Referenced by llvm::SIRegisterInfo::buildSpillLoadStore(), llvm::SelectionDAG::getAtomic(), llvm::SelectionDAG::getGatherVP(), llvm::SelectionDAG::getGetFPEnv(), llvm::SelectionDAG::getLoad(), llvm::SelectionDAG::getLoadVP(), llvm::MachineFunction::getMachineMemOperand(), llvm::SelectionDAG::getMaskedGather(), llvm::SelectionDAG::getMaskedHistogram(), llvm::SelectionDAG::getMaskedLoad(), llvm::SelectionDAG::getMaskedScatter(), llvm::SelectionDAG::getMaskedStore(), llvm::SelectionDAG::getMemIntrinsicNode(), llvm::MemSDNode::getPointerInfo(), llvm::SelectionDAG::getScatterVP(), llvm::SelectionDAG::getSetFPEnv(), llvm::SelectionDAG::getStore(), llvm::SelectionDAG::getStoreVP(), llvm::SelectionDAG::getStridedLoadVP(), llvm::SelectionDAG::getStridedStoreVP(), llvm::SelectionDAG::getTruncStore(), llvm::SelectionDAG::getTruncStoreVP(), llvm::SelectionDAG::getTruncStridedStoreVP(), llvm::LegalizerHelper::lowerLoad(), llvm::LegalizerHelper::lowerStore(), llvm::CombinerHelper::matchCombineExtractedVectorLoad(), llvm::CombinerHelper::matchCombineLoadWithAndMask(), llvm::CombinerHelper::matchLoadOrCombine(), and tryMemPairCombine().
|
inline |
Definition at line 216 of file MachineMemOperand.h.
Referenced by llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), llvm::TargetInstrInfo::describeLoadedValue(), llvm::MachineFunction::getMachineMemOperand(), getMMOFrameID(), MemOperandsHaveAlias(), and print().
Return the range tag for the memory reference.
Definition at line 268 of file MachineMemOperand.h.
Referenced by llvm::GISelKnownBits::computeKnownBitsImpl(), llvm::MachineFunction::getMachineMemOperand(), llvm::GAnyLoad::getRanges(), llvm::MemSDNode::getRanges(), and print().
|
inline |
Return the size in bytes of the memory reference.
Definition at line 239 of file MachineMemOperand.h.
References llvm::LocationSize::beforeOrAfterPointer(), and llvm::LocationSize::precise().
Referenced by llvm::AMDGPURegisterBankInfo::applyMappingLoad(), llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), llvm::TargetInstrInfo::describeLoadedValue(), llvm::PPCHazardRecognizer970::EmitInstruction(), llvm::GIMatchTableExecutor::executeMatchTable(), llvm::PPCTargetLowering::expandVSXLoadForLE(), llvm::PPCTargetLowering::expandVSXStoreForLE(), llvm::SystemZInstrInfo::foldMemoryOperandImpl(), llvm::PPCHazardRecognizer970::getHazardType(), llvm::MachineFunction::getMachineMemOperand(), llvm::GMemOperation::getMemSize(), llvm::AMDGPURegisterBankInfo::isScalarLoadLegal(), llvm::AMDGPULegalizerInfo::legalizeBufferStore(), MemOperandsHaveAlias(), llvm::MemSDNode::MemSDNode(), print(), and refineAlignment().
|
inline |
Return the size in bits of the memory reference.
Definition at line 246 of file MachineMemOperand.h.
References llvm::LocationSize::beforeOrAfterPointer(), and llvm::LocationSize::precise().
Referenced by llvm::GISelKnownBits::computeNumSignBits(), llvm::GIMatchTableExecutor::executeMatchTable(), llvm::GMemOperation::getMemSizeInBits(), and llvm::LegalizerHelper::narrowScalar().
|
inline |
Return the atomic ordering requirements for this memory operation.
For cmpxchg atomic operations, return the atomic ordering requirements when store occurs.
Definition at line 278 of file MachineMemOperand.h.
Referenced by llvm::MachineFunction::getMachineMemOperand(), getMergedOrdering(), llvm::MemSDNode::getSuccessOrdering(), isAtomic(), isUnordered(), MachineMemOperand(), and print().
|
inline |
Returns the synchronization scope ID for this memory operation.
Definition at line 271 of file MachineMemOperand.h.
Referenced by llvm::MachineFunction::getMachineMemOperand(), llvm::MemSDNode::getSyncScopeID(), MachineMemOperand(), and print().
|
inline |
Definition at line 252 of file MachineMemOperand.h.
Referenced by llvm::MemSDNode::MemSDNode().
Return the base address of the memory access.
This may either be a normal LLVM IR Value, or one of the special values used in CodeGen. Special values are those obtained via PseudoSourceValue::getFixedStack(int), PseudoSourceValue::getStack, and other PseudoSourceValue member functions which return objects which stand for frame/stack pointer relative references and other special references which are not representable in the high-level IR.
Definition at line 212 of file MachineMemOperand.h.
Referenced by llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), llvm::PPCHazardRecognizer970::EmitInstruction(), llvm::PPCHazardRecognizer970::getHazardType(), llvm::MachineFunction::getMachineMemOperand(), getMMOFrameID(), getUnderlyingObjects(), llvm::AMDGPUInstrInfo::isUniformMMO(), MemOperandsHaveAlias(), and print().
|
inline |
Returns true if this operation has an atomic ordering requirement of unordered or higher, false otherwise.
Definition at line 304 of file MachineMemOperand.h.
References getSuccessOrdering(), and llvm::NotAtomic.
Referenced by llvm::AtomicSDNode::AtomicSDNode(), llvm::MachineIRBuilder::buildAtomicRMW(), llvm::SystemZInstrInfo::foldMemoryOperandImpl(), INITIALIZE_PASS(), llvm::GMemOperation::isAtomic(), llvm::MemSDNode::isAtomic(), isMemoryOp(), and llvm::AMDGPURegisterBankInfo::isScalarLoadLegal().
|
inline |
Definition at line 299 of file MachineMemOperand.h.
References MODereferenceable.
Referenced by llvm::MemSDNode::MemSDNode(), and print().
|
inline |
Definition at line 300 of file MachineMemOperand.h.
References MOInvariant.
Referenced by llvm::AMDGPURegisterBankInfo::isScalarLoadLegal(), llvm::MemSDNode::MemSDNode(), and print().
|
inline |
Definition at line 295 of file MachineMemOperand.h.
References MOLoad.
Referenced by MachineMemOperand(), print(), and llvm::MemSDNode::readMem().
|
inline |
Definition at line 298 of file MachineMemOperand.h.
References MONonTemporal.
Referenced by llvm::RISCVInstrInfo::getInstSizeInBytes(), llvm::MemSDNode::MemSDNode(), and print().
|
inline |
Definition at line 296 of file MachineMemOperand.h.
References MOStore.
Referenced by MachineMemOperand(), print(), and llvm::MemSDNode::writeMem().
|
inline |
Returns true if this memory operation doesn't have any ordering constraints other than normal aliasing.
Volatile and (ordered) atomic memory operations can't be reordered.
Definition at line 311 of file MachineMemOperand.h.
References getSuccessOrdering(), isVolatile(), llvm::NotAtomic, and llvm::Unordered.
Referenced by llvm::MachineInstr::hasOrderedMemoryRef(), llvm::GMemOperation::isUnordered(), and llvm::MemSDNode::isUnordered().
|
inline |
Definition at line 297 of file MachineMemOperand.h.
References MOVolatile.
Referenced by llvm::SystemZInstrInfo::foldMemoryOperandImpl(), INITIALIZE_PASS(), isMemoryOp(), llvm::AMDGPURegisterBankInfo::isScalarLoadLegal(), isUnordered(), llvm::GMemOperation::isVolatile(), llvm::MemSDNode::MemSDNode(), and print().
void MachineMemOperand::print | ( | raw_ostream & | OS, |
ModuleSlotTracker & | MST, | ||
SmallVectorImpl< StringRef > & | SSNs, | ||
const LLVMContext & | Context, | ||
const MachineFrameInfo * | MFI, | ||
const TargetInstrInfo * | TII | ||
) | const |
Support for operator<<.
Definition at line 1149 of file MachineOperand.cpp.
References assert(), llvm::PseudoSourceValue::ConstantPool, llvm::PseudoSourceValue::ExternalSymbolCallEntry, llvm::PseudoSourceValue::FixedStack, getAAInfo(), getAddrSpace(), getAlign(), getBaseAlign(), getFailureOrdering(), getFlags(), getMemoryType(), getOffset(), getOpaqueValue(), getPseudoValue(), getRanges(), getSize(), getSuccessOrdering(), getSyncScopeID(), getTargetMMOFlagName(), getValue(), llvm::PseudoSourceValue::GlobalValueCallEntry, llvm::PseudoSourceValue::GOT, isDereferenceable(), isInvariant(), isLoad(), isNonTemporal(), isStore(), isValid(), isVolatile(), isZero(), llvm::PseudoSourceValue::JumpTable, MOTargetFlag1, MOTargetFlag2, MOTargetFlag3, llvm::AAMDNodes::NoAlias, llvm::NotAtomic, OS, llvm::Metadata::printAsOperand(), llvm::MIRFormatter::printCustomPseudoSourceValue(), printFrameIndex(), llvm::MIRFormatter::printIRValue(), llvm::printLLVMNameWithoutPrefix(), llvm::MachineOperand::printOperandOffset(), printSyncScope(), llvm::AAMDNodes::Scope, llvm::PseudoSourceValue::Stack, llvm::AAMDNodes::TBAA, TII, llvm::toIRString(), and llvm::Align::value().
Referenced by printMemOperand().
void MachineMemOperand::refineAlignment | ( | const MachineMemOperand * | MMO | ) |
Update this MachineMemOperand to reflect the alignment of MMO, if it has a greater alignment.
This must only be used when the new alignment applies to all users of this MachineMemOperand.
Definition at line 1127 of file MachineOperand.cpp.
References assert(), getBaseAlign(), getFlags(), getSize(), and llvm::LocationSize::hasValue().
Referenced by llvm::MemSDNode::refineAlignment().
|
inline |
Bitwise OR the current flags with the given flags.
Definition at line 226 of file MachineMemOperand.h.
Referenced by llvm::RISCVDAGToDAGISel::Select().
|
inline |
Definition at line 327 of file MachineMemOperand.h.
|
inline |
Reset the tracked memory type.
Definition at line 330 of file MachineMemOperand.h.
Referenced by llvm::LegalizerHelper::bitcast().
|
inline |
Definition at line 326 of file MachineMemOperand.h.
Change the SourceValue for this MachineMemOperand.
This should only be used when an object is being relocated and all references to it are being updated.
Definition at line 325 of file MachineMemOperand.h.
|
friend |
Definition at line 357 of file MachineMemOperand.h.
|
friend |
Definition at line 344 of file MachineMemOperand.h.