LLVM 18.0.0git
|
A description of a memory reference used in the backend. More...
#include "llvm/CodeGen/MachineMemOperand.h"
Public Types | |
enum | Flags : uint16_t { MONone = 0 , MOLoad = 1u << 0 , MOStore = 1u << 1 , MOVolatile = 1u << 2 , MONonTemporal = 1u << 3 , MODereferenceable = 1u << 4 , MOInvariant = 1u << 5 , MOTargetFlag1 = 1u << 6 , MOTargetFlag2 = 1u << 7 , MOTargetFlag3 = 1u << 8 } |
Flags values. These may be or'd together. More... | |
Public Member Functions | |
MachineMemOperand (MachinePointerInfo PtrInfo, Flags flags, uint64_t s, Align a, const AAMDNodes &AAInfo=AAMDNodes(), const MDNode *Ranges=nullptr, SyncScope::ID SSID=SyncScope::System, AtomicOrdering Ordering=AtomicOrdering::NotAtomic, AtomicOrdering FailureOrdering=AtomicOrdering::NotAtomic) | |
Construct a MachineMemOperand object with the specified PtrInfo, flags, size, and base alignment. | |
MachineMemOperand (MachinePointerInfo PtrInfo, Flags flags, LLT type, Align a, const AAMDNodes &AAInfo=AAMDNodes(), const MDNode *Ranges=nullptr, SyncScope::ID SSID=SyncScope::System, AtomicOrdering Ordering=AtomicOrdering::NotAtomic, AtomicOrdering FailureOrdering=AtomicOrdering::NotAtomic) | |
const MachinePointerInfo & | getPointerInfo () const |
const Value * | getValue () const |
Return the base address of the memory access. | |
const PseudoSourceValue * | getPseudoValue () const |
const void * | getOpaqueValue () const |
Flags | getFlags () const |
Return the raw flags of the source value,. | |
void | setFlags (Flags f) |
Bitwise OR the current flags with the given flags. | |
int64_t | getOffset () const |
For normal values, this is a byte offset added to the base address. | |
unsigned | getAddrSpace () const |
LLT | getMemoryType () const |
Return the memory type of the memory reference. | |
uint64_t | getSize () const |
Return the size in bytes of the memory reference. | |
uint64_t | getSizeInBits () const |
Return the size in bits of the memory reference. | |
LLT | getType () const |
Align | getAlign () const |
Return the minimum known alignment in bytes of the actual memory reference. | |
Align | getBaseAlign () const |
Return the minimum known alignment in bytes of the base address, without the offset. | |
AAMDNodes | getAAInfo () const |
Return the AA tags for the memory reference. | |
const MDNode * | getRanges () const |
Return the range tag for the memory reference. | |
SyncScope::ID | getSyncScopeID () const |
Returns the synchronization scope ID for this memory operation. | |
AtomicOrdering | getSuccessOrdering () const |
Return the atomic ordering requirements for this memory operation. | |
AtomicOrdering | getFailureOrdering () const |
For cmpxchg atomic operations, return the atomic ordering requirements when store does not occur. | |
AtomicOrdering | getMergedOrdering () const |
Return a single atomic ordering that is at least as strong as both the success and failure orderings for an atomic operation. | |
bool | isLoad () const |
bool | isStore () const |
bool | isVolatile () const |
bool | isNonTemporal () const |
bool | isDereferenceable () const |
bool | isInvariant () const |
bool | isAtomic () const |
Returns true if this operation has an atomic ordering requirement of unordered or higher, false otherwise. | |
bool | isUnordered () const |
Returns true if this memory operation doesn't have any ordering constraints other than normal aliasing. | |
void | refineAlignment (const MachineMemOperand *MMO) |
Update this MachineMemOperand to reflect the alignment of MMO, if it has a greater alignment. | |
void | setValue (const Value *NewSV) |
Change the SourceValue for this MachineMemOperand. | |
void | setValue (const PseudoSourceValue *NewSV) |
void | setOffset (int64_t NewOffset) |
void | setType (LLT NewTy) |
Reset the tracked memory type. | |
void | print (raw_ostream &OS, ModuleSlotTracker &MST, SmallVectorImpl< StringRef > &SSNs, const LLVMContext &Context, const MachineFrameInfo *MFI, const TargetInstrInfo *TII) const |
Support for operator<<. | |
Friends | |
bool | operator== (const MachineMemOperand &LHS, const MachineMemOperand &RHS) |
bool | operator!= (const MachineMemOperand &LHS, const MachineMemOperand &RHS) |
A description of a memory reference used in the backend.
Instead of holding a StoreInst or LoadInst, this class holds the address Value of the reference along with a byte size and offset. This allows it to describe lowered loads and stores. Also, the special PseudoSourceValue objects can be used to represent loads and stores to memory locations that aren't explicit in the regular LLVM IR.
Definition at line 126 of file MachineMemOperand.h.
Flags values. These may be or'd together.
Definition at line 129 of file MachineMemOperand.h.
MachineMemOperand::MachineMemOperand | ( | MachinePointerInfo | PtrInfo, |
Flags | flags, | ||
uint64_t | s, | ||
Align | a, | ||
const AAMDNodes & | AAInfo = AAMDNodes() , |
||
const MDNode * | Ranges = nullptr , |
||
SyncScope::ID | SSID = SyncScope::System , |
||
AtomicOrdering | Ordering = AtomicOrdering::NotAtomic , |
||
AtomicOrdering | FailureOrdering = AtomicOrdering::NotAtomic |
||
) |
Construct a MachineMemOperand object with the specified PtrInfo, flags, size, and base alignment.
For atomic operations the synchronization scope and atomic ordering requirements must also be specified. For cmpxchg atomic operations the atomic ordering requirements when store does not occur must also be specified.
Definition at line 1090 of file MachineOperand.cpp.
MachineMemOperand::MachineMemOperand | ( | MachinePointerInfo | PtrInfo, |
Flags | flags, | ||
LLT | type, | ||
Align | a, | ||
const AAMDNodes & | AAInfo = AAMDNodes() , |
||
const MDNode * | Ranges = nullptr , |
||
SyncScope::ID | SSID = SyncScope::System , |
||
AtomicOrdering | Ordering = AtomicOrdering::NotAtomic , |
||
AtomicOrdering | FailureOrdering = AtomicOrdering::NotAtomic |
||
) |
Definition at line 1070 of file MachineOperand.cpp.
References assert(), getFailureOrdering(), getSuccessOrdering(), getSyncScopeID(), isLoad(), llvm::PointerUnion< PTs >::isNull(), isStore(), and llvm::MachinePointerInfo::V.
|
inline |
Return the AA tags for the memory reference.
Definition at line 258 of file MachineMemOperand.h.
Referenced by llvm::MemSDNode::getAAInfo(), llvm::MachineFunction::getMachineMemOperand(), MemOperandsHaveAlias(), and print().
|
inline |
Definition at line 229 of file MachineMemOperand.h.
Referenced by llvm::X86TargetLowering::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccessForAlignment(), llvm::GIMatchTableExecutor::executeMatchTable(), isScalarLoadLegal(), llvm::AMDGPUInstrInfo::isUniformMMO(), and print().
Align MachineMemOperand::getAlign | ( | ) | const |
Return the minimum known alignment in bytes of the actual memory reference.
getAlign - Return the minimum known alignment in bytes of the actual memory reference.
Definition at line 1119 of file MachineOperand.cpp.
References llvm::commonAlignment(), getBaseAlign(), and getOffset().
Referenced by llvm::X86TargetLowering::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccessForAlignment(), llvm::AMDGPURegisterBankInfo::applyMappingLoad(), llvm::GIMatchTableExecutor::executeMatchTable(), llvm::MemSDNode::getAlign(), isMemoryOp(), isScalarLoadLegal(), llvm::AMDGPULegalizerInfo::legalizeLoad(), and print().
|
inline |
Return the minimum known alignment in bytes of the base address, without the offset.
Definition at line 255 of file MachineMemOperand.h.
Referenced by getAlign(), llvm::MachineFunction::getMachineMemOperand(), llvm::MemSDNode::getOriginalAlign(), print(), and refineAlignment().
|
inline |
For cmpxchg atomic operations, return the atomic ordering requirements when store does not occur.
Definition at line 277 of file MachineMemOperand.h.
Referenced by llvm::AtomicSDNode::getFailureOrdering(), llvm::MachineFunction::getMachineMemOperand(), getMergedOrdering(), MachineMemOperand(), and print().
|
inline |
Return the raw flags of the source value,.
Definition at line 220 of file MachineMemOperand.h.
Referenced by AddNodeIDCustom(), llvm::X86TargetLowering::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccess(), llvm::TargetLoweringBase::allowsMemoryAccessForAlignment(), llvm::SIRegisterInfo::buildSpillLoadStore(), combineLoad(), combineMOVDQ2Q(), combineStore(), combineTargetShuffle(), EltsFromConsecutiveLoads(), llvm::SelectionDAG::getAtomic(), llvm::SelectionDAG::getGatherVP(), llvm::SelectionDAG::getGetFPEnv(), llvm::SelectionDAG::getLoad(), llvm::SelectionDAG::getLoadVP(), llvm::MachineFunction::getMachineMemOperand(), llvm::SelectionDAG::getMaskedGather(), llvm::SelectionDAG::getMaskedLoad(), llvm::SelectionDAG::getMaskedScatter(), llvm::SelectionDAG::getMaskedStore(), llvm::SelectionDAG::getMemIntrinsicNode(), llvm::SelectionDAG::getScatterVP(), llvm::SelectionDAG::getSetFPEnv(), llvm::SelectionDAG::getStore(), llvm::SelectionDAG::getStoreVP(), llvm::SelectionDAG::getTruncStore(), llvm::SelectionDAG::getTruncStoreVP(), llvm::SITargetLowering::isMemOpHasNoClobberedMemOperand(), isScalarLoadLegal(), lowerFP_TO_SINT_STORE(), LowerLoad(), llvm::HexagonTargetLowering::LowerLoad(), LowerStore(), LowerSTORE(), narrowLoadToVZLoad(), PerformExtractFpToIntStores(), performIntToFpCombine(), llvm::AMDGPUTargetLowering::performLoadCombine(), PerformSplittingMVETruncToNarrowingStores(), PerformSplittingToNarrowingStores(), llvm::AMDGPUTargetLowering::performStoreCombine(), PerformSTORECombine(), PerformTruncatingStoreCombine(), print(), reduceMaskedStoreToScalarStore(), refineAlignment(), llvm::SparcTargetLowering::ReplaceNodeResults(), splitStores(), and splitStoreSplat().
|
inline |
Return the memory type of the memory reference.
This should only be relied on for GlobalISel G_* operation legalization.
Definition at line 233 of file MachineMemOperand.h.
Referenced by llvm::LegalizerHelper::bitcast(), llvm::AMDGPULegalizerInfo::legalizeBufferLoad(), llvm::AMDGPULegalizerInfo::legalizeLoad(), llvm::LegalizerHelper::lowerLoad(), llvm::LegalizerHelper::lowerStore(), and print().
|
inline |
Return a single atomic ordering that is at least as strong as both the success and failure orderings for an atomic operation.
(For operations other than cmpxchg, this is equivalent to getSuccessOrdering().)
Definition at line 284 of file MachineMemOperand.h.
References getFailureOrdering(), llvm::getMergedAtomicOrdering(), and getSuccessOrdering().
Referenced by llvm::MemSDNode::getMergedOrdering().
|
inline |
For normal values, this is a byte offset added to the base address.
For PseudoSourceValue::FPRel values, this is the FrameIndex number.
Definition at line 227 of file MachineMemOperand.h.
Referenced by llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), llvm::PPCHazardRecognizer970::EmitInstruction(), getAlign(), llvm::PPCHazardRecognizer970::getHazardType(), llvm::MachineFunction::getMachineMemOperand(), llvm::MemSDNode::getSrcValueOffset(), MemOperandsHaveAlias(), and print().
|
inline |
Definition at line 217 of file MachineMemOperand.h.
Referenced by print().
|
inline |
Definition at line 200 of file MachineMemOperand.h.
Referenced by llvm::SIRegisterInfo::buildSpillLoadStore(), llvm::SelectionDAG::getAtomic(), llvm::SelectionDAG::getGatherVP(), llvm::SelectionDAG::getGetFPEnv(), llvm::SelectionDAG::getLoad(), llvm::SelectionDAG::getLoadVP(), llvm::MachineFunction::getMachineMemOperand(), llvm::SelectionDAG::getMaskedGather(), llvm::SelectionDAG::getMaskedLoad(), llvm::SelectionDAG::getMaskedScatter(), llvm::SelectionDAG::getMaskedStore(), llvm::SelectionDAG::getMemIntrinsicNode(), llvm::MemSDNode::getPointerInfo(), llvm::SelectionDAG::getScatterVP(), llvm::SelectionDAG::getSetFPEnv(), llvm::SelectionDAG::getStore(), llvm::SelectionDAG::getStoreVP(), llvm::SelectionDAG::getStridedLoadVP(), llvm::SelectionDAG::getStridedStoreVP(), llvm::SelectionDAG::getTruncStore(), llvm::SelectionDAG::getTruncStoreVP(), llvm::SelectionDAG::getTruncStridedStoreVP(), llvm::LegalizerHelper::lowerLoad(), llvm::LegalizerHelper::lowerStore(), llvm::CombinerHelper::matchCombineLoadWithAndMask(), llvm::CombinerHelper::matchLoadOrCombine(), and tryMemPairCombine().
|
inline |
Definition at line 213 of file MachineMemOperand.h.
Referenced by llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), llvm::TargetInstrInfo::describeLoadedValue(), llvm::MachineFunction::getMachineMemOperand(), MemOperandsHaveAlias(), and print().
Return the range tag for the memory reference.
Definition at line 261 of file MachineMemOperand.h.
Referenced by llvm::GISelKnownBits::computeKnownBitsImpl(), llvm::MachineFunction::getMachineMemOperand(), llvm::MemSDNode::getRanges(), and print().
|
inline |
Return the size in bytes of the memory reference.
Definition at line 236 of file MachineMemOperand.h.
Referenced by llvm::AMDGPURegisterBankInfo::applyMappingLoad(), llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), llvm::TargetInstrInfo::describeLoadedValue(), llvm::PPCHazardRecognizer970::EmitInstruction(), llvm::GIMatchTableExecutor::executeMatchTable(), llvm::PPCTargetLowering::expandVSXLoadForLE(), llvm::PPCTargetLowering::expandVSXStoreForLE(), llvm::SystemZInstrInfo::foldMemoryOperandImpl(), llvm::PPCHazardRecognizer970::getHazardType(), llvm::MachineFunction::getMachineMemOperand(), llvm::GMemOperation::getMemSize(), llvm::AMDGPULegalizerInfo::legalizeBufferStore(), MemOperandsHaveAlias(), llvm::MemSDNode::MemSDNode(), print(), and refineAlignment().
|
inline |
Return the size in bits of the memory reference.
Definition at line 241 of file MachineMemOperand.h.
Referenced by llvm::GISelKnownBits::computeNumSignBits(), llvm::GIMatchTableExecutor::executeMatchTable(), and llvm::GMemOperation::getMemSizeInBits().
|
inline |
Return the atomic ordering requirements for this memory operation.
For cmpxchg atomic operations, return the atomic ordering requirements when store occurs.
Definition at line 271 of file MachineMemOperand.h.
Referenced by llvm::MachineFunction::getMachineMemOperand(), getMergedOrdering(), llvm::MemSDNode::getSuccessOrdering(), isAtomic(), isUnordered(), MachineMemOperand(), and print().
|
inline |
Returns the synchronization scope ID for this memory operation.
Definition at line 264 of file MachineMemOperand.h.
Referenced by llvm::MachineFunction::getMachineMemOperand(), llvm::MemSDNode::getSyncScopeID(), MachineMemOperand(), and print().
|
inline |
Definition at line 245 of file MachineMemOperand.h.
Return the base address of the memory access.
This may either be a normal LLVM IR Value, or one of the special values used in CodeGen. Special values are those obtained via PseudoSourceValue::getFixedStack(int), PseudoSourceValue::getStack, and other PseudoSourceValue member functions which return objects which stand for frame/stack pointer relative references and other special references which are not representable in the high-level IR.
Definition at line 209 of file MachineMemOperand.h.
Referenced by llvm::SystemZInstrInfo::areMemAccessesTriviallyDisjoint(), combineAndLoadToBZHI(), llvm::PPCHazardRecognizer970::EmitInstruction(), llvm::PPCHazardRecognizer970::getHazardType(), llvm::MachineFunction::getMachineMemOperand(), getUnderlyingObjects(), llvm::AMDGPUInstrInfo::isUniformMMO(), MemOperandsHaveAlias(), and print().
|
inline |
Returns true if this operation has an atomic ordering requirement of unordered or higher, false otherwise.
Definition at line 297 of file MachineMemOperand.h.
References getSuccessOrdering(), and llvm::NotAtomic.
Referenced by llvm::AtomicSDNode::AtomicSDNode(), llvm::MachineIRBuilder::buildAtomicRMW(), llvm::SystemZInstrInfo::foldMemoryOperandImpl(), INITIALIZE_PASS(), llvm::GMemOperation::isAtomic(), llvm::MemSDNode::isAtomic(), isMemoryOp(), and isScalarLoadLegal().
|
inline |
Definition at line 292 of file MachineMemOperand.h.
References MODereferenceable.
Referenced by llvm::MemSDNode::MemSDNode(), and print().
|
inline |
Definition at line 293 of file MachineMemOperand.h.
References MOInvariant.
Referenced by isScalarLoadLegal(), llvm::MemSDNode::MemSDNode(), and print().
|
inline |
Definition at line 288 of file MachineMemOperand.h.
References MOLoad.
Referenced by MachineMemOperand(), print(), and llvm::MemSDNode::readMem().
|
inline |
Definition at line 291 of file MachineMemOperand.h.
References MONonTemporal.
Referenced by llvm::RISCVInstrInfo::getInstSizeInBytes(), llvm::MemSDNode::MemSDNode(), and print().
|
inline |
Definition at line 289 of file MachineMemOperand.h.
References MOStore.
Referenced by MachineMemOperand(), print(), and llvm::MemSDNode::writeMem().
|
inline |
Returns true if this memory operation doesn't have any ordering constraints other than normal aliasing.
Volatile and (ordered) atomic memory operations can't be reordered.
Definition at line 304 of file MachineMemOperand.h.
References getSuccessOrdering(), isVolatile(), llvm::NotAtomic, and llvm::Unordered.
Referenced by llvm::MachineInstr::hasOrderedMemoryRef(), llvm::GMemOperation::isUnordered(), and llvm::MemSDNode::isUnordered().
|
inline |
Definition at line 290 of file MachineMemOperand.h.
References MOVolatile.
Referenced by llvm::SystemZInstrInfo::foldMemoryOperandImpl(), INITIALIZE_PASS(), isMemoryOp(), isScalarLoadLegal(), isUnordered(), llvm::GMemOperation::isVolatile(), llvm::MemSDNode::MemSDNode(), and print().
void MachineMemOperand::print | ( | raw_ostream & | OS, |
ModuleSlotTracker & | MST, | ||
SmallVectorImpl< StringRef > & | SSNs, | ||
const LLVMContext & | Context, | ||
const MachineFrameInfo * | MFI, | ||
const TargetInstrInfo * | TII | ||
) | const |
Support for operator<<.
Definition at line 1123 of file MachineOperand.cpp.
References assert(), llvm::PseudoSourceValue::ConstantPool, Context, llvm::PseudoSourceValue::ExternalSymbolCallEntry, llvm::PseudoSourceValue::FixedStack, getAAInfo(), getAddrSpace(), getAlign(), getBaseAlign(), getFailureOrdering(), getFlags(), getMemoryType(), getOffset(), getOpaqueValue(), getPseudoValue(), getRanges(), getSize(), getSuccessOrdering(), getSyncScopeID(), getTargetMMOFlagName(), getValue(), llvm::PseudoSourceValue::GlobalValueCallEntry, llvm::PseudoSourceValue::GOT, isDereferenceable(), isInvariant(), isLoad(), isNonTemporal(), isStore(), isValid(), isVolatile(), llvm::PseudoSourceValue::JumpTable, MOTargetFlag1, MOTargetFlag2, MOTargetFlag3, llvm::AAMDNodes::NoAlias, llvm::NotAtomic, OS, llvm::Metadata::printAsOperand(), llvm::MIRFormatter::printCustomPseudoSourceValue(), printFrameIndex(), llvm::MIRFormatter::printIRValue(), llvm::printLLVMNameWithoutPrefix(), llvm::MachineOperand::printOperandOffset(), printSyncScope(), llvm::AAMDNodes::Scope, llvm::PseudoSourceValue::Stack, llvm::AAMDNodes::TBAA, TII, llvm::toIRString(), and llvm::Align::value().
Referenced by printMemOperand().
void MachineMemOperand::refineAlignment | ( | const MachineMemOperand * | MMO | ) |
Update this MachineMemOperand to reflect the alignment of MMO, if it has a greater alignment.
This must only be used when the new alignment applies to all users of this MachineMemOperand.
Definition at line 1100 of file MachineOperand.cpp.
References assert(), getBaseAlign(), getFlags(), and getSize().
Referenced by llvm::MemSDNode::refineAlignment().
|
inline |
Bitwise OR the current flags with the given flags.
Definition at line 223 of file MachineMemOperand.h.
Referenced by llvm::RISCVDAGToDAGISel::Select().
|
inline |
Definition at line 320 of file MachineMemOperand.h.
|
inline |
Reset the tracked memory type.
Definition at line 323 of file MachineMemOperand.h.
Referenced by llvm::LegalizerHelper::bitcast().
|
inline |
Definition at line 319 of file MachineMemOperand.h.
Change the SourceValue for this MachineMemOperand.
This should only be used when an object is being relocated and all references to it are being updated.
Definition at line 318 of file MachineMemOperand.h.
|
friend |
Definition at line 347 of file MachineMemOperand.h.
|
friend |
Definition at line 334 of file MachineMemOperand.h.