Package org.apache.sysds.hops
Class DataGenOp
- java.lang.Object
- 
- org.apache.sysds.hops.Hop
- 
- org.apache.sysds.hops.MultiThreadedHop
- 
- org.apache.sysds.hops.DataGenOp
 
 
 
- 
- All Implemented Interfaces:
- ParseInfo
 
 public class DataGenOp extends MultiThreadedHop A DataGenOp can be rand (or matrix constructor), sequence, and sample - these operators have different parameters and use a map of parameter type to hop position.
- 
- 
Field SummaryFields Modifier and Type Field Description static longUNSPECIFIED_SEED- 
Fields inherited from class org.apache.sysds.hops.Hop_beginColumn, _beginLine, _endColumn, _endLine, _filename, _text, CPThreshold
 
- 
 - 
Constructor SummaryConstructors Constructor Description DataGenOp(Types.OpOpDG mthd, DataIdentifier id)DataGenOp(Types.OpOpDG mthd, DataIdentifier id, HashMap<String,Hop> inputParameters)Creates a new Rand HOP.
 - 
Method SummaryAll Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description booleanallowsAllExecTypes()voidcheckArity()Check whether this Hop has a correct number of inputs.Objectclone()booleancompare(Hop that)LopconstructLops()static longgenerateRandomSeed()HopgetConstantValue()doublegetIncrementValue()HopgetInput(String key)Types.OpOpDGgetOp()StringgetOpString()HopgetParam(String key)intgetParamIndex(String key)HashMap<String,Integer>getParamIndexMap()booleanhasConstantValue()booleanhasConstantValue(double val)booleanhasUnspecifiedSeed()booleanisGPUEnabled()In memory-based optimizer mode (see OptimizerUtils.isMemoryBasedOptLevel()), the exectype is determined by checking this method as well as memory budget of this Hop.booleanisMultiThreadedOpType()voidrefreshSizeInformation()Update the output size information for this hop.voidsetIncrementValue(double incr)voidsetInput(String key, Hop hop, boolean linkParent)- 
Methods inherited from class org.apache.sysds.hops.MultiThreadedHopgetMaxNumThreads, setMaxNumThreads
 - 
Methods inherited from class org.apache.sysds.hops.HopactivatePrefetch, addAllInputs, addInput, checkAndSetForcedPlatform, checkAndSetInvalidCPDimsAndSize, clearMemEstimate, colsKnown, compressedSize, computeBoundsInformation, computeBoundsInformation, computeBoundsInformation, computeMemEstimate, computeSizeInformation, computeSizeInformation, computeSizeInformation, constructAndSetLopsDataFlowProperties, createOffsetLop, deactivatePrefetch, dimsKnown, dimsKnown, dimsKnownAny, federatedCostInitialized, getBeginColumn, getBeginLine, getBlocksize, getCompressedSize, getDataCharacteristics, getDataType, getDim, getDim1, getDim2, getEndColumn, getEndLine, getExecType, getFederatedCost, getFederatedOutput, getFilename, getForcedExecType, getHopID, getInput, getInput, getInputMemEstimate, getInputMemEstimate, getInputOutputSize, getIntermediateMemEstimate, getLength, getLops, getMemEstimate, getName, getNnz, getOutputMemEstimate, getOutputMemEstimate, getParent, getPrivacy, getRepetitions, getSparsity, getSpBroadcastSize, getText, getUpdateType, getValueType, hasCompressedInput, hasFederatedOutput, hasLocalOutput, hasMatrixInputWithDifferentBlocksizes, hasValidCPDimsAndSize, isCompressedOutput, isFederated, isFederatedDataOp, isMatrix, isMemEstimated, isOutputEmptyBlocks, isRequiredDecompression, isScalar, isTransposeSafe, isVisited, prefetchActivated, printErrorLocation, refreshColsParameterInformation, refreshColsParameterInformation, refreshMemEstimates, refreshRowsParameterInformation, refreshRowsParameterInformation, requiresCheckpoint, requiresCompression, requiresLineageCaching, requiresReblock, requiresRecompile, resetExecType, resetFederatedCost, resetRecompilationFlag, resetRecompilationFlag, resetVisitStatus, resetVisitStatus, resetVisitStatus, resetVisitStatusForced, rowsKnown, setBeginColumn, setBeginLine, setBlocksize, setCompressedOutput, setCompressedSize, setDataType, setDim, setDim1, setDim2, setEndColumn, setEndLine, setExecType, setFederatedCost, setFederatedOutput, setFilename, setForcedExecType, setLops, setMemEstimate, setName, setNnz, setOutputEmptyBlocks, setParseInfo, setPrivacy, setRequiresCheckpoint, setRequiresCompression, setRequiresCompression, setRequiresDeCompression, setRequiresLineageCaching, setRequiresReblock, setRequiresRecompile, setText, setUpdateType, setValueType, setVisited, setVisited, someInputFederated, toString, updateLopFedOut, updateLopFedOut, updateRepetitionEstimates
 
- 
 
- 
- 
- 
Field Detail- 
UNSPECIFIED_SEEDpublic static final long UNSPECIFIED_SEED - See Also:
- Constant Field Values
 
 
- 
 - 
Constructor Detail- 
DataGenOppublic DataGenOp(Types.OpOpDG mthd, DataIdentifier id, HashMap<String,Hop> inputParameters) Creates a new Rand HOP. - Parameters:
- mthd- data gen method
- id- the target identifier
- inputParameters- HashMap of the input parameters for Rand Hop
 
 - 
DataGenOppublic DataGenOp(Types.OpOpDG mthd, DataIdentifier id) 
 
- 
 - 
Method Detail- 
checkAritypublic void checkArity() Description copied from class:HopCheck whether this Hop has a correct number of inputs. (Some Hops can have a variable number of inputs, such as DataOp, DataGenOp, ParameterizedBuiltinOp, ReorgOp, TernaryOp, QuaternaryOp, MultipleOp, DnnOp, and SpoofFusedOp.) Parameterized Hops (such as DataOp) can check that the number of parameters matches the number of inputs.- Specified by:
- checkArityin class- Hop
 
 - 
getOpStringpublic String getOpString() - Specified by:
- getOpStringin class- Hop
 
 - 
getOppublic Types.OpOpDG getOp() 
 - 
isGPUEnabledpublic boolean isGPUEnabled() Description copied from class:HopIn memory-based optimizer mode (see OptimizerUtils.isMemoryBasedOptLevel()), the exectype is determined by checking this method as well as memory budget of this Hop. Please see findExecTypeByMemEstimate for more detail. This method is necessary because not all operator are supported efficiently on GPU (for example: operations on frames and scalar as well as operations such as table).- Specified by:
- isGPUEnabledin class- Hop
- Returns:
- true if the Hop is eligible for GPU Exectype.
 
 - 
isMultiThreadedOpTypepublic boolean isMultiThreadedOpType() - Specified by:
- isMultiThreadedOpTypein class- MultiThreadedHop
 
 - 
constructLopspublic Lop constructLops() - Specified by:
- constructLopsin class- Hop
 
 - 
allowsAllExecTypespublic boolean allowsAllExecTypes() - Specified by:
- allowsAllExecTypesin class- Hop
 
 - 
refreshSizeInformationpublic void refreshSizeInformation() Description copied from class:HopUpdate the output size information for this hop.- Specified by:
- refreshSizeInformationin class- Hop
 
 - 
getParamIndexpublic int getParamIndex(String key) 
 - 
hasConstantValuepublic boolean hasConstantValue() 
 - 
hasConstantValuepublic boolean hasConstantValue(double val) 
 - 
hasUnspecifiedSeedpublic boolean hasUnspecifiedSeed() 
 - 
getConstantValuepublic Hop getConstantValue() 
 - 
setIncrementValuepublic void setIncrementValue(double incr) 
 - 
getIncrementValuepublic double getIncrementValue() 
 - 
generateRandomSeedpublic static long generateRandomSeed() 
 - 
clonepublic Object clone() throws CloneNotSupportedException - Specified by:
- clonein class- Hop
- Throws:
- CloneNotSupportedException
 
 
- 
 
-