Package org.apache.sysds.hops
Class DataOp
- java.lang.Object
- 
- org.apache.sysds.hops.Hop
- 
- org.apache.sysds.hops.DataOp
 
 
- 
- 
Field Summary- 
Fields inherited from class org.apache.sysds.hops.Hop_beginColumn, _beginLine, _endColumn, _endLine, _filename, _text, CPThreshold
 
- 
 - 
Constructor SummaryConstructors Constructor Description DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, String fname, long dim1, long dim2, long nnz, int blen)READ operation for Matrix w/ dim1, dim2.DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, String fname, long dim1, long dim2, long nnz, MatrixObject.UpdateType update, int blen)DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, HashMap<String,Hop> params)READ operation for Matrix / SQL operation for tensor This constructor supports expressions in parametersDataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, Hop in, HashMap<String,Hop> inputParameters)WRITE operation for Matrix This constructor supports expression in parametersDataOp(String l, Types.DataType dt, Types.ValueType vt, Hop in, Types.OpOpData dop, String fname)
 - 
Method SummaryAll Methods Instance Methods Concrete Methods Modifier and Type Method Description booleanallowsAllExecTypes()voidcheckArity()Check for N (READ) or N+1 (WRITE) inputs.Objectclone()booleancompare(Hop that)LopconstructLops()voiddisableRecompileRead()Explicitly disables recompilation of transient reads, this additional information is required because requiresRecompile is set in a top-down manner, hence any value set from a consuming operating would be overwritten by opFindExecType.Types.FileFormatgetFileFormat()StringgetFileName()longgetInputBlocksize()Types.OpOpDatagetOp()StringgetOpString()intgetParameterIndex(String name)booleanhasOnlyRDD()booleanisFederatedDataOp()Checks if the hop is a DataOp with federated data.booleanisGPUEnabled()In memory-based optimizer mode (see OptimizerUtils.isMemoryBasedOptLevel()), the exectype is determined by checking this method as well as memory budget of this Hop.booleanisPersistentReadWrite()booleanisRead()booleanisWrite()voidrefreshSizeInformation()Update the output size information for this hop.voidremoveInput(String inputName)Remove an input from the list of inputs and from the parameter index map.voidsetDataOpType(Types.OpOpData type)voidsetFileFormat(Types.FileFormat ft)voidsetFileName(String fn)voidsetInputBlocksize(long blen)voidsetOnlyRDD(boolean flag)voidsetOutputParams(long dim1, long dim2, long nnz, MatrixObject.UpdateType update, int blen)- 
Methods inherited from class org.apache.sysds.hops.HopactivatePrefetch, addAllInputs, addInput, checkAndSetForcedPlatform, checkAndSetInvalidCPDimsAndSize, clearMemEstimate, colsKnown, compressedSize, computeBoundsInformation, computeBoundsInformation, computeBoundsInformation, computeMemEstimate, computeSizeInformation, computeSizeInformation, computeSizeInformation, constructAndSetLopsDataFlowProperties, createOffsetLop, deactivatePrefetch, dimsKnown, dimsKnown, dimsKnownAny, federatedCostInitialized, getBeginColumn, getBeginLine, getBlocksize, getCompressedSize, getDataCharacteristics, getDataType, getDim, getDim1, getDim2, getEndColumn, getEndLine, getExecType, getFederatedCost, getFederatedOutput, getFilename, getForcedExecType, getHopID, getInput, getInput, getInputMemEstimate, getInputMemEstimate, getInputOutputSize, getIntermediateMemEstimate, getLength, getLops, getMemEstimate, getName, getNnz, getOutputMemEstimate, getOutputMemEstimate, getParent, getPrivacy, getRepetitions, getSparsity, getSpBroadcastSize, getText, getUpdateType, getValueType, hasCompressedInput, hasFederatedOutput, hasLocalOutput, hasMatrixInputWithDifferentBlocksizes, hasValidCPDimsAndSize, isCompressedOutput, isFederated, isMatrix, isMemEstimated, isOutputEmptyBlocks, isRequiredDecompression, isScalar, isTransposeSafe, isVisited, prefetchActivated, printErrorLocation, refreshColsParameterInformation, refreshColsParameterInformation, refreshMemEstimates, refreshRowsParameterInformation, refreshRowsParameterInformation, requiresCheckpoint, requiresCompression, requiresLineageCaching, requiresReblock, requiresRecompile, resetExecType, resetFederatedCost, resetRecompilationFlag, resetRecompilationFlag, resetVisitStatus, resetVisitStatus, resetVisitStatus, resetVisitStatusForced, rowsKnown, setBeginColumn, setBeginLine, setBlocksize, setCompressedOutput, setCompressedSize, setDataType, setDim, setDim1, setDim2, setEndColumn, setEndLine, setExecType, setFederatedCost, setFederatedOutput, setFilename, setForcedExecType, setLops, setMemEstimate, setName, setNnz, setOutputEmptyBlocks, setParseInfo, setPrivacy, setRequiresCheckpoint, setRequiresCompression, setRequiresCompression, setRequiresDeCompression, setRequiresLineageCaching, setRequiresReblock, setRequiresRecompile, setText, setUpdateType, setValueType, setVisited, setVisited, someInputFederated, toString, updateLopFedOut, updateLopFedOut, updateRepetitionEstimates
 
- 
 
- 
- 
- 
Constructor Detail- 
DataOppublic DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, String fname, long dim1, long dim2, long nnz, int blen) READ operation for Matrix w/ dim1, dim2. This constructor does not support any expression in parameters- Parameters:
- l- ?
- dt- data type
- vt- value type
- dop- data operator type
- fname- file name
- dim1- dimension 1
- dim2- dimension 2
- nnz- number of non-zeros
- blen- rows/cols per block
 
 - 
DataOppublic DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, String fname, long dim1, long dim2, long nnz, MatrixObject.UpdateType update, int blen) 
 - 
DataOppublic DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, HashMap<String,Hop> params) READ operation for Matrix / SQL operation for tensor This constructor supports expressions in parameters- Parameters:
- l- ?
- dt- data type
- vt- value type
- dop- data operator type
- params- input parameters
 
 - 
DataOppublic DataOp(String l, Types.DataType dt, Types.ValueType vt, Hop in, Types.OpOpData dop, String fname) 
 - 
DataOppublic DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, Hop in, HashMap<String,Hop> inputParameters) WRITE operation for Matrix This constructor supports expression in parameters- Parameters:
- l- ?
- dt- data type
- vt- value type
- dop- data operator type
- in- high-level operator
- inputParameters- input parameters
 
 
- 
 - 
Method Detail- 
checkAritypublic void checkArity() Check for N (READ) or N+1 (WRITE) inputs.- Specified by:
- checkArityin class- Hop
 
 - 
getOppublic Types.OpOpData getOp() 
 - 
setDataOpTypepublic void setDataOpType(Types.OpOpData type) 
 - 
setOutputParamspublic void setOutputParams(long dim1, long dim2, long nnz, MatrixObject.UpdateType update, int blen)
 - 
setFileNamepublic void setFileName(String fn) 
 - 
getFileNamepublic String getFileName() 
 - 
getParameterIndexpublic int getParameterIndex(String name) 
 - 
setOnlyRDDpublic void setOnlyRDD(boolean flag) 
 - 
hasOnlyRDDpublic boolean hasOnlyRDD() 
 - 
isGPUEnabledpublic boolean isGPUEnabled() Description copied from class:HopIn memory-based optimizer mode (see OptimizerUtils.isMemoryBasedOptLevel()), the exectype is determined by checking this method as well as memory budget of this Hop. Please see findExecTypeByMemEstimate for more detail. This method is necessary because not all operator are supported efficiently on GPU (for example: operations on frames and scalar as well as operations such as table).- Specified by:
- isGPUEnabledin class- Hop
- Returns:
- true if the Hop is eligible for GPU Exectype.
 
 - 
constructLopspublic Lop constructLops() - Specified by:
- constructLopsin class- Hop
 
 - 
setFileFormatpublic void setFileFormat(Types.FileFormat ft) 
 - 
getFileFormatpublic Types.FileFormat getFileFormat() 
 - 
setInputBlocksizepublic void setInputBlocksize(long blen) 
 - 
getInputBlocksizepublic long getInputBlocksize() 
 - 
isReadpublic boolean isRead() 
 - 
isWritepublic boolean isWrite() 
 - 
isPersistentReadWritepublic boolean isPersistentReadWrite() 
 - 
isFederatedDataOppublic boolean isFederatedDataOp() Description copied from class:HopChecks if the hop is a DataOp with federated data.- Overrides:
- isFederatedDataOpin class- Hop
- Returns:
- true if hop is a federated DataOp
 
 - 
getOpStringpublic String getOpString() - Specified by:
- getOpStringin class- Hop
 
 - 
allowsAllExecTypespublic boolean allowsAllExecTypes() - Specified by:
- allowsAllExecTypesin class- Hop
 
 - 
refreshSizeInformationpublic void refreshSizeInformation() Description copied from class:HopUpdate the output size information for this hop.- Specified by:
- refreshSizeInformationin class- Hop
 
 - 
disableRecompileReadpublic void disableRecompileRead() Explicitly disables recompilation of transient reads, this additional information is required because requiresRecompile is set in a top-down manner, hence any value set from a consuming operating would be overwritten by opFindExecType.
 - 
clonepublic Object clone() throws CloneNotSupportedException - Specified by:
- clonein class- Hop
- Throws:
- CloneNotSupportedException
 
 - 
removeInputpublic void removeInput(String inputName) Remove an input from the list of inputs and from the parameter index map. Parameter index map values higher than the index of the removed input will be decremented by one.- Parameters:
- inputName- The name of the input to remove
 
 
- 
 
-