Class ColumnEncoderBin
- java.lang.Object
- 
- org.apache.sysds.runtime.transform.encode.ColumnEncoder
- 
- org.apache.sysds.runtime.transform.encode.ColumnEncoderBin
 
 
- 
- All Implemented Interfaces:
- Externalizable,- Serializable,- Comparable<ColumnEncoder>,- Encoder
 
 public class ColumnEncoderBin extends ColumnEncoder - See Also:
- Serialized Form
 
- 
- 
Nested Class SummaryNested Classes Modifier and Type Class Description static classColumnEncoderBin.BinMethod- 
Nested classes/interfaces inherited from class org.apache.sysds.runtime.transform.encode.ColumnEncoderColumnEncoder.EncoderType
 
- 
 - 
Field SummaryFields Modifier and Type Field Description static StringMAX_PREFIXstatic StringMIN_PREFIXstatic StringNBINS_PREFIX- 
Fields inherited from class org.apache.sysds.runtime.transform.encode.ColumnEncoderAPPLY_ROW_BLOCKS_PER_COLUMN, BUILD_ROW_BLOCKS_PER_COLUMN
 
- 
 - 
Constructor SummaryConstructors Constructor Description ColumnEncoderBin()ColumnEncoderBin(int colID, int numBin, double[] binMins, double[] binMaxs)ColumnEncoderBin(int colID, int numBin, ColumnEncoderBin.BinMethod binMethod)
 - 
Method SummaryAll Methods Instance Methods Concrete Methods Modifier and Type Method Description voidallocateMetaData(FrameBlock meta)Pre-allocate a FrameBlock for metadata collection.voidbuild(CacheBlock in)Build the transform meta data for the given block input.voidbuild(CacheBlock in, double[] equiHeightMaxs)voidbuildPartial(FrameBlock in)Partial build of internal data structures (e.g., in distributed spark operations).voidcomputeBins(double min, double max)double[]getBinMaxs()ColumnEncoderBin.BinMethodgetBinMethod()double[]getBinMins()Callable<Object>getBuildTask(CacheBlock in)doublegetColMaxs()doublegetColMins()FrameBlockgetMetaData(FrameBlock meta)Construct a frame block out of the transform meta data.intgetNumBin()Callable<Object>getPartialBuildTask(CacheBlock in, int startRow, int blockSize, HashMap<Integer,Object> ret)Callable<Object>getPartialMergeBuildTask(HashMap<Integer,?> ret)voidinitMetaData(FrameBlock meta)Sets up the required meta data for a subsequent call to apply.voidmergeAt(ColumnEncoder other)Merges another encoder, of a compatible type, in after a certain position.voidprepareBuildPartial()Allocates internal data structures for partial build.voidreadExternal(ObjectInput in)Redirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd deserialization.voidsetBinMethod(String method)voidwriteExternal(ObjectOutput out)Redirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd serialization.- 
Methods inherited from class org.apache.sysds.runtime.transform.encode.ColumnEncoderapply, apply, build, compareTo, getApplyTasks, getBuildTasks, getColID, getColMapping, getEstMetaSize, getEstNumDistincts, getSparseRowsWZeros, isApplicable, isApplicable, setColID, setEstMetaSize, setEstNumDistincts, shiftCol, updateIndexRanges
 
- 
 
- 
- 
- 
Field Detail- 
MIN_PREFIXpublic static final String MIN_PREFIX - See Also:
- Constant Field Values
 
 - 
MAX_PREFIXpublic static final String MAX_PREFIX - See Also:
- Constant Field Values
 
 - 
NBINS_PREFIXpublic static final String NBINS_PREFIX - See Also:
- Constant Field Values
 
 
- 
 - 
Constructor Detail- 
ColumnEncoderBinpublic ColumnEncoderBin() 
 - 
ColumnEncoderBinpublic ColumnEncoderBin(int colID, int numBin, ColumnEncoderBin.BinMethod binMethod)
 - 
ColumnEncoderBinpublic ColumnEncoderBin(int colID, int numBin, double[] binMins, double[] binMaxs)
 
- 
 - 
Method Detail- 
getNumBinpublic int getNumBin() 
 - 
getColMinspublic double getColMins() 
 - 
getColMaxspublic double getColMaxs() 
 - 
getBinMinspublic double[] getBinMins() 
 - 
getBinMaxspublic double[] getBinMaxs() 
 - 
getBinMethodpublic ColumnEncoderBin.BinMethod getBinMethod() 
 - 
setBinMethodpublic void setBinMethod(String method) 
 - 
buildpublic void build(CacheBlock in) Description copied from interface:EncoderBuild the transform meta data for the given block input. This call modifies and keeps meta data as encoder state.- Parameters:
- in- input frame block
 
 - 
buildpublic void build(CacheBlock in, double[] equiHeightMaxs) - Overrides:
- buildin class- ColumnEncoder
 
 - 
getBuildTaskpublic Callable<Object> getBuildTask(CacheBlock in) - Overrides:
- getBuildTaskin class- ColumnEncoder
 
 - 
getPartialBuildTaskpublic Callable<Object> getPartialBuildTask(CacheBlock in, int startRow, int blockSize, HashMap<Integer,Object> ret) - Overrides:
- getPartialBuildTaskin class- ColumnEncoder
 
 - 
getPartialMergeBuildTaskpublic Callable<Object> getPartialMergeBuildTask(HashMap<Integer,?> ret) - Overrides:
- getPartialMergeBuildTaskin class- ColumnEncoder
 
 - 
computeBinspublic void computeBins(double min, double max)
 - 
prepareBuildPartialpublic void prepareBuildPartial() Description copied from class:ColumnEncoderAllocates internal data structures for partial build.- Specified by:
- prepareBuildPartialin interface- Encoder
- Overrides:
- prepareBuildPartialin class- ColumnEncoder
 
 - 
buildPartialpublic void buildPartial(FrameBlock in) Description copied from class:ColumnEncoderPartial build of internal data structures (e.g., in distributed spark operations).- Specified by:
- buildPartialin interface- Encoder
- Overrides:
- buildPartialin class- ColumnEncoder
- Parameters:
- in- input frame block
 
 - 
mergeAtpublic void mergeAt(ColumnEncoder other) Description copied from class:ColumnEncoderMerges another encoder, of a compatible type, in after a certain position. Resizes as necessary.ColumnEncodersare compatible with themselves andEncoderCompositeis compatible with every otherColumnEncoders.MultiColumnEncodersare compatible with every encoder- Overrides:
- mergeAtin class- ColumnEncoder
- Parameters:
- other- the encoder that should be merged in
 
 - 
allocateMetaDatapublic void allocateMetaData(FrameBlock meta) Description copied from interface:EncoderPre-allocate a FrameBlock for metadata collection.- Parameters:
- meta- frame block
 
 - 
getMetaDatapublic FrameBlock getMetaData(FrameBlock meta) Description copied from interface:EncoderConstruct a frame block out of the transform meta data.- Parameters:
- meta- output frame block
- Returns:
- output frame block?
 
 - 
initMetaDatapublic void initMetaData(FrameBlock meta) Description copied from interface:EncoderSets up the required meta data for a subsequent call to apply.- Parameters:
- meta- frame block
 
 - 
writeExternalpublic void writeExternal(ObjectOutput out) throws IOException Description copied from class:ColumnEncoderRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd serialization.- Specified by:
- writeExternalin interface- Externalizable
- Overrides:
- writeExternalin class- ColumnEncoder
- Parameters:
- out- object output
- Throws:
- IOException- if IOException occurs
 
 - 
readExternalpublic void readExternal(ObjectInput in) throws IOException Description copied from class:ColumnEncoderRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd deserialization.- Specified by:
- readExternalin interface- Externalizable
- Overrides:
- readExternalin class- ColumnEncoder
- Parameters:
- in- object input
- Throws:
- IOException- if IOException occur
 
 
- 
 
-