Class TokenizerPostPosition
- java.lang.Object
- 
- org.apache.sysds.runtime.transform.tokenize.TokenizerPostPosition
 
- 
- All Implemented Interfaces:
- Serializable,- TokenizerPost
 
 public class TokenizerPostPosition extends Object implements TokenizerPost - See Also:
- Serialized Form
 
- 
- 
Constructor SummaryConstructors Constructor Description TokenizerPostPosition(org.apache.wink.json4j.JSONObject params, int numIdCols, int maxTokens, boolean wideFormat)
 - 
Method SummaryAll Methods Instance Methods Concrete Methods Modifier and Type Method Description voidappendTokensLong(List<Object> keys, List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.Token> tokenList, FrameBlock out)voidappendTokensWide(List<Object> keys, List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.Token> tokenList, FrameBlock out)longgetNumCols()longgetNumRows(long inRows)Types.ValueType[]getOutSchema()FrameBlocktokenizePost(List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.DocumentToTokens> tl, FrameBlock out)
 
- 
- 
- 
Method Detail- 
tokenizePostpublic FrameBlock tokenizePost(List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.DocumentToTokens> tl, FrameBlock out) - Specified by:
- tokenizePostin interface- TokenizerPost
 
 - 
appendTokensLongpublic void appendTokensLong(List<Object> keys, List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.Token> tokenList, FrameBlock out) 
 - 
appendTokensWidepublic void appendTokensWide(List<Object> keys, List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.Token> tokenList, FrameBlock out) 
 - 
getOutSchemapublic Types.ValueType[] getOutSchema() - Specified by:
- getOutSchemain interface- TokenizerPost
 
 - 
getNumRowspublic long getNumRows(long inRows) - Specified by:
- getNumRowsin interface- TokenizerPost
 
 - 
getNumColspublic long getNumCols() - Specified by:
- getNumColsin interface- TokenizerPost
 
 
- 
 
-