gr.demokritos.iit.summarization.analysis
Interface ISplitter<TokenType>

All Known Implementing Classes:

SentenceSplitter

public interface ISplitter<TokenType>

Describes classes that can tokenize sentences into tokens.

Method Summary

java.util.List<TokenType>

split(java.lang.String sToTokenize) Splits a given string into a list of tokens.

Method Detail

split

java.util.List<TokenType> split(java.lang.String sToTokenize)

Splits a given string into a list of tokens.

Parameters:

sToTokenize - The string to tokenize.

Returns: