Overview  Package   Class  Use  Tree  Deprecated  Index  Help 
 PREV CLASS   NEXT CLASS FRAMES    NO FRAMES    
SUMMARY: NESTED | FIELD | CONSTR | METHOD DETAIL: FIELD | CONSTR | METHOD

org.cleartk.token.tokenizer
Interface Tokenizer

All Known Implementing Classes:
PennTreebankTokenizer, Subtokenizer, Tokenizer_ImplBase
public interface Tokenizer


Copyright (c) 2007-2008, Regents of the University of Colorado
All rights reserved.

Author:
Philip Ogren

Method Summary
 List<Token> getTokens(String text)
           
 

Method Detail

getTokens

List<Token> getTokens(String text)
Overview  Package   Class  Use  Tree  Deprecated  Index  Help 
 PREV CLASS   NEXT CLASS FRAMES    NO FRAMES    
SUMMARY: NESTED | FIELD | CONSTR | METHOD DETAIL: FIELD | CONSTR | METHOD
Copyright © 2012. All Rights Reserved.