Did I find the right examples for you? yes no

All Samples(1)  |  Call(0)  |  Derive(0)  |  Import(1)
Module PyTokenizer

Another Python tokenizer, but implemented without using the regex module.
(This is more folly than anything else, please use tokenize in the standard
library, or at least my wrapper class, StdTokenizer.)

XXX This now assumes that the basil.common.python submodules may be imported

$Id: PyTokenizer.py,v 1.2 2003/10/02 17:37:17 jriehl Exp $

src/m/y/mython-HEAD/basil/common/python/pyparser.py   mython(Download)
import token, exceptions, compiler
import PyTokenizer, PyGrammar, DFAParser
# ______________________________________________________________________