Did I find the right examples for you? yes no      Crawl my project      Python Jobs

All Samples(2)  |  Call(1)  |  Derive(0)  |  Import(1)

src/s/t/streamcorpus_pipeline-0.5.23.dev1/streamcorpus_pipeline/_kvlayer.py   streamcorpus_pipeline(Download)
        def keys_and_values():
            for si in streamcorpus.Chunk(t_path):
                key1 = uuid.UUID(int=si.stream_time.epoch_ticks)
                key2 = uuid.UUID(hex=si.doc_id)
                data = streamcorpus.serialize(si)

src/s/t/streamcorpus_pipeline-0.5.23.dev1/streamcorpus_pipeline/tests/test_tokenizer.py   streamcorpus_pipeline(Download)
from __future__ import absolute_import
import os
from streamcorpus import Chunk, serialize
from streamcorpus_pipeline._tokenizer import nltk_tokenizer