text_chunker
Adapted from the Griptape AI Framework documentation.
Bases:
BaseChunker
Source Code in griptape/chunkers/text_chunker.py
class TextChunker(BaseChunker): DEFAULT_SEPARATORS = [ ChunkSeparator("\n\n"), ChunkSeparator("\n"), ChunkSeparator(". "), ChunkSeparator("! "), ChunkSeparator("? "), ChunkSeparator(" "), ]
DEFAULT_SEPARATORS = [ChunkSeparator('\n\n'), ChunkSeparator('\n'), ChunkSeparator('. '), ChunkSeparator('! '), ChunkSeparator('? '), ChunkSeparator(' ')]
class-attribute instance-attribute
Could this page be better? Report a problem or suggest an addition!