Interface ITextSplitter
Splits a document into smaller chunks suitable for embedding and retrieval.
public interface ITextSplitter
Methods
Split(RagDocument)
Splits a document into chunks. Implementations may split by character count, token count, sentence boundary, etc.
IReadOnlyList<RagChunk> Split(RagDocument document)
Parameters
documentRagDocumentThe document to split.
Returns
- IReadOnlyList<RagChunk>
An ordered list of chunks.