DefaultIngestionStrategy
gitinsp.infrastructure.strategies.IngestionStrategy.DefaultIngestionStrategy
class DefaultIngestionStrategy(lang: Language, config: Config) extends IngestionStrategy
Attributes
- Graph
-
- Supertypes
Members list
Value members
Concrete methods
Creates a document splitter appropriate for the given language
Creates a document splitter appropriate for the given language
Value parameters
- chunkSize
-
The target size of each document chunk
- lang
-
The programming language of the document content
- overlap
-
The number of tokens to overlap between chunks
Attributes
- Returns
-
A DocumentSplitter configured for the language
- Definition Classes
Transforms a document before splitting it into segments
Transforms a document before splitting it into segments
Value parameters
- document
-
The document to transform
Attributes
- Returns
-
The transformed document
- Definition Classes
Transforms a text segment before storing it in the vector database
Transforms a text segment before storing it in the vector database
Value parameters
- textSegment
-
The text segment to transform
Attributes
- Returns
-
The transformed text segment
- Definition Classes
In this article