gitinsp.infrastructure.parser.RecursiveCharacterTextSplitter
See theRecursiveCharacterTextSplitter companion object
class RecursiveCharacterTextSplitter(separators: Option[List[String]], val keepSeparator: Either[Boolean, String], isSeparatorRegex: Boolean, val chunkSize: Int, val chunkOverlap: Int, val lengthFunction: String => Int, val addStartIndex: Boolean, val stripWhitespace: Boolean) extends TextSplitter
Attributes
- Companion
- object
- Graph
-
- Supertypes
-
class TextSplittertrait LazyLoggingtrait DocumentSplitterclass Objecttrait Matchableclass AnyShow all
Members list
Value members
Concrete methods
Overrides the abstract splitText method to initiate the recursive splitting process.
Overrides the abstract splitText method to initiate the recursive splitting process.
Attributes
- Definition Classes
Inherited methods
Creates TextSegment objects from a list of texts and optional metadata. It calls the subclass's splitText implementation to get initial chunks and then formats them into TextSegments, potentially adding start index metadata.
Creates TextSegment objects from a list of texts and optional metadata. It calls the subclass's splitText implementation to get initial chunks and then formats them into TextSegments, potentially adding start index metadata.
Attributes
- Inherited from:
- TextSplitter
Attributes
- Inherited from:
- TextSplitter
Entry point for splitting a single Langchain4j Document.
Attributes
- Inherited from:
- DocumentSplitter
Splits multiple documents into a list of TextSegments.
Concrete fields
Inherited fields
Attributes
- Inherited from:
- LazyLogging
In this article