Visualize and optimize text splitting strategies for better LLM performance
Splits text based on a specific separator. Ideal for simple text splitting needs with precise control over the separation points.
Uses multiple separators in a hierarchical manner. Better preserves semantic meaning and handles nested structures well.
Splits text based on tokens, such as words or punctuation. Suitable for applications that require preserving the grammatical structure and semantic meaning of the text.
Splits text based on Markdown formatting. Ideal for handling Markdown-formatted text and preserving its structure and formatting.
Splits text based on HTML formatting. Suitable for handling HTML-formatted text and preserving its structure and formatting.
Splits text based on Python code syntax. Ideal for handling Python code and preserving its structure and formatting.
Splits text based on JavaScript code syntax. Suitable for handling JavaScript code and preserving its structure and formatting.