Update text-splitter requirement from 0.24.1 to 0.26.0

[dependabot]

Updates the requirements on text-splitter to permit the latest version.

Release notes

Sourced from text-splitter's releases.

v0.26.0

What's New

• Updated to icu v2.0 for all unicode segmentation.
• Minimum Rust version updated to 1.82.0

Full Changelog: benbrandt/text-splitter@v0.25.1...v0.26.0

Changelog

Sourced from text-splitter's changelog.

v0.26.0

What's New

• Updated to icu v2.0 for all unicode segmentation.
• Minimum Rust version updated to 1.82.0

v0.25.1

What's New

• Use memchr crate instead of regex for parsing phase in TextSplitter. This should improve performance in how quickly the text is parsed when scanning for newline characters.
• Implement ChunkSizer trait automatically for many more wrappers and references to types that already implement ChunkSizer.

v0.25.0

Breaking Changes

Rust

• Remove support for rust-tokenizers crate. This crate hasn't been updated in several years and brings in depednencies that have security warnings.

What's New

• Use faster encoding method for tokenizers library, which improves performance with usage of huggingface tokenizers.

v0.24.2

Fixes

• Python packages target a newer version of libc to hopefully fix header file issues with tree-sitter.

What's New

• MSRV updated to 1.81.0

v0.24.1

What's New

Added a new chunk_char_indices method to the Rust splitters.

use text_splitter::{Characters, ChunkCharIndex, TextSplitter};
let text = "\r\na̐éö̲\r\n";
let splitter = TextSplitter::new(3);
let chunks = splitter.chunk_char_indices(text).collect::<Vec<_>>();
assert_eq!(
</tr></table>

... (truncated)

Commits

• 5f04d63 Bump check in ci
• 215c878 Clippy lints
• 2527d92 Bump msrv and version
• 0b482c3 Update snapshots
• 4635d16 Update all icu crates to 2.0
• dbd3737 chore(deps): bump icu_segmenter from 1.5.0 to 2.0.0
• 86eae5f chore(deps): bump the minor group with 2 updates
• ad2f25f chore(deps): bump rustls-pki-types in the minor group
• 3781922 chore(deps): bump libm from 0.2.14 to 0.2.15 in the minor group
• 7f06b81 chore(deps): bump webpki-roots from 0.26.10 to 0.26.11
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #13.