Skip to content

Lower tok Rust MSRV to 1.77.2#29

Merged
t-kalinowski merged 6 commits into
mainfrom
lower-msrv
May 19, 2026
Merged

Lower tok Rust MSRV to 1.77.2#29
t-kalinowski merged 6 commits into
mainfrom
lower-msrv

Conversation

@t-kalinowski

Copy link
Copy Markdown
Member

Summary

This updates tok to build with Rust 1.77.2, matching CRAN's requirement that submitted packages support a Rust toolchain at least two years old.

Public-facing changes:

  • Lowers the declared Rust requirement from rustc >= 1.91 to rustc >= 1.77.2.

Internal changes:

  • Downgrades the Rust tokenizers dependency from 0.22.2 to 0.20.4, the newest version tested here that builds on Rust 1.77.2.
  • Refreshes Cargo.lock and src/rust/vendor.tar.xz for the compatible dependency graph.
  • Regenerates bundled Rust dependency author/license metadata.
  • Skips the Hugging Face network test when huggingface.co is unreachable, so non-CRAN offline checks do not fail for unrelated DNS/network reasons.

@t-kalinowski
t-kalinowski merged commit e8c764d into main May 19, 2026
5 checks passed

@dfalbel dfalbel left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants