ERROR: Failed building wheel for tokenizers (pip install tokenizers) for Mac M1

I am on M1 and managed to go around this in the following way:
I installed a rust compiler using brew, and then initialized it.
brew install rustup
rustup-init
Then I restarted the console and checked if it is installed: rustc --version . It turned out you also have to setup the path:
export PATH="$HOME/.cargo/bin:$PATH"

 

from https://github.com/huggingface/tokenizers/issues/1050

ERROR: Failed building wheel for tokenizers · Issue #1050 · huggingface/tokenizers