LLM Token Counter — All-in-one token counter for popular LLM models.

During my work, I often have to count the words in my text. This is crucial when I need to turn text into vectors, a task that needs exactness. To make this task easier, I made a simple tool. It's built to count words easily, making it a helpful tool for others doing similar work. The most significant feature is that transformers.js runs in your browser. There are two main benefits: 1. It's fast, thanks to the Rust implementation of tokenizers. Without transferring data to the backend, it runs blazingly fast in your browser. 2. Your prompt is safe. It runs purely in your browser, making it impossible for me to store your prompts. This project is still in the early stages. If you need any features, feel free to comment. Here's what I plan to do next: 1. Multimodal language models, like GPT-4 and Claude-3, are becoming increasingly popular. I believe the next step should be to support multimodal capabilities. 2. As the number of popular LLM models continues to increase, I will support more models.