✨ Turn full websites into datasets for building custom LLMs with Webᵀ Crawl. Give us just 1️⃣ URL and let Webᵀ Crawl handle the rest. Quickly turn full websites & content (like PDFs, FAQ, etc.) into • Prompts for fine-tuning • Chunks for vector databases
Hey everyone!
I'm Mike – I'm working on 🟪 Web Transpose, a collection of tools to make the web yours.
→ https://webtranspose.com/
I'm excited to share my first tool – 🟪 Webᵀ Crawl. I had quite a few friends building chatbots from websites so I decided to build a tool to streamline the process.
I also made a few tutorials about finetuning and vector databases for LLMs here:
→ https://www.webtranspose.com/blog
🙆♂️ I'd love for you to check 🟪 Webᵀ Crawl out and have a play. Let me know what you end up building. Would love all of your feedback. I'm excited to chat about all things web data / web scraping / web crawling in the comments!
orthogonally ❤️
Mike
mike@webtranspose.com
Hey Mike, this is a really cool tool - do you plans for an API too? I'd like to think that it'd help many devs including me who want to automate the chatbot-building process :)
Webᵀ Crawl by Web Transpose
ShortVideoGen
Webᵀ Crawl by Web Transpose
Webᵀ Crawl by Web Transpose
Olly - AI Agent for Social Media
Webᵀ Crawl by Web Transpose