Prompt Hippo allows you to test LLM prompts side-by-side for robustness, reliability, and safety.
Subscribe
Sign in
Prompt Hippo allows you to test LLM prompts side-by-side for robustness, reliability, and safety.
> 1. Previously, I wanted to create a tool: > - For each prompt, automatically generate test cases of all types => The output will be: ACCURACY RATE, PASS RATE of test cases for each prompt. > -> 4 columns: for 4 prompts, the final output will be the pass rates of the test cases for each. ------------------ https://prompthippo.net/profile ----------------------------------- Tool Prompting: Quick review: - Many columns (each column is 1 prompt) => During the PROMPT TUNING process, there is no need to temporarily store the prompt, no need to ctrl Z to return to the old prompt, ) - Temprature = 0 (I tested it to match on playbackground) - Quickly switch back and forth between models to test multiple prompts at once. - TOOL CANNOT DO: +, NOT AUTOMATICALLY GENERATED TEST CASES TO TEST => NO FINAL OUTPUT IS THE PASS RATE OF TEST CASES. --------------------------------- I just tested a "prompt tweaking" tool, @Truc Le Van 😁