I'm Stuck in Pivot Hell. Please help!!
I'm a founder in the depths of pivot hell. But I have a strong feeling that the important space to build in is memory. For me, the thing that can increase the value we generate from AI 10x from where the models currently are, even without further improvement, is memory and context. Being able to transfer context from one interaction to the other, preferences for how responses should be structured, permission management, sensitive information filtering and redacting, etc. Of course, all these have to be done securely and end-to-end.
I've thought a lot about how to find this wedge. A lot of things I've found just sound cool but probably aren't providing much value to the user. I'm optimizing for a high-value, high-frequency use case. This is the best-case scenario. Especially for a consumer-based solution. I would list some of the solutions that I think can stem from having an end-to-end encrypted memory of all AI interactions (limited to conversations with AI models for now) and a system that does a basic filtering of sensitive information and PIL:
Smart search: being able to semantically search through old conversation history to find working solutions with pure conversation.
Prompt injection: Being able to use old verify prompts with a click to ask better questions.
Conversation summaries: Just as it implies, get summaries of conversations, perhaps of just one chat or multiple. And maybe even across multiple AI tools.
Project workspaces: Having an organization share a connected memory. With each team member being able to use the other members' context on what they're working on to make sure they're all aligned on the goal and keep a coherent implementation of the tasks.
Chat with memory: Using a lightweight LLM to converse with your chat history across all AI use and different conversations and sessions.
I would really appreciate any insights anyone may have on these topics. Which of these would you find valuable? If none, what do you wish was available in your AI interactions but don't have? I'm not too good at social media, so whenever I ask these questions online, I just get snubbed. But I've seen people deriving value from them; that's why I'm taking a chance here. Thank you once again for taking the time.
Replies
Product Hunt
I don't find it clear what the question here is. Are you working on a product in the memory/context problem-space? From your thread, I'd be worried that any low hanging fruit context/memory problems that exist in AI today will be solved in weeks to months by the large LLMs.
Product Hunt
@steveb getting "sherlocked" is indeed a risk, but on the other hand that's kind of a risk with most infra AI products.
Product Hunt
Hmmmm very tricky space.
First thought is that memory is certainly useful. The fact that ChatGPT has long-term memory now is a huge lock-in factor for me.
The exact form factor of the product is an open question. I like how @Supermemory is approaching it - and it seems they have some traction with their recent launches.
This might be a good area to prototype around - build a bad version of all the different things you mention and try to use them (and imagine what it could be when properly built).