Signway - pre-signed URLs for LLM apps

Signway - pre-signed URLs for LLM apps

Bring the power of pre-signed URLs for your LLM applications

33 followers

Signway is a gateway for redirecting short-lived signed URLs to the requested API. It its meant to be used for streaming data directly between client applications and LLM APIs in a secure way, using cryptographic signatures instead of API credentials.

Signway - pre-signed URLs for LLM apps gallery image
Free Options
Launch Team

What do you think? …

Gabriel Musat
I am excited to announce the launch of Signway - an open source software designed to simplify the process of data streaming in serverless architectures and enhance the experience of your end-user, all while saving you time and costs. If you've ever used a serverless architecture for your LLM app, you understand the challenge of streaming data from APIs such as OpenAI back to your user. Waiting for the API to return a full response, then relaying it back to the user, is not only resource-intensive but also impacts the user experience negatively. Signway addresses the problem of re-streaming responses from the backend to frontend by allowing the frontend to directly request OpenAI using a pre-signed URL created by Signway. This URL is short-lived, and once it passes verification for authenticity and expiry, Signway will proxy the request to the API and add the necessary authentication headers. Initially designed for OpenAI's API, Signway's high throughput makes it versatile for almost any API, thanks to its Rust-based architecture. In summary, Signway simplifies integrating AI in serverless architectures by streamlining data streaming, ensuring security, and boosting performance. Checkout this blog post for getting started using Signway for your LLM apps https://medium.com/@gb.mt.me/str.... Also, the code is open source, feel free to check it out or even deploy it yourself for free https://github.com/gabotechs/sig... Any kind of constructive feedback is welcomed! Thanks!

Do you use Signway - pre-signed URLs for LLM apps?