valmi.io

Maker

📌

Hi ProductHunt Community, We have built the valmi.io open-source reverse-ETL platform. You can quickly check out a live demo sync by following the link on the GitHub page or at the bottom. Please try it out. You can also easily deploy it locally or schedule a run on the demo website. We are seeking feedback on the product. We have outlined a variety of use cases valmi.io currently supports on the blog. Currently, the engine supports 13+ connectors. The connectors are built using the airbyte protocol, and dagster is used as the orchestration engine. We will soon provide a detailed architecture diagram. We are currently working on essential features such as injecting state on connector failures. More upcoming features are listed on the website: https://www.valmi.io. Please give it a try, and valuable feedback from early adopters will shape the product. Live Sync - https://demo.valmi.io/spaces/a91... GitHub - https://github.com/valmi-io/valm... Blog - https://blog.valmi.io Docs - https://docs.valmi.io

Report

2yr ago

Aaron Artille

Isn't the reverse of ETL still ETL? Sorry this isn't a more substantive comment, sincerely.

Report

2yr ago

Rajashekar Varkala

valmi.io

Maker

@aaror Yes, one could argue the process is still the same - Extracting data from the warehouses and loading into SaaS tools. Traditionally, ETL is associated with loading data into datawarehouses. In this context, people are identifying moving data from warehouses with the reverse of ETL. Technically speaking, it can still be blanketed under ETL. Another dimension is that there are more features that need to be built in this category. For instance, audience segmentation, ease of use for business teams, drag and drop ML models, marketing performance measurement. So, this block in the whole stack might as well need a new name. The marketed word at the moment is - reverse-ETL. Hope that is sensible

Report

2yr ago

Aaron Artille

@rajashekar_varkala1 Makes sense to me. Looks like quite a nice user experience too, would have been an excellent fit for much of the work I did in my last role where we would use SSIS on a schedule to compile reports or make determinations/catch events from a persistently replicated report server on which we attempted to kind of roll our own warehouse... It was a mess, especially when used with Looker and all of our other tooling combined, but we were learning from a legacy stack (and I digress). Great work on this — will keep this project in mind for future use cases.

Report

2yr ago

Aaron Artille

@rajashekar_varkala1 FWIW, much prefer "reverse ETL" to "regurgitation."

Report

2yr ago

Rajashekar Varkala

valmi.io

Maker

@aaror Thanks Aaron.

2yr ago

What's ETL?

2yr ago

valmi.io

Maker

@sentry_co Hi, Companies collect a lot of data about their users, operations etc. All this data is in disparate tools. They want to transfer this data to a central location such as a data warehouse like snowflake . This process is called ETL. short for Extract , Transform, Load

Report

2yr ago

valmi.io

Open Source Reverse-ETL platform

Do you use valmi.io?

Review valmi.io?