p/experimental-method
Repeatable Business Experiments 💌 -> ⚗️ -> 📈
Dan Pantelo
Marpipe 1.0 — The first multivariate testing platform for ad creative
Featured
195
Testing your ad creative is the most important thing for performance, but actually doing it sucks. Marpipe automates the entire process.
From startups to enterprises, use your assets to build/launch/analyze perfect multivariate tests & discover ads that win.
Replies
Best
Dan Siepen
Oh my! This looks absolutely incredible. This must have made the devs work hard haha. Definitely going to give this a go :)
Dan Pantelo
@dansiepen thanks Dan! Just posted this comment into our Slack channel for the devs to see :) they're incredible
Kateryna Bibik
It sounds promising! What's more, it looks very cool. You've created a product that I really want to try in action. Good job!
Dan Pantelo
@kateryna_bibik excited for you to try it out Kateryna! If you'd like a personal demo/walkthrough from me, let me know.
Anna Pozniak
Congrats with the launch! What ad platforms do you currently support? And which ones are you going to connect in the nearest future?
Pierce Porterfield
@annpozzzniak Thanks Anna! We currently support Facebook Business Manager (Facebook + Instagram). In the future we plan on expanding to Google Ads, as well as DSP's
Dan Pantelo
@pierce_engineer @annpozzzniak if you'd like to try it out and have suggestions/use cases for other networks, ping me and let's jump on a call!
Bogdan Ionita
Just wow, it could help us save weeks in display a/b testing and should put all designers on the same page.
Dan Pantelo
@bogdan_ionita incredible, can't wait for you to get into it Bogdan - let me know if you'd like a demo!
Bogdan Ionita
@danpantelo Marketing team is giving it a look, let's see what they come up with. Keep in touch!
Dan Pantelo
@bogdan_ionita you got it!
Bgf419
I've watched this video like 14 times on repeat, absolute fire 🔥 Quick question: is there a list of use cases for multivariate testing?
Pierce Porterfield
@brett_friedman1 Good question - Multivariate testing is useful for anybody who is spending money to run ads. It allows you to uncover insights in much higher resolution compared to A/B testing. Many of our customers use multivariate methodology to open up Facebook and Instagram as viable channel. Others use MVT as a focus group - figuring out how consumers will respond to different messages, positioning, and visualizations.
Bgf419
@pierce_engineer ohh so can I do audience testing with this? like run product-market fit tests basically?
Pierce Porterfield
@brett_friedman1 Yes, when you're launching your experiment you can choose to target multiple of your saved audiences. Once you start collecting data our analytics will show you how different audiences react to the various elements of your experiment. We usually see big differences in audience preference!
Dan Pantelo
@pierce_engineer @brett_friedman1 let us know if you want to walk through a demo with us!
Dan Pantelo
@pierce_engineer @brett_friedman1 I'm going to reach out and schedule! what's a good email to reach ya at?
Nikhil Jois
Have heard a lot about y’all from Andrew. Lovely to see this version of the product launched. Do you see agencies using it more or in-house teams ?
Dan Pantelo
@nikhiljoisr thanks for the feedback here and the tweet too Nikhil! Right now we've got both agencies and in-house teams using it, although much more brands picking this up directly rather than agencies. Although it's interesting for agencies bc a lot of them can actually upsell the capabilities of our product to their customers and 3x their billable hours while cutting margin..
Dan Pantelo
Hunters, I’ll be honest with you - we had an awesome creative team but no idea what we were doing when making ads. We kinda just made stuff that looked cool, and if everyone else agreed it looked good we would launch it. 🤷‍♂️ Sound familiar? Thing is, creative is (by far) the most important element to ad success. Statistically, most ads we launch don't work well. So why are we still totally shooting in the dark with NO efficient processes? Why does it feel like data science/automation has benefited every part of the marketing process EXCEPT for creative? Marpipe is 2 years in the making. We originally built it to solve our own problem as an agency, but after showing it to folks at Adobe, MediaMath, and others, we raised enough money to spend the past year building it so we can deliver it to you as a simple freemium platform (right in time for Q4!!); ✅ Using just a few creative assets, build hundreds of creatives in a multivariate grid. ✅ Launch them all to your desired level of spend (works for small OR big spenders). ✅ Find positive-outlier ads to scale. 🎉 Discover WHY your ads work at the asset-level so you can build better creative in the future. 🎉 Never make creative guesses again & stop getting crushed by creative fatigue Now trusted by creatives & marketers at companies like Segment, Tubi, and Mars, we hope you’ll take it for a spin as well and let us know what you think. Happy testing!
Dan Pantelo
@phattanle thanks Phat!
Rob Moore
Was excited to try this but it looks like there's some problem with the canvas editor. Using the tutorial template, the text gets cut off
Dan Pantelo
@robmoore aghh we've been getting a few bug reports today because of the sudden volume :/ BUT our engineers are literally squashing them right now as we speak, these are quick & simple. I'd love for you to try it and run you through it myself if you'd like? I can walk you through a 15 min demo :)
Pierce Porterfield
@robmoore Hey Rob! Glad you're checking it out. Try flipping the switch that says "Auto-Size" - it will make sure text always fits to a certain percentage of it's containing box
Sachit Gupta
There's moments as a marketer when you look at a product and go, whoa this is going to the change the game and create a new category. That's exactly how I felt when @danpantelo showed me Marpipe for the first time! Congrats on the launch - this is going to go into the toolbox of every marketer!
Dan Pantelo
@sachitgupta Sachit - an endorsement like this from you is so particularly special to us and our team. Thank you for the incredible words here.
Paul Menchov
I've been waiting what feels like years for you guys to ship this -- so excited to boost our collective creative intelligence!
Pierce Porterfield
@paul1 The wait is over -- a new era is born!
Dan Pantelo
@paul1 thanks Paul! I remember you checking out an earlier version of our product a looooong time ago - come a far way since then and glad to have you along for the ride.
Andrew Gluck
How do you ensure statistical significance for these creative tests? Don't you need that to figure out winners?
Dan Pantelo
@andrew_gluck1 Good question! The amount you should spend on a test to get significant results depends on two factors: the # of ads in your test, and existing average cost for your KPI (or, Cost Per Result). Based on hundreds of tests that we've seen over time, we recommend that you spend 75% of your average CPR per ad. SO, Example: Your average CPR is $10 in your ad account. We recommend you spend $7.50 per ad in an experiment. So you can run 100 ads for just $750. We've seen time and again that this is enough spend to accumulate more than enough results to yield clear performance outliers and make decisions that'll hold at scale. That being said, I've also seen that most marketers have their own way of thinking about what they consider 'significant' or 'enough data', and a lot of folks will make decisions well before stat sig is achieved in any sense, which is why we allow you to pre-set your own spend when launching experiments (in case you don't want to follow our reccs)!
Charlie Oliver
Congrats to Brett and the entire Marpipe team! This looks amazing and I know they've been hard at work throughout the pandemic rolling this out. Looking forward to seeing how it develops!
Dan Pantelo
@itscomplicated thanks Charlie! I'll pass this feedback along to Brett he's going to be happy to hear it :)
Brian Lee
So excited to start using this! Can I immediately start launching ads and viewing my data right away?
Pierce Porterfield
@new_user_140b4ab6a5 Yes we have free 7 day trial so you can jump right in!
adam tropp
Wow, this sounds super cool. Can I view my ad performance broken down by subcategories? I've always dreamed of having a convenient way of seeing results per audience, out-of-image-copy, etc. Would be a big boost to my creative intelligence gathering process if I could do that in a less cumbersome way...
Pierce Porterfield
@glsshsthrwngstn Yes, we give users the ability to view their performance results: In-image-copy, out-of-image copy, images, graphics, backgrounds, audiences, etc
adam tropp
@pierce_engineer WOWIIIIIIIEEEEEEEEE! That is great news. I will definitely have to check out Marpipe!
James Goldman
I haven't seen anything like this! It seems like the data you gather will be super powerful. But rendering so many ads sounds hard, is there a limit to how many of these "variants" you can create? I imagine even rendering a few hundred could take several minutes if this is all browser based. Regardless, congrats, and I'm still going to try it out.
Pierce Porterfield
@james_goldman Thanks James, we haven't seen anything like this either! We actually allow up to 1500 creative variants to be rendered for any given experiment. Even when maxing out your creative variants limit our rendering process will only take 1-2 minutes max. It's pretty overpowered if I'm being honest :P
James Goldman
@pierce_engineer that sounds awesome! I played around with it and it is even snappier than you described, don't sell yourself short!
Eric Franchi
I'm thrilled to see data science and automation being used to make creative -- one of the most important elements of marketing -- more personalized and performant. Congrats @danpantelo!
Dan Pantelo
@ericfranchi Eric - that stamp of approval from you means more than you know to us - you're someone who's truly seen it all, so it's incredible to hear this feedback. Thanks for being along for the ride with us!
Brandon Chung
Wow I'm shocked at how easy and streamlined the product looks to use. Your engineering team is crazy for this one! Is the product free to use?
Dan Pantelo
@brandon_chung1 Thanks Brandon - free to create your account and use our multivariate ad builder. Our Growth Plan is an upgrade (for $249/mo) that allows you to then launch/analyze those creative suites. BUT - today we're offering Product Hunters a 7 day free trial for our Growth Plan!
Scott Friedman
It's about time someone figured how to maximize marketing campaign spends and find a way to leverage AI to ensure ads are presented to its audience in a way that resonates the most. Love it!
Pierce Porterfield
@scottfriedman6 Theres an advertising renaissance on the horizon
Andrew Przybylski
@danpantelo Techstars is partnered with some large corporates, do you have an enterprise model or is that on the roadmap?
Dan Pantelo
@andrew_przybylski2 absolutely! We're already working with large enterprises like Segment, Tubi, Mars, and PepsiCo - I'd love to connect with you to see how we can bring enable the Techstars portfolio to achieve breakthrough performance.
Sean Hoge
Like Figma on steroids, this is really going to shake things up. Going to have my team try it! What does an enterprise plan look like?
Dan Pantelo
@seanhoge oh my god, I think "Figma on steroids" is literally the best compliment we've gotten this entire time. Enterprise plans range from $1,500 all the way up to $10k, it totally depends on your needs. Would you want to jump on a quick demo with me next week to dig in? could also give you a walkthrough of the product myself :)