Innovation Flashcards: A Free Quiz to Run the Right Experiment
Stop confusing Concierge Tests with Wizard of Oz — and save yourself thousands
By Tristan Kromer · Quick Answer: Innovation flashcards are a free quiz tool that trains us to know which experiment to run and when — like choosing between a Concierge Test and a Wizard of Oz test (they’re not the same). As product managers and founders, we can save hundreds of development hours and thousands of marketing dollars by running the right experiment at the right time before launching. The flashcards pair with The Real Startup Book and work well for startup founders, corporate innovators, students, and accelerator programs.
Hi there,
In case you are wondering - yes, we are actually launching a lot of real products this year, not just templates and services. So without further ado… tl;dr: Train yourself to know what innovation methods to use when with this handy flashcards quiz. Are flashcards the most exciting thing in the world or are they just going to give you traumatic flashbacks to cramming for a final in your dorm room days? Well, it’s pretty exciting if you can save yourself hundreds of hours of development time and thousands of wasted marketing dollars by running the right experiment at the right time before you launch your product! This is a simple tool we use in our Running Better Experiments Program to help entrepreneurs understand whether they should be running a Concierge Test or a Wizard of Oz test. (They are not the same and it’s based on what you want to learn.) These Innovation Flashcards work well with The Real Startup Book Online as a free contribution to the startup and corporate innovator community. Also great for students and accelerator programs. We really hope you enjoy - please let us know if you have any feedback! Thank you and happy reading, Tristan Kromer Founder & CEO, Kromatic
Frequently Asked Questions
What are innovation flashcards and how do they help startups?
Innovation flashcards are a training tool that helps entrepreneurs learn which innovation methods to use in different situations. By quizzing yourself on when to apply specific experiments, we can avoid wasting hundreds of development hours and thousands of marketing dollars by running the right experiment at the right time before launching a product.
What’s the difference between a Concierge Test and a Wizard of Oz test?
While often confused, a Concierge Test and a Wizard of Oz test are not the same thing. The key distinction lies in what you want to learn. Each method serves a different experimental purpose, and using the wrong one at the wrong time can waste valuable resources. The innovation flashcards help us internalize when to use each approach.
Who should use innovation method flashcards for learning?
These flashcards are designed for a wide audience — startup founders, corporate innovators, students, and participants in accelerator programs. They pair well with resources like The Real Startup Book Online and are used in structured programs like Running Better Experiments to help anyone practicing lean startup methodology master experiment selection.
How can flashcards save time and money before a product launch?
By training ourselves to instinctively know which experiment to run at each stage, we avoid the costly mistake of building features or running campaigns prematurely. Flashcards help us internalize the right method for each learning goal, so we validate assumptions cheaply and quickly before committing significant development time or marketing spend to a product launch.
Comments
Loading comments…
Leave a comment