Agile Zone is brought to you in partnership with:

Roman Pichler is an agile product management and Scrum expert. He is the author of the book "Agile Product Management with Scrum" and writes a popular blog for product owners and product managers. Roman is a DZone MVB and is not an employee of DZone and has posted 37 posts at DZone. You can read more from them at their website. View Full User Profile

Is Intuition or Data More Important in Agile Product Management?

05.31.2013
| 3569 views |
  • submit to reddit

“But with the blast shield down, I can’t even see! How am I supposed to fight,” asks Luke Skywalker in the Star Wars movie Episode IV while training with his lightsaber on board of the Millennium Falcon. “Your eyes can deceive you. Don’t trust them. Stretch out with your feelings,” answers Ben Kenobi.

This little story illustrates a fundamental question: Should we trust our intuition or our analytical abilities to make decisions?

Data-driven

Empirical approaches to product development such as Scrum and Lean Startup encourage us to leverage data to make decisions: We use product increments or MVPs to gather the relevant information from users, customers, and other stakeholders. Analysing the data should then allow us to draw the right conclusions and to adapt the product – to pivot or persevere. The following picture illustrates this approach:

data-driven, experimental process
If this blog post, for instance, does not attract as many comments and doesn’t generate as much Twitter traffic as I had hoped, does it mean that I must rewrite or remove it? The data alone is not going to tell me the right answer.

Intuition-lead

“If I had asked people what they wanted, they would have said faster horses.” This Henry Ford quote shows how difficult it can be for customers to tell us what they really need. As product owners, we have to be creative and envision the future product, a product that we believe will benefit its users and the company providing it.

Vision, however, is based on intuition or instinctive knowledge. It’s based on what we feel is right, aesthetically pleasing, and helpful. It’s the opposite of a data-driven, empirical approach:

vision-lead process
While using our vision to guide our decisions may seem attractive, there is a dark side: I could, for instance, follow my vision of creating what I believe would be a brilliant, amazing book only to find out after its publication that nobody really wants to read it. Time and money would be wasted, revenue lost.

Reality Check

Let’s recap: Data alone is unlikely to tell us what to do, and trusting our intuition is risky. Human beings are prone to make errors, and our intuition can be distorted by cognitive biases. Luckily, the two approaches complement each other: As product owners, we need a vision of where we want to take our product, and we should believe that the product can benefit its users and the company providing it.

At the same time, we should be critical of our ideas, and constantly ask ourselves: “Why would anybody want to use our product? Why should the company invest in it?” We should carefully analyse the data obtained form users, customers, and other stakeholders to repeatedly test our ideas and assumptions, to check that we are on the right rack, and that it’s worthwhile to continue. This is illustrated by the following picture:

intuition and data lead to a great product

So what should I do if the data suggests that this post is not as exciting to my readers as I would have hoped? It would certainly allow me to investigate the likely causes: Is the topic not particularly relevant? Did I present it in the wrong way? But ultimately, it’s up to me to decide what I do about the post, and if I continue writing about the subject. As the product owner, I am responsible for the success of the product. No clever algorithm or analytics tool will be able to make the right decision for me.

Summary

Innovation relies on our intuition as much as on testing our ideas by gathering and analysing the relevant data. As product owners, we should neither blindly trust our intuition, nor should we expect that the data answers all our questions. Instead, we should use both, intuition and data, to guide our decisions.

You may be wondering what happened to Luke Skywalker trying to block the laser shots with his lightsaber without being able to see. He succeeded, of course, and Ben Kenobi told him: “You see? You can do it.” Interestingly, Luke employed his intuition and the data available to him, that is, the rather unpleasant experience of being hit by the laser remote. In fact, the experience helped him to improve its intuition, to anticipate and intercept the shots.

Now, would it be data-driven or intuition-lead to claim that this enabled him to become a great Jedi?

Published at DZone with permission of Roman Pichler, author and DZone MVB. (source)

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)

Comments

Viraj Samarasekera replied on Sat, 2013/06/01 - 1:30am

@Roman,

Quite an inspring article. Base of your article points that product develop is for humans and not for machines.

Keep up the ideas ideas rolling in.

 

Roman Pichler replied on Wed, 2013/06/05 - 4:42am

Thanks for the feedback, Viraj.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.