Letters after names are really, REALLY common these days. In my parents’ generation you might see M.D., or even J.D., but that was about it. Today, post-nominal initials are hard to keep up with: CSRTE? FAcEM??. I have an MBA and someone recently asked me why those initials don’t appear after my own name.
The question lead me to do some research into the topic and I noticed that just about every discipline has some kind of post-nominal, from project management and engineering all the way to cybersecurity and finance. A Google search revealed that these disciplines do have standards behind the designations.
Our business is no different: we have rigorous standards. In decision science, we take a quantitative approach to decision analysis and risk management. Our models include random or stochastic variables, and we don’t use exact point estimate; like any research or study, we use ranges to express our uncertainty. We also use Monte Carlo simulations, which is just a way of doing the math for variables that are distributed in a variety of ways.
In the end we are able to measure things – some very cool things – like drought in the horn of Africa, fuel consumption on the battlefield or even the risk of a mine flooding. More practically, our techniques can rank a portfolio of projects or measure cybersecuirty risk(s) and the value of controls. We are able to give a “go” or “no go” decision on a major investment that’s typically full of unknown risks and returns.
Why should you care? Some methods outperform others and our methods outperform the alternatives – like human intuition and balanced scorecard!
Peer-reviewed scientific research tells us that balanced scorecard techniques and even expert intuition (gut feel) show no measurable improvement over time. In fact, we know that these methods can, at times, have a negative effect on decision outcomes. The bottom line is: if you find yourself multiplying a weight by a score, ranking projects by numbers, or using “red”, “green”, and “yellow” to analyze your risk – STOP. Just stop. You are wasting your time. The research is clear – the evidence tells us these are retrograde methods that either do not improve outcomes or damage the quality of outcomes.
Empirical research also verifies that using predictive models shows a measurable improvement in decision making. In fact, it’s been measured before – people who use Monte Carlos outperform those that don’t. They definitely outperform the alternative and that’s all we need to show to clients who want to use the method that results in the best decision.
So what does this have to do with post-nominal initials? It occurred to me that this is hard for people to swallow. I mean, try telling a CEO that “the model of her outperforms her” or “his intuition shows no measurable improvement on decisions over time.” Moreover, until very recently there were no standards for predictive models and folks were intimidated by the math, which by the way, is trivial with current tools.
In an earlier post, I mentioned the Probability Management Conference that took place this week in Silicon Valley. Harry Markowitz (Nobel Laureate and ProbabilityManagement.org Board Member), Sam Savage (Executive Director, ProbabilityManagement.org and author of The Flaw of Averages) and Doug Hubbard (President of Hubbard Decision Research and author of How to Measure Anything) spoke at the annual conference.
Along with several other speakers the group explained how simulation methods can be applied to improve decision making for a variety of problems. We heard from the Naval Post Graduate School about how simulation and statistical methods are used in sub-hunting and we did a video conference with a group of middle school kids who were learning about correlations and portfolio selection. They were really into it!
Doug took seminar attendees through a half day of applying statistical methods and simulation to cybersecurity. He showed methods from his most recent book and his co-author, Richard Seiersen, also presented about how these methods are being applied in his position as Chief Information Security Officer (CISO) at Twilio. visit: www.probabilitymanagement.org for more information.
