Thursday, January 19, 2012

The many faces of standard deviation

Confusion abounds when it comes to standard deviation. Some of the issues include:
  • Equal-weighted or asset-weighted?
  • Divide by "n" or "n-1"?
  • Is it a measure of variability, volatility, or dispersion?
  • Is it a measure of risk?
  • What's the best way to measure relative to the composite's average return?
I'll be brief, but promise to expound further upon this subject in this month's newsletter.

Equal or asset-weighted?

If you've been reading my stuff for any length of time, chances are you know the answer: EQUAL! Okay, so you're allowed to do asset-weighted, but why would you? What does the number mean or represent? This was an idea that some folks thought made sense almost 20 years ago ("since returns are asset-weighted, shouldn't standard deviation?"), but didn't and doesn't. But if you insist on doing asset-weighted, be my guest.

Divide by "n" or "n-1"?

By "n" we mean the number of accounts. I recall that the AIMR-PPS® flip flopped on this one (the first edition (1993) had one form, the second (1997) a different one [perhaps someone was planning to enter politics, and wanted practice]).

We're supposed to use "n" when we're measuring against the population, and "n-1" when against a sample. Dividing by "n" makes standard deviation a bit smaller. Most firms seem to use "n," so I say "why not join them?" We can debate which is appropriate, but why bother?

Is it a measure of variability, volatility or dispersion?

The short answer: yes!

Bill Sharpe, in his 1966 paper used the term "variability" to describe standard deviation (he referred to what we know as the "Sharpe Ratio" as the "reward to variability" (recall it has standard deviation in the denominator) and Jack Treynor's risk-adjusted measure as the "reward to volatility" (it has beta in the denominator)). However, in an email to me not long ago, he said using either the term "variability" or "volatility" is fine. Both of these are used in the context of standard deviation being a measure of risk; what some call "external dispersion."

As for "dispersion," I usually mean this in the same context as some do for "internal dispersion," meaning how the composite's returns compare / vary.

The GIPS® standards (Global Investment Performance Standards) now require both (a) a measure of dispersion (and standard deviation is just one way to accomplish this) and (b) the 36- month, annualized standard deviation for both the composite and benchmark. The former is for a single time period (standard deviation of annual portfolio returns for 2011, for example) and the other across time; a longitudinal measure, if you will (e.g., the 36-month standard deviation of the composite for the period ending 31 December 2011).

Is it a measure of risk?

It depends who you speak to. Since many consider risk to be either (a) the failure to meet the client's objective or (b) losing money, it wouldn't qualify, because it does neither. However, Spaulding Group research has shown that it's the most common measure of risk. And, the GIPS standards now require it (although they've shied away from calling it a "risk measure"). And so, regardless of its detractors, most folks do consider it a measure of risk.

What's the best way to measure relative to the composite's average return?

I saved the best for last. I am conducting a GIPS verification and was validating the client's measure of dispersion; in this case, equal-weighted standard deviation. Because I couldn't match what they had, I tried comparing it to the composite return; let me explain.

If you use Excel, for example, and run the "STDEVP" function against the returns of all account's present for the full year, you're measuring standard deviation against the average of these returns, which in almost all cases will not be the same as the composite's return, meaning it's telling us how disparate the returns are around this average, not the average reported in the presentation. I believe that ideally it should be run against the composite's return. However, this would require several more steps, and couldn't be invoked by simply running a similar function like STDEVP. Too bad.

--------------------------------------------------

And so, standard deviation isn't really so simple, is it?

4 comments:

  1. Dave, great blog. Always an intersting topic. I am an advocate of equal weighted dispersion as well as using "n" in the denominator as I feel that the standard deviation is based on the population (you are not sampling accounts from the composite). Your last paragraph is important for people to understand when using the dispersion and the composite return together. Dispersion is NOT the standard deviation of the composite return, it is the standard deviation of the annual returns in the composite.

    ReplyDelete
  2. Thanks, Jed. As to the last point, I think this was totally missed by the framers of the Standards. IDEALLY, it SHOULD be standard deviation around the composite's return, since this is the return that is reported; we don't see the return of the accounts present for the full year. In reality, is it a big deal? Probably not. And, it's probably not worth the extra effort to do the caculations, though it would be good to do a study to see HOW different they can be. Something to take up, I guess!

    ReplyDelete
  3. I too believe Standard Deviation is a measure of risk but not the best proxy for risk. As you mention above, Standard Deviation might not closely reflect the conventional interpretation of risk. To me, the more relevant question would be: what is our main purpose for examining historical risk trends? Is it used as a risk comparison method? Or are we examining the risk characteristics as a “tell” or “warning” on which direction the variability of returns will be heading in a potential bad scenario? For the former, perhaps standard deviation has its place in the investment performance world. But for the latter, if one holds the belief that we should only look at variation below an acceptable return as risk, then the risk measure that makes more sense is downside deviation not standard deviation. So although standard deviation is a crucial piece of the jigsaw in consolidating one's understanding of return variations, however it fails to improve our understanding and give us a more comprehensive idea of the “bad” risk factors involved.

    ReplyDelete
  4. Excellent points, thanks. Yes, examine WHAT you are measuring risk for, to determine if you have the right measure. In reality, standard deviaton should be part of an ARSENAL of risk measures; to use only one risk measure is like judging a prospective employee on only a single attribute: to fully assess someone's potential, you must look at a great deal. And the same for risk: to fully comprehend and assess it, you must take a broad brush approach.

    Thanks for taking the time to comment.

    ReplyDelete

Note: Only a member of this blog may post a comment.