Product × Finance × AI: Financial Products in the Age of AIPart One · Section Two Risk compensation: the price of bearing risk中文
Chapter 6

FactorsRisk compensation can be decomposed

Realized return =Time compensation+Risk compensation+Information advantage-Trading costs+LuckPremise: promises kept

Risk compensation does not come from the market as a whole alone. Long-term returns can be decomposed into compensation for a few kinds of systematic risk, and these sources of risk are called factors: market, size, value, profitability, investment and momentum. The part of a portfolio's return that seems to beat the market is often just the result of bearing the risk of these factors. A credible factor needs an economic explanation and must hold up in out-of-sample tests. Even a credible factor can underperform for more than ten years in a row, and that is precisely why it earns compensation.

1. Market risk alone does not explain everything

Under the capital asset pricing model, a stock's expected return depends only on how much it moves with the market. Researchers soon found patterns the model could not explain. Basu found in 1977 that stocks with low price-to-earnings ratios had higher average returns; Banz found in 1981 that companies with small market capitalization had higher average returns; Rosenberg and colleagues found in 1985 that stocks with high book value relative to market value had higher average returns. Using long-run data on US stocks, Fama and French confirmed in 1992 that once market capitalization and the book-to-market ratio are controlled for, beta has almost no power to explain returns.

Average returns sorted by size and book-to-market ratio

Stocks are sorted into five groups by market capitalization (small to large) and five by book-to-market ratio (low to high), giving the average annual returns of 25 portfolios. Tap any cell for a description.

Size
small
↓
large
Book-to-market: low (growth)high (value)

Tap any cell.

Illustrative data showing only the direction reported by Fama and French (1992) and related studies: portfolios of small stocks with high book-to-market ratios have higher average returns, and differences in beta across portfolios do not explain the gap. The numbers are not the original estimates.

2. What a factor is

A factor is a source of risk borne in common by a group of stocks. Researchers capture it with a simple method: sort stocks by some characteristic, buy the group with the strongest characteristic and sell the group with the weakest, and the return of this "long-short portfolio" is the factor return. For example, buying the 30% of stocks with the highest book-to-market ratio and selling the lowest 30% gives the value factor; buying the group with the smallest market capitalization and selling the largest gives the size factor.

How a factor is built

Forty stocks sorted by book-to-market ratio: buy the highest 30% and sell the lowest 30%; the return of this long-short portfolio is the value factor return for the period.

Sell: lowest 30% book-to-market Buy: highest 30% book-to-market
Average return of the long group
Average return of the short group
Value factor return (long minus short)
Illustrative simulation: each stock’s return = the common market return + a small premium related to book-to-market ratio + firm-specific noise. Subtracting short from long cancels the common market part, leaving the return related to the characteristic. Construction follows Fama and French (1993).

3. From one factor to five

In 1993 Fama and French proposed the three-factor model: market, size and value. In 1997 Carhart added momentum, the tendency of stocks that rose most over the past year to keep outperforming. In 2015 Fama and French added two more factors, profitability and investment: companies with strong profitability, and companies that expand their investment conservatively, have higher average returns.

How factor models evolved

Each extension was made to explain return differences the previous model could not. Tap a factor to see how it is built and its economic explanation.

1964Capital asset pricing model
1993Three-factor model
1997Four-factor model
2015Five-factor model
Tap a factor.
For the three- and five-factor models, see Fama and French (1993, 2015); for the momentum factor, Carhart (1997); for the momentum phenomenon, Jegadeesh and Titman (1993). The five-factor model does not include momentum, but momentum is often used alongside it.

4. Taking a portfolio's return apart

With factors, a portfolio's return can be taken apart: how much comes from bearing market risk, how much from bearing the risk of size, value and other factors, and only what remains is the manager's true excess return, usually called "alpha". For many funds that seem to beat the market, the excess return shrinks sharply or even disappears once a multi-factor decomposition is applied: they simply held more small-cap or value stocks.

Where does a “market-beating” fund’s return come from?

Over the past ten years a fund earned 9% a year above the risk-free rate, while the market earned 6% above it. Switch the explanation and see how much true excess return is left.

03%6%9%

Illustrative numbers: the fund’s exposures to the market, size, value and momentum factors are 1.0, 0.4, 0.5 and 0.2, and the factors’ annual returns over the period are 6%, 2%, 2.5% and 3%; the management fee is 1% a year.

This matters directly for evaluating products: returns earned by bearing factor risk can be replicated with low-cost factor products; only the part that remains after the factors are removed is worth paying active management fees for.

5. Why factors are compensated

There are two explanations for factor returns. Fama and French lean towards a risk explanation: value stocks are often companies in operating difficulty that are more likely to deteriorate further when the economy is bad, so investors demand a higher return to hold them. In 1994 Lakonishok, Shleifer and Vishny proposed a behavioural explanation: investors extrapolate companies' past performance too far, becoming too pessimistic about companies with dim prospects and too optimistic about popular companies, so value stocks end up undervalued.

Why value stocks earn more: two explanations

The two explanations rest on different mechanisms and have different implications. Tap a question to see how each explanation answers it.

Risk explanation

Value stocks are often companies in operating difficulty that are more likely to deteriorate further when the economy is bad. Holding them means bearing the risk of “doing worse in bad times”, so investors demand a higher return.

Proponents: Fama and French
Behavioural explanation

Investors extrapolate past performance too far: they are too pessimistic about companies with dim prospects and too optimistic about popular ones, so value stocks are undervalued and growth stocks overvalued.

Proponents: Lakonishok, Shleifer and Vishny (1994)
The two explanations are not mutually exclusive; in practice both may be at work.

The two explanations have different implications. If it is risk compensation, it will persist over the long run, at the cost of losses in bad times; if it is mispricing, it may weaken once it becomes widely known. In practice both components may be present at the same time.

6. The factor zoo and the bar for testing

Academics have reported hundreds of "factors". In 2011 Cochrane called this situation the "factor zoo". In 2016 Harvey, Liu and Zhu counted 316 published factors and pointed out that with so many attempts, some will appear significant by luck alone; they proposed raising the bar for statistical tests from the usual t-statistic of 2 to at least 3.

Test enough factors and some will look “significant” by luck

Suppose researchers test 300 candidate factors, of which only 10 are real and the other 290 do nothing. Adjust the test threshold and see how many of those that pass are real.

The usual threshold is 2; Harvey, Liu and Zhu (2016) recommend at least 3
Factors that pass
Of which useless, passed by luck
Real factors missed
Illustrative simulation: for useless factors, the absolute value of the t-statistic is drawn from a standard normal distribution; real factors have a mean t-statistic of 3.5. Each dot is a candidate factor: grey for useless ones, green for real ones. The approach follows Harvey, Liu and Zhu (2016).

Beyond the statistical bar, a credible factor needs two more conditions: a clear economic explanation, and continued validity in periods and markets outside the original study.

7. Credible factors can also slump for a long time

Even factors that pass the tests do not deliver positive returns every year. Under Fama and French's definition, the value factor lagged growth for a long stretch from 2007, and by mid-2020 its cumulative drawdown was about 55% (Arnott et al., 2021); many people concluded that value investing no longer worked. From the standpoint of risk compensation, this is exactly why the compensation exists: if bearing factor risk produced a steady profit every year, it would no longer be risk, and competition would erode the compensation.

A compensated factor can still lag for years on end

Suppose a factor earns an average compensation of 3% a year over the long run, with annual volatility of 12%. Choose a holding period to see the probability that the cumulative return over that period is negative; below are three possible 40-year paths.

Probability of a negative cumulative return over the period
Illustrative parameters, not an estimate for any specific factor. A real case: under the Fama–French definition, the value factor lagged growth from 2007, and by mid-2020 its cumulative drawdown was about 55% (Arnott et al., 2021). The probability uses a normal approximation: Φ(−average compensation × √years ÷ volatility).

8. Implications for product design

Factors break the question "where does the return come from" out of a vague "good stock picking" into a few sources that can be identified and priced.

Chapter summary: use factors to see where returns come from

Four design requirements, each tied to one mechanism in this chapter.

Returns can be broken into factor exposuresShow a portfolio’s sources of return factor by factor

Tell users how much of the return comes from market, size, value and other factors, and how much is true excess return.

Factor exposure can be replicated cheaplyFees should match the true excess return

Only the part that remains after the factors are removed is worth paying active management fees for.

Enough trials always produce false positivesRaise the bar for “newly discovered patterns”

New factors produced by AI or backtests need an economic explanation, a higher statistical threshold and out-of-sample tests.

Credible factors can also lag for a long timeExplain that factor strategies may underperform for years in a row

Show users the longest historical period of underperformance before they buy, so they are not forced to give up during a slump.

References