The Data Page
Last Updated: January 2009
This page provides information on how to collect data from a variety of sources. it also allows you to look at and download a number of data sets that you might find useful in corporate finance and valuation. If you have trouble viewing the data in your browser, you can download the data in excel format. I will try to keep them updated, and include the dates of the updates with the data sets. If you want to see the company-specific information, you can download the data on individual firms below.
Data comments for 2009: I have expanded the data
to include all publicly traded firms that had a market capitalization greater
than $ 10 million on January 1, 2009. I continue to use Value
Line for the US data updates, but I have switched to a combination of Bloomberg
and Capital IQ data for non-US firms. The betas reported for non-US firms are
now Capital IQ betas and not Bloomberg betas. In additiion to having the data
by region (US, Japan, Emerging Markets and Europe), I have also added a global
summary that lists items like beta and multiples for each sector for all companies
listed globally.
The last quarter of 2008 will have a profound effect on the numbers that you
see for most companeis and for the sectors. The market cap and price data for
all companies is of January 1, 2009 and thus reflects the market carnage of
the last few months. However, the accounting data as of January 1, 2009 is
generally either through September 2008 (for trailing 12 month data) or earlier
(December 2007 for annual data). Consequently, you will see that many companies
trade at absurdly low multiples of 2007 earnings, not because the market is
under pricing these companies but because expectations of future earnings have
changed so dramatically. While there is not much that I can do about this right
now (I could try to use forecasted earnings for 2009 but that is available
for about 15% of my overall sample), I will revisit the data in June (when
the 2008 numbers should be fully in and update the data. Note also that I have
adjusted the equity risk premium for mature markets up to 5% (from the lower
numbers that I have used in previous years) to reflect the state of the markets
today and that default spreads for both corporate bonds and sovereign data
have been updated to reflect the new reality. With the U.S. data, I have added
an extra feature, at least for the risk measures and multiples, where I have
broken down the averages by market cap class. I have also added back the data
set on the effect of capitalizing operating leases on debt ratios and returns
on capital.
To read more about my thoughts on using 2009 data, click here.
Date of last update:| Market | Date of last update | Number of firms | Data source |
| United States | January 2009 | 6870 | Value Line |
| Europe (EU, UK, Switzerland & Scandinavia) | January 2009 | 4167 | Bloomberg |
| Japan | January 2009 | 3479 | Bloomberg |
| Emerging Markets (Asia, Latin America, Eastern Europe, Mid East and Africa) | January 2009 | 10747 | Bloomberg |
| Australia, New Zealand & Canada | January 2009 | 2080 | Bloomberg |
For a 24-hour period (January 13-14 of 2009), I miscategorized Spain as an emerging market. I intended no slight to the Spanish and it was entirely a mistake. It has now been fixed.
Archived Data : The data reported in the download is the most recent data (from the dates of the last update). For the US data, you can download the archived averages from the end of the previous years (1998-2007). The 2007 archived average is the average as of December 2007 (January 2008 update), for instance.
Individual company information: While the industry averages are reported below, you can also download information on individual firms. The files below contain the information for the US, Europe and Emerging Markets separately. Be forewarned that these are large files and may take a while to download. The archived files from previous years are also available. (The 2005 file incluces data avaiable from the end of 2005 and so on... Note that the financial statement data will lag by a longer period, since the most recent financial statements as of January 2008 for a company with December year-end financials will be the 2006 financials.) All of the data is in millions of US dollars.
| US | Europe | Emerging Markets | Japan | Australia, NZ and Canada | |
| Current (January 2009) | Download | Download | Download | Download | Download |
| 2007 (January 2008) | Download | Download | Download | Download | Download |
| 2006 (January 2007) | Download | Download | Download | Download | Download |
| 2005 (January 2006) | Download | Download | Download | Download | Download |
| 2004 (January 2005) | Download | Download | Download | Download | Download |
| 2003 (January 2004) | Download | Download | Download | Download | Download |
| 2002 (January 2003) | Download | Download | Download | ||
| 2001 (January 2002) | Download | ||||
| 2000 (January 2001) | Download |
Variable definitions: The
variables are defined and described in this link.
Source data: If you want more information on the source data, click
here.
Collecting Data
|
|
|
|
| Annual Report or 10K | While both contain large amounts of relevant data, my sense is that they are both becoming data dumps as companies become increasingly risk averse (and lawsuit averse). | |
| Value Line | Plus: Old fashioned but very effective at delivering substantial
amounts of information on one page. Minus: Needs to update page to reflect available (and necessary data) and downplay its stock picking and forecasting ability. |
|
| Bloomberg | Clearly the best all-round source of market data on any firm almost anywhere in the world. It has two shortcomings. It is not very user-friendy, making it difficult to wade through the data to get the information you need, and it is often difficult to download the data that you need from the terminal. | Getting Data from Bloomberg- pdf file (online version) |
Data Sets
| Topic | Current data sets (see
above for data of update) |
Download Excel file | Archived Data( 1998 archived data is from the January 1999 update). | Description |
| Corporate Governance | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 |
This data set includes insider holdings and institutional holdings as a percent of outstanding stock, classified by industry. | ||
| Discount Rate Estimation | This data set includes actual returns on stocks, bonds and bills for the United States from 1928 to the most recent year. It is a useful starting point for estimating historical equity premiums. | |||
| Download | These risk premiums are estimated based upon a simple 2-stage Dividend discount model and reflect the risk premium which would justify they current level of the index, given the dividend yield, expected growth in earnings and the level of the long term bond rate. | |||
| Download | 2000, 2001, 2002, 2003, 2004, 2005 , 2006, 2007 | These are risk premiums estimates for other markets based upon the country ratings assigned by Standard and Poors'. | ||
| 1998, 1999, 2000, 2001, 2002, 2003. 2004 , 2005 , 2006. 2007 | This data set lists betas by industrial sector. The betas are computed using 5 years of monthly returns for each stock and then averaged (simple). The unlevered betas are estimated using the average market debt/equity ratios by industrial sector. (Hamada betas). | |||
| Marginal tax rate by country | Download | This is the KPMG survey of corporate tax rates by country. Please give them full credit when you use any of the information from this file. | ||
| Download | 1998, 1999, 2000, 2001, 2002, 2003, 2004 , 2005 , 2006, 2007 | These are betas adjusted to reflect a firm's total exposure to risk rather than just the market risk component. It is a function of the market beta and the portion of the total risk that is market risk. These betas might provide better estimates of costs of equity for undiversified owners of businesses. | ||
| Risk Measures by Market Cap Class | Download | These are risk measures - standard deviatiions, betas, total betas and hilo risk - broken down for U.S. firms into ten market cap classes. Make of it what you will. | ||
| Download | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 | This data set lists costs of equity, costs of debt, market debt ratios and costs of capital by industrial sector. | ||
| Performance Measures | Download | 2002, 2003, 2004, 2005 , 2006, 2007 | This data set lists annualized Jensen's alphas by industry, as well as R-squared values. | |
| Download | 1998, 1999, 2000, 2001, 2002, 2003, 2004 , 2005 , 2006, 2007 | This lists out the average economic value added and equity economic value added by industry sector. While I have not made any adjustments to the operating income and book value of capital, this is a good starting point for comparisons. | ||
| Capital Structure | Download | 1998, 1999, 2000, 2001, 2002, 2003, 2004 , 2005 , 2006, 2007 | This data set lists the industry averages of the market debt ratio, the effective tax rate (tax benefit), insider holdings (discipline), variance in operating income (bankruptcy risk) and fixed assets to total assets (agency costs). | |
| Download | This data set lists S&P bond ratings classes, with normal spreads over the treasury bond rate and typical interest coverage ratios | |||
Operating Lease effect on debt (Will be
fixed shortly) |
Download | This summarizes the impact of converting operating lease commitments into debt on market debt to capital ratios, operating income and return on capital, categorized by industry. | ||
| This summarizes the results of the latest cross sectional regression of the market debt ratio (total debt to capital) against financial variables. | ||||
Duration, Cyclicality and Inflation Measures
by Sector |
Download | This lists the coefficients obtained when we regress sector market value changes (quarterly) against changes in long term interest rates, GNP growth and inflation. | ||
| Download |
This data set includes annual data on interest rates, inflation rates, GNP growth and the weighted dollar from 1981 on... | |||
| Dividend Policy | Download | 1998, 1999, 2000, 2001, 2002, 2003, 2004 , 2005 , 2006, 2007 | This data set lists the industry averages of the dividend yield and payout ratios, as well as other variables that might be relevant in examining the trade off involved in paying dividends. | |
| This summarizes the results of the latest cross sectional regression of the dividend yield and payout ratio against financial variables. | ||||
| Cash Flow Estimation | Download | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 ,2005 , 2006, 2007 | This lists out average capital expenditures and depreciation by industry sector, as a percent of operating income. It is a useful resource during valuation. It also includes the sales to capital ratio which is useful when valuing young firms with negative earnings. | |
| Download | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 | This reports average operating and net margins by industry sector for the most recent time period. | ||
| Download | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005, 2006, 2007 | This lists out average inventory, accounts receivable, accounts payable and non-cash working capital by industry sector, as a percent of revenues. | ||
| Growth Rate Estimation | Download | 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005 , 2006, 2007 | This data set reports average return on equity (net income/book value of equity) by industry sector and decomposes these returns into a pure return on assets and leverage. | |
| Download | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 | This data set summarizes growth rates from fundamentals (ROE * Retention Ratio) by industry group. | ||
| Download | 1998, 1999, 2000, 2001, 2002, 2003, 2004 , 2005 , 2006, 2007 | This data set summarizes growth in earnings over the last 5 years by industry. | ||
| Download | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 | This data set summarizes growth rates from fundamentals (ROC*Reinvestment Rate) by industry group. | ||
| Multiples | 1998, 1999, 2000, 2001, 2002, 2003, 2004 , 2005 , 2006, 2007 | This lists out the PE ratio, expected growth (Value Line) and the PE/growth by industry group for the most recent time period. | ||
| 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 | This lists outs Price/Book value ratios and ROE by industry group for the most recent time period. | |||
| 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 | This lists out Price/Sales ratios and margins by industry group for the most recent time period. | |||
| 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005 , 2006, 2007 | This lists out Enterprise Value / EBITDA by industry group for the most recent time period. Enterprise Value is the market value of equity plus the book value of debt minus cash. | |||
| Multiples by Market Cap Class (US) | Download | The averages for key equity and enterprise value multiples are reported for firms in different market cap classes in the U.S. | ||
| Download | This lists out the average PE, Price to book, Price to Sales and Enterprise Value multiples by country. It also includes summary statistics on returns on equity and capital and margins (net and operating). | |||
| This lists the output from the latest regressions of multiples against fundamentals (PE, PBV and PS ratios). | ||||
| Option Pricing Models | Download | 1998, 1999, 2000, 2001, 2002, 2003 , 2004 , 2005, 2006, 2007 | This lists out average annualized stock price variance (in daily stock prices) over the previous five years, and the average firm value standard deviation over the same period. |