Skip to Content

The Almost Daily 2¢ - Attack The Index?

In the wake of the National Association of Realtors (NAR) absurd attack on Professor Robert Shiller and possibly even more ridiculous attempt to discredit the validity of the S&P/Case-Shiller Indices (CSI), it appears that there is a subtle, yet growing, effort on the part of local Realtors and other interested parties to publicly discount the accuracy of the CSI.

Spurious accusations abound but several center on the CSI being misleading, either because of an assumed complete bias towards the local metro markets they primarily track or because of the exclusion of condo and new construction properties from their calculations or even that the indices are simply used (with purposely dishonest intent) to portray a gloomier picture than reality.

Although these allegations are mostly transparent and desperate attempts to besmirch reputations and otherwise muddy the water, I thought it might make sense to compare the various modern home price indices to see how well they conform to each other and, in turn, see if any of the above mentioned allegations could be easily dispatched with.

There are three main modern home price index sources, two of which employ essentially the same “repeat sale” methodology and one that focuses on gauging the daily “price per square foot” in order to construct their respective indices and all vary notably in both region of coverage and property inclusion.

The Office of Federal Housing Enterprise Oversight’s (OFHEO) Home Price Indices (HPI) and the S&P/Case-Shiller Indices (CSI) both exclusively use single family home sale transactions, HPI’s coming from Fannie Freddie source data and CSI’s coming from county deed records, to construct their indices using two slightly different versions (HPI vs CSI methodologies) of the “arms-length repeat sale” methodology jointly proposed by Professor Karl Case of Wellesley College and Yale’s Professor Robert Shiller.

Probably the greatest difference between the HPI and the CSI is that the HPI source data is limited to “conforming” Fannie Freddie transactions and thus exclude all transactions made possible due to the use of “Jumbo” loans.

Another major difference is coverage area but although there are many hundreds more HPI indices than CSI, only a few of the HPIs are published as “purchase only” indices that include only data resulting from home “purchase” transactions rather than combining refinance (tends to skew the results) and purchase transactions.

Also, even though the CSI’s are strongly associated with designated metro markets they offer some fairly widespread coverage with inclusion of data from far reaching counties and even crossing state borders when appropriate (e.g. the Boston CSI index includes the counties of Essex, Middlesex, Norfolk, Plymouth, Suffolk, Rockingham NH and Strafford NH).

Radar Logic, on the other hand, constructs price indices (RPX) for 35 metro area markets derived from both new and existing single family and condo sale transactions using a very interesting and inventive approach that seeks to essentially establish the daily spot “price per square foot” for the entire residential property market.

All of the mentioned technologies are both highly analytical and logical and above all else offer a substantially more accurate view of real market price movement especially when compared to the Realtor’s more favored median selling price method (or sometimes average selling price…whichever way the wind is blowing of course).

But how well do these indices correlate with each other?

First, take a look at the following chart that shows the RPX for Boston (averaged monthly) and the CSI for Boston both normalized to a base of 100 and plotted since January of 2000 along with the month-to-month percent change to the CSI supplied for seasonal comparative purposes.

Notice that although the RPX is clearly capturing a more substantial seasonal variation, both indices show a well correlated (Pearson’s of 0.982, r-squared of 0.965) trend and comparable seasonality even in light of the fact that the RPX source data includes both condo and single family property transactions and CSI uses only uses single family.

Notice also that given this correlation the RPX, although not complete for February transactions, is quite possibly giving us a bit of a preview of the February results of the CSI which will be released at the end of April.

Next, study the following chart which adds the “purchase only” HPI for Massachusetts and forgive the “stepped” appearance of the series as it is published quarterly so I simply repeated each reported value as the interim monthly data.

Notice again that the HPI’s underlying trend is fairly well correlated to both the CSI (Pearson’s of 0.996, r-squared of 0.993) and the RPX (Pearson’s of 0.978, r-squared of 0.956) even though the HPI series broadly captures price changes from across all Massachusetts counties and excludes homes that were purchased using Jumbo mortgages.

So the key take away is merely this (and I suppose non-wishful thinkers and non-Realtors would have assumed as much) all of the most well regarded and highly analytical home price indices are essentially saying the same thing.

Whether you keep account by exclusively using single family homes or mix in condos, use whole property price or price per square foot, include metro-regional or look more broadly, when it comes to residential real estate… prices are trending down.

Similar entries
  • Today, the Office of Federal Housing Enterprise Oversight (OFHEO) published their Home Price Index (HPI) data for Q1 2008 showing unprecedentedly widespread weakness with 47 states including Washington DC experiencing peak home price declines with 32 declining better than 2% and 8 declining more that 7%.

    Topping the list of peak decliners by state is California at -23.22%, Nevada at -19.93%, Michigan at -15.71%, Florida at -14.76%, Arizona at -10.96%, Massachusetts at -7.62%, Rhode Island at -7.29%, and New Hampshire at -7.27%.

  • Today, the Office of Federal Housing Enterprise Oversight (OFHEO) published their Home Price Index (HPI) data for Q4 2007 showing unprecedentedly widespread weakness with 49 states and Washington DC experiencing peak home price declines with 20 declining better than 2% and 8 declining more that 6%.

    Topping the list of peak decliners by state is California at -14.72%, Michigan at-13.48%, Nevada at -11.50%, Florida at -8.51%, Washington DC at -8.07, Arizona at -7.11%, Massachusetts as -6.34% and Rhode Island at -6.02%.

  • Yesterday, the Office of Federal Housing Enterprise Oversight (OFHEO) published their Home Price Index (HPI) data for Q3 2007 showing continued deceleration of home price appreciation in most regions as well as a broadening of outright declines now including 23 states declining from their respective peaks and 11 states declining on a year-over-year basis.

  • UPDATE: Reader Tyrone of the excellent "Housing Bubble Hall of Shame" notes that the current issue of Realtor Magazine features another absurd CSI/Shiller hit piece entitled "Getting Case-Shillered" this time by Realty Times editor Blanche Evens.

    Keep in mind, Shiller's MacroMarket's sold the rights to the CSI to Standard & Poor's last February and even when they derived fees from the futures trades, MacroMarkets had no bias toward either the up or down trade.

    --


  • Today, I updated the S&P/Case-Shiller/Futures Tool to fix a few annoying bugs and to add functionality that allows for some new and really exciting data visualizations.

  • One of the more interesting aspects of this era of housing downturn that set it apart from past periods is that today’s events are unfolding against the backdrop of the internet information age.

    Aside from the Blogesphere and other internet-based means of mass communications, this is the first housing downturn in which market participants (who are inclined) can easily and efficiently follow aggregate home prices, peruse listings, track price reductions and even “snoop” deed records and seller debt obligations.

    Just imagine what the progress of today’s housing downturn would be like without all that information… possibly the 90s bust?

    To that end, recall that there are three major sources of housing price data, S&P/Case-Shiller, OFHEO and Radar Logic.

  • As I had highlighted in a prior post, because of their strong correlation, the home price indices provided daily by Radar Logic can be effectively used as a preview of the more popular monthly S&P/Case-Shiller home price indices (released this Tuesday).

    The current Radar Logic data reported on residential real estate transactions (condos, multi and single family homes) that settled as late as March 21 appears to indicate that price declines accelerated in many of the worst hit markets while markets that typically experience a seasonal lift this time a year are either trending lower or appear muted.

  • At first glance, the recent article concerning the “inside story” on the various home price indices penned by the National Association of Realtors (NAR) Chief Economist Lawrence Yun had me a steaming, especially with respect to its spurious attacks against Professor Robert Shiller.

    But after reading a bit closer, I began to get a sense of both the truly desperate and unhealthy circumstances these used-house salesman have created for themselves (and America) as well as the lengths they will go to as they devolve further and further into madness.

    I suppose that you could almost feel bad for this dwindling outfit of dimwitted losers had it not been for the obvious absurdity of the bed they made over the last decade and the faux riches it brought them.

  • First, to all U.K. readers I want to properly and whole heartedly welcome you the housing malaise!

    How’s that for an U.S. export! Take that you Redcoats!

    Recently, the two most prominent and long running monthly U.K. housing price indices registered the largest year-over-year declines in at least 15 years.

    The “Nationwide” series, which reported data through May indicated that U.K. home prices declined 4.4% on a year-over-year basis while the “Halifax” series, which reported data through April indicated that U.K. home prices declined 3.68% on a year-over-year basis.

  • Today’s release of the S&P/Case-Shiller home price indices for December continues to reflect tremendous weakness for the nation’s housing markets with 17 of the 20 metro areas tracked reporting year-over-year declines and ALL metro areas showing substantial declines from their respective peaks.

    Furthermore, the decline to the 10 city composite index declined a record 9.82% as compared to December 2006 far surpassing the all prior year-over-year decline records firmly placing the current decline in uncharted territory in terms of relative intensity.

    This report appears to continue to indicate that during the fall we essentially entered the serious price “free-fall” phase (look at the charts below) of the housing decline.

  • Today’s release of the S&P/Case-Shiller home price indices for September continues to reflect significant weakness for the nation’s housing markets with 13 of the 20 metro areas tracked reporting year-over-year declines and now ALL metro areas showing declines from their respective peaks.


  • In an effort to make the most out of the S&P/Case-Shiller indices and the implications of the futures contracts that trade in concert with them, I have created the Home Value Calculator Tool which calculates your home’s value history based on a few simple pieces of criteria.

    Plug in your purchase date, the price you paid and the market that your home is located in and…

    POOF!

  • Today’s release of the S&P/Case-Shiller home price indices for November continues to reflect tremendous weakness for the nation’s housing markets with 17 of the 20 metro areas tracked reporting year-over-year declines and ALL metro areas showing declines from their respective peaks.

  • Yesterday’s release of the S&P/Case-Shiller home price indices for October continues to reflect significant weakness for the nation’s housing markets with 17 of the 20 metro areas tracked reporting year-over-year declines and now ALL metro areas showing declines from their respective peaks.

  • Today’s release of the S&P/Case-Shiller home price indices for March continues to reflect the extraordinary weakness seen in the nation’s housing markets with now 19 of the 20 metro areas tracked reporting year-over-year declines and ALL metro areas showing substantial declines from their respective peaks.

    Readers should take a moment to carefully reflect on the charts below as this level of price decline occurring simultaneously across the whole of the U.S. is not only unprecedented but is probably the purest expression of the fundamental collapse of wealth and well being for our nations typical home owning household.

  • Sources inside the Massachusetts Association of Realtors (MAR) report that tomorrows monthly existing home sales results will show that January single family home sales crashed 27.7% on a year-over-year basis while condo sales collapsed 33.7% over the same period.

    Further, the single family median selling price declined 5.6% on a year-over-year basis to $321,000 while condo median prices increased 3.5% to $277,500.

    The following charts (click for larger) show the decline in single family home sales since 2005.

    Notice that January 2008 is registering a home sales count well below even the 2007 level as well as indicating that the February’s results will be well below 2000 units, a significant decline.

  • This week the National Association of Realtors (NAR) released their existing home sales report for the third quarter of 2007 showing, in truly stark terms, the tremendously broad nature of the housing downturn.

  • Today, Eric S. Rosengren, President of the Federal Reserve Bank of Boston (FRBB) gave an excellent speech entitled “A Historical Perspective on Housing Downturns” which, with some fairly thorough detail, attempts to add some context to the current downturn by reflecting on both the prior housing boom and bust seen in New England as well as the gruesome boom and ongoing 17 year bust currently unraveling in Japan.

  • Today, the Massachusetts Association of Realtors (MAR) released their Existing Home Sales Report for April again showing the truly dismal and deteriorating circumstances that have befallen the Bay State’s housing market.

    Whether it was a slow depression brought on by a local economy that has been eroding for over eight years, well over two years of steadily declining home sales and prices, the credit crunch, a looming recession, a palpable increase in inflation of necessities like food and fuel or just simply a change in attitudes toward the notion of a house as a vehicle for untold wealth, the regions housing market has now crossed a dangerous tipping point.


  • In an effort to gain a little better perspective on the historic, current and more importantly future direction of inflation, I’m adding coverage of the monthly CPI data to the lineup of regularly occurring posts.

    I’ll continue to develop the analysis adding other housing and economic related data in future posts but for now, let’s just get a sense of how well inflation is measured and read.

  • Today, the Massachusetts Association of Realtors (MAR) released their Existing Home Sales Report for January 2008 and simultaneously Standard & Poor’s released their Case-Shiller Home Price Index for December 2007 both showing, perfectly clearly, the truly dire circumstances that have now befallen the Bay State’s housing market.

  • Sources inside the Massachusetts Association of Realtors (MAR) report that next week’s monthly existing home sales results will show that February single family home sales crashed 22.9% on a year-over-year basis while condo sales collapsed 34.6% over the same period.

    Further, the single family median home value declined 4.6% on a year-over-year basis to $310,000 while condo median prices decreased 6.7% to $252,000.

    It’s also important to note that February’s single family home sales count was the lowest February count on record since 1996 and at 1857 units sold was 26.91% below the record peak set in February 1999 and 22.9% below the more recent peak of February 2007.

  • Sources inside the Massachusetts Association of Realtors (MAR) report that next week’s monthly existing home sales results will show that April single family home sales crashed 15.8% on a year-over-year basis while condo sales collapsed a stunning 26.6% over the same period.

    Further, the single family median home value declined a whopping 8.7% on a year-over-year basis to $314,900 while condo median prices remained unchanged at $275,000.

    It’s also important to note that the April single family home sales count was the lowest April count on record since 1993 and at 2803 units sold was 30.72% below the record April peak set in April 2004.

    The following charts (click for larger) show the decline in single family home sales since 2005.

  • Today, the Massachusetts Association of Realtors (MAR) released their Existing Home Sales Report for October 2007 showing again the utter foolishness of MAR president Doug Azarian’s purported two month long winning streak of increasing home sales earlier this fall.

  • Today, the Commerce Department released their monthly Retail Sales Report for October which continued to show an interesting and, with some pretty significant revisions to past results, even more significant correlation between declining consumer spending, particularly on discretionary items, and the decline in home values.

  • Today, the National Association of Realtors (NAR) released their Existing Home Sales Report for October again confirming, perfectly clearly, that demand for residential real estate, for both single family and condos, has now taken a new and substantial leg down uniformly across the nation’s housing markets likely as a direct result of the momentous and ongoing structural changes in the credit-mortgage markets.

  • This recurring monthly post tracks the latest results of the housing market seen in Arlington Massachusetts.

    I choose Arlington as a result of the Boston Globe’s recently published and absurdly anecdotal and ludicrous farce about the town’s “hot” housing market.

    The ridiculous tone and outright mishandling of the housing data by the Boston Globe “reporter” would almost be comical if it weren’t for the fact that the Globe’s editor, Martin Baron, ALSO blundered seriously when he responded to my email about the discrepancies.

    Baron attempted to justify the articles contents and in so doing, he disclosed his disgracefully poor and obviously unsophisticated abilities with even the most basic economic data.

  • Today, the National Association of Realtors (NAR) released their existing home sales report for the fourth quarter of 2007 showing, in truly stark terms, the tremendously broad nature of the housing downturn.

    Single family home sales, on a year-over-year basis, are now falling in every state except for Idaho and South Dakota and North Dakota (see chart below and click for larger version and note that NH doesn’t report sales data) with even those states sales growth being flat to anemic.

  • Today, State Street Global Markets released their latest monthly read of Investor Confidence showing that confidence for North American institutional investors increased 6.0% since
    January while European and Asian investor confidence remained relatively flat to mildly negative all resulting in an increase of 3.5% to the aggregate Global Investor Confidence Index.

    Given that that the confidence indices purport to “measure investor confidence on a quantitative basis by analyzing the actual buying and selling patterns of institutional investors”, it’s interesting to consider the performance surrounding the 2001 recession and reflect on the performance seen more recently.

  • Like the MIT/CRE Property Index, Standard & Poor’s also tracks commercial real estate (CRE) prices for various commercial property types.

    Although recent results have revealed some slowing across all classes of commercial real estate, December’s results show a continuation of price growth.

    All components experienced growth both on a year-over-year basis and as compared to the prior monthly result with the greatest gains seen in office properties.

    The charts below show the National index and the component indices since 1993 (click for larger).