Free market insurance is incompatible with knowledge

Yes, it’s an extreme title, but it’s true. The idea of insurance is to average risk over a large group of people. If advance information exists about the outcomes of individuals, it’s impossible for a fully competitive free market to provide insurance.

In particular, free markets cannot provide health insurance.

To see this, consider a function u:SR which assigns a utility value to each point of a state space S. For example, one of the elements of S could be “you will have cancer in 23 years”. This outcome is bad, so the corresponding u(s) would be a large, negative number.

We also have a probability distribution p:SR over S. Without insurance, the expected value of u is E(u)= sSp(s)u(s). With insurance, we can average over a large number of people to change the utility function to be closer to the average. For simplicity, we’ll consider only the case of perfect insurance, where the new utility function is exactly the average. In the perfect insurance model, we pay an insurance company E(u)+o, and in return they agree to pay us u(s) depending on the particular outcome s. o is an extra amount to cover administrative costs, risks due to lack of independence and finite numbers of customers, and profit (in the case of imperfect competition).

Assuming no one has any prior knowledge of the state s, the only way for different insurers to compete in the perfect insurance model is to reduce overhead. Everyone looks the same, so there’s no advantage in charging different amounts to different people. The insurers profit from anyone with u(s)>E(s) and lose money from anyone with u(s)<E(s), but there’s nothing they can do about it if they can’t tell the difference in advance.

Now assume there’s some prior knowledge about the state, say S=K×U where K is known in advance and U is unknown. In the absence of regulation, it becomes possible for an insurance company to charge different amounts based on the different kK. In particular, it’s possible for an insurer to sell policies only to people with a favorable value of k, and charge E(uk)>E(u). In a free market, anyone with a favorable value of k will flock to these cheaper policies. Insurers offering policies to those with unfavorable values of k will have to raise rates in order to stay in business, since they will have lost the customers from which they make money. Assuming a sufficient level of competition, the price of all insurance policies will converge on E(uk)+o(k).

The result is that we’re now insuring only over the uncertainty contained in U, not K. In the worst case, if K=S, E(uk)=u(s) and insurance vanishes completely.

Whether this is good or bad policy-wise depends on what K and U look like. For car insurance, K includes whether the driver was considered at fault in accidents in the past, whether they’ve driven drunk, whether they drive a muscle car or a Honda Civic, etc. Charging different amounts depending on these factors seems fair, since intuitively these factors can be considered the “fault” of the individual. Similarly, charging more for home owners insurance if you live in the path of a hurricane is also (arguably) reasonable.

In the case of car insurance, even with these known factors out of a way, the space of uncertainty U is still quite large. It includes the actions of other drivers, random equipment failure, invisible road conditions, etc. It is impossible for insurers to predict these factors, which means that private, free market insurance can efficiently insure against them.

For health insurance,the space of known factors includes all past medical history and preexisting conditions, public genetic information including gender and race, healthy or unhealthy lifestyle, etc. In many cases, it includes information about the current medical problem, since insurers have significant control over what kind of treatment people can receive once they are diagnosed. Now, we can argue about whether it’s fair to blame people for unhealthy lifestyles, but I highly doubt anyone will argue that black men should be held responsible for their higher rates of prostate cancer.

If we accept that the space of known factors K is too large, the only way to reduce it is to apply some type of regulation to reduce the effective size of K. A fair amount of subtlety is required to make such regulation effective. For example, let’s say we ban insurers from discriminating based on race, but still allow them to collect information about healthy lifestyle. It’s healthy to play sports, so the insurer might ask whether the person plays basketball. People who play basketball are more likely to be black than those who don’t (caveat: I’m just guessing here), and therefore it’s quite possible that they have higher risks of prostate cancer. Unless the government is smarter than the insurers (impossible, since the insurers have access to the text of laws), the only reliable way to solve this is to ban knowledge of K entirely.

However, banning insurers from using knowledge of K is dangerous unless you also ban customers from using knowledge of K. In an extreme case, it would be very bad to allow people to buy insurance policies in response to accidents of unexpected diagnoses. Everyone would wait until they needed medical coverage to buy insurance, and all insurers would rapidly go out of business.

In general, if individuals are allowed to use any information prohibited to insurers, and the space of available policies is large enough, sufficiently diligent individuals with favorable k values can use this information to lower their insurance premiums without raising their risk. Insurers will have to raise their premiums in response, which results in an increase in cost for those with unfavorable k values.

In fact, assuming sufficient options and perfect competition, the result of this individual choice would be exactly the same as if the insurers were allowed to use knowledge of K! Wow. I didn’t fully understand that point before writing this post.

The conclusion is that if we believe true health insurance is a good thing, and that health insurance means insuring over factors which can be known in advantage, free markets don’t work either for insurers or for individuals. We can’t allow insurers to base prices on prior knowledge, and we can’t even allow individuals to choose which policy they buy based on their knowledge of their own medical history.

Hmm. The individual side of this is somewhat unfortunate, but I don’t see any way around this argument.

Followup: Here are more details about the individual side.

Tags:

7 Responses to “Free market insurance is incompatible with knowledge”

  1. Rob Says:

    NPR had a nice segment on information problems in health insurance towards the end of the “Planet Money” podcast for August 21st. Not quite as precise but still an interesting explanation of this stuff.

    Unfortunately there’s no permalink to that episode but you can dig it up via http://www.npr.org/rss/podcast.php?id=510289

  2. Geoffrey Irving Says:

    That’s a wonderful podcast. Here’s a better link: http://www.npr.org/blogs/money/2009/08/hear_too_much_information.html.

    I like the part where they hypothesize that one of the reasons this hasn’t destroyed the insurance industry already is that insurance is so messy and complicated. I think that’s exactly right: if choosing between different insurance policies is confusing, it isn’t practical for individuals to carefully optimize their policy choices and thereby destroy the insurance industry.

  3. Jon Says:

    Very very few people have health insurance. No, many of us enjoy something different: an employment benefit. This eliminates the selection effect. Conversely the individual insurance market is small, volatile, and expensive.

    Certainly this benefit has risk mitigation properties: much like a defined benefit pension plan does; but employees are not offered a trade-off between risk mitigation (health care) and risk taking (more $$$). No, the trade-off they are given is usually about being subject to increasingly harsh regimes that control routine costs.

    $). No, the trade-off they are given is usually about being subject to increasingly harsh regimes that control routine costs.
  4. Geoffrey Irving Says:

    Technically, you should say that most of us pay for health insurance as a mandatory employment benefit. The fact that it’s mandatory doesn’t mean it isn’t health insurance.

    Also, it’s not always true that employee health insurance doesn’t come with options. In my case, I have a choice between two plans that differ significantly in the coverage of out-of-network expenses. The cost difference is around $100/month. Since I’m fairly healthy, and assumed I would have no trouble picking in-network care, I went for the cheap one.

    I’d argue that the major actuarial difference between the two plans relates to emergency care, not routine care. It’s easy to choose an in-network primary care doctor, and not so easy to pick which hospital you end up at in an emergency. As it happens, a few weeks after I made this choice I had to get to a hospital quickly. Happily I ended up at an in-network hospital, though apparently we weren’t sure of that when we picked it.

    I’d say this option is essentially a penalty on people who expect to need frequent emergency care. Admittedly, it’s a penalty that calls for one of the world’s smallest violins given the salaries of these particular “victims”, but I imagine similar issues apply at other companies.

  5. Jon Says:
    Also, it’s not always true that employee health insurance doesn’t come with options. In my case, I have a choice between two plans that differ significantly in the coverage of out-of-network expenses. The cost difference is around $100/month. Since I’m fairly healthy, and assumed I would have no trouble picking in-network care, I went for the cheap one.

    I think I very carefully said: “The trade-off they are given is usually about being subject to increasingly harsh regimes that control routine costs.” Now you seem to think that this decision primarily effects emergency care. I disagree*, but I certainly wasn’t saying that there weren’t options. I was referring to precisely the choice you mention.

    • In my experience, when the plan puts a price differential on in-network providers, there is a number that you call at the time of the emergency admission that eliminates the cost factor in that circumstance. The purpose of the number is to identify to the insurance company the emergency nature and have them sign-off on it–lest you sue later on for ambiguity.
  6. Jon Says:

    Your blog software appears to support some interesting short-hand control characters for formatting…

  7. Geoffrey Irving Says:

    Yeah, I have itex+markdown enabled, and it seems like enjoy doing weird things to comments. I’m not sure exactly why.

    Thanks for the correction; I agree that we were referring to the same basic trade-off. The existence of such a number would seem to mean that it comes down to routine cost control.

Leave a Reply