Pages

Showing posts with label power law. Show all posts
Showing posts with label power law. Show all posts

Monday, October 11, 2010

It's not a pyramid!

CK Prahalad’s book The Fortune at the Bottom of the Pyramid has firmly established our visual impression of how incomes are distributed as a pyramid. A strong, solid structure with the poorest at the bottom that slowly tapers, kind of holding up the apex.

In reality it looks NOTHING like a pyramid. Here’s a 3D visualization of what it looks like based on real income distributions.

Of course, if I had a lot of time on my hands I’d figure out how to plot it in 3D a lot better, maybe starting with a square shape rather than a circle so it compares better to a pyramid. But I don’t. You get the picture though. (To get more of a sense for what income distributions are like check out my earlier posts Who Cares about the Average Income and Income Distributions around the World).

Rather than put my take on the different impressions and associations you get from these pictures, I’m really curious to hear yours. What are the associations you get from this over the pyramid? I think that we need a different term to replace the ubiquitously used ‘Bottom of the Pyramid’.

Friday, March 19, 2010

The Tales of Tails

When we enter a space our natural inclination is to do a quick visual survey of who’s around. When we walk into a first grade classroom for instance, we expect to see a whole lot of 5 and 6 year olds and one or two adults.


Now if we were to plot the heights of the people in the room we would get a narrow ‘bell curve’ like distribution centred around 3.5’ and a point or two sticking out somewhere in the range of 5’and 6’.

Let’s say I wasn’t there and all I had in front of me was the distribution that you put down. I could pretty easily guess what kind of situation this was. Where else do you have a bunch of small people with just one large person? Now instead, what if I showed you a distribution that looked like this?




There are still thirty kids of the same size range. But now there are around 30 grown ups as well. Where would you find that kind of situation?

If you guessed that it was one of the kid’s 6th birthday parties, you would probably be right. So every distribution has a tale to tell. And the tale runs deeper. It tells us something about the nature of height itself. The bell shaped curve suggests that the height of one child in the class is virtually independent of the height of the others. Indeed for each of us, our heights play out from a highly similar genetic program with small variations arising from random environmental events.

It’s fairly easy to make sense of this kind of bell shaped distribution since we’ve all seen it in school. But what about the distribution of incomes? What tale does it tell? Why does it look so different? (To understand what income distributions look like, please read my earlier post Who cares about the average income!). These heavy tailed distributions and the power relationship that they often reflect, tells you that there’s no one size fits all, no meaningful ‘average’. More significantly they reveal a story of high interdependence, a story of a dynamically changing complex system. It is a reflection that my income does depend on yours in some very complex way. The distribution of income is a static view of a constantly changing interdependent process. Money is changing hands all the time and every so often we take a picture of how it is looks before it is passed on. This is fundamentally different from the story of the bell curve. And every small turn and kink in the distribution offers another twist to the tale.

Income Distributions around the World

In my last, and much lighter post Who cares about the average income! I talked about the heavy tailed nature of income distributions. Here’s a link to some actual income distributions for the USA, India, Japan and France (scroll all the way to page 3 and look at Figure 1 on that page). Of course, the data for India includes only that of taxpayers and most of India has insufficient income to pay taxes so this is grossly misrepresentative. And unfortunately, the authors also note that the Indian data, even for taxpayers, is incomplete relative to the other countries for the reason that: “In spite of the best of our efforts in collecting the equivalent data from the Income Tax Department of the Government of India or the Reserve Bank of India, we are unable to give or compare with any better data”.

But before you eagerly click on the link, note that when you take a heavy tailed distribution that looks like the graph on the left below (where the number of people that have a particular income is equal to that income raised to some negative power) and convert the axes into log units it turns into a straight line which is easy to recognize visually.



Since many income distributions tend to have such power law properties (misleadingly called a power law since there is no law here, it is just a power relationship), they are generally shown in the log-log coordinate form to easily be able to distinguish them from other kinds of heavy tailed distributions which are not power laws.

It’s a pity that power law distributions are not taught alongside the normal distribution in school since if you work with them a few times they become as easy to intuit. More importantly though is that this arrangement describes so much of nature and society that we would gain a much better understanding of our world.

Wednesday, March 17, 2010

Who cares about the average income!

Many of us think of statistics as basically taking the average of some numbers. Maybe we even think of the normal distribution or ‘the bell curve’ and the concept of standard deviation. In this context, if you say the average height of people in India is around 5’ 5” with a standard deviation of 5”, it’s pretty intuitive what that means – that when you arrive in India you will find most people around 5’5” with some variation this way and that way of mostly 5”. In large part we all look similar and can fit in the same seats, sleep on the same size beds and fit through the same doorways. Instead, imagine if the distribution was not a bell curve but rather looked like this. A decreasing function with a heavy tail.



What this would mean is that most people are less than a foot tall while a few are absolutely enormous 50’ giants (in the heavy tail) with the rest somewhere in between. In this scenario there is no one size fits all and it would be impossible for a randomly selected group to be comfortable sitting at the same sized table. The enormous giants the height of multi-storey apartment buildings would have to live in a different sort of world than their underfoot counterparts. The average height in this distribution is still around 5’5” but knowing this average, and even the standard deviation, would be completely uninformative. Rather what could prepare you for what to expect is to know something about the rate at which the distribution decreases, basically the exponent that describes the relationship.

Now, unlike height distribution, which are bell curves, virtually all over the world the distributions of incomes and wealth display heavy tails. What differs between countries is largely the exponent. So if you knew nothing about India and you wondered what single number would best prepare you for the economic landscape, average income is really quite uninformative. Rather if you knew the exponent, or better still had a good visual of the distribution, you would come prepared to find Mukesh Ambani in a 27 story house on Altamount road surrounded by millions of abysmally poor people with barely a roof over their heads (and a little bit of everything in between). So, particularly from the perspective of understanding poverty, what we should care about is the exponent. Who cares about the average income!

In a separate post I will talk about what gives rise to these different types of distributions and why income and wealth distributions looks like this. Stay tuned.

**Note that if you do decide to delve further into this, most people show heavy tailed distributions in log-log or log-linear scales to emphasize the properties of the tail so make sure you look carefully at the axes.