Addressing 2011 – One Down, Four to Go!

It’s January again, and being the start of another year, it’s as good a time as any to look at the last 12 months and see what the Internet was up to in 2011. So lets see what has changed in the past 12 months in addressing the Internet, and look at how IP address allocation information can inform us of the changing nature of the network itself.

A little over a decade ago, at the height of the first Internet boom, the confident prediction was made that the annual doubling of the size of the Internet would be a constant, akin in some ways to the underlying optimism in technology that sits behind Moore’s Law. That particular Internet bubble burst a decade ago, and the wildly optimistic predictions of the continued growth of the Internet were tempered somewhat. There was, however, the continuation of an underlying view that the Internet would just continue to grow and just when we thought that the world of humans represented a market space that would reach saturation sometime soon there was the “internet of Things” to keep us going for many decades to come. So, once again, by the late 2000’s the Internet was portrayed as a form of economic miracle that would defy conventional cycles of business activity.

The global financial crash of late 2007 and its continuing repercussions have had a negative effect on the wildly optimistic assumptions of future growth. However, at least from the Internet’s perspective this was not a major crash, and could at best be termed a “mild correction”. The effects of this economic downturn have been short-lived in the Internet, and 2010 saw the network expand at the highest rate seen so far. The market in mobile devices, fuelled in no small part by Apple’s iPhone product, and the various competitive offerings that make use of the Google’s Android platform have created an invigorated market in mobile Internet services that continued to drive growth across much of the world. In addition, the inexorable process of development in China in particular has now reached into the area of consumer electronics and communications services, and the process of deploying broad-based Internet connectivity into a country with a population of 1.3 billion has itself represented a large element of Internet growth.

But 2011 saw a new shadow appear over the Internet, namely that of the exhaustion of the pool of unallocated IPv4 addresses. The central registry, the Internet Assigned Numbers Authority (IANA) handed out the last of its store of available IPv4 address blocks in February 2011, and in April the first of the Regional internet Registries (RIRs), APNIC, reached a threshold of one remaining block of 16.7 million addresses and ceased performing general use IPv4 address allocations.

So lets see how the Internet fared in 2011.

Growth of the Internet

In terms of address space as a metric, pace of growth of the Internet slowed down substantially in 2011. The allocation of 201 million addresses in 2011 on top of a base of 3,193 million addresses that were already allocated at the start of the year represents a growth rate of 6.3%. This is the lowest relative growth rate we’ve seen.

I suspect this is due to a combination of two factors: namely the exhaustion of IPv4 address space in the fastest growing sector of the market in the regional market of Asia, and the long-standing economic malaise that has impacted much of the European and North American markets over 2011. The relationship between address allocations and overall economic activity is a direct one, as the deployment of new services into the consumer market calls for an associated investment in infrastructure and related services,. The constraints on capital borrowings over the past couple of years, and over 2011 in particular has impacted the rate of expansion of the Internet in 2011.

2005 2006 2007 2008 2009 2010 2011
Allocated IPv4
Addresses
(Millions)
174.4 168.1 203.9 203.3 189.4 248.8 201.0
Relative Annual
Growth
8.0% 7.7% 8.8% 8.0% 6.9% 8.4% 6.3%

Table 1 – IPv4 Allocated Addresses by Year

During 2011 the total number of IPv4 addresses allocated from the RIRs, supporting the growth of the Internet, was 16% lower than 2010. However before leaping to conclusions relating to a dramatic decline in investment in new network infrastructure, its useful to break this number down on a per-RIR basis, to understand the impact of address exhaustion in APNIC relative to the other regions.

Which economies received these addresses? At a regional level its possible to compare the allocations made by each RIR.

IPv4 Allocations 2005 2006 2007 2008 2009 2010 2011
APNIC 31% 31% 34% 44% 46% 48% 53%
RIPE NCC 35% 33% 31% 22% 23% 22% 22%
ARIN 27% 28% 26% 28% 22% 18% 11%
LACNIC 6% 7% 7% 6% 6% 6% 10%
AFRINIC 1% 2% 3% 1% 3% 3% 5%

Table 2 – IPv4 Allocated addresses – Distribution by RIR

In 2011 APNIC allocated 105 million addresses, down 12% from the 120 million that were allocation in 2010. However the bulk of these addresses were allocated in the first four months of 2011, with a peak allocation rate of 41 million addresses in March 2011. Once APNIC reached its “final /8” of addresses each allocation is limited to at most 1024 addresses, and the monthly allocation rate for the remainder of 2011 was between 60,000 to 130,000 addresses per month. It seems evident that in the Asia Pacific region the spectre of imminent unavailability trigged a last minute panic in the local industry and an entire year of conventional address allocations was compressed into the first three and a half months of the year.

But what of the other regions? Here was a mixed story, which is reflective of the broader relative economic conditions in the various regions of the world in 2011. In Europe we saw a protracted series of financial crises as a number of national economics faced problems in their ability to service their burgeoning national debt, and capital markets were placed under significant pressure as a result. The RIPE NCC allocated some 56.3 million addresses in 2010, and this fell to 43.3 million address in 2011, down by 23%. These adverse economic conditions were also felt in the United States, which saw unemployment levels head upwards and consumer spending fall, and there the fall in address allocations was more dramatic, declining from 45 million addresses in 2010 to 22.4 million addresses in 2011, or a relative fall of some 50%.

There was also a change in allocation practices in both of these regions, where addresses were allocated on the basis of a 3 month demonstrated need, as distinct from a 12 month need in pervious years. In theory this should not alter the overall consumption rates, as the result would be that an entity experiencing continuous growth in demand would return to the RIR 4 times in the year for its annual address allocation. However it is hard to assess the impact of this change in address allocation policy on overall address consumption levels because of the additional economic factors which have also influenced address consumption levels during the year.

Afrinic saw address allocations rise by 8%, from 8.5 million addresses in 2010 to a total of 9.2 million addresses in 2011. More startling is LACNIC, which serves Latin America and the Carribean which saw a jump from 12.9 million addresses allocated in 2010 to 20.3 million addresses in 2011, a rise of some 57%.

Which economies are leading this continued growth in IPv4 services?

IPv4 Addresses (/32s, Millions)
Rank 2007 2008 2009 2010 2011
1 USA 48.47 USA 53.79 China 50.67 China 45.2 China 53.07
2 China 37.29 China 46.49 USA 38.55 USA 42.32 USA 21.21
3 France 13.38 Japan 10.06 Japan 11.04 Rep.Korea 25.73 Japan 16.91
4 Germany 11.22 Rep.Korea 7.96 Rep.Korea 10.95 Japan 10.02 Rep.Korea 7.68
5 Rep.Korea 7.73 Germany 7.29 Russia 5.46 Australia 9.63 Indonesia 7.09
6 Japan 7.14 Brazil 6.29 Brazil 4.19 India 9.43 Brazil 6.29
7 UK 6.41 Russia 6.12 UK 4.19 UK 8.13 India 6.01
8 India 5.61 Italy 5.85 Italy 4.16 Germany 6.97 France 5.39
9 Mexico 5.24 India 4.23 France 3.85 Russia 6.46 Russia 5.02
10 Italy 5.09 Taiwan 4.18 Germany 3.6 Brazil 6.29 Germany 4.92

Table 3 – IPv4 Allocated addresses – Top 10 Economies 2007 – 2011

Within the Asia Pacific region China received 53.1 million IPv4 addresses in 2011, which represents 26% of the total IPv4 address allocations performed over the past 12 months. This appears to point to the strong pace of internet expansion in both broadband and wireless services within China, despite the structures of address exhaustion for the latter nine months of the year.

Panic? Was there a Panic?

In the Asia Pacific region the strongest driver for IP addresses appears to be the spectre of exhaustion of IPv4 addresses, and there was a strong element of panic visible in the address consumption figures for the period January – April 2011 (Figure 1). The average number of addresses allocated per week by APNIC across 2010 was some 2.3 million addresses per week, whereas the first 16 weeks of 2011 saw the volume of allocations triple to an average of some 6.9 million addresses per week.


Figure 1 APNIC Weekly Address Allocation Levels: 2010 – 2011

In other regions there was no such obvious signs of panic in 2011, although there has been a change of allocation policy in the RIPE NCC and ARIN regions, where the “window” of demonstrable need has been reduced from 12 to 3 months. The comparable week-by-week allocation record for the other four RIRs is shown below in Figure 2.


ARIN Allocations              RIPE NCC Allocations
LACNIC Allocations              AFRINIC Allocations
Figure 2 Weekly Address Allocation Levels: 2010 – 2011

Interestingly, the change in allocation policy is visible in the ARIN region, particularly for the larger allocations, but a comparable drop in allocations is not as visible in the RIPE NCC data, in spite of the reduced allocation window being used by the RIPE NCC in the latter part of 2011.

Address Distribution

Another way to look at the address distribution is in terms of “skew”. If the Internet is populated by a largely homogenous population of service providers then the distribution of address allocations would be relatively uniform, such that the group of largest allocations would not be vastly larger than the group of smallest allocations. On the other hand , if the service provider population is skewed such that there is a small number of very large providers that service the bulk of the user population, then we would expect to see the bulk of addresses being allocated to a small number of providers. One way to look at the level of skew is to use a cumulative distribution plot, comparing the number of allocations to the amount of address space, shown below.


Figure 3 – IPv4 Allocation Distribution

Compared to 2010 the concentration of address allocations to a small number of providers has increased in relative terms. In 2011

What this distribution is showing is that of the 10,061 individual IPv4 allocations that were made in 2011, just 58 allocations accounted for 50% to the total amount of allocated address space, or 100 million IPv4 addresses. There were 3 of these large allocations made by AfriNIC in 2011, 3 by the RIPE NCC, 6 by LACNIC, 7 by ARIN and 39 allocations by APNIC. Drilling down a little deeper on the largest allocations in this set, there was 1 allocation of 8.3 million addresses (/9) (made by APNIC), 7 allocations of 4.2 million addresses (/10) (4 by APNIC, 2 by ARIN and 1 by the RIPE NCC), and 14 allocations of 2 million addresses (/11) (7 by APNIC, 4 by LACNIC, 2 by Afrinic and 1 by the RIPE NCC. These 22 allocations in 2011 went to 18 distinct entities, as listed in Table 4. These 18 entities collectively accounted for 33% of the total address allocations in 2010.

Rank Economy Organization Addresses (M)
 1 Japan NTT Communications Corporation 8.39
 2 China China Mobile Communications Corporation 8.39
 3 Brazil Comite Gestor da Internet no Brasil (Brasil NIR) 6.29
 4 Indonesia PT Telekomunikasi Selular Indonesia 6.29
 5 Japan KDDI Corporation 4.19
 6 United States AT&T Mobility LLC 4.19
 7 United States AT&T Internet Services 4.19
 8 France Bouygues Telecom 4.19
 9 Germany Telekom Deutschland Mobile 2.10
10 China CHINANET Zhejiang Province Network 2.10
11 China China TieTong Telecommunications Corporation 2.10
12 Pakistan Pakistan Telecommuication 2.10
13 China China Unicom Shandong province network 2.10
14 Morocco Maroc Telecom2.10
15 India Bharti Airtel Limited 2.10
16 Vietnam Viettel Corporation 2.10
17 Mexico Uninet S.A. de C.V., Mexico 2.10
18 Egypt TE Data, Egypt 2.10
Total 67.11

Table 4 – IPv4 Allocated Addresses – Top 18 allocations for 2011

Of note here is the inclusion of a number of new economies in this list, notably from those parts of the world that are generally termed “developing economies.”

This “heavy tail” distribution of the largest allocations has not always been the case. In looking at the distribution of IPv4 allocations over the past decade the following table shows the percentage of address space that were allocated to the 1% largest individual allocations and the lower half of the individual allocations.

IPv4 Allocations 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011
Top 1% 30% 39% 38% 38% 51% 45% 51% 47% 50% 49% 60%
Lower 50% 5% 5% 4% 3% 1% 2% 1% 1% 1% 1% 1%

Table 5 – IPv4 Allocated addresses

What appears to have happened across the period 2000 – 2005 was a marked phase of aggregation in this industry, where the economies of scale in a mass market for Internet services started to exercise significant influence over the deployment of services on the Internet. This picture has remained relatively consistent since 2005, and the largest 100 Internet enterprises across the world appear to undertake at least one half of the volume of deployment of new Internet services. To the extent that the Internet on the 1990’s was a poster child of a strongly competitive environment and highly diverse supply industry in the communications sector, the 2000’s has seen the Internet progress into an environment which is dominated by economies of scale and large scale supplier enterprises. A marketplace that is strongly influenced by a small number of larger enterprises is often not as agile in areas of technical and service innovation, and competitive pressures are not as strong a factor when one or two providers assume a dominant market position.

The distribution of addresses in the IPv4 Internet paints a picture of an industry that has now completed a process of aggregation, and the pressures that will lead to further evolution of the Internet in the coming years will probably be different to those that drove the Internet of some years ago.

IPv4 Address Exhaustion

Two milestones occurred in 2011 on the path to IPv4 address exhaustion, namely the exhaustion of the central pool of addresses by the IANA in February 2011, and the first of the RIRs to exhaust its general use address pool, by APNIC in April 2011.

The Internet continues to rely very heavily, if not exclusively, on IPv4, and the consumption of a further 200 million addresses in 2011 leaves 307 million addresses in the pool of unallocated addresses, or a total of some 18 months if we were able to access these addresses at the same rate as we have been to date. However this is not the case.

Table 11 – IPv6 Address Allocation Volumes by Economy

Table 10 shows the amount of IPv6 address space assigned on a per economy basis for the past 4 years (using units of /32s). In 2011 the major component of IPv6 space allocated by APNIC was allocated to Chinese entities, and China accounted for more than half of all IPv6 addresses allocated in 2011. A large IPv6 allocation was made in Japan in 2010. With the exception of Australia no other Asia Pacific economy has figured in the top 10 economies in the past three years, so while the message about IPv6 may have been taken up in parts of the Asia Pacific region, it by no means universally taken up across the entire region as yet.

The Outlook for the Internet

The past four years has shown that the Internet is now an integral part of the portfolio of conventional business activity across the world, and the deployment of internet services and the opening up of markets through deployment of Internet services is subject to the same economic opportunities and constraints as any other business activity. Those economies that were adversely impacted by the global financial situation saw a drop in the expansion of new Internet services and a drop in their demands for IP address allocations across 2011, while other economies that managed to avoid the worst impacts of a financial recession continued to see growth in new Internet markets across the year.

The past three years has been dominated by the mass marketing of mobile internet services, and the growth rates for 2011 perhaps might have been the highest so far recorded were it not for the exhaustion of the IPv4 address pools in the Asia Pacific region. In 2012 we anticipate that the RIPE NCC will also exhaust its stocks of available IPv4 addresses.

However the industry uptake of IPv6 is still lagging, and address allocations in various economies are still highly variable. As the IPv4 address pool dwindles in 2011 we will see the growth trends change once more, and the transition to an IPv6 Internet will not be seamless.

At the same time we are witnessing an industry that is no longer using technical innovation, openness and diversification as its primary means of propulsion. Today’s internet is serviced by a far smaller number of very large players, each of whom appear to be assuming a very strong position within their respective markets. The drivers for such larger players tend towards risk aversion, conservatism and increased levels of control across their scope of operation.

This changing makeup of the Internet industry also has quite profound implications in terms of network neutrality, the separation of functions of carriage and service provision, investment profiles and expectations of risk and returns on infrastructure investments, and on the openness of the Internet itself. 2011 was a very interesting year as the stocks of IPv4 addresses were exhausted in the Asia Pacific region. We expect 2012 to be no less interesting as exhaustion becomes apparent in the European region as well.