Custom Search

How the Web ranks and how it traffics

Friday 11th April 2008
Top 20 Courtesy: http://tinyurl.com/eamrk

The Global Information Technology Report finds the US now ranks fourth in the world behind, just three European nations: Denmark, Sweden and Switzerland. Last year the it ranked seventh. And California researchers find that in its traffic, fame is a prolonged phenomenon, rather than a one-time flash in the pan, and recurs in a spasmodic fashion.

The Global IT study, which has been issued annually for the last seven years, is an effort to draw a more complete picture of national network readiness. Undertaken by Insead, the Paris business school, on behalf of the World Economic Forumpolicy and conference group, based in Switzerland.It used an index generated from 68 variables including market factors, political and regulatory environment and technology infrastructure, rather than merely bandwidth capacity and data transmission speeds.

Some Internet industry veterans were skeptical of the positive claims about the United States compared with the rest of the world. “My gut feeling is that we don’t have the type of deployment you have abroad,” said David J. Farber, an Internet pioneer and a professor of computer science at Carnegie Mellon University. “If you are looking at broadband, we have a lot of problems. We are slow as molasses in deploying the next generation.”

The Insead assessment offers a stark contrast to other appraisals based on single measures that have portrayed the US, the nation that invented the global data network, as both lagging and declining in the broadband boom. Last year a range of statistics on global bandwidth use indicated that the US was trailing other industrial nations in both broadband network consumption and penetration as a percentage of population.

For example, statistics maintained by the Organization for Economic Co-operation and Development gave a conflicting message. The average advertised broadband download speed of 23 American providers was 8.8Mb/ sec, while the average for 23 providers in Denmark was a considerably slower 5.9Mb.  But the number of broadband subscribers in Denmark was 34.3 for every 100 inhabitants, compared with 22.1 in the US, according to a 2007 study in October.

One Insead report author said the narrow measures had failed to capture the true impact of the Internet when it was considered in a cultural, economic and political context. “What the US has is a number of strengths along a number of dimensions,” said Soumitra Dutta, a professor of information systems at Insead and the director of the study. “It is not just a question of technology. Political and economic factors become extremely important.”

He pointed to France as  a technology leader in terms of network services that had trailed in the study, ranked at 21. “It’s not because France is lacking in technology,” Professor Dutta said. “If you look at other kinds of regulatory issues and labour conditions, you find a rigid situation that prohibits companies from making the most effective use of technology.”

An OECD economist acknowledged the nuances in taking into account government regulatory and related factors, and said it was hard to draw a single conclusion from the data. “I think we can say that a lot of the situation in the US is a result of the lack of competition,” said Taylor Reynolds, an economist in the Internet and Telecommunications Policy section of OECD “In Europe we have adopted an unbundling strategy wholeheartedly.”

That has led to more competition in markets outside the US, he said, which in turn has driven Internet service providers elsewhere to offer speedier service and lower prices.

An aspect of global competition that is being watched closely, he added, is the way fiber optic networks are being introduced in different regions. Even though the US has begun to accelerate the availability of fiber optic services, it is lagging Europe and Asia in network speeds. Verizon is offering 50Mb FIOS in the US, 100Mb services are common in Europe, and the Japanese are offering 1Gb services.

Still, there are puzzling aspects to the American market, which has higher broadband availability than many countries but lower adoption rates. More customers have retained dial-up services than most countries, which might be explained by price or lack of attractive broadband services.

Industry executives in the US said the Insead report was a significant counterweight to the one-dimensional OECD. statistics. “Being an optimist, I’m seeing some significant and promising things happening in the US,” said Robert Pepper, senior managing director, Global Advanced Technology Policy at Cisco Systems.

The study portrayed a number of global trends. Five Nordic countries were reported among the world’s top 10. South Korea posted one of the most significant improvements in the last year, moving up 10 places in the ranking to ninth, and China moved up five positions to 57th.
Source: http://www.nytimes.com
Web: http://tinyurl.com/eamrk

Web reaches a self-organised critical state with long lasting traffic

                                                                                                                            Web statistics of traffic:
                                                                                                            Courtesy: http://increase-your-web-traffic.com

Mikhail Simkin and Vwani Roychowdhury, electrical engineers from both the University of California Los Angeles and NetSeer.com, have constructed a model of the Web using the traffic statistics of just three Web pages:

http://reverent.org/true_art_or_fake_art.html

http://reverent.org/sounds_like_faulkner.html
http://ecclesiastes911.net/disumbrated_art.html

(Traffic patterns from a dozen other Web pages the researchers studied were very similar.) Using several years of data from these three pages, the researchers show how the Internet overall reaches a self-organized critical (SOC) state with long-lasting traffic.

“One of the main implications of our findings is that traffic and [the corresponding] fame is a prolonged phenomenon instead of a one-time fling, and recurs in a spasmodic fashion,” Roychowdhury told PhysOrg.com.

Most of the time, traffic to any single Web page is relatively low and steady, where visitors come from search engines, Web directories, online encyclopedias, and other constant sources. But these long periods of low traffic are interrupted by bursts of heavy traffic that follow a power law, usually the effect of numerous blog entries linking to those pages.

The researchers use a branching model to describe the probability and extent of these bursts. Basically, there’s a certain probability that a viewer will post a blog entry with a link to that Web page, and then a certain number of viewers who will visit the Web page via the blogger’s link. The product of these two variables determines whether or not a Web page will reach the critical value of 1, which determines if the branch keeps growing or dead-ends.

“A system is in a critical state if a single movement in an individual constituent element leads, on the average, to the movement of precisely one other element in the system,” Roychowdhury explained.

If a system is in a super- or sub-critical state, movement of one element leads, on average, to the movement of either more or less than one other element, respectively. That means that a signal generated in a super-critical system should increase forever, while a signal in a sub-critical system eventually dies out.

“But in a critical system, something very interesting happens,” Roychowdhury said. “Almost all signal cascades will die out, but some of them can last for a long time and can cover a large area. Clearly, sub- and super-critical systems are not that interesting unless we want a system that is either not that responsive or a system that explodes at the slightest provocation. Critical systems, on the other hand, allow for a responsive system to exist without it being blown apart. Many physical systems naturally gravitate towards a critical state, and this phenomenon is termed SOC.”

As the researchers explain, competition for viewers and links is a driving force of the Web, and this competition pushes the entire Web into an SOC state. Based on their data, the researchers determined the values for the two variables above for the “true art or fake art” site that closely produce its traffic patterns: they found that its link probability of 0.01 and referral number of 95 visitors per link results in a slightly sub-critical value of 0.95 for that particular Web page.

But since some Web pages are more interesting than others, some pages will achieve the critical value of 1 or even surpass it.

“To explain how the Web evolves into the SOC state, we need to use the concept of Darwinian fitness, which is a scientific measure of digital fangs and claws that help the Web page to fight for links with its competitors,” Simkin said. “The success in this competition depends not only on the Web page's own fitness, but also on the average fitness of other pages currently discussed in the blogosphere, with which our Web page competes.”

If this average is low, Simkin explained, then the fittest papers are super-critical. This means that, with time, they increase their share of the blogosphere. But in turn, this leads to the increase of the average fitness. The process continues until the fittest pages become exactly critical.

“One finding that is important for Webmasters is that our work disproves the so-called fifteen minutes of fame paradigm, according to which things can get popular soon after release and quickly become forgotten,” Simkin said. “One, of course, knows that this paradigm is manifestly wrong for immortal classics. However, our work shows it to be wrong not only for great creations, but for anything which is of any intrinsic (not created by advertisement) merit.”

The researchers found that the traffic to a Web page with fixed content can persist for at least several years.

“So one should not hurry to delete old Web pages,” Simkin said. “When there is enough – say a year – of access statistics, our model can be used to infer a page's fitness and predict the average volume and fluctuations of future traffic.”

Roychowdhury is a cofounder and Simkin a consultant for a start-up company called NetSeer.com that focuses on next-generation Internet advertising. The company utilizes similar physics-based modeling of the Web, though not the direct results of the present study.

The researchers add that the Web is just one of many complex systems that exhibit self-organized criticality, with other examples including evolutionary patterns, earthquakes, and citations in research papers. They suggest that their model could also be used to explain the spreading of cultural elements, like movies, books, and fashion styles.

More information: Simkin, M. V. and Roychowdhury, V. P. “A theory of web traffic.
Europhysics Letters, 82 (2008) 28006.

Source: http://www.iop.org/

Scotland, Computer News in Scotland, Technology News in Scotland, Computing in Scotland, Web news in Scotland computers, Internet, Communications, advances in communications, communications in Scotland, Energy, Scottish energy, Materials, Biomedicine, Biomedicine in Scotland, articles in Biomedicine, Scottish business, business news in Scotland.

Website : beachshore