The Networks Around Us
We have always been aware of the powerful characteristics of the networks that we inhabit, even if we couldn’t fully grasp the forces behind them. A chance encounter at a party reveals a common friend who lives thousands of miles away. Folklore tells us that the best way to find a new job is to “network” via acquaintances and friends-of-friends. All of us have surfed the web, suddenly realizing that just a few clicked links have taken us worlds away from our original intentions.
We live in a highly interconnected world, at many different scales. Connections are what networks are about: two nodes are joined by an edge when they are related in a specified way. We are tied to our friends. Cities are connected by roads and airline routes. Flora and fauna are bound together in a food web. Countries are involved in trading relationships. But not all networks are physical: the World Wide Web is a virtual network of information.
Until recently, thinking about networks at grand scales was intractable. Different fields reacted to this deficiency in their own ways. Sociologists limited themselves to small data sets (fewer than 50 people). Mathematicians focussed on purely aesthetic models unencumbered by applications. Scientists used simplified models that ignored the underlying networks. Our modern Information Age has produced a wealth of data about the complex networks that tie us together. In response, the field of Network Science has arisen, drawing from mathematics, computer science, sociology, economics, and the sciences. The last two decades have witnessed the development of a coherent methodology for analyzing, understanding and interpreting network data. This specialty is evolving before our eyes, and is sure to undergo further evolution in the years to come. Network Science is highly interdisciplinary: the field synthesizes multiple traditions to grapple with understanding the structure of networks, and how this structure effects the dynamic interactions between its nodes.
A Crash Course on Empirical Network Analysis
On this site, we will apply some of the tools from Network Science to everyone’s favorite complex system: the kingdoms of Westeros and Essos. We perform an exploratory analysis of networks of characters, focussing on two main questions:
- Which characters naturally belong together, forming coherent communities within the network?
- Which characters play an important role in the network?
These are actually complicated questions. We explore them both using mathematical tools that capture their essence.
The definition of a “community” is a slippery one. Intuitively speaking, a community is a subset of the network that forms a self-contained and coherent sub-network. One common metric that people use for community detection is that there should be lots of edges within communities, and fewer edges between communities. This idea is captures by a quantity called modularity that I won’t define explicitly here. Given a network, we use standard techniques to split the network into communities so that modularity is maximized (approximately, anyway). One nice feature of this process is that we discover the number of communities, rather than picking the optimal number of communities up front.
Once we have partitioned a network into communities, we color the nodes according to their community, and choose a network layout that emphasizes the community structure. For example, here is a network with three communities:
A network with three communities, image from https://data.graphstream-project.org
Not all nodes are created equal. Some nodes play an outsized role in the network, either by having many connections, or by being strategically positioned to help connect distant parts of the network. In fact, there are many ways that a node can be important or influential. In our analysis, we focus on five different centrality measures, each of which captures a different dynamic. These centrality measures have been used in diverse fields, from sociology to economics to computer science. There is no single “right” centrality measure. As with other Data Science techniques, it is essential to interpret these quantities with respect to our expert knowledge in the underlying domain.
We will be looking at a network whose nodes are characters. Two nodes are connected by an edge when those two characters interact (in some way or another). These edges are weighted by the total number of interactions. Characters who interact frequently will be connected by a high weight edge. Acquaintances will be connected by a low weight edge. Complete strangers will not be connected by any edge whatsoever.
Here are the five different centrality measures that we will use.
The degree centrality of a node is the number other nodes that are directly connected to it via an edge. This is just a raw count of the number of people that the character interacted with at least once.
Weighted Degree Centrality
The weighted degree centrality is the sum of the weights of the edges incident with the node. This is the total number of interactions involving the character.
This is weighted degree centrality with a feedback loop. Having connections to “important” people makes you more important as well. In this measure, you get full credit for knowing someone important, even if you don’t know them very well. This measures how powerful your network is (in theory), regardless of whether you are using your network to its fullest potential.
This is another version of weighted degree centrality with a feedback loop. This time, you only get your “fair share” of your neighbor’s importance. That is, your neighbor’s importance is split between their neighbors, proportional to the number of interactions with that neighbor. Intuitively, PageRank captures how effectively you are taking advantage of your network contacts. In our context, PageRank centrality nicely captures narrative tension. Indeed, major developments occur when two important characters interact.
Betweenness centrality identifies nodes that are strategically positioned in the network, meaning that information will often travel through that person. Such an intermediary position gives that person power and influence. Betweenness centrality is a raw count of the number of short paths that go through a given node. For example, if a node is located on a bottleneck between two large communities, then it will have high betweenness
Centrality for Dummies
The various centrality definitions can be overwhelming. Here is an intuitive way to think about these five centrality measures for our character interaction network. Remember that larger values make you more important.
- Degree Centrality: Do you have many connections?
- Weighted Degree Centrality: Do you have many interactions?
- Eigenvector Centrality: Do you have many connections to important people?
- PageRank Centrality: Do you have many interactions with important people?
- Betweenness Centrality: Do you help to connect different parts of the network?