Discovering Latent Structure

Recently, the rapid proliferation of mobile phones and other digital devices can created an unparalleled opportunity to observe and understand the rapidly changing structure of communities in developing and conflict-affected states. In recent years, Call Detail Records (CDR) from commercial mobile phone networks have been used to study not just the frequency and timing of communication events, but also reflect the intricate structure of an individual's social network, patterns of travel and location choice, as well as the socioeconomic and demographic structure of national and sub-regional populations.

However, current state-of-the-art computational methods used to analyse such data are notoriously ill-suited to answer basic, fundamental questions in the social science and policy arena. While many new, provably efficient algorithms for community detection have been recently developed, these methods have several key limitations: they rarely scale to real-world datasets consisting of millions of interconnected actors; they are not applicable to dynamic contexts where network structure evolves over time; and they are almost never validated.

Recently, the rapid proliferation of mobile phones and other digital devices can create an unparalleled opportunity to observe and understand the rapidly changing structure of communities in developing and conflict-affected states.