Categories
Urban

Housing Search in the Age of Big Data

My article “Housing Search in the Age of Big Data: Smarter Cities or the Same Old Blind Spots?” with Max Besbris, Ariela Schachter, and John Kuk is now published in Housing Policy Debate. We look at the quantity and quality of information in online housing listings and find that they are much higher in White and non-poor neighborhoods than they are in poor, Black, or Latino neighborhoods. Listings in White neighborhoods include more descriptive text and focus on unit and neighborhood amenities, while listings in Black neighborhoods focus more on applicant (dis)qualifications. We discuss what this means for housing markets, filter bubbles, residential sorting and segregation, and housing policy. You can download a free PDF.

Housing search technologies are changing and, as a result, so are housing search behaviors. The most recent American Housing Survey revealed that, for the first time, more urban renters found their current homes through online technology platforms than any other information channel. These technology platforms collect and disseminate user-generated content and construct a virtual agora for users to share information with one another. Because they can provide real-time data about various urban phenomena, housing technology platforms are a key component of the smart cities paradigm.

This paradigm promotes information technology as both a technocratic mode of monitoring cities and a utopian mode of improving urban life through big data. In this context, “big data” typically refers to massive streams of user-generated content resulting from millions or billions of decentralized human actions. Data exhaust from Craigslist and other housing technology platforms offers a good example: optimistically, large corpora of rental listings could provide housing researchers and practitioners with actionable insights for policymaking while also equalizing access to information for otherwise disadvantaged homeseekers. But how good are these platforms at resolving the types of problems that already plague old-fashioned, non-big data? Does this broadcasting of information reduce longstanding geographic and demographic inequalities or do established patterns of segmentation and sorting remain?

Categories
Planning

Off the Grid at TRB

I am presenting my ongoing research into the recent evolution of American street network planning and design at the annual meeting of the Transportation Research Board in Washington DC on January 13. This presentation asks the question: how has street network design changed over time, especially in recent years? I analyze the street networks of every US census tract and estimate each’s vintage.

Street network designs grew more disconnected, coarse-grained, and circuitous over the 20th century… but the 21st century has witnessed a promising rebound back toward more traditional, dense, and interconnected grids. Higher griddedness is associated with less car ownership, even when controlling for related socioeconomic, topographical, and other urban factors.

Update: the paper has been published in JAPA.

Categories
Urban

Big Data in Urban Morphology

My new article “Spatial Information and the Legibility of Urban Form: Big Data in Urban Morphology” has been published in the International Journal of Information Management (download free PDF). It builds on recent work by Crooks et al, presenting workflows to integrate data-driven and narrative approaches to urban morphology in today’s era of ubiquitous urban big data. It situates this theoretically in the visual culture of planning to present a visualization-mediated interpretative process of data-driven urban morphology, focusing on transportation infrastructure via OSMnx.

OSMnx: Figure-ground diagrams of one square mile of each street network, from OpenStreetMap, made in Python with matplotlib, geopandas, and NetworkX

Categories
Data

Defining Urban Data Science

I’m a co-author on a new article out in Environment and Planning B: Urban Analytics and City Science titled “A Roundtable Discussion: Defining Urban Data Science” (download free PDF). It arises from a panel discussion I participated in at the 2019 AAG Annual Meeting in DC. Vanessa Frias-Martinez, Song Gao, Ate Poorthuis, and Wenfei Xu joined me on the panel, which was organized and moderated by Wei Kang, Taylor Oshan, and Levi Wolf. From the abstract:

Categories
Urban

Urban Street Network Orientation

My new article, Urban Spatial Order: Street Network Orientation, Configuration, and Entropy, has just been published in one of my favorite journals: Applied Network Science (download free PDF). This study explores the spatial signatures of urban evolution and central planning. It examines street network orientation, connectivity, granularity, and entropy in 100 cities around the world using OpenStreetMap data and OSMnx for modeling and visualization:

City street network grid orientations, order, disorder, entropy, rose plot, polar histogram made with Python, OSMnx, OpenStreetMap, matplotlib.

So, who’s got a grid and who doesn’t? Each of the cities above is represented by a polar histogram (aka rose diagram) depicting how its streets orient. Each bar’s direction represents the compass bearings of the streets (in that histogram bin) and its length represents the relative frequency of streets with those bearings. The cities above are in alphabetical order. Here they are again, re-sorted from most-ordered/gridded city (Chicago) to most-disordered (Charlotte):

Categories
Data

New Article in Frontiers in Neurology

I recently teamed up with an international group of public health researchers and spatial analysts to co-author an article, An Introduction to Software Tools, Data, and Services for Geospatial Analysis of Stroke Services, that has been accepted for publication at Frontiers in Neurology (download free PDF).

Hospital catchment basin for stroke services. Spatial analysis in python, geopandas, osmnx.

Categories
Academia

Spring Teaching

Happy new year! In the spring semester I’ll be teaching two new courses: Big Data for Cities and Advanced Spatial Analysis of Urban Systems. The former serves as a sort of gateway course to Northeastern’s urban informatics master’s program, introducing students to urban theories and scientific methods of analyzing urban data. The latter introduces advanced students to a computational workflow of spatial analysis and statistics with Python, PostGIS, and other open-source tools. I’ll be creating my lectures as Jupyter notebooks and will share a GitHub link soon when they’re all together.

Categories
Data

Network-Based Spatial Clustering

Jobs, establishments, and other amenities tend to agglomerate and cluster in cities. To identify these agglomerations and explore their causes and effects, we often use spatial clustering algorithms. However, urban space cannot simply be traversed as-the-crow-flies: human mobility is network-constrained. To properly model agglomeration along a city’s street network, we must use network-based spatial clustering.

The code for this example can be found in this GitHub repo. We use OSMnx to download and assemble the street network for a small city. We also have a dataframe of points representing the locations of (fake) restaurants in this city. Our restaurants cluster into distinct districts, as many establishments and industries tend to do:

firm locations on the street network to be clustered: python, osmnx, matplotlib, scipy, scikit-learn, geopandas

Categories
Planning

Urban Form Analysis with OpenStreetMap Data

Figure-ground diagrams of urban form and building footprints in London, Paris, Venice, and Brasilia depict modernism's inversion of traditional spatial orderCheck out the journal article about OSMnx. This is a summary of some of my recent research on making OpenStreetMap data analysis easy for urban planners. It was also published on the ACSP blog.

OpenStreetMap – a collaborative worldwide mapping project inspired by Wikipedia – has emerged in recent years as a major player both for mapping and acquiring urban spatial data. Though coverage varies somewhat worldwide, its data are of high quality and compare favorably to CIA World Factbook estimates and US Census TIGER/Line data. OpenStreetMap imported the TIGER/Line roads in 2007 and since then its community has made numerous corrections and improvements. In fact, many of these additions go beyond TIGER/Line’s scope, including for example passageways between buildings, footpaths through parks, bike routes, and detailed feature attributes such as finer-grained street classifiers, speed limits, etc.

This presents a fantastic data source to help answer urban planning questions, but OpenStreetMap’s data has been somewhat difficult to work with due to its Byzantine query language and coarse-grained bulk extracts provided by third parties. As part of my dissertation, I developed a tool called OSMnx that allows researchers to download street networks and building footprints for any city name, address, or polygon in the world, then analyze and visualize them. OSMnx democratizes these data and methods to help technical and non-technical planners and researchers use OpenStreetMap data to study urban form, circulation networks, accessibility, and resilience.