Lab member Ryan Zhou receives a new NSF Research Experience for Graduates (REG) Award to study community resilience. He will work with Dr. Hu to examine human mobility changes and social media activities during natural disasters, such as the 2021 Texas winter storm. Congratulations Ryan!
Domestic violence (DV) is a serious public health issue, with 1 in 3 women and 1 in 4 men experiencing some form of partner-related violence every year. Existing research has shown a strong association between alcohol use and DV at the individual level. Accordingly, alcohol use could also be a predictor for DV at the neighborhood level, helping identify the neighborhoods where DV is more likely to happen. However, it is difficult and costly to collect data that can represent neighborhood-level alcohol use especially for a large geographic area. In this study, we propose to derive information about the alcohol outlet visits of the residents of different neighborhoods from anonymized mobile phone location data, and investigate whether the derived visits can help better predict DV at the neighborhood level. We use mobile phone data from the company SafeGraph, which is freely available to researchers and which contains information about how people visit various points-of-interest including alcohol outlets. In such data, a visit to an alcohol outlet is identified based on the GPS point location of the mobile phone and the building footprint (a polygon) of the alcohol outlet. We present our method for deriving neighborhood-level alcohol outlet visits, and experiment with four different statistical and machine learning models to investigate the role of the derived visits in enhancing DV prediction based on an empirical dataset about DV in Chicago. Our results reveal the effectiveness of the derived alcohol outlets visits in helping identify neighborhoods that are more likely to suffer from DV, and can inform policies related to DV intervention and alcohol outlet licensing.
More details are available in the full paper at:
Ting Chang, Yingjie Hu, Dane Taylor, and Brian Quigley (2022): The role of alcohol outlet visits derived from mobile phone location data in enhancing domestic violence prediction at the neighborhood level. Health & Place, 73, 102736. [PDF]
As many U.S. states implemented stay-at-home orders beginning in March 2020, anecdotes reported a surge in alcohol sales, raising concerns about increased alcohol use and associated ills. The surveillance report from the U.S. National Institute on Alcohol Abuse and Alcoholism provides data about the monthly alcohol sales in a subset of states, allowing an investigation of this potential increase in alcohol use. Meanwhile, anonymized human mobility data released by companies such as SafeGraph enables an examination of the visiting behavior of people to various alcohol outlets such as bars and liquor stores. Leveraging these novel datasets, this study examines changes to alcohol sales and alcohol outlet visits during COVID-19 and their geographic differences in a subset of U.S. states. We find major increases in the sales of spirits and wine since March 2020, while the sales of beer decreased. We also find moderate increases in people’s visits to liquor stores, while their visits to bars and pubs substantially decreased. Noticing a significant correlation between alcohol sales and outlet visits, we use machine learning models to examine how that relation changed in the early months of COVID-19 and find evidence in some states for likely panic buying of spirits and wine. Large geographic differences exist across the examined states, with both major increases and decreases in alcohol sales and alcohol outlet visits.
More details are available in the full paper at:
Yingjie Hu, Brian Quigley, and Dane Taylor (2021): Human mobility data and machine learning reveal geographic differences in alcohol sales and alcohol outlet visits across US states during COVID-19. PlOS ONE, 16(12), p.e0255757. [PDF]
This work was also covered in a number of media reports, including:
While a lot of challenges and uncertainty continued in 2021, everyone in the world has been working hard and playing their roles to keep things functioning and to help us get back to a life without virus. Let’s hope for a better new year with all promises!
We wish you a Merry Christmas and a happy and healthy 2022!
A common need for artificial intelligence models in the broader geoscience is to represent and encode various types of spatial data, such as points (e.g., points of interest), polylines (e.g., trajectories), polygons (e.g., administrative regions), graphs (e.g., transportation networks), or rasters (e.g., remote sensing images), in a hidden embedding space so that they can be readily incorporated into deep learning models. One fundamental step is to encode a single point location into an embedding space, such that this embedding is learning-friendly for downstream machine learning models such as support vector machines and neural networks. We call this process location encoding. However, there lacks a systematic review on the concept of location encoding, its potential applications, and key challenges that need to be addressed. This paper aims to fill this gap. We first provide a formal definition of location encoding, and discuss the necessity of location encoding for GeoAI research from a machine learning perspective. Next, we provide a comprehensive survey and discussion about the current landscape of location encoding research. We classify location encoding models into different categories based on their inputs and encoding methods, and compare them based on whether they are parametric, multi-scale, distance preserving, and direction aware. We demonstrate that existing location encoding models can be unified under a shared formulation framework. We also discuss the application of location encoding for different types of spatial data.
More details are available in our paper at:
Gengchen Mai, Krzysztof Janowicz, Yingjie Hu, Song Gao, Bo Yan, Rui Zhu, Ling Cai, and Ni Lao (2021): A review of location encoding for GeoAI: methods and application. International Journal of Geographical Information Science, in press. [PDF]
Maps in the form of digital images are widely available in geoportals, Web pages, and other data sources. The metadata of map images, such as spatial extents and place names, are critical for their indexing and searching. However, many map images have either mismatched metadata or no metadata at all. Recent developments in deep learning offer new possibilities for enriching the metadata of map images via image-based information extraction. One major challenge of using deep learning models is that they often require large amounts of training data that have to be manually labeled. To address this challenge, this paper presents a deep learning approach with GIS-based data augmentation that can automatically generate labeled training map images from shapefiles using GIS operations. We utilize such an approach to enrich the metadata of map images by adding spatial extents and place names extracted from map images. We evaluate this GIS-based data augmentation approach by using it to train multiple deep learning models and testing them on two different datasets: a Web Map Service image dataset at the continental scale and an online map image dataset at the state scale. We then discuss the advantages and limitations of the proposed approach.
More details are available in our paper at:
Yingjie Hu, Zhipeng Gui, Jimin Wang, and Muxian Li (2021): Enriching the metadata of map images: a deep learning approach with GIS-based data augmentation. International Journal of Geographical Information Science, in press. [PDF]
The University at Buffalo Artificial Intelligence Institute was established in 2018 to explore ways to combine machines’ superior ability to ingest, connect and recall information with concepts that humans excel at, such as reasoning, judgement and strategizing, to develop dynamic human-machine partnerships. Its mission is to bring together educators and researchers in an interdisciplinary environment to continue to make significant breakthroughs in advancing the promise of machine or human-machine systems that can address complex cognitive tasks.
Our GeoAI Lab was invited to join UB AI Institute as an affiliated lab. This affiliation will further strengthen the connections and collaborations between our lab and other UB units.
The objective of this project is to understand how people describe locations on social media during natural disasters. These data from social media are potentially beneficial in disaster response efforts, and to further this goal, computational algorithms are being developed to extract location information from social media postings. However, uneven use of social media by different populations and varying ways of describing places can complicate the process of identifying locations. This project advances knowledge by enhancing the understanding of the ways in which people describe geographic locations during natural disasters, the effectiveness of different algorithmic approaches for location extraction, and the potential spatial biases in the described locations. Such knowledge benefits society by informing future disaster response practices to help save lives and reduce inequality in response efforts. This project provides interdisciplinary research experience for undergraduates and graduates and will enhance academia and industry partnership. The datasets and algorithmic tools produced from this project will be publicly shared.
Social media platforms, such as Twitter, are increasingly being used by people impacted by natural disasters. Descriptions about the locations of victims and accidents are often contained in help-seeking messages posted on these platforms. However, a limited understanding exists of how locations are described on social media during natural disasters, which hinders their automatic extraction via computational tools. This project addresses three research questions: (1) What are the typical forms of location descriptions used by people on social media during natural disasters? (2) How effective are different geospatial artificial intelligence (GeoAI) approaches for extracting these location descriptions and representing them in geographic space? And (3) What spatial biases have characterized location descriptions on social media during natural disasters? The research team is collaborating with emergency management specialists to understand location descriptions on social media, examine multiple geo-knowledge-informed AI approaches for location extraction, and investigate the spatial biases of the extracted locations and their relation to vulnerable communities. The obtained knowledge about location descriptions and the developed methods can be applied to future disasters in diverse settings.
NSF award page: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2117771
We are seeking three UB undergraduate students with work-study support to contribute to two NASA-funded projects in collaboration with an interdisciplinary team of scientists and conservation professionals located in Buffalo, NY, Merced, CA, and Cape Town, South Africa.
Scientific Illustrator – Are you interested in science but passionate about art? Create digital artwork that captures the incredible biodiversity of South Africa and the technology we are using to study it. Learn more and apply at https://app.joinhandshake.com/jobs/4834211.
Geographic Data Visualization Analyst – Are you interested in learning how to tell stories with maps and building your online GIS portfolio? Join us to develop ‘story maps’ that share geospatial information, photographs, and details about the biodiversity hotspot and project. Learn more and apply at https://app.joinhandshake.com/jobs/4834301.
GIS Analyst – Do you want to get involved under the hood of a NASA project using high-resolution imagery and artificial intelligence to help conserve biodiversity? Help us document ecological change by developing a geospatial dataset we’ll use for model training and prediction. Learn more and apply at https://app.joinhandshake.com/jobs/4838720.
Important – these positions are only open to current UB students with work-study support for the 2021-2022 academic year. See here for more information about work-study positions at UB.
We received the notification from NASA that our project proposal “Near-Real-Time Forecasting and Change Detection for a Fire-Prone Shrubland Ecosystem” was selected for funding support. This project aims to utilize statistical modeling and GeoAI methods for near-term ecological forecasting to predict natural land surface processes and evaluate near-real-time changes in the state of a hyperdiverse, fire-dependent and seasonally fluctuating open ecosystem: the fynbos of the Cape Floristic Region (CFR) of South Africa.
Our research team consists of:
• Dr. Adam M. Wilson, Principal Investigator, Wilson Lab, Department of Geography, University at Buffalo, State University of New York, United States
• Dr. Yingjie Hu, Co-Investigator, GeoAI Lab, Department of Geography, University at Buffalo, State University of New York, United States
• Dr. Glenn R. Moncrieff, Co-Investigator, Fynbos Node, South African Environmental Observation Network, South Africa
• Dr. Jasper A. Slingsby, Co-Investigator, Fynbos Node, South African Environmental Observation Network, South Africa
This project further enhances our current AI for Earth project funded by Microsoft and led by Dr. Hu.
We will be hiring a Graduate Research Assistant (starting from Fall 2022 or earlier) and a post doc researcher (starting around Summer 2021), both of whom will be co-advised by Dr. Adam Wilson and Dr. Yingjie Hu. By participating in this project, the GRA and post doc researchers will develop expertise on GeoAI, raster data processing, biodiversity, and ecological forecasting. Interested candidates are encouraged to contact Dr. Hu.