Visible to the public Large-Scale Mapping of Human Activity Using Geo-Tagged Videos

TitleLarge-Scale Mapping of Human Activity Using Geo-Tagged Videos
Publication TypeConference Paper
Year of Publication2017
AuthorsZhu, Yi, Liu, Sen, Newsam, Shawn
Conference NameProceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-5490-5
Keywordsactivity recognition, convolutional neural networks, Deep Learning, deep video, geographic visualization, Metrics, pubcrawl, resilience, Resiliency, Scalability, spatio-temporal analysis

This paper is the first work to perform spatio-temporal mapping of human activity using the visual content of geo-tagged videos. We utilize a recent deep-learning based video analysis framework, termed hidden two-stream networks, to recognize a range of activities in YouTube videos. This framework is efficient and can run in real time or faster which is important for recognizing events as they occur in streaming video or for reducing latency in analyzing already captured video. This is, in turn, important for using video in smart-city applications. We perform a series of experiments to show our approach is able to map activities both spatially and temporally.

Citation Keyzhu_large-scale_2017