The Archive of Many Outdoor Scenes has captured 400 million images. Many of these cameras and images are of street intersections, a subset of which has experienced built environment improvements during the past seven years. We identified six cameras in Washington, DC, and uploaded 120 images from each before a built environment change (2007) and after (2010) to the crowdsourcing website Amazon Mechanical Turk (n=1,440). Five unique MTurk workers annotated each image, counting the number of pedestrians, cyclists, and vehicles. Two trained Research Assistants completed the same tasks. Reliability and validity statistics of MTurk workers revealed substantial agreement in annotating captured images of pedestrians and vehicles. Using the mean annotation of four MTurk workers proved most parsimonious for valid results. Crowdsourcing was shown to be a reliable and valid workforce for annotating images of outdoor human behavior.@en

Introduction: Fewer than 50% of adults and 40% of youth meet US CDC guidelines for physical activity (PA) with the built environment (BE) a culprit for limited PA. A challenge in evaluating policy and BE change is the forethought to capture a priori PA behaviors and the ability to eliminate bias in post-change environments. The present objective was to analyze existing public data feeds to quantify effectiveness of BE interventions. The Archive of Many Outdoor Scenes (AMOS) has collected 135 million images of outdoor environments from 12,000 webcams since 2006. Many of these environments have experienced BE change. Methods: One example of BE change is the addition of protected bike lanes and a bike share program in Washington, DC. We selected an AMOS webcam that captured this change. AMOS captures a photograph from each webcam every half hour. AMOS captured the 120 webcam photographs between 0700 and 1900 during the first work week of June 2009 and the 120 photographs from the same week in 2010. We used the Amazon Mechanical Turk (MTurk) website to crowd-source the image annotation. MTurk workers were paid US$0.01 to mark each pedestrian, cyclist and vehicle in a photograph. Each image was coded 5 unique times (n=1200). The data, counts of transportation mode, was downloaded to SPSS for analysis. Results: The number of cyclists per scene increased four-fold between 2009 and 2010 (F=36.72, p=0.002). There was no significant increase in pedestrians between the two years, however there was a significant increase in number of vehicles per scene (F=16.81, p<0.001). Discussion: This novel research presents unobtrusive surveillance of PA policy and BE intervention effectiveness. Washington, DC, added bike lanes during 2009 and the use of webcam data allowed for a pre- and post-bike lane analysis of travel. The addition of the bike lane is associated with a significant four-fold increase in number of cyclist per scene. The number of vehicles per scene also increased. A portion of this increase may be associated with compressed lanes due to lane removal for the bike lane, thus increasing vehicles per remaining lane. Captured public webcam scenes and MTurks offer an inexpensive (US$12.00), discreet means to evaluate effectiveness of BE policy change and interventions. This abstract presents an initial effort. We continue to test methodology with additional scenes, including parks, school playgrounds, and safe routes to schools, and are working to automate the MTurk process. @en