Evaluation Update
SAIC created the Camera Phone Proof of Concept Project Evaluation Update to describe to the users the evaluation strategy, evaluation status, summary of usage, and preliminary findings. This was presented to project participants at a user debriefing held at the end of the demonstration/test period.
Slide 1: Camera Phone Proof of Concept Project
IPAS II – Task # 61020 Evaluation Update Briefing March 1, 2007
Slide 2: Evaluation Strategy
The focus of the evaluation is to assess the impact of the camera phone with respect to the following key areas:
User Satisfaction:
Assess end-user perceptions on feasibility of camera phones to improve incident clearance times.
Assess end-user perceptions regarding overall benefits of camera phone
Operational Procedures:
Determine how the phones were used to improve incident management & response activities
Determine how the phones were integrated into existing operational/incident response activities
Slide 3: Evaluation Strategy (cont’)
Technology Functionality:
Assess end-user perceptions on the effectiveness of the technology (image quality, equipment reliability, speed of service, etc.)
Safety Improvement:
Assess end-user perceptions of how camera phones improve levels of safety during traffic incident remediation (including reductions in roadway exposure, secondary accidents, etc.)
Institutional & Technical Issues:
Identify/Report any issues, technical or institutional, that were encountered during project (Ex. Storing of images)
Slide 4: Evaluation Status: Phase I
SAIC developed interview guides that were designed to address key evaluation areas
SAIC is in the process of conducting stakeholder interviews to capture participant feedback
As of 2/8/2007, 4 interviews have been conducted with project participants
Goal is to complete additional interviews by 03/01/2007
As of 2/18/2007, 100 pictures have been taken by project participants (VDOT, Tow Companies, etc.)
Submit draft Lessons Learned and Benefit write-ups by 03/22/2007
Submit final Lessons Learned and Benefit write-ups by 05/1/2007
At date of presentation development, two additional interviews were scheduled
Slide 5: Summary of Usage
There were 100 pictures taken between August 2006 and February 2007. Of the 100 pictures sent, 56 included audio recordings detailing the accident scene.
14 of the 100 pictures were taken between the times 12:00am and 6:00am
45 of the 100 pictures were taken between the times 6:00am and 12:00pm
23 of the 100 pictures were taken between the times 12:00pm and 6:00pm
18 of the 100 pictures were taken between the times 6:00pm and 12:00am
VDOT sent 76 of the 100 pictures
Henry's Wrecker Service sent 12 of the 100 pictures
Willow Spring Towing and Recovery sent 6 of the 100 pictures
CapWIN sent 4 of the 100 pictures
An unknown Agency sent 2 of the 100 pictures
Slide 6: Preliminary Findings
Benefits
Camera phone functionality
Send photo and voice message
Transmission includes number of sender
Archived photos may be used by VDOT for training
Towing companies and operational changes
Help identify what equipment is needed to handle a particular incident
Help plan incident management remediation activities prior to arriving on scene
Lessons Learned
Camera phone technology (features, capabilities, model type) may need to be enhanced in order to improve night-time usage and image quality
Lack of interoperability between different service providers often impacts the ability of users to send/receive data
Slide 7: Sample Images
Image taken on 08/11/06 at
10:50am by VDOT
Image taken on 8/26/06 at
9:22am by VDOT
Slide 8: Sample Images (cont’)
Image taken on 10/05/06
at 11:53am by Willow
Springs
Image taken on 10/13/2006
at 5:12am by VDOT
Slide 9: Sample Images (cont’)
Image taken on 10/20/06 at
2:02pm by Henry's Wrecker
Service
Image taken on 2/4/2007
9:48 pm by VDOT
Slide 10: Sample Images (cont’)
Image taken on 08/11/06
at 3:24am by VDOT
Image taken on 01/29/07
at 2:59pm by VDOT
Next Steps TimeLine (Phase I)
3/8/2007: Draft and send evaluation notes and findings to stakeholders
3/15/2007: Comments and updates returned to evaluation team
3/22/2007: Draft of benefits and lessons learned submitted to Noblis for review
3/29/2007: Benefits and lessons learned received and submitted to JPO
4/15/2007: Receive comments from JPO
TBD: Phase II