The broader monitoring and evaluation arrangements have been defined before the plan is adopted (> Activity 8.1). With the implementation of the measures it is time to regularly apply the selected monitoring and evaluation tools and to check how much progress has been made towards achieving the objectives. The results of the evaluation will be needed to enable a “repackaging” of measures in order to achieve targets more efficiently and within the available budget (> Activity 11.1 Update current plan regularly). The reporting should ensure that the results of plan implementation that are actually measured feed back into the public debate, thus enabling all actors to consider and make corrections where necessary (e.g. if targets are achieved, measures appear to be contradictory, etc.).
- Keep track of progress towards achieving the objectives.
- Identify problems, bottlenecks and other challenges for on-time implementation.
- Regularly inform stakeholders and citizens about progress of measure implementation.
- Regularly monitor the progress of the implementation and the impact, in terms of outputs and outcomes (> Activity 8.1)
- Include “hard” findings that show progress towards measurable objectives and indicators (e.g. reduction of particulate matter), as these will show you whether your measures have achieved what they were intended to.
- Include “soft” findings that refer to implementation experiences, fulfilment of overall goals, levels of awareness etc., as these will be invaluable if you wish to replicate or modify the measure in another location in the future.
- Regularly (every 1-5 years – depending on measures) evaluate the impacts of the measures or bundles of measures.
- Publish an evaluation report targeted at citizens and politicians.
Activities beyond essential requirements
- Include a “sanity check” in monitoring of the implementation, meaning that stakeholders, the public and possible peers from other cities should provide feedback on how the implementation responds to the agreed-upon objectives and targets of the Sustainable Urban Mobility Plan.
- Have the monitoring and evaluation carried out in a transparent way, preferably by an independent agency to guarantee neutrality, and applying the same indicator set that was used throughout the previous steps. If this seems unrealistic (e.g. due to budget restraints), a self-monitoring and evaluation by authorities is a valid alternative.
Timing and coordination
- After adoption of action and budget plan (implementation phase).
|Implementation of measures continually monitored.|
|Impacts evaluated at regular intervals.|
|Evaluation report prepared and published.|
Further information on monitoring and evaluation
See Activity 8.1 Arrange for monitoring and evaluation
Aachen, Germany: Monitoring implementation through regular status meetings
In the City of Aachen, different stakeholders meet quarterly as part of an ongoing monitoring process on the status of the implementation of measures in the field of environmentally-friendly mobility.
Against the backdrop of the commencement of a clean air plan with 29 mobility-related measures at the beginning of 2009, a working group consisting of the city’s transport and environment departments, the chamber of industry and commerce, the local public transport operator (ASEAG) and the regional transport association (AVV) was set up to monitor the implementation of the measures at quarterly meetings, during which the status of each measure is discussed and, in cases where the target achievement is in doubt, contingency activities are set up. Apart from a system of continual reporting on implementation of the measures, the establishment of regular status meetings is a soft approach for low-cost and efficient monitoring during the implementation phase.
Source: Rupprecht Consult based on input from the City of Aachen
Vitoria-Gasteiz, Spain: Checking progress towards achieving objectives
The “Plan de Movilidad Sostenible y Espacio Público” (“Sustainable Mobility and Public Spaces Plan”) of the City of Vitoria-Gasteiz is one of the strategic projects which reflects the actions that must be taken in order to reach the city vision described in the Master Plan of Vitoria-Gasteiz 2015. It must accept the social responsibility for introducing and executing policies that contribute to a sustainable future with special emphasis on the battle against climate change and the need to promote social cohesion and of the creation of a compact city.
In order to check the progress towards achieving the objectives, a survey on the city’s urban mobility was carried out in 2011. This survey contributed to an understanding of the changes in the city since the introduction of the plan and to determining to what degree the mobility habits of the citizens have already changed. The survey consisted of two parts: in the first part, 4,000 telephone interviews were carried out to evaluate the Sustainable Mobility Plan. The second part of the survey focused on the aspect of mobility in relation to economic functionality (how do we get to work, etc.) and was carried out through direct interviews with 300 companies and 2,700 employees.
A survey performed in 2006 served as a reference point to compare how mobility has changed since the beginning of the Sustainable Mobility Plan. The data indicated that in the period between 2006 and 2011, the number of public transport users increased by 80%.
Sources: Kerstin Burckhart, IET Barcelona; Environmental Studies Centre, Vitoria-Gasteiz City Council www.vitoria-gasteiz.org/movilidad