Rationale

Monitoring and evaluation of both the planning process and of the implementation of the measures are crucial to the effectiveness of the plan. A monitoring and evaluation mechanism helps to identify and anticipate difficulties in the preparation and implementation of the SUMP, and, if necessary, to “repackage” measures in order to achieve targets more efficiently and within the available budget. It will also provide proof of the effectiveness of the plan and its measures. This allows those responsible for the actions to justify where money was spent.

The reporting should ensure that the results of the evaluation feed back into the public debate, thus enabling all actors to consider and make the necessary corrections (e.g. if targets are achieved or if measures appear to be in conflict with one another). The monitoring and evaluation mechanisms should be defined early and become an integrated part of the plan.

Aims

• Build a suitable monitoring and evaluation arrangement into the plan to help identify barriers and drivers for measure design and implementation, and to enable timely and effective responses.
• Determine how the degree of measure implementation and target achievement will be assessed.
• Develop suitable mechanisms to assess the quality of the planning process.
• Make monitoring and evaluation arrangements an integral part of the SUMP document.

Tasks

• Connect indicator selection for monitoring and evaluation to setting SMART targets (> Activity 5.2). Choose a few easily-measurable indicators and avoid information overload.
• The ex-post evaluation reviews the sustainable urban mobility planning and implementation stages, and the overall results of the decision making pro-cess. It should include the following areas:
  • Output (action taken): Newly constructed infrastructure (e.g. x km bicycle lanes) or new transport and mobility services in operation (e.g. x new buses) – using output indicators.
  • Outcome (impact of action): Real and measurable improvements in quality of life and the quality of transport services (outcome indicators) should be the main focus. Examples are congestion (vehicle delay) or the number of cycling trips. Include intermediate outcomes if possible; these represent milestones towards key outcome targets. The indicators should measure outcomes directly, or measure how outputs are demonstrably related to outcomes.
  • Planning process of the measure implementation: The efficient use of resources as an investment in measures; the process of implementation: e.g. timing of implementation, quality (process indicators).
• Include qualitative and quantitative indicators.
• Anticipate arrangements for ex-ante evaluation (appraisal – a process of checking how well a scheme or strategy will perform, can assist in making efficient choices between options.) and ex-post evaluation of plan preparation process.
• Perform a data audit (what is available? where are gaps?) and if necessary develop a data collection strategy (quantitative and qualitative indicators). This is linked to the data audit in Activity 3.1 (Prepare an analysis of problems and opportunities). These activities are related and should be coordinated with each other.
• Determine how monitoring and evaluation will be integrated in the Sustainable Urban Mobility Plan. Develop a work plan for monitoring and evaluation activities that is integrated with the project schedule.
• Define trajectories to measure intermediate outcomes and assess the progress in achieving targets.
• Define clear responsibilities of well skilled staff members – or an external partner – for monitoring and evaluation. Ideally the responsibility should be with an independent body.
• Clearly define the available budget and activities for monitoring and evaluation – typically this should be at least 5% of the total available budget.
• Plan for a minimum stakeholder involvement in monitoring and evaluation.

Activities beyond essential requirements

• Integrate an assessment of costs and benefits of the Sustainable Urban Mobility Plan development process.
• Plan for extensive stakeholder involvement in monitoring and evaluation.
• Involve peers from other cities in the feedback process.
• Coordinate with relevant local and regional stakeholders on regional indicators.

Timing and coordination

• Consider monitoring and evaluation needs from the outset, especially when developing SMART targets and selecting related indicators (> Activity 5.2).
• Include ex-ante evaluation (appraisal) in the status analysis (> Activity 3.1), scenario development (> Activity 3.2) and action and budget plan (> Activity 7.2).
• Include arrangements for monitoring and evaluation arrangements for ex-post evaluation in Sustainable Urban Mobility Plan document (> Activity 9.1).

Checklist

	Suitable indicators (based on indicators selected in Activity 5.2 Develop SMART targets) selected.
	Suitable monitoring and evaluation tools agreed on.
	Work plan and responsibilities for data collection and management agreed.