OECD countries and the EU have implemented proportionality tests for a number of reasons. First, they help to ensure that regulations with significant societal impacts are adequately assessed before being approved. Secondly, they ensure that government resources are not unduly wasted in assessing regulatory proposals or reviewing existing regulation with only minor impacts; where the costs of conducting RIA, consultation and other development process may outweigh their benefits. In turn, this also helps to avoid consultation fatigue, particularly with external stakeholders. It ensures that broader consultation is conducted where the impacts of a regulation are expected to be significant, and consultations will improve proposals. Finally, thresholds help to improve the transparency of the overall development system, where there are clear criteria that are straightforward to apply in practice.
There is a wide disparity in approaches and definitions that countries use when administrating proportionality and threshold tests based on their given political context. However, despite realising these surface differences, the core of filtering mechanisms generally works towards serving the same objectives:
Support RIA oversight bodies to focus their efforts on those regulatory proposals where an in-depth approach is justified;
Help to decide which analytical tools are appropriate for each situation (Cost-Benefit Analysis, Cost-Effectiveness Analysis, Risk Analysis, etc.);
Signal the necessity of a more exhaustive RIA. Therefore, demanding the early involvement of any national body(ies) that may be responsible for this exercise and to avoid delays when requirements are not met at a later stage in the regulatory development process; and
Contribute to a RIA report that is more consistent, effective and has substantial quality to fulfil its role as a support for the policymaking process.
Broadly speaking, the use of thresholds and proportionality for RIA can be broken into four types based on their main features, although all countries use some mix of qualitative and quantitative criteria.
1. Total impact quantitative test: The level or depth of analysis is dependent on the total impacts to society. The policymaker needs to estimate the total impacts quantitatively, usually as part of a preliminary step in the development of a new regulation.
2. Multi-criteria test: The depth of RIA is based on a mix of quantitative and qualitative criteria in a number of key areas. The criteria may include, for example, the number of affected businesses, a certain level of CO2 emissions or a subjective assessment of the significance of impacts on key sectors. Normally, these impacts are quantified, but not monetised like the other types in this list.
3. Single-issue test: The analytical depth of RIA is based on impacts to one sector or stakeholder group. For example, a full RIA is only required when business costs exceed a certain amount.
4. Discretionary with oversight test: In these systems, generally, the policymaker undertakes a preliminary RIA and then a ROB determines the level of analysis in the next step. Alternatively, an ROB gives an opinion if the level of analysis is sufficient at the end of the process.
It can be very difficult for a ROB to monitor or judge the precise level of effort put into the analysis and development of a new regulatory proposal. Despite this, OECD Member countries often recommend that policymakers have a proportionate approach to regulation without setting concrete criteria or thresholds, leaving significant discretion to policymakers. This discretionary approach makes the targeting of RIA efforts rather flexible.
Generally, the ROB checks the quality and scope of analysis at one or more stages during the development of a regulation. However, the ROB does not necessarily have sufficient information on the significance of the problem and potential impacts to know if policy teams have given a proposal due consideration. Thresholds may be one way of encouraging more analysis without leaving a high-level of discretion to policymakers.
Based on the OECD’s experience, policymakers often ignore or underplay the initial, critical aspect of the RIA process: identifying the problem. It only makes sense for policymakers to consider solutions or policy options once the magnitude of the problem is understood, particularly its causes. It is at this stage that the regulatory design process and RIA have the most impact. Often ministers or policymakers may be unwilling to change a proposal that is relatively well-developed because of the delay it may cause in enacting the policy or regulation. Therefore, the selection of the policy instrument itself at the early stage of the process will have significant impacts. This suggests that ROBs should intervene early to coax policymakers to consider a wide range of policy options for major problems.
The economic context of the country plays an important part in the depth of analysis of any particular proposal and any thresholds. In large economies like the E.U. and the U.S., relatively minor changes in regulations or directives can have impacts worth billions of euros or dollars. The time and resources spent on analysis should then be significantly more sophisticated and scale to the size of the economy. Larger economies, where small changes have large potential impacts, should apply more resources to the analysis and oversight of regulation than small countries. Nevertheless, small economies are not off the hook. In a small economy, regulations could have significant impacts per capita, so proportionally more analysis may be worthwhile, if there may be significant impacts on any one sector or stakeholder group. (OECD, 2019[3])
Ideally, the existence of a problem and its significance should be developed before the stage of legislative planning. Many countries develop annual legislative plans. One might think that at this stage, policymakers should make a quick analysis of the scope of the issue, stakeholders affected, and the magnitude of potential impacts. Based on this preliminary analysis, a decision could be made on the depth of RIA necessary. The ROB should then evaluate the legislative plan checking the decisions of individual ministries and government agencies on the anticipated depth of RIAs necessary and potentially suggesting adjustment.