Enhancing the Public Procurement Performance Measurement Framework in Hungary

Annex A. List of indicators of the Hungarian public procurement measurement framework

 

	Category	Sub-category	Indicator
1	Compliance	Effectiveness of the remedies	Number of public procurement challenges
2	Compliance	Effectiveness of the remedies	Distribution of ex officio initiators
3	Compliance	Effectiveness of the remedies	Share of public procurement challenges out of the total number of public procurement procedures
4	Compliance	Effectiveness of the remedies	Share of successful public procurement challenges
5	Compliance	Effectiveness of the remedies	Share of public procurement procedures with a request for a preliminary dispute settlement as a percentage of all public procurement procedures
6	Compliance	Effectiveness of the remedies	Number of notifications of public interest received by the Public Procurement Authority
7	Compliance	Effectiveness of the remedies	Number of launched review procedures based on notifications of public interest received by the Public Procurement Authority
8	Compliance	Effectiveness of the remedies	Cost of public procurement challenges
9	Compliance	Effectiveness of the remedies	Average duration of redress procedures
10	Compliance	Effectiveness of the remedies	Number and share of judicial reviews in the number of appeals
11	Compliance	Effectiveness of the remedies	Number and percentage of challenges by contracting authorities against themselves out of the total number of challenges
12	Compliance	Legal compliance	Number of infringements broken down by the legal provision infringed
13	Compliance	Transparency	Share of lots (in numbers) of public procurement procedures launched by public notice among the lots awarded
14	Compliance	Transparency	Share of negotiated procedures without prior publication of a contract notice
15	Compliance	Transparency	Share of lots (in numbers) of public procurement procedures conducted under Article 115 of the PPA
16	Compliance	Transparency	Share of lots (in values) of public procurement procedures conducted under Article 115 of the PPA
17	Efficiency	Efficiency of public procurement procedures	Average time, in days, between the publication of the call for tender and the publication of the report on the award of the contract
18	Efficiency	Efficiency of public procurement procedures	Average time in days between the publication of the call for tender and the bid submission deadline
19	Efficiency	Efficiency of public procurement procedures	Average time in days between the bid submission deadline and the publication of the summary
20	Efficiency	Efficiency of public procurement procedures	Share of unsuccessful lots
21	Efficiency	Efficiency of public procurement procedures	Share of each reason of unsuccessful lots
22	Efficiency	Efficiency of public procurement procedures	Number and share of lots using efficient procurement techniques
23	Efficiency	Efficiency of public procurement procedures	Average duration of framework agreements
24	Efficiency	Efficiency of public procurement procedures	Share of framework agreements concluded with one or multiple operators
25	Efficiency	Efficiency of public procurement procedures	Share of lots awarded in public procurement procedures using each evaluation criteria
26	Efficiency	Efficiency of public procurement procedures	Share of procurement procedures broken down into lots (as a percentage of the number of successful procurement procedures)
27	Efficiency	Cost-effectiveness /administrative costs	Cost for contracting authorities of running a public procurement procedure
28	Efficiency	Cost-effectiveness /administrative costs	Cost for economic operators of bidding in a public procurement procedure
29	Efficiency	Cost-effectiveness /administrative costs	Ratio of the estimated value of lots to the contract price for the awarded lots in public procurement procedures
30	Efficiency	Cost-effectiveness /administrative costs	Share of number of lots in which a tendering security has been lodged in respect of the number of lots awarded
31	Efficiency	Effectiveness of contract performance	Share of the number of contracts that were fully terminated in the course of contract performance
32	Efficiency	Effectiveness of contract performance	Share in value of contracts that were fully terminated in the course of contract performance
33	Efficiency	Effectiveness of contract performance	Number and share of contracts affected by contract modification
34	Efficiency	Effectiveness of contract performance	Share of number of contracts where there was a delay in the performance of the contract (compared to the originally planned deadline)
35	Efficiency	Effectiveness of contract performance	Share of contracts affected by cost overruns
36	Efficiency	Competition	Number of preliminary market consultations
37	Efficiency	Competition	Number of comments received during preliminary market consultations
38	Efficiency	Competition	Share in number of lots awarded to one bidder
39	Efficiency	Competition	Share in value of lots awarded to one bidder
40	Efficiency	Competition	Median number of bids received per lots awarded
41	Efficiency	Competition	Mode number of bids received per lots awarded
42	Efficiency	Competition	Number of decisions establishing a breach by the Competition Authority in public procurement cartel cases
43	Efficiency	Capacity	The organisation has its own methodology for measuring its procurement performance
44	Efficiency	Capacity	Use of services of an external consultant with expertise in the subject matter of the procurement have been used by the organisation
45	Efficiency	Capacity	Employment of an Accredited Public Procurement consultant or a procurement expert to perform procurement consultancy tasks
46	Efficiency	Capacity	Reasons for the organisation to use the services of an external consultant
47	Efficiency	Capacity	Percentage of procedures involving external experts
48	Efficiency	Capacity	Number of staff involved in public procurement
49	Efficiency	Capacity	Number of staff with higher vocational training in public procurement
50	Efficiency	Capacity	Number of staff involved in the management of public procurement procedures in the institution who have received external or internal training in public procurement in a given year
51	Efficiency	Centralisation	Number of contracting authorities using CPB services per CPB in a given year
52	Efficiency	Centralisation	Number of contracts concluded under framework agreements or dynamic purchasing systems of CPBs per CPB in a given year
53	Efficiency	Centralisation	Number of contracts concluded with SMEs/CPB in a given year
54	Efficiency	Centralisation	Number of requests received by CPB from contracting authorities to conduct procurement procedures by themselves.
55	Efficiency	Centralisation	Number of procurement procedures that have been referred back for own responsibility by the CPB
56	Efficiency	Centralisation	Share of the value of successful purchases conducted in a specific year under the framework agreement to the total value of the framework agreement concluded / CPB
57	Efficiency	Centralisation	Procurement capacity in each CPB in a specific year (in number)
58	Efficiency	Centralisation	Staff with a postgraduate certificate on public procurement/ CPB
59	Efficiency	Centralisation	Number and percentage of staff trained externally or internally in public procurement in a given year /CPB
60	Efficiency	Centralisation	Use of CPBs of external consultants for the implementation of public procurement procedure (Yes/no)
61	Efficiency	Centralisation	Average use by a CPB of accredited procurement consultants services for procurement consultancy tasks per 10 procedures.
62	Efficiency	Centralisation	Share of procurement procedures of CPBs involving the services of external consultants for public works per CPB
63	Efficiency	Centralisation	Share of procurement procedures of CPBs involving the services of external consultants for services per CPB
64	Efficiency	Centralisation	Share of procurement procedures of CPBs involving the services of external consultants for goods per CPB
65	Efficiency	Centralisation	Existence of a system to monitor market price evolution of procurement items covered by FAs/ CPB
66	Efficiency	Centralisation	Percentage of price reduction compared to the original price as a result of reopening competition for a given year
67	Efficiency	Centralisation	percentage of savings achieved through centralisation in a given year (compared to market price)
6	Efficiency	Centralisation	Percentage of time savings achieved through centralisation
69	Efficiency	Centralisation	Operation of an online marketplace or catalogue specifically for procurement below the threshold/CPB
70	Efficiency	Centralisation	Frequency of conducting a preliminary market analysis before launching public procurement procedures
71	Efficiency	Centralisation	Existence of a methodology for the preliminary assessment of procurement needs
72	Efficiency	Centralisation	Existence of a framework for measuring the effectiveness of the public procurement procedures carried out (indicators for monitoring the effectiveness of the CPB and of each procurement procedure and their evaluation)
73	Strategic		Share of lots with environmental aspects (in numbers)
74	Strategic		Share of lots with social aspects (in numbers)
75	Strategic		Share in number of lots awarded to micro and SMEs
76	Strategic		Share of bids submitted by micro and SMEs (among the valid bids)
77	Strategic		Share of contracts awarded (in numbers) where the full life cycle of the contract or life cycle costing was taken into account