5. Strengthening the governance of the skills system in Kazakhstan
Effective governance arrangements are essential to support Kazakhstan in developing and using skills. The success of skills policies typically depends on the actions of a wide range of actors, including government bodies, employers, employees, their associations, education and training providers, representatives of civil society and local communities. Achieving this requires a whole-of-government approach, effective stakeholder engagement, integrated information systems and co-ordinated financing arrangements. This chapter explains the importance of strengthening the governance of the skills system and provides an overview of Kazakhstan’s current practices and performance in this area. It then explores three opportunities to strengthen skills governance: strengthening co-ordination and co-operation across the whole of government; strengthening stakeholder engagement in skills policies; and better aligning and co-ordinating financing arrangements.
Effective governance arrangements are central to effective skills policies and creating a resilient skills system. The skills policy priorities discussed in the previous chapters will only realise their full potential if accompanied by supportive governance arrangements. The policy responses to the economic crisis resulting from the coronavirus (COVID-19) pandemic also require strong governance arrangements, as many challenges of Kazakhstan’s skills system might be exacerbated.
For the purpose of this chapter, skills policies refer to the set of measures to improve the development and use of skills throughout the life course. Policy areas related to the development of skills include compulsory schooling, vocational education and training (VET), higher education (HE), training for enterprises and adult learning opportunities. Policy areas related to the use of skills include activation policies, such as active labour market programmes (ALMPs) and policies to disseminate better management and work practices in workplaces.
Skills policies contribute to societal as well as economic goals by both fostering economic development, as evidenced through key indicators like wages, productivity, growth and export performance, and reducing unemployment and wage inequality (OECD, 2020[1]).The governance of skills policies is therefore complex, involving a wide range of actors in the provision, financing, reform and day-to-day administration, from different levels of government to stakeholders such as employers, employees, their associations, education and training providers, representatives of civil society and local communities.
To manage their complex interactions, effective governance needs to be multilevel and agile. Multilevel governance involves creating a set of arrangements for making binding decisions that engage a multiplicity of interdependent actors at different levels of territorial aggregation through continuous negotiation, deliberation and implementation (Schmitter, Wiener and Diez, 2018[2]). Agile governance enables policy makers to rapidly gather input from a variety of stakeholders to design cross-cutting policy solutions (World Economic Forum, 2019[3]). The COVID-19 pandemic has highlighted the importance of having agile governance arrangements, as different ministries in Kazakhstan, as in other countries, have had to quickly design policies to solve shared challenges, such as supporting access to learning opportunities and skills activation. Agile governance arrangements will also prove crucial to increase the resilience of the skills system in the context of megatrends, such as digitalisation, by enabling Kazakhstan to rapidly adapt to new circumstances (World Economic Forum, 2019[3]).
The OECD Skills Strategy 2019 (OECD, 2019[4]) identifies four pillars on which well-functioning governance arrangements are built (see Figure 5.1). These four pillars can be seen as enabling conditions for other skills policy areas (OECD, 2019[4]):
The first pillar captures co-ordination across the whole of government (a “whole-of-government approach”). This includes “vertical” co-ordination between different levels of government as well as “horizontal” co-ordination between different departments of government that are either directly responsible for skills policy or impact on skills policies. It also captures whether horizontal and vertical co-ordination are supported by effective assessment and monitoring practices.
The second pillar emphasises the importance of stakeholder engagement in skills policies. These non-governmental stakeholders include employers and their associations, trade unions as well as education and training providers, students, and the voluntary and community sector.
The third pillar recognises that an integrated information system to assess (future) skills needs is necessary to cope with the inherent complexity and uncertainty present in skills policy.
The final pillar captures the necessity of aligning and co-ordinating financing arrangements within skills policy.
Given its particular importance in Kazakhstan’s context, building an effective skills information system is discussed separately in Chapter 4. This chapter focuses on the three remaining pillars: promoting co-ordination and co-operation across the whole of government; engaging stakeholders throughout the policy cycle; and aligning and co-ordinating financing arrangements. This chapter first provides an overview of Kazakhstan’s skills governance system and performance across these three pillars. Subsequently, it identifies opportunities that can help Kazakhstan to strengthen the governance of its skills system, based on desk research and discussions with government and stakeholder representatives (participants) consulted during the OECD Skills Strategy project.
Current arrangements for the governance of skills policies
Promoting co-operation and collaboration across the whole of government
Several ministries and government bodies play a role in skills policies in Kazakhstan, as in OECD countries and other countries (see Figure 5.2). The direction of skills policies is set by the president and the government through the Prime Minister Office. As described in Chapter 2, the Ministry of Labour and Social Protection of the Population (MLSPP) leads national policy formulation related to skills activation through active labour market programmes. Within the MLSPP, the Workforce Development Centre (WDC) is in charge of providing information and analytical support for public policies to regulate the labour market and implement active measures to promote employment, methodological support for local employment authorities and employment centres. As discussed in Chapter 3, the Ministry of Education and Science (MOES) is responsible for implementing a unified state policy in the field of education, while the Ministry of National Economy (MNE) leads and co-ordinates policies to support industrial development, which can contribute to increasing the intensity of skills use in workplaces.
The MLSPP supervises the design and implementation of the National Qualifications System (NQS) in co-operation with the MOES, other ministries and social partners. The Prime Minister Office is in charge of co-ordinating the development of the NQS through the National Council for Development of Social and Labour Sector (NCDSLS) established in December 2019, which is chaired by the deputy prime minister and includes vice ministers from all ministries. According to legislation, this council should also be responsible for co-ordination in the spheres of social protection of the population and in the development of the labour market.
As described in Chapter 1, the different ministries develop state programmes to deliver the objectives set by the president and the government through the Kazakhstan 2050 strategy. For instance, the MLSPP has taken the lead on the State Programme of Productive Employment and Mass Entrepreneurship Development 2017-2021 (Enbek) to promote skills activation, especially among vulnerable groups (see Chapter 2). The Ministry of Finance (MF) is responsible for funding the national programmes and for approving annual budgets related to education and skills policies. As well as implementing policies to support industrial development, the MNE co-ordinates the development of the state budget and oversees the co-ordination and monitoring of the national programmes.
At the local level, Kazakhstan is divided into 14 regions (oblystar), which are further split into 177 districts (akimats). Subnational authorities consist of local branches of the MLSPP and MOES and local representative bodies (maslikhats), and are mainly responsible for implementing policies as specified in the state programmes. The Kazakhstan 2050 strategy foresees the need to decentralise decision making from central to local government to improve accountability and better reflect regional differences. However, according to stakeholders, limited progress has been made on this decentralisation agenda.
Engaging stakeholders throughout the policy cycle
As in other countries, non-governmental stakeholders in Kazakhstan, such as representatives of civic society, employers and trade unions, play an important role in skills policies.
Since 2019, representatives from local communities, non-governmental organisations (NGOs) and media meet in the National Council of Public Trust to voice public opinion or to provide recommendations on ongoing reforms related to skills policy development, as well as other policy areas, at the presidential level.
The role of employers and trade unions in policy development is recognised in legislation. The National Chamber of Entrepreneurs (NCE or Atameken) accredits industry associations that can officially engage with government ministries on behalf of their members. These industry associations mainly represent the interests of large enterprises. According to the existing legislation, trade unions can engage in policy development by participating in consultations with government officials and employers at the national, regional and sectoral levels. At the national level, according to legislation, consultations on policy development should happen within the Tripartite Republican Commission, which includes no more than seven representatives of the Kazakhstan Government, trade unions and employers. Representatives from the NCE, the Federation of Trade Unions (FTU) and sectoral associations also sit in the recently established NCDSLS.
Employers play an important role in policy implementation, especially in vocational and education training (VET) and policies to promote entrepreneurship and skills use in enterprises. The NCE takes part in the accreditation of VET institutions, conducts independent qualification certification and plays an important role in the development of education materials and curricular framework for VET. The NCE also supports the MNE in the implementation of policies to promote innovation and growth by facilitating interactions between MNE and enterprises at the national and regional levels (see Chapter 3).
To strengthen employer involvement in the education and training system, Kazakhstan has taken two additional steps in the last few years. First, the MOES and MLSPP signed a memorandum of understanding with the NCE in 2014, which made it possible to establish dual education programmes and employer-led VET training centres and schools. Second, the Government of Kazakhstan has passed legislation to introduce public-private partnerships (PPPs), which have been found to be an effective way to facilitate co-operation between employers and educational institutions on skills development, especially in the case of VET and adult learning (ETF, 2020[5]). For the purpose of this report, PPPs indicate mechanisms for co-ordinating action and sharing responsibility between public and private stakeholders in skills, with a view to formulating, designing, financing, managing or sustaining engagements of common interest (ETF, 2020[5]). Kazakhstan’s law on public-private partnership (with amendments and additions as of 3 April 2019) sets the rights and obligations of public and private partners, state regulation in the field of PPPs, forms of participation in PPPs, general provisions by definition of a private partner and features of legal regulation.
As in other countries, employers also play a crucial role in the development of the NQS (see Box 5.1 for a definition). As well as in the NCDSLS, employer representatives sit in the sector skills councils (SSCs), which are in charge of developing Sectoral Qualification Frameworks (SQFs). As in many other countries, Kazakhstan has developed a National Qualifications Framework (NQF) to help employers and other stakeholders develop SQFs, occupational standards and educational programmes. The NQF is aligned to the European Qualifications Framework (EQF) and includes eight levels. As in the EQF, outcomes are divided into three groups: knowledge, abilities, competencies and ability to describe theoretical knowledge; practical and technical skills; and social competencies.
In the context of this report, the NQS refers to all the structures and activities that lead to the award of a qualification, including, among other things, comprehensive institutional arrangements. Such activities are related to recognition of learning outcomes and other mechanisms that link education and training to the labour market and civil society. Other activities of the NQF include the definition of qualification policy, training design and implementation, funding, quality assurance; assessment, validation and certification of learning outcomes. The NQF is an instrument for the development and classification of qualifications (e.g. at national or sectoral level) according to a set of criteria (e.g. using descriptors) applicable to specified levels of learning outcomes.
Source: Cedefop (2011[6]), Glossary Quality in Education and Training, https://www.cedefop.europa.eu/files/4106_en.pdf.
Aligning and co-ordinating financing arrangements
In Kazakhstan, public expenditure accounts for a substantial share of total expenditure on education policies. According to data from the World Bank, public expenditure accounted for 85% of spending on primary, secondary and tertiary education in 2018 (World Bank, 2020[7]). The allocations of public expenditure across different ministries are conducted through the Ministry of Finance’s Budget Committee. The Budget Committee approves state and programme budgets (such as for Enbek programme) on an annual basis, with a three-year rolling forecast. For education policies, the MOES distributes the funding according to funding formulas and state grants, but the process differs across level of education, as in other countries. For primary, secondary and VET, the MOES distributes funding to local authorities, which then allocates it to the institutions. For tertiary education, the MOES distributes the funding directly to institutions through a funding formula and to students through state scholarships.
There is limited information on the financing of adult learning opportunities (see Chapter 3). As described in Chapters 2 and 3, the MLSPP funds the Enbek programme, which provides learning opportunities for vulnerable groups, such as the unemployed, workers younger than 29, self-employed and individuals with no formal education, whereas companies are responsible for organising their own training depending on the size and capacity of their business. Large firms, which account for more than 50% of total formal employment, often establish their own training centres to meet the sector’s needs at their own expense, whereas smaller firms often struggle (see Chapter 3). As discussed in Chapter 2, local authorities receive funding from the MLSPP to implement ALMPs. The amount of the transfer is proportional to the size of the local active populations but is often adjusted to reflect specific regional development priorities.
Performance in the governance of its skills system
Promoting co-operation and collaboration across the whole of government
Effective horizontal and vertical co-operation and collaboration arrangements are crucial to ensure that countries develop and implement policies that are coherent, mutually reinforcing (i.e. complementary to each other) and sufficiently flexible to be able to deal with new challenges (OECD, 2020[1]). Even if effective collaboration and co-operation arrangements are in place, countries also need effective monitoring and evaluation mechanisms in place to assess the functioning of the skills system (OECD, 2020[1]).
Kazakhstan has room for improvement in both dimensions. First, as in other formerly centrally planned economies, Kazakhstan has inherited a top-down governance model that leaves little room for extensive horizontal co-ordination in policy development and implementation (OECD/The World Bank, 2015[8]; ETF, 2020[9]). In the last few years, there has been a transition towards a more inclusive governance model with increasing exchange and dialogue among government ministries and between central and local government (UNESCO, 2020[10]). However, there are no systemic institutional arrangements to guide horizontal co-operation and collaboration on skills policies. Co-operation and collaboration seem to take place on an ad hoc basis through formal mechanisms such as memorandums, based on synergies created by certain projects or in the context of ambitious policy goals, such as the development of the dual VET system. The recent introduction of the NCDSLS could increase co-ordination and co-operation among ministries, but it will require some adjustments (see Opportunity 1). Similarly, there are no effective mechanisms for vertical co-ordination and co-operation between central and local government. This might help explain why some government programmes, such as the Enbek programme often fail to take into account the needs of more remote regions (see Chapters 2 and 3).
These insights are corroborated by the work of the European Training Foundation (ETF), which has undertaken considerable analysis on the governance of the VET system (ETF, 2019[11]). As part of its ongoing work with partner countries, ETF governance experts have assessed the strength of horizontal and vertical governance arrangements for the VET system for four countries in Central Asia (Kazakhstan, Kyrgyzstan, Tajikistan and Uzbekistan). The ETF framework ranks the performance of countries across four categories: “low”, “medium”, “high” or “outstanding”. Kazakhstan scored medium on both dimensions, while the other three countries scored low. This suggests that, although Kazakhstan has considerable room for improving VET horizontal and vertical governance, it could still be considered as a leading performer in the region (ETF, 2019[11]).
Second, when it comes to assessment and monitoring practices, Kazakhstan has room for improvement. There are limited resources for the assessment and monitoring of government policies, and very few evaluations are carried out across the different areas of the skills system. As remarked in Chapter 2, evaluations on the impact of ALMPs are not common in Kazakhstan, making it difficult to understand which programmes deliver the best value for money. Similarly, there is limited evidence on the effectiveness of different adult learning programmes (see Chapter 3). The work by the ETF also confirms that the lack of systematic monitoring and assessment applies to VET policies (ETF, 2020[9]). Kazakhstan has also struggled in designing an effective system of quality assurance for non-formal educational institutions (see Chapter 3), schools, VET colleges and HE institutions (OECD, 2017[12]; ETF, 2020[9]; OECD, 2020[13]).
Engaging stakeholders throughout the policy cycle
Engaging non-governmental stakeholders is an effective instrument to support policy makers in dealing with the inherent complexities of skills policies. Stakeholders contribute valuable information to the development of skills policies that is difficult for policy makers to access themselves. For instance, non-government stakeholders have experience regarding the real-world effects of policies and regulations, which might be quite different from the steering effects that governmental policy makers initially intended (OECD, 2020[1]). Engaging stakeholders in policy development can also contribute to increased trust and transparency in decision making (OECD, 2020[1]). Stakeholders can then play an important role in supporting policy implementation. For example, employers can provide adult learning opportunities in the workplace (see Chapter 3) or apprenticeships to young people through dual education (OECD, 2020[1]).
Engaging non-governmental stakeholders, such as employers and trade unions, is particularly important to support the development of the NQS because they can provide information on what skills are required across different qualifications and occupations (ETF, 2017[14]). The analysis gathered by the OECD team suggests that Kazakhstan should better co-ordinate stakeholder engagement in the development of the NQS.
Fuelled by the need to develop high-quality qualifications that could meet labour market demand, Kazakhstan has made substantial progress in the development of the NQS over the past decade. With support from the World Bank, Kazakhstan launched projects for the targeted development of occupational standards, which led to the creation of around 36 SQFs (UNESCO Institute for Lifelong Learning, ETF and Cedefop, 2015[15]). These SQFs have been consolidated into the national system, however the system is still fragmented and not yet fully utilised. This fragmentation contributes to weak linkages among the VET and HE sectors in the Kazakh NQF. The levels 6-8 form a sub-system managed by HE institutions, which are bound to implement the Qualifications Framework for the European Higher Education Area (QF-EHEA). This is necessary as Kazakhstan joined the Bologna process in 2011 (UNESCO Institute for Lifelong Learning, ETF and Cedefop, 2015[15]).
More broadly, Kazakhstan has the potential to improve stakeholder engagement throughout the policy cycle, both in policy development and implementation.
Kazakhstan has already made progress in strengthening stakeholder engagement in policy development in recent years (UNESCO, 2020[10]). It has made increasing use of dialogue and stakeholder co-operation practices, engaging civil society and citizens in public consultations (UNESCO, 2020[10]). For example, the National Council of Public Trust meets regularly to discuss ongoing reforms and offer new initiatives related to skills policies, as well as other policy areas. A meeting in June 2019 was focused on discussion around human capital development and further reformation of the education sector (Akorda, 2020[16]).
Employers and trade unions have also been increasingly active trying to shape the direction and implementation of skills policies. According to the consultations conducted by the OECD team during the OECD Skills Strategy project, the NCE has a strong reputation and is actively involved in the policy debate on developing and using skills. The OECD team also found that trade unions have a strong willingness and motivation to become more involved in the skills policy debate. For example, the latest strategy by the FTU places a strong emphasis on improving co-operation with government and employers in the development of the NQS and ensuring that education meets the needs of the labour market.
However, there seem to be two barriers to creating effective stakeholder engagement in policy development. First, the approach to stakeholder engagement to inform policy development needs to be more unified and systematic, especially in the case of employers and trade unions. Discussions with employers and trade unions seem to happen on an ad hoc basis, without a coherent and structured process. The recent introduction of the NCDSLS could provide a platform to engage employers and trade unions in policy development, but it will require some adjustments (see Opportunity 1). Second, policy makers in ministries need to collectively shift their mindsets when it comes to their understanding of the role of stakeholders and how best to engage with them. Specifically, they need to transition from viewing stakeholder perspectives as external demands that need to be managed to viewing them as contributions made in the common public interest. As well as generating better policy outcomes, this could also contribute to improving the transparency and accountability of skills policies, which has been signalled as an issue by many active stakeholders in the country.
When it comes to improving stakeholder engagement in policy implementation, Kazakhstan could strengthen employer involvement in the provision of VET and adult learning opportunities (see Chapter 3). As discussed in Chapter 3, large employers could strengthen the intensity of training and better incorporate foundational and soft skills in their training programmes, whereas more small and medium-sized enterprises (SMEs) could engage in training. In the case of VET, there is potential to expand the role of dual education. Following the memorandum of understanding signed in 2014, Kazakhstan has started to make progress in the implementation of the dual system of technical education. However, so far only 10% of VET students are enrolled on a dual track, which is still far from the objective of creating “a core of a national system of dual technical and professional education” stated in the Kazakhstan 2050 strategy (ETF, 2020[9]). PPPs could play an important role in making further progress in these two areas by offering a framework to organise co-operation between public and private actors (ETF, 2020[5]).
Aligning and co-ordinating financing arrangements
Aligning and co-ordinating financing arrangements is crucial for an effective skills policy. First, countries should provide adequate resources for skills policies by setting long-term budgetary goals and distributing them effectively. When distributing these resources, they then need to bear in mind equity, as well as efficiency considerations. Second, countries should diversify financing arrangements by tapping into multiple sources of funding, for instance, from employers, to complement public funding raised from taxation (OECD, 2020[1]).
Kazakhstan does not seem to provide sufficient resources to primary, secondary and tertiary institutions when compared to neighbouring countries, other upper middle income countries and top-performing OECD countries (see Figure 5.3). According to World Bank data, Kazakhstan spends approximately 3.4% of its gross domestic product (GDP) on primary, secondary and tertiary education. This is below the OECD average (4.6%), neighbouring countries such as Uzbekistan (5.7%) and Tajikistan (5.2%) and upper middle income countries such as Mexico (6.2%) and Peru (6.9%). Across countries, there is substantial variation in the relative contributions from government and households. Kazakhstan seems to perform broadly around the average for spending by households, whereas government spending is below every country in the comparison group.
This level of relative underspending on education also remains when government expenditure per student is used as a measure. Kazakhstan spends less per student (as percentage of GDP per capita) than the OECD average, neighbouring countries and upper middle income countries (excluding Ecuador), both across primary and secondary education, and tertiary education (see Figure 5.4).
When it comes to adult learning, as discussed in Chapter 3, the evidence is more limited. Across OECD countries, employers account for a large share of adult learning opportunities. The available evidence suggests that both large enterprises and SMEs under-invest in training, compared to upper middle income and OECD countries (see Chapter 3). Similarly, as described in Chapter 2, Kazakhstan seems to under-invest in ALMPs, especially in the provision of training opportunities.
Increasing the funding for skills policies will likely depend on tapping into multiple sources or raising additional tax revenues. Kazakhstan is already spending a substantial proportion of total government expenditure on primary, secondary and tertiary education (see Figure 5.5). This implies that there might be limited scope to shift resources away from other policy areas towards skills policies. To some extent, improving the funding for skills policies will depend on increasing financial contributions from employers by strengthening the use of financial incentive schemes. The evidence gathered during the OECD Skills Strategy project suggests that Kazakhstan is making limited use of financial incentives, such as tax deductions, subsidies and levies, which can help increase investment from employers on skills development.
This section describes three opportunities to strengthen the governance of the skills system in Kazakhstan. It is based on input from literature, desk research, discussions with Kazakhstan’s national project team, discussions with stakeholders in workshops in Nur-Sultan and Almaty, as well as virtual meetings involving more than 100 stakeholders. In light of this evidence, the following opportunities are considered to be the most relevant for the specific context in Kazakhstan to strengthen the governance of its skills system:
Opportunity 1: Strengthening co-ordination and co-operation across the whole of government
Opportunity 2: Strengthening stakeholder engagement in skills policies
Opportunity 3: Better aligning and co-ordinating financing arrangements.
Opportunity 1: Strengthening co-ordination and co-operation across the whole of government
Strong governance arrangements first require effective co-ordination and co-operation across the whole of government. As discussed in the performance section, horizontal co-ordination and co-operation on skills policies at the central government level in Kazakhstan are fragmented and tend to rely on formal mechanisms, such as memorandums. Kazakhstan has also faced difficulties in monitoring and evaluating the functioning of the skills system. Building on these findings, this opportunity first explores how to improve horizontal and vertical co-ordination and co-operation on skills policies. Then, it considers how Kazakhstan can implement better monitoring and evaluation mechanisms, with regard to the effectiveness of skills policies and the quality of education and training institutions.
Improving co-operation and collaboration on skills policies
Ministers and government agencies in Kazakhstan have shown an increasing willingness to strengthen co-operation and collaboration in the design and implementation of skills policies. As seen in the description of current arrangements, for instance, the MLSPP and MOES have signed a memorandum to guide co-operation on the provision of VET. There has also been some progress in inter-ministerial collaboration in the development of the NQS (see Opportunity 2).
However, in at least three important skills policy areas, co-operation and collaboration are not in place. Adult learning policies are currently implemented in Kazakhstan by the MOES, the MLSPP and the MNE. The MOES is responsible for HE and VET, the MLSPP oversees training opportunities offered within active labour market policies, and the MNE and the NCE are responsible for training opportunities for SMEs (see Chapter 3). Large firms also play an important role by running private, stand-alone centres for their employees (see Chapter 3). There is currently no formal mechanism to guide co-operation and collaboration on adult learning policies, leading to potential duplication and unexploited synergies between different initiatives. The second area is the production and dissemination of information on labour market and skills, including information on current and future labour market needs from skills assessment and anticipation (SAA) exercises, as well as study and career opportunities for individuals (see Chapter 4). Currently, the production of SAA tools is under the responsibility of the MLSPP. According to stakeholders consulted during the missions, other governmental bodies that may require the use of forecasts to inform policy development, such as the MOES, are not involved in their governance and do not have access to the underlying data. Similarly, there is little co-ordination on strategies to disseminate information on the labour market and skills between the MLSPP, the MOES and other relevant governmental actors, such as education and training institutions or local government bodies. The third area is the assessment and monitoring of skills policies, which is discussed in depth in the following section.
In principle, the recent introduction of the NCDSLS could foster horizontal co-operation in these three areas and across skills policies broadly. However, its current set-up is not fit for purpose for two reasons. First, its remit only covers explicitly the development of the NQS, whereas other policy areas where co-ordination is missing, such as adult learning and the production of SAA tools, are not mentioned in the underlying legislation. Second, the council lacks mechanisms to ensure that co-ordination at the vice-ministerial level translates in co-ordination and co-operation among policy makers involved in policy design and implementation.
To overcome these shortcomings, Kazakhstan could transform the NCDSLS into a Skills Policy Council, as, for example, in Norway (see Box 5.2), by taking two additional steps. First, Kazakhstan should clarify which policy areas, besides the development of the NQS, should be covered by the remit of the council, by conducting a review of institutional arrangements (RIA), which is a structured process for assessing the capacity of different ministers to implement the specific measures assigned to them (ETF, 2014[17]). The RIA could help clarify existing overlaps in goals and responsibilities across ministers involved in skills policies, providing useful evidence on areas where co-ordination should be strengthened. The RIA should be a collaborative effort, involving officials from central government, experts and stakeholders. This means that the process underlying the RIA could lead to building a clearer vision and a consensus on how to modernise governance arrangements in the country.
Second, following the RIA results, Kazakhstan should establish inter-ministerial working groups or technical bodies to ensure that high-level strategic co-ordination at the vice-ministerial level can be complemented by co-ordination and co-operation among policy makers involved in policy design and implementation. Based on the evidence gathered during this project, Kazakhstan could introduce three separate inter-ministerial working groups, responsible for: 1) adult learning policies (see Chapter 3); 2) the production and dissemination of information on the labour market and skills (see Chapter 4); 3) monitoring skills policies (see the following section). Kazakhstan could also introduce a technical body responsible for the development of the NQS (see Opportunity 2). The three inter-ministerial working groups should share information with the NCDSLS to help prepare the meetings and receive feedback from the NCDSLS on their initiatives, whereas the technical body should report to the NCDSLS directly (see Opportunity 2). These proposed arrangements are shown in Figure 5.6. Clearly, the results of the RIA might provide evidence to further refine these proposed arrangements.
As well as improving horizontal co-ordination and co-operation at the ministerial level, Kazakhstan should increase vertical co-ordination and co-operation on skills policies between central and local government. While some skills policies are best overseen and designed at a central level, such as the development of the NQS, other initiatives, particularly those related to the implementation of education and training programmes, could benefit from being tailored to local needs. Kazakhstan exhibits substantial variation in the levels of GDP per capita and skill and labour market outcomes by region. The latest PISA data show large regional differences in reading performance, with more rural, poorer regions attaining scores more than 40 points lower than urban and richer regions (OECD, 2020[13]). These differences are very large, as one year of schooling on average across OECD countries is equal to 40 points (OECD, 2019[18]). Similarly, as shown in Chapter 3, there are significant differences in the proportion of low achievers in reading, numeracy and digital skills across adults in urban and rural areas. These gaps in skills outcomes also mirror divergences in skills activation and labour market performance (see Chapter 2). However, the current design and implementation of skills policies do not fully reflect these regional differences. For instance, as discussed in Chapter 3, according to stakeholders consulted during the OECD Skills Strategy project, the Enbek programme has not managed to support training opportunities aligned with regional needs.
To a significant extent, this lack of co-ordination and co-operation is the result of the current governance structure, in which regional authorities are mainly required to implement priorities and policies designed by the central government. Further decentralisation as foreseen in the Kazakhstan 2050 strategy could contribute to improving the effectiveness and flexibility of skills policies. For example, the local representative bodies (maslikhats) could gradually acquire more responsibility in designing and overseeing skills policies.
To make progress in the decentralisation agenda, Kazakhstan could conduct pilot projects to deliver regional skills strategies, for instance, as in Scotland (United Kingdom) or Sweden (see Box 5.2). The creation of the regional skills strategies could be overseen by regional skills hubs, involving local government bodies, local branches of the MLSPP and MOES, the NCE and educational institutions. More broadly, Kazakhstan could benefit from the experiences of Ukraine, which has been working with the Swedish Association of Local Authorities and Regions (SALAR) to pursue the decentralisation agenda (see Box 5.2).
Establishing inter-ministerial committees: An example from Norway
In order to improve governance arrangements in Norway, the Norwegian Strategy for Skills Policy 2017-2021 (Nasjonal Kompetansepolitisk Strategi) included the implementation of the Skills Policy Council. According to its mandate, the council’s purpose is to implement the strategy and to promote co-operation between the involved stakeholders. The governmental stakeholders include all ministries involved in skills policy (Ministry of Labour and Social Affairs; the Ministry of Local Government and Modernisation; the Ministry of Education and Research; the Ministry of Trade, Industry and Fisheries; the Sami parliament), as well as Skills Norway – an arms-length body specialised in lifelong learning. Including non-governmental stakeholders (e.g. social partners), the Skills Policy Council has 15 members. The council’s activities include regular discussions and advice on current skills policy issues, regular reports on the strategy partners’ own policy measures to implement the strategy, as well as potential revisions to the strategy if needed. High-level discussions at ministerial level are supplemented by working-level discussions among civil servants, thereby ensuring that skills are on the agenda of decision makers, and that concrete outputs in terms of policy making are met.
Regional skills strategies: Examples from Scotland and Sweden
Many countries have developed regional skills strategies as part of their local development plans. In Scotland, the national skills body – Skills Development Scotland (SDS) – has produced a series of regional skills strategies to tailor skills development more closely to local labour market conditions. The Regional Skills Strategy for Aberdeen City & Shire, for example, is grounded firmly in the need to diversify the region away from the oil and gas sector, which is suffering an economic downturn that is likely to be permanent. The strategy has been developed to work alongside and support other strategies for the area, including the Regional Economic Strategy and the signed Aberdeen City Region Deal. SDS consulted a range of local partners and stakeholders to formulate the strategy, including local government universities and chambers of commerce.
In Sweden, regional smart specialisation strategies play an important role in supporting local research and innovation efforts. The strategies follow the European Smart Specialisation Platform guide by including analysis, monitoring and assessment, implementation procedures, priorities and an overarching vision. Industry, academy and civil society contributed to the strategies and helped identify priority sectors in which the region has a competitive advantage and where efforts should focus. A range of thematic programmes is linked to these priority areas where regional stakeholders can seek funding for collaborative projects and research and innovation milieus, as well as test-beds and demonstration projects.
Bringing forward the decentralisation agenda: The Swedish-Ukraine co-operation
The Support to Decentralisation in Ukraine initiative (DSP) is an innovative multi-year programme of support from Sweden to help improve and deliver Ukraine’s decentralisation agenda. Sweden has a long history of effective decentralisation within the education sector, which it can draw on to provide support for Ukraine. The DSP is run by Sveriges Kommuner och Landsting (SKL) International, which is overseen by the Swedish Association of Local Authorities and Regions (SALAR) and is funded by Swedish and international aid agencies. SKL International focuses on the development of well-functioning local and regional administrations abroad. In Ukraine, the DSP is centred around improving fiscal decentralisation, education decentralisation, reform process management and co-ordination, and how to successfully communicate these reforms to stakeholders and the wider public. A joint Swedish-Ukrainian Secretariat was set up in Kiev to work closely with Ukrainian ministries to ensure the project was capable of responding to emerging needs and priorities for the Ukrainian government. The project has helped create the legal basis for decentralised education through input in drafting the Framework Law on Education; engaged in capacity building at the MES Institute for Education Analytics; and launched a serious of regional pilots to share best practices with Ukrainian counterparts.
Source: Skills Development Scotland (2018[19]), Regional Skills Strategy Aberdeen City & Shire, https://www.skillsdevelopmentscotland.co.uk/media/44785/aberdeen_city_and_shire_regional_skills_strategy.pdf; OECD (2017[20]), Education Policy Outlook: Sweden, http://www.oecd.org/education/Education-Policy-Outlook-Country-Profile-Sweden.pdf; EURYDICE (2020[21]), Sweden: Organisation of the Education System and of its Structure, https://eacea.ec.europa.eu/national-policies/eurydice/content/organisation-education-system-and-its-structure-80_en; Västra Götalandsregionen (2016[22]), Smart Specialisation in Västra Götaland, https://s3platform.jrc.ec.europa.eu/documents/20182/232763/SE_V%C3%A4stra+G%C3% B6taland_RIS3_Final.pdf/700f7d05-afb1-4d13-9abb-94bb3e38a484; SKL International (2020[23]), Ukraine – Support to Decentralisation, https://sklinternational.se/projects/projekt/ukrainesupporttodecentralization.739.html.
4.1. Strengthen the remit of the National Council for Development of Social and Labour Sector by specifying a clearly defined mandate and introducing a combination of inter-ministerial working groups and technical bodies. Kazakhstan could transform the NCDSLS into a Skills Policy Council (e.g. as in Norway). The Government of Kazakhstan should launch a review of institutional arrangements (RIA) to clarify existing overlaps in goals and responsibilities across ministries involved in skills policies specifically. The Government of Kazakhstan could then introduce inter-ministerial working groups or technical bodies to promote co-ordination and co-operation among policy makers involved in policy design and implementation. Based on the evidence gathered during the OECD Skills Strategy project, Kazakhstan could introduce three separate inter-ministerial working groups responsible for: 1) adult learning policies (see Chapter 3); 2) production and dissemination of information on the labour market and skills (see Chapter 4); 3) monitoring skills policies (see the following section). Kazakhstan should also establish a technical body responsible for co-ordinating the development of the NQS (see Opportunity 2). The three inter-ministerial working groups should share information with the NCDSLS to help prepare the meetings and receive feedback from the NCDSLS on their initiatives, whereas the technical agency should report to the NCDSLS directly (see Opportunity 2).
4.2. Gradually increase the responsibilities and capacities of local government in delivering skills policies, starting with the launch of regional skills strategies. In the short term, the Government of Kazakhstan could form regional skills hubs to pilot regional skills strategies (e.g. as in Scotland or Sweden). The hubs could be led by a local co-ordinator, who would be responsible for liaising with the central government to ensure alignment with central government priorities. The hubs could involve representatives from local government bodies, local branches of the MLSPP and MOES, the NCE and educational institutions, as in Sweden and Scotland. To produce a clear roadmap for the decentralisation agenda, the Government of Kazakhstan could also consider starting an international collaboration with a country that has undertaken similar reforms (e.g. as between Ukraine and Sweden).
Implementing better monitoring and evaluation mechanisms
Previous chapters in this report have highlighted that Kazakhstan has substantial room for improvement in the evaluation of skills policies. As foreshadowed in the performance section, several stakeholders reported that very limited evaluations of the impact of active labour market programmes are carried out in Kazakhstan (see Chapter 2). Moreover, even when the evaluations are carried out, the results are unlikely to be used to inform relevant policies to facilitate progress towards good practices. As discussed in Chapter 3, there is also limited evidence on the outcomes of different adult learning programmes. For instance, it is not clear whether short-term courses delivered with the Enbek programme result in actual skills gains for participants.
To some extent, limited evaluation might depend on the lack of easily accessible data on labour market and skills policies (see Chapter 4). However, even as more data become available, it would be useful to develop a common framework to assess and evaluate the effectiveness of skills policies. This common framework can help policy makers monitor and evaluate skills policies by specifying principles and methods that they should rely upon. An example from OECD countries are the resources, information and tools produced by the federal government in Canada (see Box 5.3). A similar harmonised framework could be applied to all state programmes delivered within the context of the Kazakhstan 2050 strategy that focus on skills policies. To further increase co-operation among policy makers, the framework could be drafted by an inter-ministerial working group, as Brazil’s Committee for Monitoring and Evaluation of Federal Public Policies does, for example (see Box 5.3). This inter-ministerial working group could become part of the Skills Policy Council and report back to the NCDSLS (see the previous section).
As well as implementing a common framework to evaluate government policies, Kazakhstan could make further progress in assessing and monitoring the quality of education and training institutions across the skills system. Chapter 3 highlights that Kazakhstan does not have a strong system of quality assurance in place for providers offering non-formal learning opportunities. Recent research by the OECD and the European Training Foundation suggests that the problem extends to compulsory education, VET and HE (OECD, 2017[12]; ETF, 2020[9]; OECD, 2020[13]).
According to the recent series of OECD Education Policy Perspectives on Kazakhstan, the country does not currently have an active school evaluation framework, which is a set of explicitly related policies that cover how school quality will be evaluated. The Committee for Quality Assurance in Education and Science in the MOES carries out school visits, but these are mainly concerned with evaluating compliance with legislative standards. In the past five years, Kazakhstan has developed a “school review”, which focuses on assessing teaching and learning in schools and supporting school improvement. To help implement this new framework, the OECD has recommended establishing a separate school inspectorate, because schools currently regard the Committee for Quality Assurance in Education and Science with anxiety and do not like interacting with it for fear of reprisal (OECD, 2020[13]).
According to the OECD’s Higher Education in Kazakhstan 2017, the system of external quality assurance fails to effectively monitor the conduct of HE institutions, due to high levels of fragmentation. In Kazakhstan, the quality of HE institutions and programmes is recognised by independent accreditation agencies (OECD, 2017[12]). The speed with which these agencies have accredited HE institutions and programmes, however, has raised concern about the thoroughness of the external quality checks being undertaken (OECD, 2017[12]). Accreditation agencies are not required to adopt uniform standards. While some agencies have high standards for the accreditation process, meeting European standards and guidelines, this is not necessarily the case for all agencies (OECD, 2017[12]). To help strengthen external quality assurance, the OECD HE review for Kazakhstan has recommended setting achievable and realistic targets and metrics for assessing the quality of different types of institutions (OECD, 2017[12]). These measures could be combined with initiatives to strengthen quality assurance at the institutional level, for instance, by conducting cyclical reviews of academic programmes (OECD, 2017[12]).
The situation is potentially more problematic in vocational education and training. According to the ETF Torino Process report, there is no specific quality assurance system for VET institutions (ETF, 2020[9]). Existing external quality assurance tools, such as obtaining accreditation with an agency to provide vocational training, are either too expensive, or they are no longer compulsory (ETF, 2020[9]). In light of these findings, the ETF has recommended upgrading the quality assurance system in VET (ETF, 2020[9]).
Implementing these recommendations is crucial to ensure that different segments of the skills system develop a strong quality assurance framework. However, they should not be implemented in isolation, as doing so risks leading to duplication of work and lack of policy coherence. Kazakhstan could consider introducing an intra-ministerial working group on quality assurance within the MOES, comprising policy makers involved in quality assurance in compulsory education, VET, HE and adult learning. The group could develop common principles for internal and external quality assurance standards and their implementation at the institutional level, as the National Center for Educational Quality Enhancement (NCEQE) in Georgia does (see Box 5.3).
Improving monitoring and evaluation of government policies: Examples from Canada and Brazil
In Canada, the Results Division of the Treasury Board of Canada Secretariat is responsible for evaluation activities, under the 2016 Policy on Results. The division offers useful resources, information and tools to government professionals and anyone else interested in evaluation at the federal level. Overall, the Treasury Board of Canada Secretariat has functional leadership regarding the implementation, use and development of evaluation practices across government. To support evaluation practices, the Results Division offers a number of useful guidelines, such as a “Guide to Rapid Impact Evaluation” (RIE), which provides a range of methods for conducting RIE and advice on when and how it can be used in government, as well as “Theory-Based Approaches to Evaluation: Concepts and Practices”, which introduces key concepts of theory-based approaches to evaluation and their application to federal programmes.
In 2016, Brazil established the Committee for Monitoring and Evaluation of Federal Public Policies (CMAP) with the objective of encouraging the use of evaluation results to improve public policy outcomes and performance, the allocation of resources, and the quality of public spending. The committee involves representatives from various ministries, who meet periodically to monitor and evaluate the public policies selected by CMAP and accordingly propose alternative designs and adjustments to them. All policy makers in charge of the evaluated policies are invited to participate in CMAP’s evaluation activities.
Quality assurance systems: An example from Georgia
In 2010, Georgia established the National Center for Educational Quality Enhancement (NCEQE), which is the only authorised quality assurance agency in the country. NCEQE implements and develops external and internal quality assurance mechanisms, supports the creation of educational programmes, and provides relevant recommendations for HE institutions. The NCEQE develops the education quality concept, creates and maintains up-to-date quality assurance standards and arranges their proper implementation on both the institutional and programme level.
Source: Centre of Excellence for Evaluation of the Treasury Board of Canada Secretariat (2020[24]), Guide to Rapid Impact Evaluation, https://www.canada.ca/en/treasury-board-secretariat/services/audit-evaluation/evaluation-government-canada/guide-rapid-impact-evaluation.html; Centre of Excellence for Evaluation of the Treasury Board of Canada Secretariat (2020[25]), Theory-Based Approaches to Evaluation: Concepts and Practices, https://www.canada.ca/en/treasury-board-secretariat/services/audit-evaluation/centre-excellence-evaluation/theory-based-approaches-evaluation-concepts-practices.html; Treasury Board of Canada Secretariat (2016[26]), Policy on Results, https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=31300; OECD (2020[27]), Improving Governance with Policy Evaluation: Lessons From Country Experiences, https://dx.doi.org/10.1787/89b1577d-en; National Center for Educational Quality Enhancement (2020[28]), About Us, https://eqe.ge/eng/static/5/about-us.
4.3. Establish a common evaluation and assessment framework for skills policies to help inform future strategies via an inter-ministerial working group. The Government of Kazakhstan should form an inter-ministerial working group to develop a framework to monitor and evaluate skills policies. The framework should specify principles and methods to be used in the evaluations of state programmes linked to the Kazakhstan 2050 strategy. The inter-ministerial working group could become part of the Skills Policy Council (see the previous section) and should share information on the development of the framework with the NCDSLS and receive feedback to further strengthen it.
4.4. Develop common principles for the quality assurance of educational institutions and training providers via an intra-ministerial working group within the Ministry of Education and Science. The MOES should introduce an intra-ministerial working group responsible for developing common principles for internal and external quality assurance standards and their implementation at the institutional level in compulsory education, VET, HE and adult learning (see Chapter 3). The working group should actively engage with educational institutions and other relevant stakeholders, such as employers, to gather their perspectives on the common principles.
Opportunity 2: Strengthening stakeholder engagement in skills policies
Improving horizontal and vertical co-ordination and co-operation across governmental actors is but one path to strong governance of skills policies. As foreshadowed in the performance section, Kazakhstan also needs to better co-ordinate stakeholder engagement to make further progress in the development of the NQS, which is considered a policy priority by the government. More broadly, Kazakhstan can benefit from more systematically involving employers and trade unions in policy development and implementation, while making further progress in engaging representatives from civic society in the debate on skills policies. In light of these insights, this opportunity first explores how to strengthen stakeholder engagement in the development of the NQS. Then, it considers how to improve stakeholder engagement throughout the policy cycle.
Strengthening stakeholder engagement in the development of the National Qualifications System
Developing the NQS requires a substantial degree of stakeholder engagement because social partners need to feed detailed information on what skills are required across different qualifications and occupations (ETF, 2017[14]).
Kazakhstan has made some progress in developing the NQS. Under the leadership of the NCE, sectoral associations have been quite active in developing occupational standards and qualification frameworks. As discussed in the performance section, a large number of sectoral standards and frameworks have been developed. However, according to stakeholders consulted during the OECD Skills Strategy project, there is no national register or database that centralises them, and there has been little oversight to reduce duplication and overlaps. Better co-ordination of the stakeholder engagement process is crucial to ensure that the frameworks and standards are merged into a coherent NQS with aligned educational programmes.
Kazakhstan has already taken three additional steps to make further progress in the development of the NQS. First, the MLSPP has developed a step-by-step roadmap (Roadmap for Development of National Qualifications System 2019-2025), which outlines specific actions, responsible parties and deadlines for the development of the NQS (Government of Kazakhstan, 2019[29]). Second, following the roadmap, Kazakhstan has introduced the NCDSLS, which, as foreshadowed in the description of current arrangements and Opportunity 1, could strengthen co-ordination in the development of the NQS at the vice-ministerial level. Third, the MOES, the MLSPP and the NCE committed to increasing their co-operation efforts via a memorandum signed in February 2020. The memorandum commits the three parties to developing and implementing a joint list of educational programmes and standard curricula based on approved occupational standards. To help translate this memorandum into action, the MOES and the MLSPP have also agreed to establish joint working groups and share information on standards and learning outcomes.
The roadmap has contributed to revamping the progress of NQS development, but Kazakhstan has struggled to implement some of its actions successfully. The MLSPP could not continue to co-ordinate the implementation of the roadmap in 2020, due to its critical shift in focus to develop an effective social policy response to the coronavirus (COVID-19) crisis. As a result, stakeholders involved in the NQS development do not yet have a common vision and are not yet working towards a clear set of objectives.
Going forward, the introduction of the NCDSLS and the memorandum are unlikely to be sufficient to strengthen co-ordination across stakeholders. The consolidation of the NQS is a time-consuming and complex process, which requires close interactions between experts from different fields, for instance, to review, update and merge different Sectoral Qualification Frameworks (ETF, 2017[14]). As discussed in Opportunity 1, the NCDSLS can only provide high-level strategic co-ordination at the vice-ministerial level. The joint working groups formed by MOES and the MLSPP could provide valuable input, but are unlikely to have the capacity to co-ordinate the whole process.
To strengthen co-ordination on the NQS development in the short term, Kazakhstan could establish a technical body reporting directly to the NCDSLS. Many countries have taken a similar route to finalise the development of the NQS (see Box 5.4). The technical body should include full-time staff, potentially on secondment, with different backgrounds (e.g. with experience in government or industry). The co-ordinator could be a skills policy expert with some managerial experience, reporting directly to the Deputy Prime Minister. The co-ordinator should start by revising the existing roadmap and allocating responsibilities across different stakeholders.
As well as introducing a technical agency to co-ordinate the NQS development, Kazakhstan should review the roles, composition and functioning of the sector skills councils. The OECD team could not gather sufficient evidence to assess their institutional performance. According to stakeholders, the functioning of SSCs is not a transparent system, and almost no information is available to the general public about how they operate and what outcomes they generate. The limited feedback that the OECD was able to gather suggests that their effectiveness and capacities vary across sectors. These councils could be a useful platform to co-ordinate stakeholder feedback on the development of the qualification framework by reviewing and updating occupational standards. They could also be involved in forecasting or validating forecasts from SAA tools (see Chapter 4) and in providing input on state programmes and specific policy initiatives (see the following section).
Setting up agencies to co-ordinate the NQS: Examples from Estonia and South Africa
Many OECD countries and other countries have set up agencies or technical bodies to supervise and co-ordinate the development of their national qualifications systems.
The occupational qualification system in Estonia is developed and administrated by a private legal entity – the Estonian Qualifications Authority (EQA). The EQA was established in 2001 to develop a competence-based professional qualifications system. In 2010, by decision of the Ministry of Education, the Qualifications Authority was nominated as the national qualifications framework co-ordination point to ensure the involvement of stakeholders and the transparency of the process; implement principles ensuring quality of the referencing process agreed in Europe; and inform all stakeholders and the public about developments involving the Estonian qualifications framework. The EQA co-ordinates the 14 sector skills councils and provides technical support. Typically, the following institutions are represented in sector skills councils: employers’ organisations; trade unions; professional associations; education and training institutions; and responsible government institutions. They are responsible for preparing, amending, renewing or approving professional standards, and for deciding on the linking of occupational qualifications to the NQF.
In South Africa, the South African Qualifications Authority (SAQA) is the oversight body of the South African National Qualifications Framework. SAQA is responsible for developing and implementing NQF policies and criteria. It also runs the National Learners’ Records Database and is responsible for informing the public about any changes to the NQF. Quality assurance is implemented in practice through Education and Training Quality Assurance bodies (ETQAs). These are accredited by SAQA to monitor and audit the provision, assessment and achievement of specified standards and/or qualifications in their sector of operation for a particular set of NQF qualifications and standards. ETQAs are then able to accredit learning providers to develop, deliver and evaluate learning programmes.
Source: Estonian Qualifications Authority (2020[30]), Estonian Qualifications Authority, https://www.kutsekoda.ee/en/; SAQA (2020[31]), What is the South African Qualifications Authority?, https://www.saqa.org.za/about-saqa.
4.5. Introduce a technical body to co-ordinate the development of the NQS. The Government of Kazakhstan should introduce a technical body to co-ordinate the development of the NQS, which would report directly to the NCDSLS. The body should be led by a co-ordinator with some managerial experience, who could report directly to the Deputy Prime Minister. The co-ordinator should start by revising the existing roadmap for the development of the NQS. The roadmap should specify the roles and responsibilities of different actors, such as the MOES, the MLSPP, the NCE and the SSCs.
4.6. Review the functioning of the sector skills councils to ensure that they have sufficient resources and capacities to support the development of the NQS. The NCDSLS, and if introduced, the technical body responsible for the NQS development should conduct a thorough review of the SSCs to assess whether their composition and resources are sufficient to gather information from employers and stakeholders in the development.
Improving stakeholder engagement throughout the policy cycle
Kazakhstan could strengthen stakeholder engagement beyond the development of the NQS, both in the case of policy development and implementation.
With regard to policy development, the current mechanisms to gather inputs from stakeholders are not sufficiently systematic. The recent introduction of the National Council of Public Trust could provide a useful framework to gather input from representatives of civic society in the development of skills policies at the presidential level. However, Kazakhstan does not seem to have well-functioning mechanisms to involve employers and trade unions in similar discussions. According to stakeholders consulted during the OECD Skills Policy project, the Tripartite Republican Commission does not play an active role in shaping policy discussions. Some active stakeholders had never heard of its existence. More broadly, when it comes to the development of the state programmes or other specific policy initiatives, there are no well-defined arrangements to engage employers, trade unions or civic society alike. Employers are represented by the NCE, which is designed to enhance the negotiation power of business with the Government of Kazakhstan and public authorities, but the process of development and implementation of existing programmes does not generally include consultations with non-governmental actors. According to stakeholders consulted during the project, engagement has an ad hoc nature, and the level of influence is low.
The introduction of the NCDSLS could allow Kazakhstan to make some progress on this front. The “Order of the Prime Minister of the Republic of Kazakhstan from 19 December 2019 No. 226-r” provides a legal basis for the involvement of stakeholders in the NCDSLS with the NCE, the Federation of Trade Unions, and various oil, gas and energy companies represented.
The position of external stakeholders in the NCDSLS can, however, be strengthened in three ways. First, a broader range of external stakeholders could sit in the council, including other sectors such as the service industry, regional representatives and social partners who work in skills-related fields. Second, the council meets on an ad hoc basis whenever there is the need, but Kazakhstan could consider mandating meetings to be held on a regular basis (such as every quarter) to ensure that external stakeholders have a regular forum to express their opinions. Third, Kazakhstan should ensure that relevant legal documents, minutes from previous meetings, and topics for discussion in the upcoming meeting are circulated in advance, so stakeholders have time to gather input from their organisations and prepare their stance on suggested reforms.
Kazakhstan could also consider strengthening the role of the Tripartite Republican Commission to increase engagement at the presidential level. In the case of the state programmes and more specific policy initiatives, Kazakhstan could consider gradually strengthening the remit of the SSCs, building on the experiences of OECD and other countries, such as Australia and South Africa (see Box 5.5).
Strengthening institutional arrangements needs to be complemented by a shift in the culture of government officials. As noted in the performance section, in the consultations during the OECD Skills Strategy project, it emerged too frequently that government officials view stakeholder concerns as external concerns. To facilitate this cultural shift, Kazakhstan could consider developing a digital platform to promote exchange on skills policies between the central government and external stakeholders, as Estonia has done with the Electronic Co-ordination System for Draft Legislation (see Box 5.5). This could also contribute to increasing transparency of the policy-making process and increase trust in government policies, which has been signalled by many stakeholders as important to tackle.
In the case of policy implementation, as explained in the performance section, Kazakhstan needs to strengthen employer involvement in the provision of dual education and adult learning (see Chapter 3). Public-private partnerships could play an important role in making progress in these two areas. For example, PPP frameworks could be used to create employer-led associations to organise apprenticeships, as seen in Norway (see Box 5.5), or to set up local training networks to increase access to training opportunities among SMEs (see Chapter 3). PPPs could also facilitate co-operation between public and private employment agencies in the provision of career guidance and job-matching services for the unemployed (see Chapter 2).
As outlined in the section on current arrangements, Kazakhstan has taken important steps to establish a PPP framework. The work by the ETF highlights that the Government of Kazakhstan considers PPPs as an effective mechanism for delegating responsibilities on policy implementation to the private sector (ETF, 2020[5]). Kazakhstan has also established the PPP Project Support Centre under the MNE to support the implementation of PPP projects. The team of professional experts and analysts in the field of PPP has implemented more than 30 unique PPP projects to date. The PPP Project Support Centre implements projects in such areas as education, health, energy, culture and sports, housing and social facilities, telecommunications, transport and infrastructure, and others. In the field of education, 271 contracts have been concluded for KZT 74 billion (ETF, 2020[5]).
Kazakhstan can strengthen the adoption of PPPs for skills development in two ways. First, Kazakhstan could improve the legislative framework. The current law on PPPs only sets the rights and obligations of public and private partners in relation to broad objectives, such as creating the conditions for effective interactions between the public and private partners and improving availability and quality of goods, works and services. However, ETF’s recently published report, Public-Private Partnerships for Skills Development, which reviewed good practices across more than ten countries, suggests that a specific bylaw could foster the adoption of PPPs for skills development (ETF, 2020[5]). Skills-orientated PPPs require a relatively unique set of legislative requirements in order to balance the risk and responsibility of providing social services. To strengthen the legislative framework, Kazakhstan could introduce a bylaw specifying the responsibilities of public and private partners for PPPs that focus on the provision of education and training, such as employer-led associations might organise apprenticeships or local training networks (see Chapter 3).
Second, Kazakhstan can disseminate good practices to implement PPPs for skills development. According to stakeholders, there is limited awareness among public and private actors on how to establish a successful PPP for skills development. To help build awareness about good practices, Kazakhstan could build an online platform that provides information on important principles that stakeholders should follow in implementing PPPs for skills development and shows successful examples of PPP projects. The platform could potentially rely on principles and good practices gathered by the ETF during its project on “Public Private Partnerships: Success factor for skills development” (ETF, 2019[32]) According to the ETF, for instance, a successful PPP for skills development requires an actor to set clear objectives in the partnership, establish how risks should be balanced, and set criteria on how to allocate and transfer responsibilities among private and public actors (ETF, 2019[32]).
Using industry-specific skills councils to increase stakeholder engagement: Examples from South Africa and Australia
In South Africa, stakeholder engagement has been strengthened through the creation of Skills Education Training Authorities (SETAs). There are currently 21 SETAs, each one dealing with a distinct sector of the economy, such as banking or safety and security. Their main role is to implement the National Skills Development Strategy in their sector. They manage the skills development levy that companies are required to pay and use that money to fund training and skills development programmes. This can include supporting the development of learning materials, establishing apprenticeships, identifying workplaces that could be used for practical workplace experience, and accrediting education and training providers. Every SETA brings together stakeholders from across that sector in order to make informed decisions. As a result, each SETA includes professional bodies, associations and bargaining councils, NGOs, private providers, independent schools and school governing bodies, and government departments.
Similarly, in Australia, stakeholders are engaged in Industry Reference Committees (IRCs), where industries can outline their skills requirements and develop and review training packages. They are responsible for gathering and collating information on the challenges, opportunities and trends in their sectors, and they act as a forum for sectors to ensure that training opportunities meet the needs of employers, employees, training providers and people seeking training qualifications. Each committee is made up of a diverse group of stakeholders with industry links, including big employers, small enterprises and trade unions. Each IRC is also supported by a Skills Service Organisation (SSO) to help them in their work. These are independent, professional service organisations that can help IRCs evaluate training needs. IRCs then go on to advise the Australian Industry and Skills Committee (AISC) about the skills needs of their industry sector. AISC itself recommends national training package products to the National Skills Council for endorsement and uses the input from IRCs to advise the Government of Australia on the quality, relevance and responsiveness of Australia’s VET sector.
Online tools for engaging with stakeholders: An example from Estonia
The Government of Estonia places a strong focus on accessibility and transparency of regulatory policy. A range of online tools are used to engage with stakeholders in regulation making, including an online list of laws to be prepared, modified, reformed or repealed, the Electronic Coordination System for Draft Legislation (EIS), an interactive website for public consultations and an official online State Gazette. EIS tracks the development of all Estonian and EU draft legal acts and makes available RIAs and documents of legislative intent (describing the problem to be addressed, analysing policy options and determining initial likely impacts). EIS is the official system used for inter-ministerial consultations, public consultations at an early stage in the legislative development process on the basis of legislative intent documents, and public consultations at a later stage on draft regulations. EIS allows any member of the general public to follow the development of a draft legal act, search for documents in the system, and give his/her opinion on the documents open for public consultation. Input from stakeholders (e.g. formal letters with stakeholder feedback, proposals, etc.) can be sent directly or uploaded by a responsible ministry to EIS.
Using PPPs to engage employers in policy implementation: An example from the oil sector in Norway
In Norway, the oil and gas sector has established an Education Office of Oil-Related Trades (OOF) to facilitate the organisation of apprenticeship schemes via a PPP project. OOF is a private association with 37 oil, gas and ship-owner companies participating. It is a co-operative effort that enables active participation from all relevant stakeholders, as well as ensuring that the cost and risk of providing for apprenticeships are pooled. OOF organises a close tripartite dialogue with oil companies, vocational schools and local government to provide these apprenticeships. It is also responsible for the training content and quality of apprenticeships, and supervises and evaluates the apprentices. To help it fulfil its responsibilities, the Government of Norway provides subsidies to OOF. OOF represents one way to involve stakeholders in the provision of apprenticeships, whereby private companies are able to take the lead in determining how apprenticeships are conducted in their sector.
Source: Skills Academy (2020[33]), SETAs, https://www.skillsacademy.co.za/list-of-setas/; eMatla Solutions (2020[34]), Banking Sector Education and Training Authority, https://ematlasolutions.co.za/banking-sector-education-and-training-authority/; Australian Industry and Skills Committee (2020[35]), What is an IRC?, https://www.aisc.net.au/content/what-irc; Australian Industry Standards (2020[36]), Industry Reference Committees, https://www.australianindustrystandards.org.au/committees/; OECD (2016[37]), “Online tools for engaging with stakeholders (Estonia)”, http://www.oecd.org/gov/regulatory-policy/EST-Online-Tools.pdf; ETF (2020[5]). Public-Private Partnerships for Skills Development: A Comparative Analysis from the Governance Perspective, https://www.etf.europa.eu/en/publications-and-resources/publications/public-private-partnerships-skills-development-governance.
4.7. Strengthen mechanisms to engage stakeholders in policy development, for instance, by improving stakeholder participation in the National Council for Development of the Social and Labour Sector. The Government of Kazakhstan needs to ensure that the format and frequency of meetings within the NCDSLS allow representatives of employers and trade unions to channel their feedback on policy development by incorporating a broader array of stakeholders in the council, ensuring meetings are held on a regular basis, and circulating relevant material to stakeholders in advance of discussions. The Government of Kazakhstan could also consider increasing the role and powers of the Tripartite Republican Commission to increase engagement of employers and trade unions at the presidential level. For state programmes and more specific policy initiatives, the Government of Kazakhstan could consider gradually strengthening the remit of the SSCs to provide information to ministers and inter-ministerial working groups (see Opportunity 1) on the development of state programmes and specific policy initiatives, for instance regarding adult learning, SAA tools or VET. The ministries and inter-ministerial working groups (see Opportunity 1) should develop and implement clear guidelines and practices on how to engage with the SSCs, as well as other external stakeholders.
4.8. Develop a single digital platform to promote exchange on skills policies between the central government and external stakeholders. Ministries involved in skills policies should work together on the development of a single digital platform to promote dialogue between policy makers and stakeholders. The development of the platform could be overseen by the NCDSLS within the newly introduced Skills Policy Council (see Opportunity 1). The platform could be used to pool different documents and legislation, run consultations on the effectiveness of existing policies and organise seminars and events to share new policy initiatives with the wider public.
4.9. Strengthen the adoption of public-private partnerships to improve employer involvement in the provision of education and training by improving the legislative framework and disseminating good practices. The Government of Kazakhstan should introduce a bylaw to specify the allocation of roles and responsibilities for PPPs that focus on the provision of education and training, e.g. employer-led associations might organise apprenticeships or local training networks. The PPP Project Support Centre under the MNE, in collaboration with the MOES and the MLSPP, could launch a platform to disseminate good practices. This platform could provide information on important principles that stakeholders should follow in implementing PPPs, and show successful examples of PPP projects, both from Kazakhstan and abroad.
Opportunity 3: Better aligning and co-ordinating financing arrangements
Effective co-ordination and co-operation across government and with stakeholders need to be supported by strong financing arrangements. As discussed in the performance section, Kazakhstan does not seem to provide sufficient public funding to education, when compared to neighbouring countries, other upper middle income countries and top-performing OECD countries. In spite of these comparatively low levels of public investment, Kazakhstan has made limited use of financial incentives, such as tax deductions, subsidies and levies, which can help increase investment from employers on skills development. Building on these findings, this opportunity explores how to strengthen public funding arrangements for skills policies. Then, it discusses how to better use incentives to engage the private sector in skills development.
Strengthening public funding arrangements for skills policies
As discussed in the performance section, Kazakhstan’s relative underperformance in providing public funding to education applies whether education spending is measured as a percentage of GDP or as expenditure on education per student, and to different education levels, such as compulsory and tertiary education.
The international evidence suggests that in Kazakhstan’s case, increasing the share of government funding for education policies could result in better skills outcomes for youth, which lag behind other countries (see Chapter 1). Across countries, there is a positive relationship between expenditure per student and skills outcomes, both for compulsory education and tertiary education, but only up to a threshold. Such a threshold is approximately equal to USD 50 000 (per student and in cumulative expenditure) for students from age 6 to 15, and USD 5 000 in government funding for tertiary education (see Figure 5.7) (OECD, 2019[18]; OECD, 2019[38]; World Bank, 2020[7]). After this threshold, the relationship between the amount invested in education and student performance weakens, and how resources are allocated becomes more important. Kazakhstan lies significantly below this funding threshold, both in primary and secondary education and in tertiary education, implying that there might be substantial benefits in increasing public funding for education policies.
As discussed in the performance section, it is unlikely that a substantial increase in funding could happen by shifting resources away from other policy areas. However, Kazakhstan could, for example, rely on contributions from employers, gathered through a training levy, to increase funding in VET (see the following section). However, the funds gathered through training levies are not typically used to finance general education programmes in primary, secondary and tertiary education (OECD, 2017[39]). To increase funding for these general programmes, Kazakhstan could first consider whether at least some resources could be re-allocated from other policy areas. Further increases in funding for these general programmes will depend on raising additional tax revenue, for instance, through direct and indirect taxes. Given the substantial impact of the COVID-19 pandemic, it might be appropriate to wait until the economy starts to recover before pursuing this avenue.
Reforming the financing of HE institutions: An example from Poland
In Poland, recent reforms in funding have introduced changes that should improve incentives for aligning the educational offering for VET and HE institutions.
Since 2019, the VET funding algorithm reflects the demand for specific occupations in the region and training costs for specific jobs. To monitor the demand for different occupations, the Ministry of National Education creates a shortlist of shortage occupations, consolidating different data from skills assessment and anticipation tools. These shortage occupations receive more funding. As a result of these two adjustments, there are sizable differences in funding across fields of study. For example, for a graduate in mechatronics, a school receives, all else being equal in the funding formula, approximately 80% more funding than graduates pursuing other fields of study. These reforms have introduced some positive changes in the funding system, but they will need to be adequately supported and monitored.
In HE, Poland has introduced different formulas for professional and academic HE institutions. Before the reforms, both received their core funding (dotacja podstawowa) on the basis of student enrolment and staff costs (80%), scientific activity (10%) and internationalisation (10%). Under the new regime, both professional and academic HE institutions will continue to receive the majority of their core funding on the basis of student enrolment and staff costs (90% in the case of professional HE institutions and 60% in the case of academic HE institutions). Professional HE institutions will now receive the remainder on the basis of the relative unemployment rate among their graduates (5%) and the external income they generate (5%). Academic HE institutions will receive the rest of their funding on the basis of the quality of their scientific research (25%), their research and development (R&D) spending (10%) and internationalisation (5%). The proportion of funding conditional on employability outcomes for professional HE institutions is broadly in line with comparable institutions in other OECD countries. For example, polytechnics in Finland receive approximately 3% of funding based on graduate employment rates.
Source: OECD (2019[40]), OECD Skills Strategy Poland: Assessment and Recommendations, https://dx.doi.org/10.1787/b377fbcc-en.
As well as increasing public spending on education policies, Kazakhstan should consider improving the efficiency and equity of public funding allocations across the skills system. As highlighted in the performance section, Chapter 2 provides specific recommendations on the financing of ALMPs, whereas Chapter 3 provides recommendations on financing incentives for adult learning opportunities among individuals and enterprises. The United Nations International Children's Emergency Fund (UNICEF), the ETF and the OECD have already reviewed financing arrangements for compulsory education, VET and HE in depth (Clarke, 2018[41]; ETF, 2020[9]; OECD, 2020[42]).
A report by UNICEF has broadly endorsed the per capita funding formula introduced in 2016 for compulsory education but has recommended adjusting some coefficients to ensure that smaller schools and schools with a lower class size receive sufficient funding (Clarke, 2018[41]). In the case of VET, the ETF has recommended diversifying the streams of VET funding to better reflect different regional needs (ETF, 2020[9]). When it comes to tertiary education, the OECD Education Policy Perspectives section on Kazakhstan has recommended providing additional financial resources alongside state scholarships, such as student loan schemes, so students are not wholly dependent on the outcome of the Unified National Test (UNT) exam to be able to afford higher education (OECD, 2020[42]).
Kazakhstan should now make further progress in implementing these recommendations. As more data on labour market and skill needs become available (see Chapter 4), Kazakhstan could also consider modifying funding arrangements in VET and HE, so that institutions become more responsive to labour market needs. The experiences of Poland could be useful in this respect (see Box 5.6).
4.10. Increase public funding in primary, secondary and tertiary education to improve skills outcomes of youth, by reallocating funding from other policy areas, raising additional tax revenue and increasing contributions from employers. The Government of Kazakhstan should increase funding allocations to primary, secondary and tertiary education. Contributions from employers gathered through a training levy (see the following section) could be used to increase spending in VET. To increase spending for general programmes across primary, secondary and tertiary education, the MF should start by reviewing whether there are any resources that can be reallocated from other policy areas. Depending on the results of this exercise, the Government of Kazakhstan should then consider raising additional revenue through taxation.
Better using incentives to engage the private sector in skills development
As foreshadowed in the performance section, Kazakhstan could make better use of financial incentives to engage the private sector in developing skills. Across OECD countries, a variety of financial incentives are used to expand the role of employers in funding and delivering skills policies (see Table 5.1). The vast majority of incentives come in the form of direct subsidies (OECD, 2017[39]). Training levies are less commonly used, and tax incentives and public procurement are relatively uncommon (OECD, 2017[39]). Although payback clauses can be found in most European countries, it is not clear to what extent they are being used or enforced (OECD, 2017[39]). International experience suggests that different schemes have potential advantages and disadvantages (see Table 5.1). Generally speaking, it is important to carefully assess different options (e.g. cost-efficiency) and strongly co-ordinate policy dialogue with potential partners to identify the most suitable solution.
Kazakhstan has so far made limited use of these financial incentive schemes. The only financing incentive schemes the OECD team were able to identify during the stakeholder consultations were a tax exemption for education and training of employees, specifically targeting subsoil users, and subsidies for more vulnerable individuals (including workers made redundant) in the framework of the Enbek programme (see Chapter 3 for details).
Among the different incentives, Kazakhstan should give priority to the introduction of a training levy. As discussed in the previous section, Kazakhstan is already investing a substantial proportion of total government expenditure in education policies, implying that further increasing spending might be difficult. Introducing a training levy could help raise additional resources, which could be earmarked for expenditure on VET (see the previous section), ALMPs (see Chapter 2) and training in enterprises (see Chapter 3). Kazakhstan could learn from the experiences of a number of OECD countries to understand how to introduce a training levy (see Table 5.2). Among these different schemes, Kazakhstan could closely consider Brazil’s Systema S and Hungary’s training fund (see Box 5.7). These levies have the advantage of being hybrid schemes. The contributions are collected centrally but are then allocated to different funding purposes, which may suit Kazakhstan’s need to increase spending across different policy areas.
Implementing a training levy successfully will require employer-buy-in. A detailed review of training levy schemes by the World Bank has concluded that extensive consultations and consensus with employers on the need and benefits are essential before introducing a levy scheme (Johanson, 2009[43]). Countries that allocate a leading role to employers, such as Brazil, tend to be successful, whereas over-control by government can have deleterious results (Johanson, 2009[43]).
In Kazakhstan’s case, employers should be closely involved in discussions on which initiatives should be financed with the additional revenue because there are numerous options on the table. An obvious choice might be to use some of the funding to finance learning opportunities in the VET system, consistent with other countries, such as Hungary and Brazil. The funding from the levy could also be important to expand the role of dual education. Kazakhstan could consider introducing subsidies to encourage firms to deliver apprenticeships. The grants could be offered directly to enterprises and/or could be used to finance the creation of employer-led associations established through a PPP, such as the OOF in Norway, which can support employers in operating the system (see Box 5.5). Kazakhstan could also learn from the experiences of Austria to make progress on this front (see Box 5.7).
Revenue-generating and levy-grant schemes: Examples from Hungary and Brazil
In Hungary, companies are obliged to pay 1.5% of their payroll (a contribution called the szakképzési hozzájárulás) into a training fund. Different methods exist to distribute funds gathered through such a fund, and Hungary’s approach is a hybrid between a revenue-generating scheme and levy-grant scheme. In a revenue-generating scheme, employer contributions are used to finance general training programmes, whereas in a levy-grant scheme, payroll contributions are collected from employers and redistributed as grants for companies to engage in their own training. In Hungary, funds go towards a general training fund (the National Employment Fund), but a proportion can also be used by companies for internal training. The National Employment Fund is a ring-fenced training fund that can only be used to fund objectives related to VET and adult training. These funds can help support training providers, subsidise courses, and be used to develop vocational training opportunities. If companies hire individuals within more vulnerable groups such as career starters, beneficiaries of childcare support, and the long-term unemployed, they are exempt from paying the contribution for those individuals for up to two years.
In Brazil, a revenue-generating scheme is run to provide funding to technical schools in a system called Sistema S. This scheme requires that firms in each sector (agriculture, trade, manufacturing and transportation) transfer a share of their revenues to the institution supporting training in their area of activity. There are nine institutions in total organised at both the national and state level. The contribution required of firms differs depending on the sector and lies between 0.2% and 2.5%, with most paying between 1% and 1.5%, an amount in line with other revenue-generating schemes in different countries. There is now a requirement that some of these funds must be used by the institutions to provide free training to more vulnerable groups such as the unemployed. This levy ensures a reliable source of funding for the institutions and means that they can offer vocational education at secondary and tertiary levels, as well as short training courses. Due, in part, to the specialisation of the Sistema S schools, individuals aged 15-29 years old at these institutions receive a considerably higher wage return than those trained in other institutions: 28.3% versus 10.4%.
Incentivising the uptake of apprenticeships: An example from Austria
Austria runs a grant-based system to encourage employers to hire apprentices. The amount of grant received by the employer depends on the year of apprenticeship, with the subsidy decreasing with each year of apprenticeship (in the first year of apprenticeship, the employer receives the equivalent of three gross apprentice wages per apprentice; in the second year, the equivalent of two gross apprentice wages; and in the third year, the equivalent of one gross apprentice wage). Extra support is also available to employers offering apprenticeships, for the provision of additional training to apprentices and training of instructors, to employers whose apprentices excel on final assessment, and to employers whose apprentices face learning difficulties. Until 2008, the scheme relied on tax incentives, rather than grants. Tax incentives were abolished in 2008 and replaced by direct subsidies because the Ministry of Economics and Labour concluded that the tax incentive scheme failed to target companies that would benefit most from additional support for apprenticeships.
Source: OECD (2017[39]), Financial Incentives for Steering Education and Training, https://dx.doi.org/10.1787/9789264272415-en; Cedefop (2020[45]), Financing Adult Learning Database, https://www.cedefop.europa.eu/en/publications-and-resources/tools/financing-adult-learning-db/search/training-sub-fund-national-employment-fund-vocational; OECD (2018[46]), Getting Skills Right: Brazil, https://doi.org/10.1787/25206125; Kuczera, M. (2017[47]), “Incentives for apprenticeship”, https://doi.org/10.1787/55bb556d-en.
4.11. Introduce a training levy to increase the financial contribution of employers to VET, adult learning and ALMPs, following extensive consultations with employers. The Government of Kazakhstan could introduce a hybrid scheme where the money is collected centrally, but then distributed across VET (see the previous section), ALMPs (see Chapter 2) and adult learning (see Chapter 3). The contributions should vary by firm size, with large employers contributing more than SMEs. Before implementing the levy, Kazakhstan should conduct extensive consultations with employers (e.g. through the NCE) to reach a consensus on the design.
4.12. Introduce subsidies to encourage employers to hire apprentices within the dual VET system. The Government of Kazakhstan could offer grants to employers directly and/or could offer grants to help establish employer-led associations that could help employers operate the system. These associations could be established via a PPP scheme (see Opportunity 2). The funding could come from the training levy.
Table 5.3 summarises the recommendations for this chapter. Based on feedback from stakeholders and from the national project team, three recommendations have been selected that could be considered to have the highest priority based on potential impact and relevance in the current Kazakhstan context. To strengthen the governance of the skills system, the OECD recommends that Kazakhstan should:
Strengthen the remit of the National Council for Development of Social and Labour Sector, by specifying a clearly defined mandate and introducing a combination of inter-ministerial working groups and technical bodies (Recommendation 4.1).
Introduce a technical body to co-ordinate the development of the NQS (Recommendation 4.5).
Introduce a training levy to increase the financial contribution of employers to VET, adult learning and ALMPs, following extensive consultations with employers (Recommendation 4.11).
References
[16] Akorda (2020), Глава государства принял участие в третьем заседании Национального совета общественного доверия [The Head of State took part in the third session of the National Council of Public Trust], https://www.akorda.kz/ru/events/glava-gosudarstva-prinyal-uchastie-v-tretem-zasedanii-nacionalnogo-soveta-obshchestvennogo-doveriya.
[35] Australian Industry and Skills Committee (2020), What is an IRC?, https://www.aisc.net.au/content/what-irc (accessed on 7 October 2020).
[36] Australian Industry Standards (2020), Industry Reference Committees, https://www.australianindustrystandards.org.au/committees (accessed on 1 October 2020).
[45] Cedefop (2020), Financing adult learning database, https://www.cedefop.europa.eu/en/publications-and-resources/tools/financing-adult-learning-db/search/training-sub-fund-national-employment-fund-vocational (accessed on 5 October 2020).
[6] Cedefop (2011), Glossary Quality in Education and Training, https://www.cedefop.europa.eu/files/4106_en.pdf.
[24] Centre of Excellence for Evaluation of the Treasury Board of Canada Secretariat (2020), Guide to Rapid Impact Evaluation, https://www.canada.ca/en/treasury-board-secretariat/services/audit-evaluation/evaluation-government-canada/guide-rapid-impact-evaluation.html (accessed on 7 October 2020).
[25] Centre of Excellence for Evaluation of the Treasury Board of Canada Secretariat (2020), Theory-Based Approaches to Evaluation: Concepts and Practices, https://www.canada.ca/en/treasury-board-secretariat/services/audit-evaluation/centre-excellence-evaluation/theory-based-approaches-evaluation-concepts-practices.html (accessed on 7 October 2020).
[41] Clarke, G. (2018), A Review of Formula Funding, UNICEF Kazakhstan, https://www.unicef.org/kazakhstan/en/reports/review-formula-funding (accessed on 7 October 2020).
[34] eMatla Solutions (2020), Banking Sector Education and Training Authority, https://ematlasolutions.co.za/banking-sector-education-and-training-authority/ (accessed on 7 October 2020).
[30] Estonian Qualifications Authority (2020), Estonian Qualifications Authority, https://www.kutsekoda.ee/en/ (accessed on 8 October 2020).
[9] ETF (2020), Policies for Human Capital Development in Kazakhstan: An ETF Torino Process Assessment, European Training Foundation, Turin, https://www.etf.europa.eu/en/publications-and-resources/publications/policies-human-capital-development-kazakhstan-etf-torino.
[5] ETF (2020), Public Private Partnerships for Skills Development: A Comparative Study from a Governance Perspective – Volume I. Thematic overview, European Training Foundation, Turin, https://doi.org/10.2816/422369.
[11] ETF (2019), Governance arrangements for vocational education and training in ETF partner countries: Analytical overview 2012–17, European Training Foundation, Turin, http://hhttps://www.etf.europa.eu/en/publications-and-resources/publications/governance-arrangements-vocational-education-and-training.
[32] ETF (2019), Public Private Partnerships: Success factor for skills development, Workshop conclusions , 4-5 December, European Training Foundation, Turin, https://www.etf.europa.eu/en/news-and-events/news/public-private-partnerships-success-factor-skills-development.
[14] ETF (2017), Getting organised for better qualifications: A toolkit, European Training Foundation, Turin, https://www.etf.europa.eu/en/publications-and-resources/publications/getting-organised-better-qualifications-toolkit.
[17] ETF (2014), Guide for the Review of Institutional Arrangements, European Training Foundation, Turin, http://etf.europa.eu/en/publications-and-resources/publications/guide-review-institutional-arrangements.
[21] EURYDICE (2020), Sweden: Organisation of the Education System and of its Structure, https://eacea.ec.europa.eu/national-policies/eurydice/content/organisation-education-system-and-its-structure-80_en (accessed on 12 October 2020).
[29] Government of Kazakhstan (2019), Road Map on the Development of the National Qualifications System for 2019-2025, https://old.enbek.gov.kz/en/node/363246.
[43] Johanson, R. (2009), “A Review of National Training Funds”, The World Bank: Social Protection & Labor, http://siteresources.worldbank.org/SOCIALPROTECTION/Resources/SP-Discussion-papers/Labor-Market-DP/0922.pdf.
[47] Kuczera, M. (2017), “Incentives for apprenticeship”, OECD Education Working Papers, No. 152, OECD Publishing, Paris, https://dx.doi.org/10.1787/55bb556d-en.
[44] Müller, N. and F. Behringer (2012), “Subsidies and Levies as Policy Instruments to Encourage Employer-Provided Training”, OECD Education Working Papers, No. 80, OECD Publishing, Paris, https://dx.doi.org/10.1787/5k97b083v1vb-en.
[28] National Center for Educational Quality Enhancement (2020), About Us, https://www.eqe.ge/en/page/static/5/chven-shesakheb (accessed on 29 January 2021).
[13] OECD (2020), “Developing a school evaluation framework to drive school improvement”, in OECD Education Policy Perspectives, OECD Publishing, Paris, https://doi.org/10.1787/60b471de-en.
[27] OECD (2020), Improving Governance with Policy Evaluation: Lessons From Country Experiences, OECD Public Governance Reviews, OECD Publishing, Paris, https://dx.doi.org/10.1787/89b1577d-en.
[42] OECD (2020), “Strengthening national examinations in Kazakhstan to achieve national goals”, in OECD Education Policy Perspectives, OECD Publishing, Paris, https://doi.org/10.1787/0bf8662b-en.
[1] OECD (2020), Strengthening the Governance of Skills Systems: Lessons from Six OECD Countries, OECD Skills Studies, OECD Publishing, Paris, https://dx.doi.org/10.1787/3a4bb6ea-en.
[4] OECD (2019), OECD Skills Strategy 2019: Skills to Shape a Better Future, OECD Publishing, Paris, https://dx.doi.org/10.1787/9789264313835-en.
[40] OECD (2019), OECD Skills Strategy Poland: Assessment and Recommendations, OECD Skills Studies, OECD Publishing, Paris, https://dx.doi.org/10.1787/b377fbcc-en.
[18] OECD (2019), PISA 2018 Results (Volume I): What Students Know and Can Do, OECD Publishing, Paris, https://dx.doi.org/10.1787/5f07c754-en.
[38] OECD (2019), Survey of Adult Skills (PIAAC) (2012, 2015, 2019) (database), https://www.oecd.org/skills/piaac/.
[46] OECD (2018), Getting Skills Right: Brazil, Getting Skills Right, OECD Publishing, Paris, https://doi.org/10.1787/25206125.
[20] OECD (2017), Education Policy Outlook: Sweden, OECD Publishing, Paris, http://www.oecd.org/education/Education-Policy-Outlook-Country-Profile-Sweden.pdf.
[39] OECD (2017), Financial Incentives for Steering Education and Training, Getting Skills Right, OECD Publishing, Paris, https://dx.doi.org/10.1787/9789264272415-en.
[12] OECD (2017), Higher Education in Kazakhstan 2017, Reviews of National Policies for Education, OECD Publishing, Paris, https://dx.doi.org/10.1787/9789264268531-en.
[37] OECD (2016), “Online tools for engaging with stakeholders (Estonia)” OECD Publishing, Paris, http://www.oecd.org/gov/regulatory-policy/EST-Online-Tools.pdf.
[8] OECD/The World Bank (2015), OECD Reviews of School Resources: Kazakhstan 2015, OECD Reviews of School Resources, OECD Publishing, Paris, https://dx.doi.org/10.1787/9789264245891-en.
[31] SAQA (2020), What is the South African Qualifications Authority?, https://www.saqa.org.za/about-saqa (accessed on 2 October 2020).
[2] Schmitter, P., A. Wiener and T. Diez (2018), “Neo-Neofunctionalism”, in European Integration Theory (Third Edition), Oxford University Press, https://www.oxfordpoliticstrove.com/view/10.1093/hepl/9780198737315.001.0001/hepl-9780198737315-chapter-3.
[33] Skills Academy (2020), SETAS, https://www.skillsacademy.co.za/list-of-setas/ (accessed on 7 October 2020).
[19] Skills Development Scotland (SDS) (2018), Regional Skills Strategy Aberdeen City & Shire, https://www.skillsdevelopmentscotland.co.uk/media/44785/aberdeen_city_and_shire_regional_skills_strategy.pdf.
[23] SKL International (2020), Ukraine – Support to Decentralisation, https://sklinternational.se/projects/projekt/ukrainesupporttodecentralization.739.html.
[26] Treasury Board of Canada Secretariat (2016), Policy on Results, https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=31300.
[10] UNESCO (2020), Ensuring Lifelong Learning for All in Kazakhstan, Kyrgyzstan, Tajikistan and Uzbekistan: Country Evidence and Policy Recommendations, UNESCO; UNESCO Almaty Office, https://unesdoc.unesco.org/ark:/48223/pf0000372898?posInSet=1&queryId=69cc8c8e-9c3a-470d-8995-3fd1f3b0cd60&fbclid=IwAR1Yc2tONlcJA6OLnV64DeIkQM6LHDqrPPnHwiZE6otBbjeH6n1PIjNE6U8.
[15] UNESCO Institute for Lifelong Learning, ETF and Cedefop (2015), Global Inventory of Regional and National Qualifications Frameworks, Volume II: National and Regional Cases, UNESCO Institute for Lifelong Learning, https://unesdoc.unesco.org/ark:/48223/pf0000235123.
[22] Västra Götaland (2016), Smart Specialisation in Västra Götaland, https://s3platform.jrc.ec.europa.eu/documents/20182/232763/SE_V%C3%A4stra+G%C3%B6taland_RIS3_Final.pdf/700f7d05-afb1-4d13-9abb-94bb3e38a484.
[7] World Bank (2020), Education Statistics - All Indicators, https://databank.worldbank.org/source/education-statistics-%5e-all-indicators.
[3] World Economic Forum (ed.) (2019), Agile Governance for Creative Economy 4.0, http://www3.weforum.org/docs/WEF_Agile%20Governance_for_Creative_Economy_4.0_Report.pdf.