Since the creation of the European Higher Education Area (EHEA), which stems from the Bologna Declaration (1999), fostering the comparability and recognition of qualifications has made higher education evaluation a priority in education policy. From an incipient and contested initial system of quality assurance set up in the late 20th century (Law No 38/94, 21 November), higher education evaluation in Portugal has expanded rapidly, today boasting high-quality supervisory and consultancy services, no longer focussing merely on teaching-learning processes and results achieved, but including an analysis of course organisation and operation.

In 1998, by Decree-Law No 205/98, 11 July, the National Board for Higher Education Assessment (Conselho Nacional de Avaliação do Ensino Superior - CNAVES) was created, aiming to ensure the higher education system’s “harmony, cohesion and credibility”, using meta-evaluation and, if necessary, foreign experts. In 2000, the second evaluation cycle was completed, covering all higher education institutions (HEIs), however, the process was contested and considered ineffective due to its considerable dependence on higher education institutions, not producing results in terms of eradicating cases of inferior quality.

In 2005, the Portuguese government requested an assessment of the quality assurance system in Portuguese higher education from the European Association for Quality Assurance in Higher Education (ENQA), to offer recommendations for improvement and for the creation of a system that would comply with European standards and guidelines. In 2007, the new Law on Higher Education Evaluation, No 38/2007, 16 August was published and the Agency for Assessment and Accreditation of Higher Education was created via Decree-Law No 369/2007, 5 November, with the main objective of promoting and ensuring quality higher education.

Both the legal framework for higher education quality assurance (Law No 38/2007, 16 August) and its quality evaluation system are universal, compulsory and frequent in nature. They require quality policies within the HEIs themselves; quality criteria being submitted to the standards stemming from the Bologna Process; assessment of R&D activities; participation of foreign experts in the evaluation process; student intervention, etc. As such, evaluation in higher education is considered clearly supervisory in nature.

The objectives of higher education quality assurance are:

a) to improve the quality of HEIs.

b) to provide society with information on the HEI performance quality.

c) to promote an internal quality assurance culture within HEIs.

In 2012, the first regular accreditation cycle began. It consisted of a five-year evaluation and accreditation phase of all operating study cycles with preliminary accreditation. It was concluded in 2017/18 with the institutional assessment process, as part of the reconstruction of the higher education database. The aim was to provide a global vision of the system and an analysis of the improvements achieved in relation to the initial 2010 undertaking.

The Higher Education Evaluation Law includes regular international evaluation of the Agency (Article 25, a). After the experience of conducting assessment and accreditation processes, the A3ES fulfilled the requirements for an independent international review, as determined by The European Standards and Guidelines (ESG). This evaluation was a condition for A3ES’s application to be included on the European Quality Assurance Register (EQAR). The external evaluation of A3ES was coordinated by ENQA, and the external evaluation panel visited the Agency on 15-16 January 2014. In March 2014, ENQA submitted its report and that year the result of the evaluation allowed A3ES to become a full member of ENQA and be registered in EQAR. The evaluation was repeated in 2019 (five-year cycle), again with positive results, and A3ES’s registration in EQAR was renewed until 30/06/2024.

A3ES is also a member of the European Consortium for Accreditation (ECA), CHEA International Quality Group, SIACES (Sistema Iberoamericano de Aseguramiento de la Calidad de la Educación Superior) and of the IMHE programme from OECD.

Responsible bodies

The Agency for Assessment and Accreditation of Higher Education (A3ES) was set up by the state for an indefinite period as a foundation governed by private law, boasting legal personality and public utility. It is independent in performing its duties within the framework of the law and its statutes, without prejudice to the guiding principles established by the state through its own bodies.

The mission of A3ES is to ensure the quality of higher education in Portugal and perform the duties attached to the country’s place in the European quality assurance system.

Its main objectives are improving the quality of HEIs and their study cycles, as well as ensuring compliance with the basic requirements of official recognition via evaluation and accreditation that promote an internal institutional culture of HEI quality assurance.

The A3ES mission involves the following duties:

• defining and ensuring quality standards for the system.
• evaluating and accrediting study cycles and higher education institutions.
• publicly disseminating evaluation and accreditation results.

• promoting the internationalisation of the Portuguese higher education system.
• advising the state on matters of quality assurance in higher education.
• carrying out studies and provides opinions, either on its own initiative or at the State’s request.
• participating in the European quality assurance system for higher education – EQAR.
• coordinating assessment and accreditation in Portugal with international assessment institutions and mechanisms.

The Agency's statutory bodies are the board of trustees, the management board, the audit committee, the advisory council and the appeals council.

The board of trustees is the steering body and made up of five members of recognised merit and experience. They are proposed by the minister responsible for higher education and appointed by Resolution of the Council of Ministers. The board's mandate is five years, which cannot be renewed.

The board of trustees’ responsibilities include:

• appointing the members of the management board and of the appeals council.
• providing a generic assessment of the management board’s performance, and potentially providing opinions or recommendations on its performance.
• providing an opinion on the agency's annual activities plan and budget.
• providing an opinion on the agency's management report and accounts.
• ensure containment, economy, efficiency, effectiveness and compliance with international best practice regarding the setting of evaluation and accreditation costs.

The management board is the executive body, consisting of a maximum of seven members appointed by the board of trustees. These members are individuals of recognised scientific and professional merit and relevant to the agency's duties. This board's mandate lasts four years and is renewable.

The management board’s responsibilities include:

• representation and management duties.
• instituting evaluation and accreditation procedures.
• final decisions regarding results.
• approval of its own reports and those of other quality assurance bodies (national or foreign).
• approval of higher education quality assurance system regulations, in compliance with the terms of reference of the legal provisions for evaluation.

The audit committee consists of three members appointed by order of the government member responsible for finance, one of whom must be a statutory auditor, and is responsible for controlling the legality and regularity of A3ES’s financial and asset management.

The advisory council is an advisory body on higher education quality assurance and supports the management board’s decisions regarding evaluation and accreditation. It is responsible for providing opinions on the Agency’s annual activity plan, its main focusses and strategic guidance. It is made up of various stakeholders, including representatives from the Portuguese Universities Council of Rectors, polytechnics, private higher education, the various employer orders and confederations, students and ministerial representatives from other sectors.

The appeals council is the body for appeals against the management board’s decisions. It is made up of five members with relevant professional experience, with no tenure to Portuguese higher education institutions.

According to Article 17 of Law No 38/2007, 16 August, HEIs are obliged to institute an internal quality assurance policy for their study cycles, developing strategies, policies and procedures for continuous quality improvement. These must be formally approved by the HEI’s legally and statutorily competent body and made public, guaranteeing the participation of students and others interested in the process. Internal quality assurance is provided by HEIs as part of their autonomy and in accordance with their own regulations.

Approaches and methods for quality assurance

The A3ES quality assurance approach is based on an "external quality assurance" model, a combination of internal quality assurance system, self-assessment and external evaluation, in which the HEI’s internal monitoring and evaluation processes are analysed and used in the external quality audit and accreditation process. It adheres to standards defined in the European standards and guidelines (ESG), transposed into national legislation that establishes educational institutions as those primarily responsible for the quality of the education provided.

Every HEI is responsible for defining the internal evaluation model. Each has a duty to adopt a quality assurance policy for their study cycles, ensuring appropriate procedures, promoting a culture of quality and quality assurance, as well as developing and implementing a continuous quality improvement strategy.

There are core regulations stemming from the law regarding internal evaluation that HEIs must comply with. Among the general requirements of higher education institutions (Law No 65/2007, 10 September, Art. 40) is ensuring teacher, researcher, and student participation regarding how the establishment is governed through the general council. Students should represent at least 15 % of general council members. In terms of the legislative structure that formalised the HEI evaluation system, student participation takes other forms, such as their presence on the advisory council, in the self-evaluation processes associated with institutions’ internal quality assurance systems, and external evaluation via external assessment teams (Comissões de Avaliação Externa - CAE).

Internal evaluation takes place annually and its results must be made available to the A3ES. In turn, the A3ES provides a set of internal evaluation recommendations for HEIs in its evaluation manual (e.g., measures to prepare the institution for internal evaluation and the self-evaluation report). The broad participation of stakeholders in the diagnosis, implementation, evaluation and review – at every stage of the quality cycle - is important and, for example, the use of SWOT exercises involving students, teachers, employees and employers in the institution’s diagnosis is valued.

As part of their self-evaluation, HEIs should:

a) define formal procedures for the approval, monitoring and periodic evaluation of their study cycles, which must include the participation of pedagogical councils and students’ opinion (through their associations); of research centres that are involved in the organisation and operation of study cycles; of external consultants working with the institution.

b) adopt procedures that ensure that teaching staff have the necessary qualifications and skills to perform their duties. These must be made available to those responsible for the external evaluation processes and assessed in the evaluation reports.

c) ensure that the teaching resources available are sufficient and appropriate for each of their study cycles.

d) collect, analyse and use relevant information to effectively manage their study cycles and other activities.

e) regularly publish updated, impartial and objective quantitative and qualitative information about the study cycles they teach and the degrees and diplomas they award, monitor graduates’ progress for a reasonable period of time, in terms of employability.

These are some of the aspects that should be analysed as part of quality assurance.

Evaluation is obligatory for higher education institutions. The external evaluation of institutions and study cycles for which A3ES is responsible has a six-year cycle. The first five years focus on study cycle evaluation, while the sixth year concentrates on institutional evaluation.

Evaluation focusses are defined in the current legislation, especially in Law No 38/2007, 16h August, amended by Law No 79/2019, 4 September and include:

1) scientific level of teaching.

2) teaching and learning methodologies.

3) student evaluation processes.

4 teaching staff qualification and appropriacy to study cycles analysed.

5) the efficiency of the internal quality assurance system.

6) the institution’s scientific, technological and artistic activity.

7) facilities and didactic/scientific equipment.

8) social support mechanisms.

External evaluation is based on the work of the external assessment teams (CAE), blending documentary analysis of self-evaluation reports - based on a set of criteria that includes widespread  stakeholder participation – implementation  data and other institution documents, with a CAE case study visit, which includes visiting infrastructures, interviews with management, focus groups with students, teachers, and other stakeholders.

The CAE are made up of between three and five independent experts who have no relationship with the higher education institution being evaluated. They are appointed by the A3ES management board and must include one student and one international expert. All CAE visits are accompanied by an A3ES procedure manager. This manager is not a commission secretary, but a professional highly trained in evaluation methodologies, and a full member of the commission. The standards of conduct for A3ES employees constitute the code of ethics, which are part of the quality manual, including standards for CAE designation and conduct.  

The members of the CAE attend a training session specifically designed and delivered by A3ES. They are responsible for preparing for their duties via prior analysis and study of documents, such as the evaluation manual, the evaluation/accreditation of study cycles guide and, in particular, the self-evaluation reports corresponding to the study cycles being analysed.

The evaluation results are based on explicit and published criteria. These are consistently applied and found in the evaluation manual, which is available on the A3ES website.

Guides and manuals for procedures regarding the various components of the quality assurance system are also available, particularly on how to conduct the accreditation process to ensure some uniformity of procedures among the different CAE.

The CAE prepares the preliminary external evaluation report. At this time, HEIs are entitled to comment. The CAE publishes the final report and the A3ES decides on accreditation. In conditional cases, an assessment follow-up may be required. The management board makes the final decision on accreditation. Where there are professional associations, their opinions are considered. The management board may make decisions that do not coincide with the CAEs’ or professional orders’ recommendations. Because the management board is responsible for ensuring the equity and balance of final decisions, it may decide in favour (be less demanding than the team) or against (be more demanding than the team) the CAE’s recommendation. The management board’s decisions may be reviewed by the appeals council on appeal by the HEIs.

According to Article 16 of Law No 37/2007, 16 August, evaluation results are public and published on the A3ES and HEI website/study cycle evaluated. Also, the contradiction (pronouncement) to the external evaluation reports, if there is one, must be published alongside the final version of the same reports. In addition to this, the applicable legislation (Article 16(2) of Law No 38/2007, 16 August) requires higher education institutions to publish both the self-evaluation and external evaluation reports.

Non-accreditation of a study cycle means that the HEI cannot accept new students but may continue to operate for two years to allow students to complete their studies. If an institution fails to receive accreditation it will close. In either case, measures are taken to ensure that students are not disadvantaged.

During the new regular evaluation/accreditation cycle (2018-2023), the Agency developed a simplified system that was based on the principles of risk management and institutional responsibility for the quality of educational provision. The simplified procedures are based on a sampling system combined with institutional audits. They will be adopted for institutions with better quality indicators, in terms of teaching staff qualifications and the quality of research undertaken, as well as performance in the first assessment/accreditation cycle and duly certified internal quality assurance systems. This simplification of the system also means a revision and simplification of all guidelines.

A3ES quality policy is based on a clear definition of mission and objectives within the framework of European standards and guidelines for quality assurance and the applicable legal provisions. It is based on strategic planning of its activity, as demonstrated in its multiannual strategic plan and annual activity plans, sustained monitoring and continuous improvement mechanisms, and accountability, which assures transparency in all activities. A3ES adopts a code of ethics applicable to all Agency staff and promotes the development of a culture and awareness of quality in Agency workers (internal and external). It establishes monitoring and continuous improvement mechanisms for its work, as well as undertaking systematic research, development studies and projects for further development of issues and mechanisms related to quality assurance and regular external evaluation of the Agency in accordance with European standards.