Discipline External Examiner Handbook

Welcome 

Welcome to Northeastern University London (the University). We hope that your period of tenure as a Discipline External Examiner for the University will be a successful and valuable experience.

The procedures regarding External Examining at the University have been developed in line with the QAA UK Quality Code for Higher Education for the assurance of academic quality and standards in higher education – Theme: External Expertise. For more information, please read AQF11 External Examining.

The purpose of this handbook is to provide relevant information to you about the University and its examination processes, and to provide you with support and guidance for carrying out your role.

Should you have any queries at any point during your period of appointment, please do not hesitate to contact the Academic Registrar or relevant Head of Discipline (please see the Programme Specific Queries & Support from the University section of this handbook).

Northeastern University London

Founded in 2011, as the New College of the Humanities, Northeastern University London offers a unique liberal arts-inspired curriculum taught to small groups and through the one-to-one tutorial system that is the gold standard of a humanities education.

In February 2020 the University was granted (time-limited) Taught Degree-Awarding Powers (TDAP) which enabled the University to enhance its provision of education to undergraduate and postgraduate students and include degree apprenticeship programmes in its portfolio. In August 2020, the Department of Education granted the University indefinite Taught Degree Awarding Powers due to its registration with the Office for Students, and becoming a publicly funded HE provider.

Also, in March 2020, the University became a Registered Approved Training Provider for Degree Apprenticeships which provided the University with additional channels for offering higher education to a broader spectrum of students and in August 2020, the University was officially on the Register of End-Point Assessment Organisations.

In 2020 New College of the Humanities joined Northeastern University, a large research led university based in Boston in the United States. In June 2020, NCH at Northeastern was recognised as a charity and was entered onto the Register of Charities.

In June 2022 NCH at Northeastern became Northeastern University – London. The University is now fully a part of the Northeastern University global network and is one of three sights providing undergraduate degree programmes.

Founding Values of the University 

The University’s mission is to foster a collegial environment in which learning, debate and the sharing of ideas is central, and in which all members of the University treat one another as partners in the quest for knowledge and intellectual enlargement. The students are embarked on courses of systematic study; the faculty advise, assist and challenge; the joint venture is not a matter of de haut en bas but of co-operation. Encouragement of students to think across the boundaries of disciplines and to see the connection between what we study and our experience of life at large – these are some of the desiderata to place at the heart of University life.

Undergraduate Programmes

The University will start delivery in the 2023-24 academic year of a new suite of undergraduate double-degree programmes which cover 13 major disciplines and are centred around a liberal arts structure which allows students to complete credited courses from other disciplines. Details of the different programmes the University offers can be found here. The previous combined honours degree programmes are currently being taught out.

Diploma

Undergraduate Students who registered onto their combined honours programme prior to the 2023-24 academic year combine their Degree studies with the University’s enriching Diploma,¹ which is designed to provide the insights required to lead a rewarding and fulfilling life and offers exceptional professional development opportunities. The Diploma, which is non-credit bearing, is awarded to graduates in addition to their Degree, and sets them apart from their peers by marking the greater depth of their education.

Postgraduate Degrees

The University currently offers the following postgraduate degrees: 

• MSc Artificial Intelligence & Computer Science
• MSc Artificial Intelligence & Data Analytics
• MSc Artificial Intelligence & Data Science
• MSc Artificial Intelligence & Ethics
• MSc Artificial Intelligence & Technology Leadership
• MA Contemporary Creative Writing
• MSc Digital Politics & Sustainable Development
• MA Philosophy
• MA Philosophy and Artificial Intelligence
• MSc Responsible AI
• MSc Global Investment Banking
• MSc Computer Science (Software Development)
• LLB (Hons) Law with International Legal Studies (Senior Status)

Degree Apprenticeship Programmes

The University currently offers the following apprenticeship programmes: 

• BSc (Hons) Digital and Technological Solutions
• BSc (Hons) Data Science
• BSc (Hons) Project Management and Digital Transformation
• BSc (Hons) Bio Science and Digital Technologies
• MSc Artificial Intelligence and Data Science
• MSc Digital and Technology Solutions

External Examiner Pack 

For your first year of your tenure, the University will provide you with a Subject External Examiner Pack that includes relevant documentation as follows:

• Subject External Examiner Handbook and referenced documents.
• Programme documentation including:
  • The relevant Programme Specifications.
  • The relevant Course Descriptors.
  • Assessment Regulations for Taught Awards.
  • The last Annual Monitoring Report, where available.

• Relevant assessment information including:
  • The assessment schedule for the relevant courses, including dates when examination scripts and coursework will be available for moderation.
  • Assessment briefs.
  • Related grading schemes, model answers, etc. as appropriate.
• Boards of Examiners information including:
  • Minutes of the most recent Progression Award Board Meeting.
  • Dates of forthcoming Progression Award Board Meeting.
• Previous Discipline External Examiner Reports, normally for the last two years, where available.

Should you require any further copies of the above or wish to request any additional information, please contact the Academic Registrar Rebecca Harrison (rebecca.harrison@nulondon.ac.uk):

Discipline External Examiner Induction Provided by the University

The University organises a Discipline External Examiner Induction session to which newly appointed External Examiners are invited to attend. Due to the current social distancing regulations, the induction session will take place online.

The aim of the Induction session is to provide Discipline External Examiners with:

• An opportunity to meet newly appointed Discipline External Examiners and key staff.
• An opportunity to meet Heads of Discipline to discuss specific programmes and courses.
• General information about the University, including recent activities and new developments.
• Further information about the roles, responsibilities and value of Discipline External Examiners at the University.
• Information regarding Assessment Boards at the University, including the three-tier assessment board process for all taught courses, how Assessment Boards operate at the University, and forthcoming dates of Assessment Boards.
• An overview of relevant University policies and procedures.
• An opportunity to ask any questions and request additional information as appropriate.

An indicative agenda for the Discipline External Examiner Induction is provided below:

• Welcome to the University: recent activities and new developments
• Roles, responsibilities and the value of External Examiners at the University
• Assessment Boards at the University
• Assessment at the University: policies, procedures and practice
• An overview of the programmes and their constituent courses
• Marking criteria and schemes
• The logistics of External Examining
• Confirming key contacts
• Confirming receipt of relevant documentation
• Confirming where and when to send relevant documentation
• Confirming criteria for selecting samples of examination scripts/assignments for consideration

The Role of the Discipline External Examiner and External Examining

Discipline External Examiners play a fundamental role in assuring the University’s academic standards by providing an external perspective on student performance and on the conduct of the assessment process at the University.
External examining provides one of the principal means for maintaining nationally comparable standards within autonomous higher education institutions. The main purposes of external examining are:

• To verify that academic standards are appropriate for the award and its component parts by reference to published national subject benchmarks, the FHEQ, programme specifications and other relevant information.
• To help providers ensure that the assessment process measures student achievement appropriately against the learning outcomes of the programme/course.
• To verify that providers’ assessment processes are sound, fairly operated and in line with their policies and regulations.
• To help the University to assure and maintain academic standards.

Regular roles of Discipline External Examiners at the University include the following:

• Reviewing examination papers and marking criteria, and coursework assignments and project titles as appropriate.
• Reviewing samples of students’ work and reporting on the marking standards.
• Completing an annual report to evaluate whether the University’s academic standards are comparable with those in other UK HE institutions, and whether the standards of student performance are comparable with the standards of students on comparable courses in other institutions.
• Attending Assessment Boards at the University.
• In addition, the University will consult its Discipline External Examiners on:
• Changes to programmes and/or courses through appropriate programme and course modifications processes.
• Programme or course development.

The Responsibilities of Discipline External Examiners

Your primary responsibilities as a Discipline External Examiner are to verify that the academic standards of the University’s awards, as indicated by students’ attainment in assessment, have been set and maintained at the level prevailing in other higher education bodies in the United Kingdom, and that the process of assessment is fair, rigorous and conducted according to the appropriate academic regulations.
In order to carry out these responsibilities, you should be able, individually or collectively, to:

• Judge students impartially on the basis of the work submitted for assessment without being influenced by previous association with the course, the staff or any of the students.
• Calibrate the performance of students with that of their peers on comparable programmes of higher education elsewhere.
• Provide advice and feedback on proposed course assessment.
• Be consulted on the details of assessment (such as mode and weighting) and be given the opportunity to comment on the approved assessment regulations which will directly affect students on the course.
• Consider a sample of graded scripts from each course for which you are contracted, in order to confirm that the scripts have been graded in accordance with the criteria stated, to the proper standard, fairly and accurately. Samples will normally comprise grades corresponding to the highest available category of the award, borderlines, and fails.
• Exercise your right to moderate the marks awarded by internal examiners, and adjust the overall range of grades if warranted.
• Ensure that the assessments are conducted in accordance with the University’s regulations, as found in AQF7 Academic Regulations.
• Attend all meetings of Assessment Boards and ensure that decisions reached have been reached by means according to the University’s autonomy and normal practice in higher education.
• Report back to the University on the effectiveness of the assessments and any lessons to be drawn from them.
• Submit an annual report for courses examined.
• Be competent in assessing students’ knowledge and skills at higher education level.
• Be an expert in the field of study concerned.
• Be impartial in judgement.
• Be properly briefed in your role, the relevant course and the University’s regulations.

Assessment Boards

Progression and Award Board (PAB)

Progression and Award Boards (PAB) confirm student course marks, approve progression between levels, approve the conferment of University awards, and award academic credit.

Discipline External Examiners attend old the Progression Award Board Meetings that consider their respective programmes and/or discipline areas. The Terms of Reference, including membership, can be found here.

In respect of each student, the PAB will receive:

1. The overall mark for each course.
2. The mark for each assessment element.
3. Notification of the pathway courses (undergraduate double degree ONLY)
4. Notification of any irretrievable deficits.
5. Extenuating circumstances decisions confirmed by the University’s Extenuating Circumstances Panel.
6. Confirmation where a late submission penalty has been applied.
7. Confirmation where the student is subject to an academic misconduct ruling.
8. Confirmation where any recognition of prior learning credit has been awarded.
9. Level averages to one decimal place and award averages to one decimal place.
10. A total of all credit points achieved by the student in the named programme in this and previous years.

The PAB will:

1. Agree the final version of the minutes of the previous meeting and note any matters arising from them.
2. Note any actions taken under the delegated authority since the previous meeting.
3. Confirm the course assessment results for students and the award of credit.
4. Confirm whether students can progress onto the next level of their programme.
5. Confirm the conferment of an award and, as appropriate, its classification.
6. Confirm the awarding of a Pathway (undergraduate double degree students ONLY)
7. Confirm that core attributes have been passed in accordance with the double degree programme specifications (undergraduate double degree students ONLY).
8. To confirm the successful completion of the individual integrated end-point-assessment and confirm the award of credit. (Work Related programmes ONLY)
9. Note any reports submitted by the Assessment Team and advise on any relevant follow up actions.
10. Identify any Flagged Courses and advise on any follow up actions.

The business of the PAB is confidential.

Appeals Against Examination Board Decisions

Students can appeal the decision of the Progression and Award Board. Further information on Academic Appeals can be found here.

Extenuating Circumstances 

Except when prevented by medical reasons or other sufficient causes, students who fail to present themselves for an examination shall be deemed by the Assessment Board to have failed that examination.

Students are strongly advised to submit their coursework assessments ahead of the published deadline. However, if assessments are submitted late without approved Extenuating Circumstances, there are penalties:

• Up to one day late of the published submission deadline = 5% points deducted from mark. For example, an assessment awarded 58% from the markers, the final mark recorded will be 53%. If the assessment is awarded 42% from the markers, the final mark recorded will be 37%.
• Up to wo days late, any mark of 40% or higher will be capped at 40% for undergraduate students. Any mark of 50% or higher will be capped at 50% for postgraduate students. Any mark below 40% for undergraduate students and below 50% for postgraduate students, will stand.
• Students who do not submit their assessment within the two days following the deadline, and have no approved extenuating circumstances, are deemed to have failed that assessment element and the mark recorded will be 0%.

If a student experiences serious events that have a significant adverse effect on their ability to study or undertake an assessment, they may report them as Extenuating Circumstances using the University’s Extenuating Circumstances Policy, which is provided to students through the Academic Handbook, on the University website. The students are also directed to this policy through their programme handbooks. This policy provides students with clear instructions about events that are and are not considered Extenuating Circumstances and the procedure for submitting Extenuating Circumstances for both examinations and continuous performance (including the submission of coursework/assignments).

Assessment Regulations 

All students are required to comply with the University’s Assessment Regulations for Taught Awards. These are made available to students through the University’s Academic Handbook and are reviewed with students during the examination preparation sessions delivered by Registry. These regulations provide students with clear instructions about:

• Attending examinations.
• Examination room regulations for written exams.
• In-course assessment regulations – coursework and assignment submission.
• Assistance to students with Specific and Non-Specific Learning Difficulties.
• Extenuating Circumstances.

Review of Assessments

The University operates an internal peer review procedure to ensure that the assessments are set at the required level and enable students to meet the learning outcomes. The peer review also checks for grammar and spelling.

Once the assessments have been peer reviewed, Discipline External Examiners will be sent the assessments to ensure that they are appropriate for the sector.

This process happens prior to their being published to the students, which provides the peer reviewer and Discipline External Examiner an opportunity to provide feedback and for the assessments to be modified accordingly.

External Moderation 

Discipline External Examiners are asked to moderate the marking of internal markers for undergraduate courses at FHEQ Level 4, Level 5 and Level 6, and all postgraduate courses. This is to ensure that marking is accurate, consistent, fair, equitable, reliable, transparent and in line with national standards for the provision.  

Discipline External Examiners are not expected to mark work themselves and must not be asked to arbitrate or moderate disagreements between internal markers/moderators, or be used as a third marker. Any disagreements must be resolved between the marker, peer reviewer and moderator.

Where the external moderation of assessment raises substantial queries concerning the standards or consistency of marking, the Discipline External Examiner has the right to recommend to the Assessment Board a change to element marks and where appropriate course marks.  

Discipline External Examiners cannot recommend that any individual mark be changed in isolation, unless the work of every student for that assessment has been reviewed, to ensure that no student is unfairly advantaged/disadvantaged.

All assessment submissions, examination scripts and coursework assignments go through the following procedure:

• All assessment submissions are marked by the internal marker.
• 10% or 5 (whichever is the greater) submissions are internally moderated.
• The Discipline External Examiner will also be sent samples of Level 6 assessments which have been double marked.
• The Discipline External Examiner will receive electronically:
  • Sample coursework or examination scripts
  • Internal Moderation Record
  • Marks sheet
  • Coursework Assessment Brief or Examination Paper
  • Course Descriptor
  • Grade Marking Scale
  • External Examiner sheet to record comments in preparation for a verbal report at the Assessment Board and/or for the Annual Report

Discipline External Examiner Annual Report

As a Discipline External Examiner, you are required to submit a Discipline External Examiner Annual Report to the University. The University will be able to give you the dates and submission requirements.

In addition, a Discipline External Examiner will be required, at the end of their appointment, to provide a summative report of the period of their appointment.

The Purposes of the Annual Report

The main purpose of the Annual Report is to enable the University to consider and determine whether its programmes are meeting their stated objectives and to ensure that any necessary improvements are made, either immediately or at the next review of the programme as appropriate. 

Discipline External Examiners are required to report annually on the standards of their allocated provision and will also be asked to comment on:

• That the threshold academic standards set for the provision are being maintained.
• That the assessment process measures student achievement rigorously and fairly against intended learning outcomes.
• That the academic standards and achievement of students are comparable to the sector.
• The strengths and weaknesses of the students.
• The quality of knowledge and skills (both generic and subject specific) demonstrated by the students.
• The structure, organisation, design and marking of all assessments.
• The quality of student learning as indicated by student performance.
• The implications to be drawn from the assessments for the curriculum, syllabus, teaching methods, and for the resources for the programmes.
• Good practice and innovation relating to the learning, teaching and assessment, and opportunities for enhancement.

The Annual Report also informs the University’s annual monitoring and reporting processes. Annual monitoring and reporting forms a key part of the University’s cycle of assuring and enhancing the academic standards and quality of its programmes and courses. Each Head of Discipline/Programme Director completes an Annual Faculty Review annually involving input from External Examiners through the Annual Report.

Responses to the Annual Report

Annual Reports are made available to the Head of Discipline, faculty and the Quality Team. In addition, they are made available to students through Canvas, the University’s virtual learning environment.

The Head of Discipline, in collaboration with their Course Leaders and faculty, will write a letter, responding to your key points and informing you of any actions that have been agreed by the Faculty.

The response to External Examiner Annual Reports will record actions planned to be taken in response to your recommendations as well as recording areas of good practice that you have identified. It is the responsibility of the Head of Discipline to ensure that each action is monitored and completed, and to disseminate the areas of good practice for wider consideration and adoption as appropriate.

The completed responses to External Examiner Annual Reports are submitted to Academic Board for consideration and monitoring of any outcomes.

Raising a Concern

If you have cause to raise a concern regarding the academic standards of courses, you are advised to raise this with the Academic Registrar. The Academic Registrar will investigate the issue in order to resolve the matter to the satisfaction of all parties.

Should the issue remain unresolved, you may submit a confidential report directly to the Academic Dean of Northeastern University London.

Where a Discipline External Examiner has a serious concern relating to systemic failings with the academic standards of a programme and has exhausted all published applicable internal procedures, they may invoke the ‘QAA’s concerns scheme’ or inform the relevant professional, statutory or regulatory body.

The scheme’s focus is designed for systemic failings in the University’s management of standards or quality and should not be used for one-off cases of ineffective practice, or to raise a personal grievance or issues relating to an appointment.

If you have cause to raise a concern about the behaviour or performance of a member of staff at the University, you should put this in writing to the Dean of Faculties (concerning academic staff) or the Chief Executive Offcer (concerning professional staff).  

Key Academic Contacts 

General Queries & Support from the University

If you have any general queries about your role as a Discipline External Examiner or require copies of documentation mentioned in this handbook, please contact the Academic Registrar,: rebecca.harrison@nulondon.ac.uk

Programme Specific Queries & Support from the University

If you have any queries about the courses for which you are a Subject External Examiner, please contact the relevant Head of Faculty or :

List of Referenced Documentation in this Handbook

The following is a list of the documentation that is referenced throughout this handbook (excluding weblinks).

• Academic Appeals Policy
• Academic Misconduct Policy
• Assessment Board Terms of Reference
• Assessment Regulations for Taught Awards
• Extenuating Circumstances Policy 
• Marking, Moderation and Feedback Policy