ID Description Affection %
1 Assessment method not integrated into the curriculum 75
2 CBA for a particular degree programme not acceptable to the relevant professional bodies 50
3 Unsuitable or badly designed questions 50
4 Academic staff leaving the system because of complete test redesign each academic year 50
5 Examination contains errors 50
6 Students very anxious about new assessment method 75
7 Lack of interest from academic staff 75
8 CBA exam unacceptable to a student 50
9 Staff not convinced of benefit 100
10 No availability of past papers for revision 100
11 The need to use different moderation procedures for CAA not recognized 75
12 Errors in questions 50
13 Unrealistic schedules for delivery of CBA system 75
14 Personnel skills shortfall (academic) 50
15 Personnel skills shortfall (support) 50
16 Students accessing CBA papers breaking network security 50
17 Students that cannot take the exam on a computer or need more time are not accommodated 50
18 Computer workstations too close to each other encourage viewing_x000D_ adjacent screens 75
19 Module size too large for number of workstations available 100
20 Student starts to take the wrong exam 50
21 Student arrives late for the exam 50
22 Student leaves the exam early 50
23 Inadequate access to workstations 50
24 Unauthorised access to answer files 50
25 Students NOT taking CBA affected by lack of access to computing resources during exam period 50
26 Student attends correct exam but wrong session 50
27 Students not familiar with system 50
28 Student not registered on module, so no test available 50
29 Different invigilation requirements for CAA not recognized 100
30 Students with special needs (screen readers etc), not accommodated 75
31 Staff try to use system with inadequate training 75
32 No trained invigilators 100
33 Roles and responsibilities not clear 100
34 Past papers/practice tests available during exam 50
35 Different exam procedures (e.g., registration and id checking) not_x000D_ recognized 75
36 Students not consulted on introduction of new technologies 75
37 Communication between sets of students not addressed (between sittings of the same exam or during the exam) 75
38 No copy of individual exam in case of appeal by student available 50
39 Students keep copies of exam questions 25
40 Students distribute copies of their exam question answers - in room 75
41 Students distribute copies of their exam question answers - external 75
42 Students create screenshots for communication 75
43 Leak of exam questions 75
44 Students use other documents than allowed 100
45 Errors in wording appear, open questions 25
46 Students not submitting quiz at the end 50
47 Students not saving files after upload on Moodle 75
48 Errors in wording appear, closed questions 50
49 Students unenrol themselves from the course 100
50 Students make changes after end of exam 100
51 Use of questions already known to students from previous exams 25
52 Workstation collapse during exam 25
53 Server collapse during exam 25
54 Answer files not being stored or updated 25
55 Answer files lost once exam complete 25
56 A badly designed user front end 75
57 An unbelievable result 25
58 Computer becomes disconnected 25
59 Student Laptop failure 100
60 Student browser incompatibility 50
61 Student software problem (Excel, Eclipse, ...) 25
62 External access on students' computers (TeamViewer etc.) 100
63 Authentication of login across internet not secure 50
64 Different authentication between on-campus and off-campus (web based) use not recognized 75
65 External Examiners unable to access exams across web 50
66 Students accessing inappropriate materials (e.g., web-based) during_x000D_ assessment 50
67 Students using different technical platforms (between sites, at home, _x000D_Macs?) 75
68 Students using different browsers (compatibility issues) 75
69 Network load too high 75
70 Spurious network failure (Wifi lost) 75
71 E-Learning availability failure (< 10 minutes) 75
72 E-Learning availability failure (> 10 minutes) 100
73 Network persistently slow 75
74 Lack of commitment from management 75
75 Unrealistic budgets for delivery of CBA 100
76 CBA system not cost effective 75