Special Operations Unit for English Education
Introduction
Because English education in Korea focuses on reading and grammar, many Koreans who have learned English for ten years in school still have difficulty in daily conversation. This tendency is not caused by the fact that the English curriculum in Korea's middle and high schools concentrates on reading and grammar rather than improvement in expression in areas such as speaking and writing; the current curriculum has been established to improve expression in speaking and writing, but learners cannot be motivated due to an absence in connection with evaluation.
From the dimension of the school field, three causes impeding improvement in English expression (including speaking and writing) of learners are as follows.
First, schools present classes focusing on the college entrance examination centered on listening and reading, thus hardly evaluating speaking and writing. In the college entrance exam, listening and reading are evaluated directly but speaking and writing are evaluated indirectly. Classes presented by schools should center on listening and reading while excluding improvement in expression such as speaking and writing, and it is difficult for schools to normally comply with the curriculum.
Second, it is hard to present performance assessment of speaking and writing in large classes. As for speaking assessment, it is not possible to assess face to face speaking ability between teachers and students in large classes with 35 or more students. As for writing assessment, it has insufficient time for conducting process assessment in which teachers correct the drafts or answers of English writing written by learners in large classes several times to enhance their percentage of completion, due to teachers' excessive classes and work.
Third, the expertise of English teachers on speaking and writing assessment is insufficient. Because schools are accustomed to assessment centered on multiple-choice or short-answer questions, they have no systematic standards of marking speaking and writing. Teachers have no training on marking standards that can be differentiated according to questions, and as a consequence reliability on marking is not secured. The assessment system in the level of school units for securing
reliability among markers in performance assessment of speaking and writing stands out in particular.
In order to solve the three problems, the Korea Institute for Curriculum and Evaluation (KICE) is developing the State English Aptitude Test, which can help to solve the problem of feedback effect on curriculum. In other words, when speaking and writing assessment is performed by direct evaluation and not by the current indirect evaluation, English teachers or learners in school units have to prepare for speaking and writing, in addition to reading and listening. Then, the problem of balanced evaluation of the four functions will be solved and the measure can be helpful to realize the English curriculum in a normal manner.
Also, the State English Aptitude Test can settle the difficulty in performance assessment of speaking and writing in large classes. Even when high-quality questions on speaking and writing are developed to be used, it is insufficient in time to assess individual learners and to mark individual answers. In the State English Aptitude Test, the individual answers of learners' speaking can be recorded and preserved and teachers can mark the answers when they are convenient. As for writing, when a securing system for markers is constructed, statistic and analysis processes can be conducted only by inputting grades via a marker securing login conducted anytime and anywhere. Therefore, the problems caused by large classes can be solved by improving the methods of marking speaking and writing assessment.
Furthermore, the State English Aptitude Test can solve problems where there are no systematic standards of marking speaking and writing. The KICE supervising the test is planning to establish and distribute a system of speaking and writing for school units, and the system contains types of assessment questions and example materials, as well as the marking standards of speaking and writing. Also, the KICE intends to enhance the expertise of teachers on the assessment by developing training manuals for school teachers in order to properly distribute the system. When the system is properly materialized, processes from design of rubric marking to questions analysis will be able to be realized in a school unit.
Therefore, when the State English Aptitude Test is established and realized on a stable basis, the learning methods of English speaking and writing can be improved and consequently the ability of students to speak and write can be considerably enhanced. Other than the current college entrance exam as an indirect assessment, the test directly assesses English speaking and writing to conduct performance
assessment with authenticity, to be able to realize balanced teaching of the four linguistic functions including expression such as speaking and writing, and then to normalize the management of English curriculum in the school field.
Missions
The preliminary test for May of the State English Aptitude Test was performed on May 28, and 29, 2009. The test was conducted at 33 high schools located in Seoul and the capital area in order to identify the reliability, level of difficulty, and establishment of the Internet-based, large-scale assessment system of the State English Aptitude Test, or the so-called "Korean type TOEIC or TOEFL." Further preliminary tests will be conducted in order to verify the validity and reliability of the test, and then the actual test will be introduced in 2012.
In order to do this, the State English Aptitude Test is planned to sufficiently reflect the school curriculum of listening, reading, speaking, and writing, and to be conducted at ordinary times for reduction in student burden. Based on the basic plan for introduction of the State English Aptitude Test that was established and pronounced in 2007, two types of the test will be developed for students and the general public, respectively: the type for students presents a national standard with public confidence on school English education by connection with curriculum; and the type for the general public replaces foreign tests for domestic purposes (such as TOEIC), to conduct balanced assessment of the four linguistic functions, and to secure and promote international use.
The contents of the plan for introduction of the State English Aptitude Test shown from the measure to innovate English education presented in November 2006 to the report on operations by the Ministry of Education, Science, and Technology were partially adjusted and have been promoted with consistency, except the fact that the State English Language ability test for elementary school students was removed. More concretely, the first-class test is going to be developed for the purpose of assessment domains including expressive ability such as speaking and writing and securing international use, as well as assessment reflecting the curriculum for middle and high schools and receptive ability such as reading and listening. Also, the application to the college entrance exam will be decided in 2012, and the efficiency
in assessing and marking speaking and writing will be promoted via the Internet Based Test (IBT) method, not the Paper Based Test (PBT) method.
The State English Aptitude Test is based on a system of speaking and writing assessment as follows:

Major Research & Development
The concrete tasks of each team are as follows.
- Team for Assessment Framework
- The tasks of the team for assessment framework of the State English Aptitude Test are (1) establishment of standards on the first-, second- and third-class. The first-class test will be developed for sophomores or juniors in colleges and be used for graduation exams or employment, and the second- and third-class tests will be developed for high school students and be used as reference materials in the college entrance exam. English ability under the National Curriculum System, (2) development of the first-, second- and third-class English assessment system based on the State English Aptitude Test, (3) development of the test paper model on the basis of the entire system of the State English Aptitude Test, and (4) establishment of the system and directions to promote positive effects of assessment on English education. Also, as for exams of listening and speaking, the tasks of the team include establishment of language input materials, language types used in presenting questions (sound and written languages), and the levels and stages of the test, development of test specifications, establishment of test standards based on works for technical definition of performance standards presented by the curriculum, and decision on the test period and number & types of the questions. The team for assessment framework basically conducts studies on development and supplementation of manuals for editing questions for speaking and writing, presentation and analysis of questions for speaking and writing, development of types of questions for speaking and writing, development and research on questions for experimental assessments, selection and determination of questions for final performance, and research of reliability and quality control of the test. Also, the team continuously performs works not only to enhance the completion of questions by persistent correction and supplementation via preliminary tests in order to realize the purpose of the IBT-formed test, but to negotiate with and manage the human resource pool of those who make and review questions for speaking and writing, to research question-making systems and test equating, in order to improve the validity and reliability of the test.
- Team for Marking Research
- The most important characteristic of the State English Aptitude Test is the assessment of speaking and writing, and thus there is a need to secure those who mark the answers of the students, as well as constructing the IBT system, in order to assess speaking and writing. Domestic scholars studying English assessment and education and English teachers in the school field may have accumulated sufficient knowhow on listening and reading tests because there has been listening and reading in the college entrance exam for 15 years, from 1993. Therefore, tests of listening and reading are not worried about for their reliability because generally question-makers analyze listening and reading abilities to present multiple-choice questions based on the analysis and then the answers are marked mechanically. However, other than listening and reading assessment, speaking and writing have not been considered at the national level, and there is insufficient experience on them. In speaking and writing assessment, it is difficult to present assignments or questions for students, and additionally, it is problematic that the qualities of answers of students should be assessed subjectively. This problem requires research on methods securing the reliability and discrimination of expressive ability assessment. Furthermore, it is required to take measures for equating by verifying the validity of the test such as a reliability test among assessors, and then re-applying the results of the verification to the re-developed test. The team performs works to project concrete methods of marking speaking and writing, to develop training processes and marking manuals for markers of speaking and writing, to secure the validity and reliability of assessment tools, and to specify the standards of marking speaking and writing developed by the team for question development, in order to establish the foundation for the assessment system of the State English Aptitude Test.
- Team for Establishment of IBT Infrastructure
- The State English Aptitude Test is not PBT but IBT. A paper-based test is practically stable, and a web-based test should be made to maximize the merits and to minimize the demerits of a paper-based test. Therefore, numerous errors that can occur when the participants access the web at the same time nationwide should be expected in the IBT, and security for markers as well as server security has to be satisfied in the stability of the test and the process of question marking. The tasks of the team for establishment of IBT infrastructure are as follows. First, while PBT has no problem in computer familiarity of the participants, in a computer- or web-based test the computer familiarity of the participants should be considered. Second, in a computer- or web-based test, limitations in question development of the PBT need not be considered, but instead the security of questions should be strictly established. Third, making questions, collecting answers, delivering answers to markers in an IBT should be automatized and designed to have higher practicality when compared to those of a PBT. Fourth, markers of a computer- or web-based test, other than those of a PBT, can be free from temporal and spatial limitations to improve efficiency in marking, but studies on methods of marker certification and marker security should be continued. The success of an IBT depends on overloading that can occur between downloading and uploading questions, exam halls for the test that are confirmed for successive conducting of the test, optimization of computers and monitors for participants as hardware requiring to conduct web-based tests, sufficient security of speakers, microphones, servers of centers and exam halls, and network equipment. Furthermore, the merits of a web-based test should be sufficiently realized such as verified security programs, optimization of computers for participants before the test, and colored audiovisual materials used in the test in development of IBT questions. In addition to the conditions, development of programs of speaking and writing that can be used in large classes and programs of marking for teachers to improve marking reliability should be continued.
- Support Team for School Unit Assessment
- The State English Aptitude Test contains English expressive ability of speaking and writing, as well as reading and listening. Other than the indirect assessment required by the listening test of the current college entrance exam, the test directly assesses the ability of participants to express their thoughts in English, and thus it is not a familiar type in the school field. This type of test should be sufficiently received in schools in order to change English education in the school field. Above all, school units should develop their own questions for assessing students related with the curriculum based on the types of the test to apply them to English performance assessment for students. In other words, a system should be designed in which teachers develop assessment questions appropriate to learning progress, the questions are delivered to personal computers for participants via school intranet, the answers are delivered and stored in DB servers after the test, and programs of analyzing marks automatically report on the marks. The positive effects of the State English Aptitude Test can be realized when the expertise of teachers on assessment in the school field can be improved. Therefore, in order to establish the speaking and writing tests in a school unit, the support team for school unit assessment is conducting works to take measures to construct a school unit intranet with which assessment questions can be developed and contained, school unit tests can be performed, and answers of the participants can be analyzed, to enhance the expertise of teachers on assessment of expressive ability such as English speaking and writing by English teachers' participation in developing questions and marking, to develop questions with which English proficiency can be assessed by normally evaluating the achievement of students of the purpose of English education presented by the curriculum, and to realize programs with which the four domains of listening, reading, speaking, and writing by IBT by using the school intranet network can be assessed with balance.

