Simple: Sistim Penilai Esei Otomatis Untuk Menilai Ujian Dalam Bahasa Indonesia

Anak Agung Putri Ratna • Bagio Budiardjo • Djoko Hartanto
Journal article Makara Journal of Technology • April 2007 Indonesia

Abstract

SIMPLE: System Automatic Essay Assessment for Indonesian Language Subject Examination. Evaluation ofstudy of a student is a very important aspect of an educational process. Evaluation is aimed at measuring the level ofstudent understanding of the given lecture materials. Measuring student understanding of the course material, usingessay-type exam, is generally used as the evaluation tool. In this essay-type exam, the student has to answer questionsusing sentences, whereby choices of possible answers are not indicated. The student has to answer the questions withhis/her sentences. The answers may vary, since it reflects the student's best thoughts of the materials. One of theweaknesses of essay-type exam is the difficulty to grade the answers and it tends to be time consuming. Currently,automatic grading systems that may speed up the grading process, are being developed in many research institutions.The method used to grade, varies form one system to another, and one of the popular system is the Latent SemanticAnalysis (LSA). LSA is a method of grading essay by extracting words and representing the sentence in the form ofmathematical or statistical formulation, from a text with a relatively large number of words. The grade of the essay isdetermined, by matching the important words to a group of words prepared by the human rater. This paper describes aneffort to developed LSA, enhanced with word weighting, word order and the word synonym to improve the accuracy ofgrading. This system is called SIMPLE. SIMPLE is used to grade answers using bahasa Indonesia. The exam is carriedout on-line through the Web. From the experiments conducted, for small classes, the conformity of grade compared tothe grade of human rater lies between 69.80 % - 94.64 %, and for medium size classes the conformity lies between77.18 % - 98.42 % with the human rater. These results are roughly proportional with the result of LSA system, whichgrade essay given in English.

Metrics

  • 163 views
  • 386 downloads

Journal

Makara Journal of Technology

Makara Journal of Technology is a peer-reviewed, multidisciplinary journal committed to the advan... see more