Claim Missing Document
Check
Articles

Found 4 Documents
Search
Journal : Jurnal Pendidikan Terbuka Dan Jarak Jauh

ANALISIS BUTIR TES OBJEKTIF UJIAN AKHIR SEMESTER MAHASISWA UNIVERSITAS TERBUKA BERDASARKAN TEORI TES MODERN Ratnaningsih, Dewi Juliah; Isfarudi, Isfarudi
Jurnal Pendidikan Terbuka Dan Jarak Jauh Vol 14 No 2 (2013)
Publisher : LPPM Universitas Terbuka

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Universitas Terbuka has been applying a test of final examination for measuring student learning outcomes. Type of final examination that developed is objective test consisting of stem and option. Option of test covering answer key and detractors. A good question should have detractors relatively homogenous, so that it is difficult to guessed by a student. Criteria of good question can be determined by item analysis with using classical test theory and modern test theory. Universitas Terbuka has been doing item analysis based on classical test theory. This theory has the limitations characteristic of the index items were highly dependent on the group of test. Unlike the case with modern test theory (item response theory). Item response theory is based on the ability of individual test. The purpose of this paper is to determine: (1) how the result of the final exam item analysis using item response analysis, (2) how the comparison of the number of valid and invalid between item response analysis and classical test analysis, and (3) how to determine item characteristics of the items and estimate the ability of participants to the test item response using Rasch models. The data used are student answers that took exams on subjects selected sample in 2009.1 and 2009.2. The total sample used by 8 subjects consisting of 16 sets of questions. The study results showed: (1) average difficulty level of the sample items was subject to item response items (Rasch Model) is between 0.618 to 1.417, (2)comparison of the results of the analysis of test items using classical analysis and the Rasch model analysis is very significant, and (3)on the number of examinees who many (over 1,500 people), the number or percentage of items was valid by using item response analysis more than the classical analysis.   Universitas Terbuka menerapkan tes berupa Ujian Akhir Semester untuk mengukur hasil belajar mahasiswa. Tipe soal UAS yang dikembangkan berbentuk tes objektif yang meliputi pernyataan (stem) dan alternatif jawaban (option). Option suatu tes meliputi kunci jawaban dan bukan kunci jawaban (pengecoh). Soal yang baik harus memiliki pengecoh yang relatif homogen, sehingga sulit ditebak oleh mahasiswa. Kriteria soal yang baik dapat diketahui dengan melakukan analisis butir soal baik menggunakan teori tes klasik maupun teori tes modern. Universitas Terbuka melakukan analisis butir soal UAS berdasarkan teori tes klasik. Teori ini memiliki keterbatasan yakni indeks karakteristik butir soal sangat bergantung pada kelompok peserta tes. Pada teori tes modern (teori respon butir), analisis butir soal didasarkan pada kemampuan individu peserta tes bukan berdasarkan kemampuan kelompok peserta tes. Tujuan penulisan artikel ini adalah untuk menentukan: (1) bagaimana hasil analisis butir soal UAS menggunakan teori respon butir, (2) bagaimana perbandingan jumlah soal valid dan tidak valid antara analisis respon butir dengan analisis tes klasik, dan (3) bagaimana menentukan karakteristik soal dan estimasi kemampuan peserta tes dengan analisis respon butir menggunakan model Rasch. Data yang digunakan adalah jawaban mahasiswa yang mengikuti ujian pada 8 mata kuliah sampel terpilih masa ujian 2009.1 dan 2009.2 yang terdiri atas 16 set soal. Hasil penelitian menunjukkan, rata-rata tingkat kesukaran soal mata kuliah sampel dengan teori respon butir (model Rasch) berkisar antara 0,618 sampai dengan 1,417. Perbandingan hasil analisis butir soal model klasik dengan model Rasch sangat signifikan. Pada jumlah peserta ujian yang banyak (lebih dari 1.500 orang), jumlah atau persentase butir soal yang valid dengan menggunakan item respon butir lebih banyak dibanding dengan analisis klasik.
ANALISIS BUTIR SOAL PILIHAN GANDA UJIAN AKHIR SEMESTER MAHASISWA DI UNIVERSITAS TERBUKA DENGAN PENDEKATAN TEORI TES KLASIK Ratnaningsih, Dewi Juliah; Isfarudi, Isfarudi; Soleiman, Nuraini
Jurnal Pendidikan Terbuka Dan Jarak Jauh Vol 12 No 2 (2011)
Publisher : LPPM Universitas Terbuka

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Multiple choice tests have been used to measure students learning achievement for most of the courses at Universitas Terbuka (UT). To ensure the quality of the tests, test item analysis based on classical test theory has been employed regularly. This paper aims to analyze multiple-choice items of the End Semester Examination of UT using the program ITEMAN. The data used were the answers sheets of students taking eight courses in the first and second semester of 2009. Courses analyzed in this study were MKDU4111, PEMA4210, MKDU4109, ISIP4215, EKMA4214, ESPA4112, BIOL4110, and BIOL4119. The results showed that the test items used have had a pretty good quality. Average test item difficulties were fair. This was indicated by the mean value of P which ranged from 0.328 to 0.461. Discrimination index for both semester tests were good in about 75% of the courses measured. Its value ranges from 0.304 to 0.451 for the first semester of 2009 tests and 0.343 to 0.382 for the second semester of 2009 tests. Meanwhile, the reliability of the test items could be considered good except for the courses PEMA4210 (first semester 2009) and MKDU4111 (second semester 2009).
ANALISIS BUTIR TES OBJEKTIF UJIAN AKHIR SEMESTER MAHASISWA UNIVERSITAS TERBUKA BERDASARKAN TEORI TES MODERN Dewi Juliah Ratnaningsih; Isfarudi Isfarudi
Jurnal Pendidikan Terbuka Dan Jarak Jauh Vol. 14 No. 2 (2013)
Publisher : LPPM Universitas Terbuka

Show Abstract | Download Original | Original Source | Check in Google Scholar | Full PDF (536.565 KB)

Abstract

Universitas Terbuka has been applying a test of final examination for measuring student learning outcomes. Type of final examination that developed is objective test consisting of stem and option. Option of test covering answer key and detractors. A good question should have detractors relatively homogenous, so that it is difficult to guessed by a student. Criteria of good question can be determined by item analysis with using classical test theory and modern test theory. Universitas Terbuka has been doing item analysis based on classical test theory. This theory has the limitations characteristic of the index items were highly dependent on the group of test. Unlike the case with modern test theory (item response theory). Item response theory is based on the ability of individual test. The purpose of this paper is to determine: (1) how the result of the final exam item analysis using item response analysis, (2) how the comparison of the number of valid and invalid between item response analysis and classical test analysis, and (3) how to determine item characteristics of the items and estimate the ability of participants to the test item response using Rasch models. The data used are student answers that took exams on subjects selected sample in 2009.1 and 2009.2. The total sample used by 8 subjects consisting of 16 sets of questions. The study results showed: (1) average difficulty level of the sample items was subject to item response items (Rasch Model) is between 0.618 to 1.417, (2)comparison of the results of the analysis of test items using classical analysis and the Rasch model analysis is very significant, and (3)on the number of examinees who many (over 1,500 people), the number or percentage of items was valid by using item response analysis more than the classical analysis. Universitas Terbuka menerapkan tes berupa Ujian Akhir Semester untuk mengukur hasil belajar mahasiswa. Tipe soal UAS yang dikembangkan berbentuk tes objektif yang meliputi pernyataan (stem) dan alternatif jawaban (option). Option suatu tes meliputi kunci jawaban dan bukan kunci jawaban (pengecoh). Soal yang baik harus memiliki pengecoh yang relatif homogen, sehingga sulit ditebak oleh mahasiswa. Kriteria soal yang baik dapat diketahui dengan melakukan analisis butir soal baik menggunakan teori tes klasik maupun teori tes modern. Universitas Terbuka melakukan analisis butir soal UAS berdasarkan teori tes klasik. Teori ini memiliki keterbatasan yakni indeks karakteristik butir soal sangat bergantung pada kelompok peserta tes. Pada teori tes modern (teori respon butir), analisis butir soal didasarkan pada kemampuan individu peserta tes bukan berdasarkan kemampuan kelompok peserta tes. Tujuan penulisan artikel ini adalah untuk menentukan: (1) bagaimana hasil analisis butir soal UAS menggunakan teori respon butir, (2) bagaimana perbandingan jumlah soal valid dan tidak valid antara analisis respon butir dengan analisis tes klasik, dan (3) bagaimana menentukan karakteristik soal dan estimasi kemampuan peserta tes dengan analisis respon butir menggunakan model Rasch. Data yang digunakan adalah jawaban mahasiswa yang mengikuti ujian pada 8 mata kuliah sampel terpilih masa ujian 2009.1 dan 2009.2 yang terdiri atas 16 set soal. Hasil penelitian menunjukkan, rata-rata tingkat kesukaran soal mata kuliah sampel dengan teori respon butir (model Rasch) berkisar antara 0,618 sampai dengan 1,417. Perbandingan hasil analisis butir soal model klasik dengan model Rasch sangat signifikan. Pada jumlah peserta ujian yang banyak (lebih dari 1.500 orang), jumlah atau persentase butir soal yang valid dengan menggunakan item respon butir lebih banyak dibanding dengan analisis klasik.
ANALISIS BUTIR SOAL PILIHAN GANDA UJIAN AKHIR SEMESTER MAHASISWA DI UNIVERSITAS TERBUKA DENGAN PENDEKATAN TEORI TES KLASIK Dewi Juliah Ratnaningsih; Isfarudi Isfarudi; Nuraini Soleiman
Jurnal Pendidikan Terbuka Dan Jarak Jauh Vol. 12 No. 2 (2011)
Publisher : LPPM Universitas Terbuka

Show Abstract | Download Original | Original Source | Check in Google Scholar | Full PDF (70.931 KB)

Abstract

Multiple choice tests have been used to measure students learning achievement for most of the courses at Universitas Terbuka (UT). To ensure the quality of the tests, test item analysis based on classical test theory has been employed regularly. This paper aims to analyze multiple-choice items of the End Semester Examination of UT using the program ITEMAN. The data used were the answers sheets of students taking eight courses in the first and second semester of 2009. Courses analyzed in this study were MKDU4111, PEMA4210, MKDU4109, ISIP4215, EKMA4214, ESPA4112, BIOL4110, and BIOL4119. The results showed that the test items used have had a pretty good quality. Average test item difficulties were fair. This was indicated by the mean value of P which ranged from 0.328 to 0.461. Discrimination index for both semester tests were good in about 75% of the courses measured. Its value ranges from 0.304 to 0.451 for the first semester of 2009 tests and 0.343 to 0.382 for the second semester of 2009 tests. Meanwhile, the reliability of the test items could be considered good except for the courses PEMA4210 (first semester 2009) and MKDU4111 (second semester 2009).