English
Eurasian Journal of Educational Research
Print ISSN: 1302-597X & e-ISSN: 2528-8911
EJER | 2017 Issue 72

Ebru BALTA, Secil OMUR SUNBUL

An Investigation of Ordering Test Items Differently Depending on Their Difficulty Level by Differential Item Functioning

10.14689/ejer.2017.72.2
  Author : Ebru BALTA, Secil OMUR SUNBUL
  This abstract has been read 203 times.

Title :
Ebru BALTA, Secil OMUR SUNBUL

An Investigation of Ordering Test Items Differently Depending on Their Difficulty Level by Differential Item Functioning

10.14689/ejer.2017.72.2

Abstract :

Purpose:

Position effects may influence examinees' test performance in several ways and trigger other psychometric issues, such as Differential Item Functioning (DIF) .This study aims to supply test forms in which items in the test are ordered differently depending on their difficulty level (from easy to difficult or difficult to easy); to determine whether the items in the test form result in DIF and to determine whether if there exists a consistency between the methods for detecting DIF.

Method:

Methods of Mantel Haenszel (MH) and Logistic Regression (LR) have been taken into consideration to identify whether the items in the tests involve DIF.The data of the work includes the answers of 300 students in the focal group and reference group who was applied three mathematics achievement test. The data obtained from tests have been statistically analyzed by using R- 3.2.0. software program.

Findings:

Results of this study can be summarized with the following findings: "ordering the items differently depending on their difficulty level affects the probability of individuals in various groups answering the items correctly; and also LR and MH methods produce different results with respect to the items with DIF which they have identified similar in terms of magnitude order in the amount of DIF.

Implications for Research and Practice:

In further test developing studies, in order to identify if giving the test form which have different ordering of items with regard to subjects and cognitive difficulty levels emerges DIF.

Keywords: Item Orderings, Mantel-Haenszel, Logistic Regression, Moodle

« Back