Senin, 04 Mei 2015

Requirements, Assumptions, @ Estimation of Parameters as well as Instrument Development based on IRT

By:
Marwa & Erlik Widiyani Styati

IRT has a number of advantages over CTT methods to assess test outcomes.  CTT statistics such as item difficulty (proportion of correct responses), item discrimination (corrected item-total correlation), and reliability are contingent on the sample of respondents to whom the questions were administered.  IRT item parameters are not dependent on the sample used to generate the parameters, and are assumed to be invariant (within a linear transformation) across divergent groups within a research population and across populations.

Introduction to Item Response Theory (Comparison between CTT and IRT)

By:
Marwa & Erlik Widiyani Styati
Classical test theory (CTT and item response theory (IRT) are widely perceived as representing two very different measurement frameworks. There have been a brief review of related theories. Additional detail is provided elsewhere (Crocker & Algina, 1986; McKinley & Mills, 1989).

Issues in the Development of Authentic Assessment: Portfolio, Project, Extended Response, etc.

By:
Marwa & Erlik Widiyani Styati
A commonly advocated best practice for classroom assessment is to make the assessments authentic. Authentic is often used as meaning the mirroring of real-world tasks or expectations. There is no consensus, however, in the actual definition of the term or the characteristics of an authentic classroom assessment. Sometimes, the realistic component is not even an element of a researcher’s or practitioner’s meaning.
            Simply testing an isolated skill or a retained fact does not effectively measure a student's capabilities. To accurately evaluate what a student has learned, an assessment method must examine his or her collective abilities. The term authentic assessment describes the multiple forms of assessment that reflect student learning, achievement, motivation, and attitudes on instructionally relevant classroom activities.
           
            There are several challenges to using authentic assessment methods. They include managing its time-intensive nature, ensuring curricular validity, and minimizing evaluator bias. Despite these challenges, efforts must be made to appropriately assess all LEP students and to welcome the possibility of assessment strategies that can empower students to take control of their own learning and to become independent thinkers and users of the English language.




REFERENCES
O’Malley, J.M. and Pierce, L.V. 1996: Authentic Assessment for English Language      Teachers: Practical Approaches for Teachers. New York:Addison-Wesley Publishing         Company.




Issues in the Development of Non-Test Instruments (Rating scales, semantic differential scales, checklists, questionnaires and others)

By:
(Marwa & Erlik Widiyani Styati)
Rating scale is one of the enquiry form. Form is a term applied to expression or judgment regarding some situation, object or character. Opinions are usually expressed on a scale of values. Rating techniques are devices by which such judgments may be quantified. Rating scale is a very useful device in assessing quality, especially when quality is difficult to measure objectively. For Example, “How good was the performance?” is a question which can hardly be answered objectively. Rating scales record judgment or opinions and indicates the degree or amount of different degrees of quality which are arranged along a line is the scale. For example: How good was the performance?

Parallel Tests & Equating: Theory, Principles, and Practice

By:
(Marwa & Erlik Widiyani Styati)
Definition of Equating
            The process of equating is used to obtain comparable scores when more than one test forms are used in a test administration. As Petersen et al. (1989) point out the process of equating “is used to ensure that scores resulting from the administration of the multiple forms can be used interchangeably.” They further argue that equating can be defined as empirical procedures for establishing a relationship between raw scores on two test forms that can then be used to express the scores on one form in terms of the scores on the other forms. Angoff (1971) has defined the equating of tests as a process “to convert the system of units of one form to the system of units of the other” so that the scores obtained from one form could be compared directly with the scores obtained from the other form.

Minggu, 03 Mei 2015

Issues in the Development of Standardized Proficiency Tests (Language Skills and Components): Academic Vocational: BULATS, TOEIC, & TOEP



By: Marwa and Erlik Widiyani Styati

The standardized test such as TOEFL and IELTS are discussed in the previous chapter. The other standardized test are BULATS, TOIEC, and TOEP. BULATS (Business Language Testing Service) is a multilingual set of workplace language assessment. It is used internationally for business and industry recruitment, for identifying and delivering training, for admission to study business-related courses and for assessing the effectiveness of language courses and training. The language skills in BULATS are listening, reading, writing, speaking. Topics in BULATS refers to the real-life topic. The test can be done without particular software but it needs internet connection. The listening and reading test in online. There are also knowledge and grammar in online test. It takes about an hour in doing the test and the result is available at the end of the test.

Issues in the Development of Standardized Proficiency Tests (Language Skills and Components): Academic: IELTS and TOEFL



 By: Marwa and Erlik Widiyani Styati

Standardized test is developed, administered, and scored using established procedures and guidelines. All the students are given test in the same test, under the same condition. The students are given opportunity to determine the correct answers and all the scores are established and intepreted using the criteria.