Wednesday, August 30, 2023

Criterion-related validity

Criterion- Related Validity

by Nang Aye Aye Htun

What is criterion-related validity? 

  • evaluate how accurately a test measures the outcome it was designed to measure. 
  • To establish criterion validity, you need to compare your test results to criterion variables

How to measure criterion validity

Criterion validity is assessed in two ways:

  • By statistically testing  a new measurement technique against an independent criterion or standard to establish concurrent validity
  • By statistically testing against a future performance to establish predictive validity
Example: Criterion validity

A researcher wants to know whether a college entrance exam is able to predict future academic performance. First-semester GPA can serve as the criterion variable, as it is an accepted measure of academic performance.The researcher can then compare the college entry exam scores of 100 students to their GPA after one semester in college. If the scores of the two tests are close, then the college entry exam has criterion validity.

Types of criterion validity

There are two types of criterion validity.

  • Concurrent validity is used when the scores of a test and the criterion variables are obtained at the same time.
  • Predictive validity is used when the criterion variables are measured after the scores of the test


Criterion Validity Evaluating Methods

Correlation Coefficients

Correlation coefficients, such as Pearson’s correlation coefficient (r), are used to measure the strength and direction of the relationship between the scores on a test or measurement instrument and the criterion or outcome. A high correlation indicates a strong relationship, suggesting good criterion validity.

Receiver Operating Characteristic (ROC) Analysis

ROC analysis is commonly used when the test or measurement instrument produces dichotomous outcomes (e.g., pass/fail). It evaluates the ability of the test to accurately discriminate between individuals who have the criterion or outcome and those who do not. The area under the ROC curve (AUC) is used as a measure of the test’s predictive accuracy, with higher values indicating better criterion validity.

Sensitivity and Specificity

Sensitivity refers to the proportion of individuals with the criterion or outcome who are correctly identified by the test, while specificity refers to the proportion of individuals without the criterion or outcome who are correctly identified as such. Sensitivity and specificity are typically calculated based on predetermined cutoff scores on the test and are used to evaluate the accuracy of the test in correctly classifying individuals.

Regression Analysis

Regression analysis can be used to predict the criterion or outcome variable based on the scores obtained on the test or measurement instrument. By examining the strength and significance of the regression coefficients, researchers can determine the extent to which the test predicts or correlates with the criterion or outcome.

Known Groups Method

The known groups method involves comparing the scores obtained on the test or measurement instrument between groups that are known to differ in terms of the criterion or outcome. If the test can effectively distinguish between these groups, it suggests good criterion validity.

Sunday, August 27, 2023

Construct Validity

By Nutthakan O. 

What is Construct Validity?

What is Construct Validity?

Construct validity serves as a crucial quality indicator in data collection. It ensures that the measurements used effectively capture the underlying theoretical concepts or constructs being studied. By establishing construct validity, researchers ensure that their data collection methods accurately reflect the intended attributes and dimensions of the construct. This helps in preventing biases, errors, and misinterpretations, ultimately enhancing the reliability and credibility of the research outcomes. In essence, construct validity guarantees that the data collected truly measures what it is intended to measure, making it an essential benchmark for the quality of data collection in research.

Types of Construct Validity:

  1. Convergent Validity: This examines the extent to which measures of related constructs align with each other. Measures of related traits are expected to correlate positively, indicating a consistent assessment of the underlying construct.

  2. Discriminant Validity: This assesses the extent to which measures of unrelated constructs display weak or negative correlations. Measures of distinct concepts should not strongly correlate, confirming their independent assessment.


    Selecting Unrelated Constructs:

    In testing discriminant validity, it's important to choose theoretically distinct or opposing concepts within the same category. For instance, when assessing introversion, selecting a contrasting trait like extroversion is appropriate. This opposition allows for an expected negative correlation between the measures.

    Measuring Construct Validity:

    Pilot Study: After developing a new measure, conducting a pilot study with a small sample helps evaluate its feasibility, reliability, and validity. This ensures necessary adjustments are made to accurately test the construct.

    Statistical Analyses: Correlations are often employed to assess convergent and discriminant validity by comparing results from your test with established measures. Regression analyses can also gauge whether the measure predicts expected outcomes, reinforcing its construct validity claim.

    Incorporating construct validity measures in research methods enhances the reliability of findings and the confidence in the interpretations drawn from test scores and measurements.


    Conclusion


    Ensuring Accuracy: Construct validity safeguards the meaningfulness and credibility of research findings.

    Construct validity helps researchers ensure that their measurements are meaningful and trustworthy for making valid inferences and conclusions. It involves demonstrating that the operationalization (measurement) of a construct aligns with the theoretical understanding of that construct.



Thursday, August 3, 2023

The Educational Management Guidelines by using a Community Participation Process for a Child Development Center in Phadungmart Sub- district, Janae district, Nawathiwat Province

by Kanokwann Kanyati and Recha Choosuwan

Education Administration program, Faculty of Education, Prince of Songkla UNiversity, Pattani Campus, Pattani 94000, Thailand

 Received : August 9, 2020 , Revised: Novembe 7, 2020 , Accepted : December 7, 2020

                                                                                                                                Nang Aye Aye Htun

                                                                                                                         Seminer on Dissertaion

1) Background of the research

This research studies the guidelines of educational management by using a community participation process in a Childhood Development Center in Phadungmart Sub-district, Janae District, Narathiwat Province. This study used qualitative research that was designed for this specific research. There were 40 participants who were considered key informants to the research. This group included 10 representatives of the Child Development Center Committee, 9 teachers, children’s parents, and community leaders. A purposive sampling was used to select the participants. Semi-structured interviews were used to collect as much in-depth data as possible. The data was analyzed by a content analysis technique.

2)  The research objective

To study the guidelines for educational management through a community participation process of the Child Development Center of Phadungmart Sub-district, Janae District, Narathiwat Province.

3) The research methodology

It is a qulitative research. The research tool is the interview which was held in a private place. The researcher also allowed the participants to use psedonyms with the purpose of not to affect the informants.

Research tool

Date is collected by semi-structured interview protocal. It is an open interview and the answers of the participants are not limited. In the interview, the participants are also allowed to tell stories or exeriences freely. The purpose for doing this is to build the credibility of the data. 

Tape recording and note taking are used to collect the data from the interview.

Protocol of the interview

1. study relevant reserach documents to determine the framework and scope of the appropriate tools for this research

2. study the principles of creating a semi-structured interview form

3. send the tools to the thesis advisor to check

4. request a letter form to  Department of Education Administration Faculty to verify the accuracy of the tools and methods

5. Inspect the chosen reserach tools by having three experts inspectors

6. modify interview forms based on the advice of experts and professors

7. prepare the complete interview form

Data Collection

1. Data providers were selected by considering whether the person providing the information meets the requirements to be able to discuss problems and provide information on what the researcher wants to study.

2. The researcher sent a document introducing the research and asking for cooperation in data collection.

3. The researcher worked to build good relationships with the key informants in order to establish trust so that they felt comfortable to disclose information that could assist in the objectives of the researcher. 

4. In-depth interviews were conducted, each taking approximately 11/2-2 hours, to gather information in a descriptive format.

5. Date was collected from various related documents for use in data analysis according to research objectives.

6. The interview results were sent to the key informants for confirmation.

7. A summary of the research was made.

* Key informants are the people who are related to the educational management of the Child Development Center in Phadungmat Sub-district.

Data Analysis

This research analyzed data using content analysis techniques. The data was analyzed with the following steps: 

1. The dialogue from all interviews was transcribed.

2. Data management methods were used to sort the data. The researcher prepared the data by putting each type of data in a separate data file according to the characteristics of the data.

3. The researcher re-examined the information in order to consider the accuracy and completeness of the information before using the data for analysis. 

4. The researcher used a content analysis procedure for data analysis. 

5. The researcher defined the key words and ideas related to the issues that need to be studied. The definitions helped to specify a clear direction and framework for conducting research which would be easy to remember, provide consistency, and prevent the overcomplexity of data during data analysis. 

6. The researcher analyzed and presented the data by using Microsoft Word. 

7. Drawing and verifying conclusions were done to include finding patterns, grouping, factor analysis, identification of event associations, conceptual theory links and other discoveries. The success of creating a summary depends on the completeness of the data that is summarized. 

8. The researcher confirmed the correctness of the conclusion by examining the validity and representation of the data with a multi-step method. The methods included collecting data from different data sources to gather the same information, using observation along with questioning while also studying additional information from the source documents, and asking important informants to check the conclusions obtained with the informants after the conclusion of the study.

4) the research findings

The research findings revealed that the guidelines of educational management in this particular study refer to principles and methods of educational management in accordance with the Child Development Center operating standards. There are 6 principles which are listed here. 

(1) Decentralization of educational administration by participation of communities from all regions. There are 4 areas in which these methods are used. The first is that of participation in making decisions and planning, determining measures, and creating guidelines for educational management. The second area is defining various department systems. The third area is establishing a community representative committee. And the final area is the presentation of information 

(2) Participation in the development of the potential of community personnel. This involves training methods such as career skills seminars, personnel education development and building morale in people. The second evaluation of performance is by making a policy plan and checking the implementation of project activities. 

(3) Cooperative management based on mutual trust. There are 2 methods that are used to assess development and system security. 

(4) Integrating knowledge management from communities. There are 3 methods that search for learning resources and local wisdom, planning meetings for integration of local knowledge and wisdom and procuring community folk philosophers. 

(5) Positive empowerment of the community by creating an understanding of the operations of the Child Development Center by using project presentations and inviting community members to join activities of the Child Development Center. The purpose of these activities would be to develop leaders and create engaging forums where all groups can share their ideas. 

 (6) Principles of empowerment from a network outside the Child Development Center by building an attitude of confidence in the Child Development Center. Establishing a parent network can help reach these goals as well as promote and support the development of networks in the community. 

5) Strength and weakness of the research

Although it is a qualitative research, the interview questions are well-designmed with the advice from the experts who are working in Education administration department. The data collection and analysising processes are described in details. so, overall, it is a very clear reserach paper.

6) What I have learned from the research

After reading this reserach, I have realized the importance of community participation in assisting the education sector. In addition, I come to understand that Child Development Center is not just related to the nursey or primary sector only. It is related to every students who are studying for their basic education.

Impact of Principal Leadership Styles on Teacher Job Performance : An Empirical Investigation

Assignment 2     :  Analysing the research paper Submitted by     : Nang Aye Aye Htun St. ID                  : 236511001      Date         ...