Single-Subject Experimental Designs: Measuring Treatment Fidelity

https://www.youtube.com/watch?v=IQbI-xhQGnk

Repeated measures 

https://www.youtube.com/watch?v=YnTuI_0Ha_Y

Inter rater Reliability

1. Calculating Inter Rater Reliability/Agreement in Excel

https://www.youtube.com/watch?v=fq_LNTPgVF8

2. SPSS Tutorial: Inter and Intra rater reliability (Cohen's Kappa, ICC)

https://www.youtube.com/watch?v=jJTx5rfnN-w

https://www.dropbox.com/s/qr8hnaa4fqdy8gx/Kappa%20CI%20calculator%20and%20SEM%20calculator%20.xlsx?dl=0

Calculator of measurement errors

https://www.dropbox.com/s/qr8hnaa4fqdy8gx/Kappa%20CI%20calculator%20and%20SEM%20calculator%20.xlsx?dl=0

https://www.researchgate.net/post/Intraclass_correlation_coefficient_when_data_are_not_normally_distributed

3 What is the difference between intra rater and inter rater relibility 

i.             Carry out a rank order correlation of the first and second sets of marks. 

       This is to check ‘intra-rater reliability’.

1. i.          Intra-rater reliability

	1st time		2nd time		d = R1-R2	d2
	Mark	Rank (R1)	Mark	Rank (R2)
Student 1
Student 2
Student 3
Student 4
Student 5

ii.            Correlate the first set of marks with another person’s first set of marks. 

       This is to check ‘inter-rater reliability’.

1. ii.        Inter-rater reliability

	Own 1st time		Other 1st time		d = R1-R0	d2
	Mark	Rank (R1)	Mark	Rank (R0)
Student 1
Student 2
Student 3
Student 4
Student 5

Read more on :

Factors That Can Affect The Inter-rater Reliability

There are several factors that can affect inter-rater reliability

Knowledge background.
	v  Markers’ knowledge background is somehow a factor that can alter the reliability for marking process. It is because their views on certain issues may vary, thus affecting their agreement on the issues. This may lead to differences in evaluation during the marking.
Markers’ experience in marking.
		v  A group of markers’ with distinct differences in experiences may lead to disagreement among them. Experience may alter their perceptions towards candidates’ performances, thus becoming a major factor that can affect the inter-rater reliability.

Source:  http://rater-reliability.blogspot.com/

Further readings

https://www.youtube.com/watch?v=1Avl7DzKmnc

http://neoacademic.com/2011/11/16/computing-intraclass-correlations-icc-as-estimates-of-interrater-reliability-in-spss/

Experimental design

I need to find more on:

1. Repeated measures experimental design /
This type of design is also known as within groups
https://www.simplypsychology.org/experimental-designs.html

2. ANOVA and repeated measures

3. Counterbalance methods

4, Recommended effect size statistics
for repeated measures designs.

https://www.youtube.com/watch?v=cYZSjy4RTPg

https://stats.stackexchange.com/questions/301801/generalized-eta-squared

Find more on generalised eta squared

Sem pls

http://slideplayer.com/slide/6240241/

https://www.smartpls.com/documentation/learn-pls-sem-and-smartpls/pls-sem-compared-with-cbsem

Using excel to conduct t-test

https://www.youtube.com/watch?v=BlS11D2VL_U

https://www.scopus.com/  : SCOPUS - Document Search

https://www.elsevier.com/solutions/scopus/content  :

http://www.scimagojr.com/index.php  Scimago Journal & Country Rank for SCOPUS (SJR)

https://jcr.incites.thomsonreuters.com/  Web of Science - InCites Journal Citation Report

SAMPLE SIZE FOR WITHIN-SUBJECT EXPERIMENT

Good reading about  sample size
https://www.researchgate.net/post/What_is_the_minimum_sample_acceptable_for_structural_equation_modelling_using_AMOS