The evaluation method of rater reliability is various and each method has its own using condition and its respective advantage and disadvantage.

Methods Scorer reliability method which meant information of the same patient was collected by two trained doctors was used to collect the information of clinic or in-hospital patients in 6 centers.

An Experimental Research on uhe Inter-rater Reliability of Portfolio Assessment;

By comparing results from different methods, including bivariate correlation, intraclass correlation, percentage of inter-rater reliability and the generalizability theory, we highlighted the advantages and disadvantages of each method and the generalizability theory in estimating the inter-rater reliability of perfor.