#Maxqda intercoder reliability code#
#Maxqda intercoder reliability free#

The ast column indicates a kappa value that contains a chance correction for the level of agreement (calculation: see below).For Interview 2, the example shows a value of 3 / (3+2) codes = 60.00 % – this is the proportion of codes that match in Interview 2. The percentage agreement is calculated as follows: Agreements / (Agreements + Disagreements).

#Maxqda intercoder reliability code#

the relative number of matching code assignments). The “Percent” column displays the percentage agreement (i.e.

The “Agreement” column displays the number of code assignments that match between Coder 1 and Coder 2 for each document.

In this case, there is one “disagreement” for 3 evaluated documents symbolized by a red symbol. The first column displays a green symbol if Coders 1 and 2 have assigned the same codes to the document.The “code-specific results table” lists all evaluated codes and indicates for how many documents the coders match in their assignment of the code: MAXQDA generates two tables, the “code-specific results table” with the analyzed codes and the “result table” with detailed information on each compared document.

#Maxqda intercoder reliability free#

This option can be useful, for example, if you are working with relatively short documents, such as free text responses to a survey, and with a large number of codes. Thus, the criterion of comparison is the occurrence or absence of a code in the document. Per document, it is checked whether both persons have assigned the same codes. Option 1 (document comparison level): Code occurrence in the document In the following, all three variants and the respective presentation of results are explained in detail.

Min- code overlapping rate of X% at the segment level – Per coded segment, it is checked whether the other person has assigned the same code to the segment.

Code frequency in the document – Per document, it is checked whether both coders have assigned the same codes the same number of times.

Code occurrence in the document – Per document, it is checked whether both persons have assigned the same codes.

In the lower area you can choose between three alternative analysis levels:.

You can limit the analysis to the currently activated documents and/or codes by selecting the appropriate options.

Select the document group or document set with the document assigned to Coder 1 in the upper drop-down menu and the document assigned to Coder 2 in the lower drop-down menu.

The “Document System” will look like this:

Use the function Home > Merge Projects to merge both projects into one.

Both coders independently code the data and add new codes if necessary.

Both coders write their names behind all document groups or document sets.

Make a copy of the project file and pass it on to the second coder.

Make sure that the necessary codes are included in the “Code System”.

The documents must be contained in one or more document groups or, alternatively, one or more document sets.

Create a project with the documents to be coded.

The documents must have the same name, but must be in different document groups or document sets!

The two identical documents coded by different coders must be contained in the same MAXQDA project.

Of course, it is important that both coders cannot see what the other person has coded. This can be done on the same computer or on separate computers. Two coders process the identical document independently and code it according to mutually agreed code definitions.The intercoder agreement procedureĬhecking the intercoder agreement involves the following: Instead, qualitative researchers want to address and edit the code assignments that do not match, so that they can move on with more accurately coded material. For this reason, one does not stop at the determination of a coefficient. Rather, the focus is on a practical improvement of the coding quality. It is not, however, focused on getting to a fixed statistical coefficient as is common practice in quantitative research. It is always the goal of qualitative analysts to achieve as high a level of agreement as possible between independent coders. Anyhow, this percentage is provided by MAXQDA. In other words, the actual percentage of agreement is not the most important aspect of the tool. In qualitative research, the purpose of comparing independent coders is to discuss the differences, figure out why they occurred, and learn from the differences in order to improve coding agreement in the future. The MAXQDA Intercoder Agreement function makes it possible to compare the coding of two people who coded the data independently of each other. You assume, for example, that coding is not arbitrary or random, but rather that a certain level of agreement between coders will be reached. When assigning codes to qualitative data, it is recommended to specify certain qualitaty criteria.