Skip to main content

How to Calculate Interrater Reliability using Fleiss’ Kappa

April 24, 2020

In a previous post, we discussed the process of calculating interrater reliability (IRR) on qualitatively coded data using Cohen’s kappa. However, there are many different tests that can be used to calculate IRR, depending on the type of qualitative coding that you have done. In this post, I will discuss using Fleiss’ kappa, including when […]

Read more: How to Calculate Interrater Reliability using Fleiss’ Kappa »

How to Calculate Interrater Reliability using Cohen’s Kappa

April 10, 2020

In a previous post, we discussed the process of analyzing qualitative data using a codebook and codes. A code is a word or phrase that helps define a piece of qualitative data as belonging to a category to help draw conclusions from the data [1]. This process can essentially be split into three stages. 1) […]

Read more: How to Calculate Interrater Reliability using Cohen’s Kappa »

How to Qualitatively Code

March 9, 2020

As a member of the INIT lab, I’m writing today’s blog post about the qualitative coding of research data. Depending on the type of data, research data can be analyzed either quantitatively or qualitatively. Researchers use quantitative approaches (e.g., means, standard deviations, statistical tests) to quantify certain patterns in numeric data. On the other hand, […]

Read more: How to Qualitatively Code »

Tips for Writing the UF CISE Qualifying Exam

July 23, 2018

I just completed my qualifying exam and in this blog post, I will detail what I think I learned from the qualifying exam (quals) process. In the CISE department at UF, the qualifying exam is the first milestone used to assess the student’s ability to successfully complete the Ph.D. program. This exam involves a literature […]

Read more: Tips for Writing the UF CISE Qualifying Exam »

Word Error Rate (WER) for Recognition of Natural Interactions

April 3, 2018

In the INIT Lab, we focus on natural user interaction for children. Many of these modalities, such as touch, gesture, and speech, involve some type of recognition process to understand what the user input is. To determine how accurate a recognizer is, there are several methods. One of these methods is using binary classifiers, as […]

Read more: Word Error Rate (WER) for Recognition of Natural Interactions »