The Art of Crafting Prompts for Essay Grading with ChatGPT Introduction In our first blog, “A Comprehensive Guide to Essay Grading with ChatGPT,” we navigated the initial steps of using the ChatGPT API for grading essays. For those with some python experience, the process of incorporating code from the first blog is …

How to Grade Essays with ChatGPT Introduction The rise of large language models (LLMs) like OpenAI’s ChatGPT has opened exciting possibilities in essay grading. With its advanced natural language processing capabilities, ChatGPT offers a new dimension in assessing written work, potentially revolutionizing the grading …

Estimating subgroup impacts in an RCT can be hard. An RCT by itself is usually underpowered for this task–we barely have enough data to give us an overall average, and as subgroups are smaller, they are noisier! One idea recently gaining increased traction is to augment an RCT with observational data. We might use …

Do you ever want to visualize the distribution of effects across sites in a multi-site evaluation (or meta analysis)? For example, consider a multisite trial with 30 sites, where each site is effectively a small randomized experiment. A researcher might fit a multilevel model with a random effect for the impact in each …

There are a lot of ways to do power calculations, but I wanted to show off a package, PUMP, that my collaborators and I recently set out into the world. The original purpose of the package was to provide tools for power analyses that account for multiple outcomes under a variety of common experimental designs—an …

A simulation and R tutorial demonstrating how to recover interpretable treatment effects from logistic regression.

When does blocking help? Should we always do it if we can? In this post we talk about how there are actually different kinds of blocking, and different ways of thinking about where blocks come from. The question of whether blocking can ever cause harm turns out to depend on these perspectives.

When estimating average treatment impact for a multisite randomized trial, recent literature (see Bloom et al. (2017)) has suggested using the so-called FIRC (Fixed Intercept, Random Coefficient) model. There are some technical details that make fitting this model slightly tricky in R; this post talks through these …

A shady figure presents you with a game. They have a deck of cards numbered 1, 2, 3, or 4, the exact distribution of which you do not know. They randomly shuffle and separate the deck into two equally sized piles, facedown, and after checking the piles for themselves, reveal some cards from each. From the first set: 4, …

You’ve taken the leap, and you wrote a manuscript using R Markdown. Good job! I support your endeavor, especially as it is a good practice for reproducible research. You’ve finished your work, and you want to submit your manuscript for publication. Unfortunately, the journal has various style and formatting …