About Guidance Rubrics

Guidance-rubrics is designed to enable instructors to use AI such as OpenAI for grading and giving feedback. The system works with Canvas Quizzes. The system helps you build rubrics. These rubrics are used to grade Canvas quizzes. Writing rubrics requires you to write prompts for ChatGPT.

Besides using this system for classes, it is also designed for instructors and researchers to experiment with using AI for grading and giving feedback. Since it works with Canvas, it is very easy to start investigating.

Ease-of-use and research focused features are frequently added. Please let us know if there are any features that would be helpful.

Costs

There are two sources of costs, namely, cost for the AI and costs for running the servers. The server cost is small, so that is free. AI costs is usually small, but can be larger. However, for getting started and experimenting, it is free and should enable using this system for grading a class of under 20 students, depending on the size of the quizzes. Note that OpenAI lowest cost LLM only charges $0.10 for processing one million tokens.

For more intense usage, you will need to get an OpenAI API Key that will direct the charges for your AI usage to you. There is a help video on how to get an OpenAI API Key.

Privacy

Since we use the OpenAI API, OpenAI does not collect any data. As we expand to other AI providers, we will only consider methods where the data is not stored or used for further training. This system does store student submissions; they are displayed in this user interface system. This system does not store the student names. Instead, only the Canvas student ID is saved and matched up with the student name on-the-fly. That is, no PII is stored. Be sure that the student submissions themselves do not contain PII.

You can use your students' data for fine-tuning and training AI. You can delete the models and they will not be used without your permission. Your students' data will not be used to train any models without your permission.

Release Status

This an early beta release. Please let us know about bugs that you hit. We plan on fixing bugs, adding features, and developing more tutorials. Some behaviors might change over time.