Administrator

How do I run Test Analytics Reports?

Follow
Ryan Richins
  • Agilix team member
  • Updated:
    info_outline
    Created:

To run Test Analytics Reports, open Reports from the Main Menu, select Test Analytics, and follow the numbered steps:

  1. Choose a course: Enter or browse to the desired course.
  1. Choose an assessment: Find the desired assessment in the second field.
  1. Filter the data: Choose to Include past enrollments if you want. If you don't check the box, only active enrollments are run.
  1. View the results: Click Run Report to review the results. If there aren't enough graded activities, you receive the following message instead of analytics: To protect student privacy, statistics are not available until grading has been completed for more students.

Review Test Analytics results

Test Analytics Reports include:

  1. Statistics, which lists the significant data, like values for the passing threshold, mean, median, standard deviations, and quartiles.
  2. Frequency of Grades, which breaks the data down and represents it according to the course's grading scheme.
  3. Question Item Analysis, which illustrates item difficulty and discrimination performance for each question and allows users to see how the each question answer impacts score. You can hover over the icons to see what they indicate.
    • Icons: The crossed arrows icon means "low discrimination," meaning that students who performed well overall had a harder time  with this question. The exclamation point icon means that most students answered the question incorrectly. Hover over the icons for more information.  
    • Learn more about item difficulty and discrimination here; keep in mind, however, that Buzz uses Spearman's Correlation, and not the Pearson Product Moment correlation that is described in that article.
  1. Proficiency by Learning Objective, which breaks the performance data down by learning objectives.
  2. Proficiency by Student, which breaks objective performance down by student.
  1. Export CSV, which downloads the student data in a comma-separated value (CSV) file. From the Report to export dropdown, you can choose from the following export options to specify the data you want run: Test Scores, Item Responses, Item Analysis, Learning Objective Mastery, and Student Proficiency.
  2. Start over, which clears the report, so you can run a new one.

Master course Test Analytics Reports

If you run the report on a Master course, a Proficiency by Course section replaces the Proficiency by Student section and breaks down objective proficiency by derivative courses. In this case, the Export CSV button downloads the course data.

Master course Test Analytics Reports

Comments (10)

Sort by
Gideon Seaman

I am excited to share this reporting in the new UI with my teachers!

0 Comment actions Permalink
Chad Kafka (FPS)

This is great data! I see right now that I can only do this as 'Admin' role -- how do teachers access this at the 'teacher' level? 

0 Comment actions Permalink
Brian Williams
  • Agilix team member

Hello Chad!


Currently the Test Analytics feature is only available through the Admin app.  

0 Comment actions Permalink
Chad Kafka (FPS)

I am a little perplexed right now. I am trying to run (as Admin) the Test Analytics for various assessments across different courses and I'm just constantly getting a "Running....." message when I hit 'run report.'  No choices for Reports are coming up...?  Is something wrong with this feature right now?

0 Comment actions Permalink
Brad Marshall
  • Agilix team member

Hey Chad, we are aware of this issue and it will be fixed in this week's update (2/28). Sorry for any inconvenience this has caused.

0 Comment actions Permalink
Brian Williams
  • Agilix team member

Hi Chad,

A workaround can be applied beforehand until that fix goes live: After a user encounters the "Running" dialogue when running the report, select the browser's refresh button and it will display the analytics data. 

0 Comment actions Permalink
Chad Kafka (FPS)

Thanks Brad and Brian.  I'm also sharing here a work around another team member of mine found in case it is any help now or in the future...

If you go to the Gradebook and click on the 'header' of the Assessment and then choose ANALYTICS, there is a 'download cloud arrow' at top right that you can click on and check off what items you want on a report and then 'export as csv' at the bottom.  That was helpful to have.  

 

0 Comment actions Permalink
RCSD eLearning Team

Is there a reason this is not available to teachers?  We have many teachers who need this information and it is a lot of work for us to run it for them.

0 Comment actions Permalink
Brian Williams
  • Agilix team member

Hi RCSD:

Test analytics is currently available to teachers through a different process than outlined in this article. To access the analytics page a teacher will open their gradebook, select the activity name from the column header to open the activity grader for all students, select the Analytics button from the tool bar. Additionally, there an option to export the analytics via the export button (cloud button) located at the upper right side of the page. If you have additional questions, let me know in the ticket that was submitted to Agilix Support regarding this topic. 

0 Comment actions Permalink
RCSD eLearning Team

Perfect.  Thank you.  We did not see that other article.  

0 Comment actions Permalink
Please sign in to leave a comment.