How to create Criteria-based AI-Subjective Questions?
AI evaluation questions play a pivotal role in assessing human-like cognitive abilities in artificial intelligence systems. In this guide, we'll walk you through the process of creating subjective AI evaluation questions to ensure meaningful and reliable results. Use Criteria-based Questions and define what you’re looking for—communication, critical thinking, domain expertise—and our AI will score responses based on your custom criteria. Great for both technical case questions and non-tech scenarios.
To create your subjective AI Evaluation question, go to "Library" tab. There, click "My Questions" tab.
In "My Questions" tab, click "Add Domains". Name your domain. Press "Add Domain" for your domain to be created.
Click on the domain name, there is a drop-down called "Create Question". Click and select "Create Subjective Question"
Type your domain name which you created, select the difficulty, click on Response Type and select Text/Video based on your choice and click on Evaluation Type, select Xobin AI Evaluate. Enable Criteria-based Evaluation to generate criterias for your open-ended or opinionated questions.
Enable AI Response Verifier - an anti-cheating feature which detects if a candidate has taken inspiration from AI to write their answer or it's all written on their own. It's best and recommended only for textual responses.
Enable Communication Checker if it's a video response and you want to check the English Proficiency along with their Domain Expertise.
Create your question in the Add Question text field and press "Generate Evaluation Criteria" button at the bottom of your page.
A set of criteria for the question will be generated by AI for that question. Click on edit to edit the target answer or add your own target answer. You can also Regenerate the answer 'N' number of times.
Once you're done with your question creation, press Save Question button on the top-right corner. If you've multiple questions to add in the same domain, click Save and Add Another button.
To have a look at your question, go to "My questions" and select your domain name. The question can be previewed using "View" button.
To create your subjective AI Evaluation question, go to "Library" tab. There, click "My Questions" tab.
In "My Questions" tab, click "Add Domains". Name your domain. Press "Add Domain" for your domain to be created.
Click on the domain name, there is a drop-down called "Create Question". Click and select "Create Subjective Question"
Type your domain name which you created, select the difficulty, click on Response Type and select Text/Video based on your choice and click on Evaluation Type, select Xobin AI Evaluate. Enable Criteria-based Evaluation to generate criterias for your open-ended or opinionated questions.
Enable AI Response Verifier - an anti-cheating feature which detects if a candidate has taken inspiration from AI to write their answer or it's all written on their own. It's best and recommended only for textual responses.
Enable Communication Checker if it's a video response and you want to check the English Proficiency along with their Domain Expertise.
Create your question in the Add Question text field and press "Generate Evaluation Criteria" button at the bottom of your page.
A set of criteria for the question will be generated by AI for that question. Click on edit to edit the target answer or add your own target answer. You can also Regenerate the answer 'N' number of times.
Once you're done with your question creation, press Save Question button on the top-right corner. If you've multiple questions to add in the same domain, click Save and Add Another button.
To have a look at your question, go to "My questions" and select your domain name. The question can be previewed using "View" button.
Updated on: 04/14/2025
Thank you!