In order to make sure Feedback Campaigns provide users with high quality feedback, we've created an AI-powered rating system, with moderator oversight, to evaluate and rate given feedback.
The rating system objectively evaluates the quality of written feedback. It does not make any subjective judgements about whether the feedback is right or wrong (because this will often involve opinion or taste).
Feedback will be scored based on the following criteria:
Constructive Criticism
Specific Observations
Knowledgeable Feedback
Suggestions and Solutions
Useful Resources
Requested Areas Covered
The AI tool does not mark down feedback for spelling or grammar mistakes, or for different styles of writing, but it does look at levels of detail and how effectively points are expressed.
What are the advantages of the AI-assisted feedback rating system?
Instant - feedback providers receive an instant rating for their response, which updates their level (and earnings) in real-time.
Consistent - feedback is evaluated against a consistent set of criteria, and ratings are not biased by subjective views or emotions.
Improving - with moderator oversight and user feedback we can continually improve the evaluation process to make it as fair and effective as possible.
Will the feedback receiver be able to influence the rating at all?
While the evaluation and rating will be carried out by our AI tool, feedback receivers will be able to let us know if they think the rating is too high or too low. Human moderators will be monitoring this input closely in order to improve the system, and ratings will be manually adjusted if necessary. Additionally, users can report feedback using the flag icon if it appears nonsensical, irrelevant or abusive.