AI tool usage during evaluation work

AI/LLM Usage Policy · Students & Scholars · Updated

The entire purpose of human evaluation is to provide genuine human judgment. Using AI tools to do the evaluation for you defeats the purpose and produces training data that actively degrades model quality. Our policy on AI/LLM usage is strict and non-negotiable.

What is allowed

  • Spelling correction: You may use the spell-checker built into your browser or the platform. Cloud writing assistants (Grammarly, browser AI extensions and similar) send your text to a third party, so they are not allowed on project work.
  • Dictionaries and thesauruses: You may look up word definitions and synonyms in a dictionary or thesaurus.

What is strictly prohibited

  • Using AI to evaluate or assess response quality. You may not ask ChatGPT, Claude, Gemini, or any other AI system to tell you which response is better.
  • Using AI to generate justifications or explanations. Your rationale for why one response is better must come from your own reasoning.
  • Using AI to predict code behaviour or runtime results. If a task involves evaluating code, you must assess it yourself.
  • Having AI compose or rewrite your submissions. AI may not write or rewrite your responses, even partially. Your browser's spell-checker is the only exception.

Enforcement

Submissions are monitored for signals of AI-generated content. If your work is flagged as AI-assisted beyond the allowed scope:

  • Your submission will be rejected.
  • You will receive a warning or, in serious cases, immediate contract termination.
  • Repeated violations result in a permanent ban from the platform.

The rule of thumb: every word, judgment and line of reasoning you submit must be yours. Your browser's spell-checker may fix typos, and nothing else may touch your text.

Frequently asked questions

Can I use a spell-checker or grammar tool like Grammarly?

You may use the spell-checker built into your browser or the platform. Grammarly and other cloud writing assistants send your text to a third party, so they are not allowed on project work. Using AI to generate, evaluate or rewrite the content of your submissions is never allowed.

Can I use a thesaurus or dictionary?

Yes. Looking up word definitions or synonyms in a dictionary or thesaurus is fine. These are reference tools, not AI-powered content generators.

What about translation tools? Can I use Google Translate?

Machine translation is not allowed on project work. If you need a translation to understand a task, it is outside your language level: flag it to your project lead and skip it. If one term is unclear, ask your project lead.

How does Sovrano AI detect AI-generated content?

We use a combination of automated detection tools, statistical analysis, and human review. The specific methods are not disclosed to prevent circumvention. Detection is ongoing and may flag work retroactively.

What happens on a first offense?

First offenses are reviewed on a case-by-case basis. Minor or ambiguous cases may result in a warning and the submission being rejected. Clear, deliberate use of AI to generate evaluation content typically results in immediate contract termination.

What if I suspect another evaluator is using AI?

Report your concern to your project lead or email support@sovrano.ai. You can report anonymously. Provide any relevant details (patterns you've noticed, specific submissions, etc.). All reports are investigated.

Does this policy apply to assessments and interviews too?

Yes. AI and LLM tools are strictly prohibited during assessments unless the assessment explicitly states otherwise. The same rules apply to all work done on the Sovrano AI platform.

Can I use AI tools for personal research unrelated to my evaluation tasks?

Your personal use of AI tools outside of Sovrano AI work is your business. You may never put any project data, prompts, model outputs, or confidential information into any external AI tool. Doing so is both a policy violation and an NDA breach.

Related articles

Can't find what you're looking for?

We reply within one business day.

Contact Support

Help us build a better platform for experts

We use analytics to see which tasks and features work for you, and marketing cookies to measure the campaigns that bring new experts in. Nothing optional is set until you choose. Change your mind anytime in Cookie settings.

Cookie policy

Cookie settings

Pick what you are comfortable with. You can change this anytime from Cookie settings.

Strictly necessary

Login, security and storing this choice. Required for the app to work.

Always on

Product analytics Helps us most

Helps us see which parts of the platform work well and where things get stuck, so we can make it smoother for you.

Marketing

Lets us see which campaigns bring new experts to Sovrano AI, so we can keep growing the community and the projects on offer.

See the full list of cookies