Skip to main content

Skills

Generative AI Competence Assessment.

An objective, performance-based assessment of generative-AI competence: twenty keyed multiple-choice items covering four content areas, plus one open task in which you write a prompt. It takes about fifteen minutes.

Time
About 15 min
Questions
21
Single overall measure

Instructions

This is a knowledge and judgement test, not a questionnaire about yourself. Each of the first twenty questions has one correct answer. The last question asks you to write something in your own words. There is no pass mark. Your result is the number of the twenty keyed items you answered correctly, placed in one of three reference bands. The last question is not scored. The four content areas the items cover are coverage categories, not separate scores. Answer without using an AI assistant or a search engine. A result produced with help measures the help, not you. Items 1 to 20 are reproduced, with minor typographic corrections, from Jin, Y., Martinez-Maldonado, R., Gasevic, D., and Yan, L. (2024). GLAT: The Generative AI Literacy Assessment Test. arXiv:2411.00283v2 (https://arxiv.org/abs/2411.00283v2). CC BY 4.0, creativecommons.org/licenses/by/4.0.

What to expect

Scientifically validated
Based on established psychological research
Private results
Your data is secure and private
Detailed results
Comprehensive insights and recommendations

About the Generative AI Literacy Test (GLAT)

Generative AI tools write, summarise, draw and answer on request, and most people now use one at work or in study without ever having checked what they actually know about it. This test measures that knowledge directly. Instead of asking how confident you feel, it asks twenty questions with one correct answer each, covering what generative AI is and how it works, how to use it well, how to judge what it produces, and the ethical questions it raises. A twenty-first question asks you to write a prompt in your own words.

The twenty keyed items are the Generative AI Literacy Assessment Test (GLAT), an openly licensed instrument developed and validated by education researchers in 2024. The open task is our own addition and is not part of your result; it is there so that the test also captures something you do with generative AI, not only what you know about it.

The test has 21 questions and takes about fifteen minutes. Your result is the number of the twenty keyed items you answered correctly, placed in one of three reference bands. There is no pass mark. Answer without an AI assistant or a search engine open: a result produced with help measures the help, not you.

Items
21
Duration
About 15 min
Format
Twenty multiple-choice questions with one correct answer each, plus one open prompt-writing task that is not part of the result
Free result
Whether your total sits below the reference band, within it, or above it, free after completion
Full report
A detailed report interpreting your band, the habits of use it points to, and concrete steps for learning further (free with an account)

What it measures

The test measures generative AI competence as one overall score: how much of the working knowledge and judgement that competent everyday use requires you actually have. The items were written against a four-part blueprint. Know and understand covers what generative models are, how they are trained and why they can produce fluent but false output. Use and apply covers how to get useful results, including how a prompt shapes the answer. Evaluate and create covers judging the quality and reliability of what a tool produces and deciding when to rely on it. Ethics covers privacy, bias, authorship and responsible use.

Those four areas are coverage categories, not separate scores: they make sure the twenty items span the construct rather than clustering on definitions, and they are reported as a single total. The open task, writing a prompt for a realistic job, is recorded with your answers but does not count towards the score. The band you receive says where your total sits against the reference mean of the validation sample, roughly one standard deviation either side; it is a guideline for reading your score, not a percentile and not a certificate of competence.

  • Generative AI competenceThe number of twenty keyed questions answered correctly, spanning how generative AI works, how to use it, how to judge its output, and the ethics of using it.

The science and validity

The GLAT was published in 2024 by Jin, Martinez-Maldonado, Gasevic and Yan as an objective test of generative AI literacy, built on the AI-literacy competency framework described earlier by Long and Magerko. It is an objective alternative to self-report questionnaires, which measure how competent people feel with AI rather than what they know. In the validation sample of 355 higher-education students, tested in English, the twenty items gave a reliability of 0.80 (Cronbach's alpha), with an average item difficulty of about 0.67, meaning the average participant answered roughly two thirds of the questions correctly.

The reference bands this page uses are derived from those published item statistics, not from our own general-population sample. They say whether your total sits more than about one standard deviation below the reference mean, within it, or above it; they do not say what percentage of people you outscored. The test measures knowledge and judgement at one moment and can be improved by learning. It is not a certificate, it does not assess your skill in any particular tool, and it says nothing about your intelligence or personality.

References

  1. Jin, Y., Martinez-Maldonado, R., Gasevic, D., & Yan, L. (2024). GLAT: The Generative AI Literacy Assessment Test. arXiv:2411.00283v2.
  2. Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1-16. ACM.

Read more about our standards: How our tests are built and validated.

Sample items

  • Which statement best describes why a generative language model can give a confident but wrong answer?Illustrative Know and understand item (not a scored item).
  • You want a short, accurate summary of a long report for readers with no technical background. Which prompt is most likely to produce a useful result?Illustrative Use and apply item (not a scored item).
  • A tool has cited a reference in support of a claim. What is the most appropriate next step before you rely on it?Illustrative Evaluate and create item (not a scored item).

Frequently asked questions

Is this a personality test or a knowledge test?

A knowledge test. Each of the first twenty questions has one correct answer, and your result is the number you got right. It does not ask how you feel about AI or how often you use it; it asks what you know about it and how you judge its output.

Is this AI literacy test free?

Yes. Taking the 21-question test is free, with no account required to start, and your free result shows whether your total sits below the reference band, within it, or above it. The full report, free with an account, interprets your band in detail, describes the habits of use it points to, and gives concrete steps for learning further.

What does the reference band mean?

The bands are derived from the published item statistics of the GLAT validation study, whose sample was 355 higher-education students tested in English. They say whether your total sits more than about one standard deviation below that reference mean, within it, or above it. They are not general-population percentiles, and there is no pass mark.

Does the open task count towards my result?

No. The twenty-first question asks you to write a prompt exactly as you would type it. It is there so that the test also captures something you do with generative AI, and it does not count towards the total of twenty. If an organisation or practitioner invited you, it is also scored automatically for their group report (see our privacy policy).

Can I use an AI assistant while taking the test?

You can, but then the result measures the assistant, not you. The test is designed to be taken unaided, with no search engine or chatbot open, so that the total reflects your own knowledge and judgement.

Is the test available in Montenegrin?

Yes. The twenty items have been translated into Montenegrin from the English original, and the open task is written in both languages. The reference bands come from the English-language validation and are a guideline for the Montenegrin version rather than a separately normed result.

Who wrote the questions?

The twenty scored items were published by Jin, Martinez-Maldonado, Gasevic and Yan (2024) as the GLAT, under a Creative Commons Attribution 4.0 licence, and are used here with attribution and with the translation indicated. The open task is our own work and is not part of the GLAT.

Related tests

Created and reviewed to professional scientific standards. See how our tests are built and validated.