Don’t Be Outwitted by AI: The Educator’s Guide to Smarter Evaluation

12th Conference on Academic Integrity ‘Resources in the Age of AI’, Universidad de Monterrey, San Pedro Garza García, Nuevo León, Mexique

2024-09-26

By Martine Peters, Université du Québec en Outaouais, Canada

---

References

Slide 1 :

• PUPP website https://pupp.uqo.ca/en/home/

Slides 5-6: FASTER Principles (Canadian Federal Government)

• Government of Canada. (2024). Guide on the Use of Generative AI. https://www.canada.ca/en/government/system/digital-government/digital-government-innovations/responsible-use-ai/guide-use-generative-ai.html

Slide 11: Course Outline…

• Tice, C. (2024). Higher Ed Discussions of AI Writing. [Facebook Groupe privé]. https://www.facebook.com/groups/632930835501841/?hoisted_section_header_type=recently_seen&multi_permalinks=934744765320445

Slide 12-13: Classroom AI Use

• Miller, M. (2023). Template Classroom AI Use: What’s Cheating? What’s OK? https://ditchthattextbook.com/ai-cheating/

Slide 14: Starting slowly with AI²

Coffey, L. (2024). Inside Barnard’s Pyramid Approach to AI Literacy. Inside Higher Ed. https://www.insidehighered.com/news/tech-innovation/artificial-intelligence/2024/06/11/inside-barnards-pyramid-approach-ai?fbclid=IwZXh0bgNhZW0CMTEAAR3AODn6ud4EQOI4srx2fN4K33KwQSHHIL7W3h343VUh6hLgM8oiU6KqTG4_aem_AdmOGXS9vhNBVHHYB8yPH8sxAmLxuR-cuSLRx0sFJvd3TG1Ci2sDl_obkQUjJxDTwGtbWOgyZk8MFcq_rkmYGV0x

Slide 16: Period of Mourning

• Crisci, J. (2023). An important note for anyone doing AI PD for teachers. [LinkedIn]. https://www.linkedin.com/posts/jerrycrisci_an-important-note-for-anyone-doing-ai-pd-activity-7128070990684717056-V47e?utm_source=share&utm_medium=member_desktop

Slide 17: Redefine Assessment with AI² and AI¹

• Lodge, Howard and Broadbent (2023). Assessment redesign for generative AI: A taxonomy of options and their viability. LinkedIn. https://www.linkedin.com/pulse/assessment-redesign-generative-ai-taxonomy-options-viability-lodge/?fbclid=IwAR2IGAAocNIMWoj9AIyBWQLiEIaJP12-9UQCaLQrH7wGp6ugTcfvUGCuE7Y

Slide 19-24: Leon Furze’s Five Options

• Furze, L. (2023, October 04). Rethinking Assessment for Generative AI: Beyond the Essay. LeonFurze.com. https://leonfurze.com/2023/10/04/rethinking-assessment-for-generative-ai-beyond-the-essay/?fbclid=IwAR2AovmNzhN94MJlxPSkffge-Hh58PALY-q2wcedRu5uJZnSLO20JPytGTQ
• Furze, L. (2023). AI Assessment Where Does your Assessment Sit on the Scale? https://leonfurze.com/wp-content/uploads/2023/04/scalePDF.pdf

Slide 25: AI²: Total Generation Activities

• Johnston, J. (2023). AI Assignment Flip – 10 Examples. LinkedIn. https://www.linkedin.com/pulse/ai-assignment-flip-10-examples-jason-johnston/

Slide 26: Is there such a Thing as Plagiarism-Proof Homework?

• Sidorkin, A. S. (2023, December 20). AI Pedagogy, the Introduction. AI-EDU. https://aiczar.blogspot.com/2023/12/ai-pedagogy-introduction.html?fbclid=IwAR2xNsIp8_dtp8vUHTPc7XAOcEaRj3gWW69R3L2fBNeoqrtreWft50v7UcE

Slide 27: Impossible tasks for AI² (as of 11-2023)

• Mialon, G., Fourrier, C., Swift, C., Wolf, T., LeCun, Y. & Scialom, T. (2023). GAIA: a Benchmark for General AI Assistants. https://arxiv.org/pdf/2311.12983.pdf

Slide 29-30: Originality versus creativity ❤️

• Johnson-Eilola, J. et Selber, S. A. (2007). Plagiarism, originality, assemblage. Computers and Composition, 24(4), 375-403.
• Acar, S., Burnett, C. et Cabra, J. F. (2017). Ingredients of Creativity: Originality and More. Creativity Research Journal, 29(2), 133-144. doi: 10.1080/10400419.2017.1302776
• Sternberg, R. J. et Lubart, T. I. (1999). The concept of creativity: Prospects and paradigms. Handbook of creativity, 1, 3-15.

Slide 31-32: Academic Integrity and Creativity in the age of Artificial Intelligence model  (AICAI)

• Peters, M. & Angelov, D. (2024). Academic Integrity and Creativity in the age of Artificial Intelligence model  (AICAI). https://mpeters.uqo.ca/modele-de-planification-dune-tache-evaluative-2023-2024/

Slides 33-34: Bloom’ Taxonomy

• Anderson, L.W., Krathwohl, D.R., Airasian, P.W., Cruikshank, K.A., Mayer, R.E., Pintrich, P.R., Raths, J., & Wittrock, M.C. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s Taxonomy of Educational Objectives (Complete edition). New York: Longman.
• Prof Innovant. (2023). Taxonomie de Bloom révisée : verbes d’action. https://www.profinnovant.com/taxonomie-de-bloom-revisee-verbes-daction/
• Oregon State University. (2023). Advancing Meaningful Learning in the Age of AI: Bloom’s Taxonomy Revisited. https://ecampus.oregonstate.edu/faculty/artificial-intelligence-tools/meaningful-learning/?fbclid=IwAR3nzsEV0-BTPXTRdgAW6EqcbyL3pWx-LmNfH88fVjew-hZLEMe3-z5Wn1Y

Slides 35: Fundamental Skills or Not…

• Sidorkin, A. S. (2023, December 20). AI Pedagogy, the Introduction. AI-EDU. https://aiczar.blogspot.com/2023/12/ai-pedagogy-introduction.html?fbclid=IwAR2xNsIp8_dtp8vUHTPc7XAOcEaRj3gWW69R3L2fBNeoqrtreWft50v7UcE

Slide 38-40 : Cognitive Offloading, Assessment and AI²

• Risko EF, Gilbert SJ. (2016). Cognitive offloading. Trends in Cognitive Sciences. 20(9):676–688. doi: 10.1016/j.tics.2016.07.002.
• Dawson, P. (2020). Cognitive Offloading and Assessment. In: Bearman, M., Dawson, P., Ajjawi, R., Tai, J., Boud, D. (eds) Re-imagining University Assessment in a Digital World. The Enabling Power of Assessment, vol 7. Springer, Cham. https://doi.org/10.1007/978-3-030-41956-1_4 ❤️

Slide 42: Authentic Assessment Tasks

• Fahim, S. (n.d.). Assessments – Prevention Strategies to Combat Plagiarism [PowerPoint presentation]. The British University in Egypt. https://www.bue.edu.eg/powerpoints-academic-honesty/
• Culwin, F., & Lancaster, T. (2001). Plagiarism, prevention, deterrence and detection. Available for ILT members from https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=a949423f6c0358eda3f919025c7b203955510501
• Gibelman, M., Gelman, S. R., & Fast, J. (1999). The downside of cyberspace: Cheating made easy. Journal of Social Work Education, 35(3), 367-376. https://www.tandfonline.com/doi/abs/10.1080/10437797.1999.10778975
• Sotiriadou, P., Logan, D., Daly, A., & Guest, R. (2020). The role of authentic assessment to preserve academic integrity and promote skill development and employability. Studies in Higher Education, 45(11), 2132-2148. https://www.tandfonline.com/doi/full/10.1080/03075079.2019.1582015 ❤️

Slides 44-45: Authentic Assessment

• Frey, B. B., Schmitt, V. L., & Allen, J. P. (2012). Defining authentic classroom assessment. Practical Assessment, Research & Evaluation, 17(2).
• Kashani-Vahid, L., Afrooz, G., Shokoohi-Yekta, M., Kharrazi, K., & Ghobari, B. (2017). Can a creative interpersonal problem solving program improve creative thinking in gifted elementary students? Thinking Skills and Creativity, 24, 175-185.
• Wadaani, M. R. (2015). Teaching for Creativity as Human Development toward Self-Actualization: The Essence of Authentic Learning and Optimal Growth for All Students.Creative Education, 6,669-679.
• Wiggins, G. (2011). A true test: toward more authentic and equitable assessment. Phi Delta Kappan, 92(7), 81–93.
• Dawson, P. (2020). Cognitive Offloading and Assessment. In: Bearman, M., Dawson, P., Ajjawi, R., Tai, J., Boud, D. (eds) Re-imagining University Assessment in a Digital World. The Enabling Power of Assessment, vol 7. Springer, Cham. https://doi.org/10.1007/978-3-030-41956-1_4 ❤️

Slides 47-48: The Debate

• Bauschard, S. (2023, November 05). Debating in the World of AI. Stefan Bauschard. Education Disrupted: Teaching and Learning in An AI World. https://stefanbauschard.substack.com/p/debating-in-the-world-of-ai?utm_source=post-email-title&publication_id=1673728&post_id=138620336&utm_campaign=email-post-title&isFreemail=true&r=2fm3lf&utm_medium=email

Slides 49-51: Instructions

• Smith, C. D., Worsfold, K., Davies, L., Fisher, R. et McPhail, R. (2013). Assessment literacy and student learning: the case for explicitly developing students ‘assessment literacy’. Assessment & Evaluation in Higher Education, 38(1), 44-60. doi: 10.1080/02602938.2011.598636
• Harris, Robert (2015). Antiplagiarism Strategies for Research Papers. Virtual Salt. http://www.virtualsalt.com/antiplag.htm  ❤️
• Cullen, C. (2020). Syllabi Designed with Integrity In Mind. Sur le site web https://www.academicintegrity.org/integrity/syllabi-designed-with-integrity-in-mind/
• Spannagel, C. (2023). Rules for Tools. Pädagogische Hochschule Heidelberg. https://csp.uber.space/phhd/rulesfortools.pdf ❤️
• Turnitin (2023). AI misuse checklist. Academic integrity in the age of AI – Checklist. https://marketing-tii-statamic-assets-us-west-2.s3-us-west-2.amazonaws.com/marketing/tli_ai_misusechecklist_us_0223.pdf

Slides 52-53: Evaluation Criteria

• Smith, C. D., Worsfold, K., Davies, L., Fisher, R. et McPhail, R. (2013). Assessment literacy and student learning: the case for explicitly developing students ‘assessment literacy’. Assessment & Evaluation in Higher Education, 38(1), 44-60. doi: 10.1080/02602938.2011.598636
• Shin et al. (2012) White M, Kern ML. Positive education: Learning and teaching for wellbeing and academic mastery. International Journal of Wellbeing. 2018;8(1):1-17. DOI: 10.5502/ijw.v8i1.588
• De Bruijn-Smolders, M., Timmers, C. F., Gawke, J. C. L., Schoonman, W., & Born, M. P. (2016). Effective self-regulatory processes in higher education: research findings and future directions. a systematic review. Studies in Higher Education, 41(1), 139–158.