Demo of TurnItIn - New AI Detection Tool

Sarah Moore, Ph.D.
4 Apr 202303:12

TLDRDr. Moore from the University of Texas at Dallas demonstrates Turnitin's new AI detection tool by creating a memo with AI writer Chat GPT. The tool flagged the memo as 100% AI-written, cautioning that the similarity score may not indicate academic misconduct. Faculty are encouraged to adapt their rubrics and assignments to counter the use of AI writers, as relying on them for assignments is considered cheating at their university. The video concludes by emphasizing the importance of original student writing.

Takeaways

  • 👩‍🏫 Dr. Moore is a faculty member at the University of Texas at Dallas.
  • 📝 The video demonstrates Turnitin's new AI detection tool capabilities.
  • 📚 Dr. Moore simulated a student's experience using Chat GPT to write a memo comparing AI writers.
  • 💻 The memo generated by Chat GPT was uploaded to Turnitin for analysis.
  • 🔍 Turnitin provided a similarity score of 45%, indicating a match with previously uploaded documents.
  • 🚩 Turnitin flagged the document with 'AI 100', cautioning that the percentage may not indicate academic misconduct and requiring a review.
  • 📌 The tool correctly identified the memo as 100% AI-written, despite not flagging the sources.
  • 👀 Faculty are encouraged to consider new strategies and possibly adjust rubrics and assignments to counter AI writing tools.
  • 🚫 The use of Chat GPT to complete assignments is considered unauthorized and could be classified as cheating at the University.
  • 📝 The memo written by Chat GPT lacks quality, lacking a conclusion and overall being less interesting than student-written essays.
  • 👍 The video aims to inform and assist both faculty and students in understanding the implications of AI detection in academic writing.

Q & A

  • Who is Dr. Moore and what is their role in the video?

    -Dr. Moore is a faculty member at the University of Texas at Dallas. In the video, they demonstrate how Turnitin's new AI detection tool works by simulating a student's use of AI writers to complete an assignment.

  • What was the original assignment prompt given to the students?

    -The original assignment prompt was to write a memo comparing three AI writers, including some sources.

  • How did Dr. Moore use Chat GPT to complete the assignment?

    -Dr. Moore logged into Chat GPT and provided a simplified version of the assignment prompt, asking it to write a memo comparing AI writers and including sources.

  • What was the similarity score given by Turnitin for the memo generated by Chat GPT?

    -The similarity score given by Turnitin for the memo was 45%, indicating a match with previously uploaded documents.

  • What does the 'AI 100' flag in Turnitin indicate?

    -The 'AI 100' flag in Turnitin indicates that the document is 100% AI-written, suggesting that it may not be the result of original student work.

  • What does Dr. Moore suggest for faculty regarding the new AI detection tool?

    -Dr. Moore suggests that faculty should be aware that the new AI detection tool is effective and may require them to adjust their rubrics and assignments to account for the use of AI writers.

  • What is the potential consequence for students using Chat GPT to complete assignments at the University of Texas at Dallas?

    -At the University of Texas at Dallas, using Chat GPT to complete assignments is considered unauthorized and can be classified as cheating if reported.

  • How does Dr. Moore evaluate the quality of the memo written by Chat GPT?

    -Dr. Moore evaluates the memo as not being of good quality, lacking a conclusion and being less interesting and well-written compared to what their students are capable of.

  • What advice does Dr. Moore give to students regarding their writing?

    -Dr. Moore advises students to remember that their own writing is often the best and to strive for originality and quality in their work.

  • What is the main takeaway from the video for both faculty and students?

    -The main takeaway is that Turnitin's new AI detection tool is capable of identifying AI-written content, and both faculty and students should be aware of the implications of using AI writers in academic work.

  • Why did Dr. Moore choose to demonstrate the AI detection tool with a memo comparing AI writers?

    -Dr. Moore chose this topic because it directly relates to the current discussion around the use of AI in academic writing and provides a practical example of how the tool can detect such usage.

Outlines

00:00

🔍 AI Detection Tool Test

Dr. Moore, a faculty member at the University of Texas at Dallas, conducts an experiment to test Turnitin's new AI detection tool. He simulates a student's scenario by using an essay assignment prompt to compare AI writers. Dr. Moore then utilizes Chat GPT to generate a memo based on the prompt, which he uploads to Turnitin. The system assigns a similarity score of 45%, indicating a match with previously uploaded documents. However, the tool flags the document with a 'caution' for potential AI writing, marking it as 100% AI-written upon further review. This demonstration highlights the effectiveness of Turnitin's new feature in identifying AI-generated content.

Mindmap

Keywords

💡Turnitin

Turnitin is an online plagiarism detection service that checks the originality of written work by comparing it to a vast database of internet content, academic papers, and other documents. In the video, Dr. Moore uses Turnitin to demonstrate how it can detect AI-generated content, showing its effectiveness in identifying potential academic misconduct.

💡AI Detection Tool

The AI Detection Tool is a feature within Turnitin designed to identify content that may have been generated by artificial intelligence. In the script, Dr. Moore tests this tool by submitting an essay generated by an AI and observes the tool's ability to flag the content as AI-written.

💡Dr. Moore

Dr. Moore is the faculty member at the University of Texas at Dallas who is demonstrating the AI Detection Tool in the video. He serves as the narrator, guiding viewers through the process of using Turnitin to detect AI-generated content.

💡Memo

A memo, short for memorandum, is a document typically used in business or academic settings to convey information or instructions. In the video, Dr. Moore asks an AI to write a memo comparing AI writers, which he later submits to Turnitin for analysis.

💡AI Writers

AI writers refer to artificial intelligence systems capable of generating written content. In the context of the video, Dr. Moore's assignment prompt asks students to compare different AI writing tools, which he then uses to test Turnitin's AI Detection Tool.

💡Chat GPT

Chat GPT is a reference to an AI chatbot, likely a predecessor or variant of GPT (Generative Pre-trained Transformer), which is capable of generating human-like text. Dr. Moore uses Chat GPT to create a memo for his demonstration of Turnitin's AI Detection Tool.

💡Microsoft Word

Microsoft Word is a word processing software used to create, edit, and format documents. Dr. Moore mentions using Microsoft Word to save the AI-generated memo before uploading it to Turnitin, indicating a common step in the process of document preparation.

💡Similarity Score

The similarity score in Turnitin represents the percentage of a document's content that matches existing sources in its database. In the video, Dr. Moore discusses the memo's similarity score of 45, which indicates a significant overlap with previously uploaded content.

💡Academic Misconduct

Academic misconduct refers to actions that violate the standards of academic integrity, such as plagiarism or cheating. The video highlights the use of AI writers to complete assignments as a form of academic misconduct that Turnitin's AI Detection Tool can help identify.

💡Rubrics

A rubric is a set of criteria used for assessing the quality of students' work. Dr. Moore suggests that faculty might need to adjust their rubrics in response to the ability of Turnitin's AI Detection Tool to identify AI-generated content.

💡Cheating

Cheating is the act of using dishonest methods to gain an advantage, such as using AI to complete assignments. The video script warns students that using AI writers to complete assignments could be considered cheating and lead to academic penalties.

💡Business Writing

Business writing refers to the style and conventions used in professional communications. Dr. Moore comments on the quality of the AI-generated memo, noting that it lacks elements such as a conclusion and is not as effective as student-written business communications.

Highlights

Introduction to Turnitin's new AI detection tool by Dr. Moore from the University of Texas at Dallas.

Demonstration of using Chat GPT to write a memo comparing AI writers based on a standard essay assignment prompt.

The memo generated by Chat GPT is uploaded to Turnitin for similarity score analysis.

Turnitin's similarity score for the AI-generated memo is 45%, indicating traditional matches.

Turnitin does not flag the AI-generated content as problematic initially.

Upon closer inspection, Turnitin identifies the document as 100% AI-written with cautionary advice for review.

Sources included in the memo are not flagged by Turnitin, but phrases are identified as new and different.

Implications for faculty: the new AI detection tool is effective and may require changes in grading strategies and rubrics.

Students are warned that using Chat GPT for assignments can be considered cheating and lead to academic penalties.

Dr. Moore emphasizes that original student writing is generally superior to AI-generated content.

The AI-generated memo lacks a conclusion and overall quality compared to student writing.

Turnitin's new tool is expected to catch instances of cheating that were previously undetected.

The video serves as a tutorial and warning about the use of AI in academic writing.

Dr. Moore suggests that students should focus on their own writing skills for better academic performance.

The video concludes with a reminder that the use of AI in assignments is unauthorized and can be penalized.

Final thoughts on the importance of originality and the limitations of AI-generated content in academic settings.