How can we spot AI use?

Author

Neil Almond
June 04, 2024

Hey human, welcome to June. At the end of this month, Maidstone Grammar School for Girls are hosting an AI and technology conference - more details can be found here. It would be great to see you there.

📚 Knowledge builders

How can teachers quickly work out if students have been using AI? → I get this question a lot, and it is a tricky one to navigate. You need to ensure you get the call right or the trust between yourself and the student can deteriorate quickly. As of right now, due to the nature of how LLMs work, AI plagiarism detectors are pretty unreliable, but I have two ideas that may help.

  1. US English bias → Unless prompted otherwise (and many do not), LLMs tend to have a US English spelling bias in their outputs. So if you see pupil discussing their ‘favorite color’ or the suffix ‘ize’ appears more often than not, then that could be a potential indictor that AI was used. Made you look!

  2. Prompt Injection refers to ways that text can be snuck into prompts without the user knowing. This is usually done through changing the colour of text to white and placing this text in a line break between paragraphs or at the end of the final line of text. This text could be something silly like asking answers to include a certain key word or sentence etc. What you would hope for is that pupils will paste your instructions as part of their prompt, not realise you have injected the text with additional information and then turn that work it. If the keyword is present, then you can be certain that AI was used.

 🤖 Industry updates

  • ChatGPT Edu → OpenAI has introduced ChatGPT Edu, a tailored version of ChatGPT for universities, powered by GPT-4o. It offers advanced capabilities like text and vision reasoning, data analysis, and custom GPT creation. This tool supports over 50 languages and includes enterprise-level security and privacy features.

🔬 Zooming in

🎙️ What is the role of AI in your classroom? → In this episode of the Hello World podcast, the theme of AI and its application in the classroom, both now and in the future is explored.

📑 ChatGPT for feedback → Alex Quigley recently shares an interesting study that looked at ChatGPT vs Human feedback. Here is how Alex summarises the findings. ‘Unsurprisingly real people give better feedback & ChatGPT can be generic & limited - but the difference isn’t huge right now. The time-saving trade off is a big question.’

A few notes from me:

  1. The study used ChatGPT 3.5, so an old model.

  2. The humans received a detailed rubric to support their feedback, and it is not clear if this rubric was included in the prompt to the LLM.

  3. The study is an excellent example of the authors being transparent regarding which AI is used and how it was used. This will really help replicability.

    A screenshot from the paper demonstrating some detail on the use of AI in the experiment.

 ✨Fresh prompts

  1. Primer → Sometimes, when planning a curriculum/lessons collaboratively, providing ‘one pagers’ of a lesson or unit can be helpful to provide an overview of the context of what is being taught. These are often referred to as primers, and they are used to ensure everyone is on the same page in the year group/department.

    This prompt utilises the "Specificity and Context" Framework.

    This framework emphasizes providing detailed context and being specific about the information needed.

    Structure:

    • Context: Start with a brief overview of the topic or background information.

    • Question/Task: Clearly state the question or task.

    • Constraints: Specify any constraints or particular angles to consider.

    • Examples (if applicable): Provide examples to clarify the request.

    Notice the need to know something about the topic/lesson for this to be effective. 

Context:
We are currently studying the history of medicine as part of the GCSE curriculum, with a focus on how different civilizations have contributed to the development of public health practices. We have already covered the contributions of the Egyptians and Greeks. Now, we are exploring the Roman era and its impact on public health.

Question/Task:
Can you explain how the Romans changed public health practices?

Constraints:

Focus on specific innovations and practices introduced by the Romans.
Discuss the role of infrastructure such as aqueducts, public baths, and sewers.
Explain the importance of these developments in the context of public health.
Highlight any long-term impacts of Roman practices on future generations.
Examples (if applicable):

Describe how Roman aqueducts improved access to clean water.
Explain the significance of Roman public baths in maintaining hygiene.
Discuss the role of Roman sewers in preventing the spread of disease

The Roman era marked a significant advancement in public health practices, laying a foundational infrastructure that influenced future generations. The Romans introduced several key innovations that had a profound impact on public health, primarily through their sophisticated engineering and organizational skills. Below are some of the pivotal contributions made by the Romans:

Roman Aqueducts

One of the most remarkable Roman innovations was the construction of aqueducts. These structures were designed to transport fresh water from distant sources into cities and towns, ensuring a steady supply of clean water.

Impact on Public Health:

- Improved Sanitation: By providing a reliable source of clean water, aqueducts reduced the dependence on local, often contaminated water sources, thereby decreasing the incidence of waterborne diseases.

- Enhanced Hygiene: The availability of clean water facilitated personal hygiene, cooking, and cleaning, which collectively contributed to better overall health standards.

- Urban Development: The access to water supported the growth of urban centers, promoting economic and social development while also emphasizing the importance of public health in urban planning.

Public Baths

Public baths, or thermae, were another hallmark of Roman public health practice. These baths were not just places for bathing but also social and recreational centers.

Significance in Maintaining Hygiene:

- Regular Cleansing: Public baths encouraged regular bathing among citizens, which was crucial in maintaining personal cleanliness and preventing the spread of skin infections and other hygiene-related diseases.

- Social Cohesion: The baths served as community centers where people could gather, promoting social well-being and a sense of communal responsibility towards hygiene and health.

- Therapeutic Benefits: Many baths included facilities such as saunas and steam rooms, which had therapeutic benefits and contributed to overall well-being.

Roman Sewers

The Roman sewer system, exemplified by the Cloaca Maxima in Rome, was one of the earliest forms of organized waste management.

Role in Preventing Disease:

- Waste Removal: Efficient removal of waste from urban areas prevented the accumulation of garbage and sewage, which could lead to the spread of diseases.

- Water Drainage: The sewer systems also helped manage stormwater, reducing the risk of flooding and the associated health hazards.

- Foundation for Modern Systems: Roman sewers set a precedent for future urban waste management systems, highlighting the importance of proper sanitation in public health.

Long-Term Impacts on Future Generations

The Roman contributions to public health had enduring effects, influencing various aspects of urban planning and public health practices in subsequent civilizations. Their emphasis on infrastructure, hygiene, and waste management became a model for future generations, particularly in Europe during the Renaissance and beyond.

Legacy of Roman Innovations:

- Urban Planning: Many modern cities still use principles derived from Roman urban planning, including zoning for public facilities and the integration of clean water and waste management systems.

- Public Health Policies: The concept of state responsibility for public health, evident in the Roman approach, laid the groundwork for modern public health policies and government intervention in health matters.

- Engineering Techniques: Roman engineering techniques, particularly in building aqueducts and sewers, influenced civil engineering and infrastructure development for centuries.

In summary, the Romans made substantial contributions to public health through their innovations in water supply, hygiene facilities, and waste management. These advancements not only improved the quality of life in Roman times but also set a standard for future public health practices, demonstrating the long-term impact of their engineering and organizational prowess.

Keep on prompting. ‘Till next week.

Mr A 🦾