AI in Education Podcast

The season-ending episode for Series 7, this is the fifteenth in the series that started on 1st November last year with the "Regeneration: Human Centred Educational AI" episode. And it's an unbelievable 87th episode for the podcast (which started in September 2019). When we come back with Series 8 after a short break for Easter, we're going to take a deeper dive into two specific use cases for AI in Education. The first we'll discuss is Assessment, where there's both a threat and opportunity created by AI. And the second topic is AI Tutors, where there's more of a focus on how we can take advantage of the technology to help improve support for learning for students. This episode looks at one key news announcement - the EU AI Act - and a dozen new research papers on AI in education. News EU AI Act https://www.europarl.europa.eu/news/en/press-room/20240308IPR19015/artificial-intelligence-act-meps-adopt-landmark-law The European Parliament approved the AI Act on 13 March and there's some stuff in here that would make good practice guidance. And if you're developing AI solutions for education, and there's a chance that one of your customers or users might be in the EU, then you're going to need to follow these laws (just like GDPR is an EU law, but effectively applies globally if you're actively offering a service to EU residents). The Act bans some uses of AI that threaten citizen's rights - such as social scoring and biometric identification at mass level (things like untargeted facial scanning of CCTV or internet content, emotion recognition in the workplace or schools, and AI built to manipulate human behaviour) - and for the rest it relies on regulation according to categories. High Risk AI systems have to be assessed before being deployed and throughout their lifecycle. In the High Risk AI category it includes critical infrastructure (like transport and energy), product safety, law enforcement, justice and democratic processes, employment decision making - and Education. So decision making using AI in education needs to do full risk assessments, maintain usage logs, be transparent and accurate - and ensure human oversight. Examples of decision making that would be covered would be things like exam scoring, student recruitment screening, or behaviour management. General generative AI - like chatgpt or co-pilots - will not be classified as high risk, but they'll still have obligations under the Act to do things like clear labelling for AI generated image, audio and video content ; make sure there's it can't generate illegal content, and also disclose what copyright data was used for training. But, although general AI may not be classified as high risk, if you then use that to build a high risk system - like an automated exam marker for end-of-school exams, then this will be covered under the high risk category. All of this is likely to become law by the middle of the year, and by the end of 2024 prohibited AI systems will be banned - and by mid-2025 the rules will start applying for other AI systems. ResearchAnother huge month. I spent the weekend reviewing a list of 350 new papers published in the first two weeks of March, on Large Language Models, ChatGPT etc, to find the ones that are really interesting for the podcast Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges arXiv:2401.08664 A Study on Large Language Models' Limitations in Multiple-Choice Question Answering arXiv:2401.07955 Dissecting Bias of ChatGPT in College Major Recommendations arXiv:2401.11699 Evaluating Large Language Models in Analysing Classroom Dialogue arXiv:2402.02380 The Future of AI in Education: 13 Things We Can Do to Minimize the Damage https://osf.io/preprints/edarxiv/372vr Scaling the Authoring of AutoTutors with Large Language Models https://arxiv.org/abs/2402.09216 Role-Playing Simulation Games using ChatGPT https://arxiv.org/abs/2402.09161 Economic and Financial Learning with Artificial Intelligence: A Mixed-Methods Study on ChatGPT https://arxiv.org/abs/2402.15278 A Study on the Vulnerability of Test Questions against ChatGPT-based Cheating https://arxiv.org/abs/2402.14881 Incorporating Artificial Intelligence Into Athletic Training Education: Developing Case-Based Scenarios Using ChatGPT https://meridian.allenpress.com/atej/article/19/1/42/498456 Incorporating Artificial Intelligence Into Athletic Training Education: Developing Case-Based Scenarios Using ChatGPT https://meridian.allenpress.com/atej/article/19/1/42/498456 RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education https://arxiv.org/abs/2403.08272 Comparison of the problem-solving performance of ChatGPT-3.5, ChatGPT-4, Bing Chat, and Bard for the Korean emergency medicine board examination question bank https://journals.lww.com/md-journal/fulltext/2024/03010/comparison_of_the_problem_solving_performance_of.48.aspx?context=latestarticles Comparing the quality of human and ChatGPT feedback of studen

This week we talked with Professor Danny Liu and Dr Joanne Hinitt, of The University of Sydney, about the Cogniti AI service that's been created in the university, and how it's being used to support teaching and learning. Danny is a molecular biologist by training, programmer by night, researcher and academic developer by day, and educator at heart. He works at the confluence of educational technology, student engagement, artificial intelligence, learning analytics, pedagogical research, organisational leadership, and professional development. He is currently a Professor in the Educational Innovation team in the DVC (Education) Portfolio at the University of Sydney. Here's Danny's academic profile. If you want to follow Danny's future work you can find him on LinkedIn and Twitter Joanne is a Lecturer in Occupational Therapy, and her primary area of interest is working with children and their families who experience difficulties participating in occupations related to going to school. She has extensive clinical experience working within occupational therapy settings, providing services for children and their families. Her particular interest is working collaboratively with teachers in the school setting and she completed her PhD in this area. Here's Joanne's academic profile Further reading on the topics discussed in the podcast Cogniti's website is at https://cogniti.ai/ Articles about the topics discussed: How Sydney educators are building 'AI doubles' of themselves to help their students, Dec 2023 AI as an authentic and engaging teaching tool for occupational therapy students, Oct 2023 Meet 'Mrs S': a classroom teacher who helps budding occupational therapists hone their skills, Oct 2023 Recorded talks Using Cogniti to design for Diversity, Feb 2023

It's a News and Research Episode this week There has been a lot of AI news and AI research that's related to education since our last Rapid Rundown, so we've had to be honest and drop 'rapid' from the title! Despite talking fast, this episode still clocked in just over 40 minutes, and we really can't out what to do - should we talk less, cover less news and research, or just stop worrying about time, and focus instead on making sure we bring you the key things every episode? News More than half of UK undergraduates say they use AI to help with essays https://www.theguardian.com/technology/2024/feb/01/more-than-half-uk-undergraduates-ai-essays-artificial-intelligence This was from a Higher Education Policy Institute of 1,000 students, where they found 53% are using AI to generate assignment material. 1 in 4 are using things like ChatGPT and Bard to suggest topics 1 in 8 are using it to create content And 1 in 20 admit to copying and pasting unedited AI-generated text straight into their assignments Finance worker pays out $25 million after video call with deepfake 'chief financial officer' https://www.cnn.com/2024/02/04/asia/deepfake-cfo-scam-hong-kong-intl-hnk/index.html An HK-based employee of a multinational firm wired out $25M after attending a video call where all employees were deepfaked, including the CFO. He first got an email which was suspicious but then was reassured on the video call with his "coworkers." NSW Department of Education Launch NSW EduChat https://www.theguardian.com/australia-news/2024/feb/12/the-ai-chat-app-being-trialled-in-nsw-schools-which-makes-students-work-for-the-answers NSW are rolling out a trial to 16 public schools of a chatbot built on Open AI technology, but without giving students and staff unfettered access to ChatGPT. Unlike ChatGPT, the app has been designed to only respond to questions that relate to schooling and education, via content-filtering and topic restriction. It does not reveal full answers or write essays, instead aiming to encourage critical thinking via guided questions that prompt the student to respond – much like a teacher. The Productivity Commission has thoughts on AI and Education https://www.pc.gov.au/research/completed/making-the-most-of-the-ai-opportunity The PC released a set of research papers about "Making the most of the AI opportunity", looking at Productivity, Regulation and Data Access. They do talk about education in two key ways: "Recent improvements in generative AI are expected to present opportunities for innovation in publicly provided services such as healthcare, education, disability and aged care, which not only account for a significant part of the Australian economy but also traditionally exhibit very low productivity growth" "A challenge for tertiary education institutions will be to keep up to date with technological developments and industry needs. As noted previously by the Commission, short courses and unaccredited training are often preferred by businesses for developing digital and data skills as they can be more relevant and up to date, as well as more flexible" Yes, AI-Assisted Inventions can be inventions News from the US, that may set a precedent for the rest of the world. Patents can be granted for AI-assisted inventions - including prompts, as long as there's significant contribution from the human named on the patent https://www.federalregister.gov/public-inspection/2024-02623/guidance-inventorship-guidance-on-ai-assisted-inventions Not news, but Ray mentioned his Very British Chat bot. Sadly, you need the paid version of ChatGPT to access it as it's one of the public GPTs, but if you have that you'll find it here: Very British Chat Sora was announced https://www.abc.net.au/news/2024-02-16/ai-video-generator-sora-from-openai-latest-tech-launch/103475830 Although it was the same day that Google announced Gemini 1.5, we led with Sora here - just like the rest of the world's media did! On the podcast, we didn't do it justice with words, so instead here's four threads on X that are worth your time to read\watch to understand what it can do: Taking a video, and changing the style/environment: https://x.com/minchoi/status/1758831659833602434?s=20 Some phenomenally realistic videos: https://x.com/AngryTomtweets/status/1759171749738840215?s=20 (remember, despite how 'real' these videos appear, none of these places exist outside of the mind of Sora!) Bling Zoo: https://x.com/billpeeb/status/1758223674832728242?s=20 This cooking grandmother does not exist: https://x.com/sama/status/1758219575882301608?s=20 (A little bit like her mixing spoon, that appears to exist only for mixing and then doesn't) Google's Gemini 1.5 is here…almost https://www.oneusefulthing.org/p/google-gemini-advanced-tasting-notes Research Papers Google's Gemini 1.5 can translate languages it doesn't know https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf Google also published a 58 page report on what their researchers had foun

This week's episode is our final interview recorded at the AI in Education Conference at Western Sydney University at the end of last year. Over the last few months you have had the chance to hear many different voices and perspectives Leanne Cameron, is a Senior Lecturer in Education Technologies, from James Cook University in Queensland. Over her career Leanne's worked at a number of Australian universities, focusing on online learning and teacher education, and so has a really solid grasp of the reality - and potential - of education technology. She explores the use of AI in lesson planning, assessment, and providing feedback to students. Leanne highlights the potential of AI to alleviate administrative burdens and inspire teachers with innovative teaching ideas. And we round the episode with Dan and Ray as they reflect on the profound insights shared by Leanne and discuss the future of teacher education. You can connect with Leanne on LinkedIn here

This week's episode is an absolute bumper edition. We paused our Rapid Rundown of the news and research in AI for the Australian summer holidays - and to bring you more of the recent interviews. So this episode we've got two months to catch up with! We also started mentioning Ray's AI Workshop in Sydney on 20th February. Three hours of exploring AI through the lens of organisational leaders, and a Design Thinking exercise to cap it off, to help you apply your new knowledge in company with a small group. Details & tickets here: https://www.innovategpt.com.au/event And now, all the links to every news article and research we discussed: News stories The Inside Story of Microsoft's Partnership with OpenAI https://www.newyorker.com/magazine/2023/12/11/the-inside-story-of-microsofts-partnership-with-openai All about the dram that unfolded at OpenAI, and Microsoft, from 17th November, when the OpenAI CEO, Sam Altman suddenly got fired. And because it's 10,000 words, I got ChatGPT to write me the one-paragraph summary: This article offers a gripping look at the unexpected drama that unfolded inside Microsoft, a real tech-world thriller that's as educational as it is enthralling. It's a tale of high-stakes decisions and the unexpected firing of a key figure that nearly upended a crucial partnership in the tech industry. It's an excellent read to understand how big tech companies handle crises and the complexities of partnerships in the fast-paced world of AI MinterEllison sets up own AI Copilot to enhance productivity https://www.itnews.com.au/news/minterellison-sets-up-own-ai-copilot-603200 This is interesting because it's a firm of highly skilled white collar professionals, and the Chief Digital Officer gave some statistics of the productivity changes they'd seen since starting to use Microsoft's co-pilots: "at least half the group suggests that from using Copilot, they save two to five hours per day," "One-fifth suggest they're saving at least five hours a day. Nine out of 10 would recommend Copilot to a colleague." "Finally, 89 percent suggest it's intuitive to use, which you never see with the technology, so it's been very easy to drive that level of adoption." Greg Adler also said "Outside of Copilot, we've also started building our own Gen AI toolsets to improve the productivity of lawyers and consultants." Cheating Fears Over Chatbots Were Overblown, New Research Suggests https://www.nytimes.com/2023/12/13/technology/chatbot-cheating-schools-students.html Although this is US news, let's celebrate that the New York Times reports that Stanford education researchers have found that AI chatbots have not boosted overall cheating rates in schools. Hurrah! Maybe the punch is that they said that in their survey, the cheating rate has stayed about the same - at 60-70% Also interesting in the story is the datapoint that 32% of US teens hadn't heard of ChatGPT. And less than a quarter had heard a lot about it. Game changing use of AI to test the Student Experience. https://www.mlive.com/news/grand-rapids/2024/01/your-classmate-could-be-an-ai-student-at-this-michigan-university.html Ferris State University is enrolling two 'AI students' into classes (Ann and Fry). They will sit (virtually) alongside the students to attend lectures, take part in discussions and write assignments. as more students take the non-traditional route into and through university. "The goal of the AI student experiment is for Ferris State staff to learn what the student experience is like today" "Researchers will set up computer systems and microphones in Ann and Fry's classrooms so they can listen to their professor's lectures and any classroom discussions, Thompson said. At first, Ann and Fry will only be able to observe the class, but the goal is for the AI students to soon be able to speak during classroom discussions and have two-way conversations with their classmates, Thompson said. The AI students won't have a physical, robotic form that will be walking the hallways of Ferris State – for now, at least. Ferris State does have roving bots, but right now researchers want to focus on the classroom experience before they think about adding any mobility to Ann and Fry, Thompson said." "Researchers plan to monitor Ann and Fry's experience daily to learn what it's like being a student today, from the admissions and registration process, to how it feels being a freshman in a new school. Faculty and staff will then use what they've learned to find ways to make higher education more accessible." Research Papers Towards Accurate Differential Diagnosis with Large Language Models https://arxiv.org/pdf/2312.00164.pdf There has been a lot of past work trying to use AI to help with medical decision-making, but they often used other forms of AI, not LLMs. Now Google has trained a LLM specifically for diagnoses and in a randomized trial with 20 clinicians and 302 real-world medical cases, AI correctly diagnosed 59% of hard cases. Doctors only got 33% right

In this second episode of 2024, we bring you excerpts from interviews conducted at the AI in education conference at Western Sydney University in late 2023. In this week's episode, we dive deep into the world of AI in higher education and discuss its transformative potential. From personalised tutoring to improved assessment methods, we discuss how AI is revolutionising the teaching and learning experience. Section 1: Vitomir Kovanovic, Associate Professor of Education Futures, University of South Australia In this interview, Vitomir, a senior lecturer at UniSA Education Futures, shares his perspective on AI in education. Vitomir highlights the major impact that generative AI is having in the field and compares it to previous technological advancements such as blockchain and the internet. He emphasises the transformative nature of generative AI and its potential to reshape teaching methodologies, organizational structures, and job markets. Vita also discusses the importance of adapting to this new way of interacting with technology and the evolving role of teachers as AI becomes more integrated into education. Section 2: Tomas Trescak - Director of Academic Programs in Undergraduate ICT, Western Sydney University Tomas delves into the challenges of assessment in the age of AI. He highlights the inherent lack of integrity in online assessments due to the availability of undetectable tools that can easily fill in answers. Tomas suggests that online assessments should play a complementary role in assessing students' knowledge and skills, while the main focus should be on in-person assessments that can't be easily duplicated or cheated. He also discusses the role of AI in assessing skills that won't be replaced by robots and the importance of developing graduates who can complement AI in the job market. Section 3: Back to Vitomir, to discuss the changing model of education and the potential impact of AI. We explore the concept of education as both a craft and a science and how technology is gradually shifting education towards a more personalised and flexible approach. The discussion highlights the ability of AI to adapt to individual teaching styles and preferences, making it a valuable tool for teachers. We also delve into the potential of AI in healthcare and tutoring, where AI can provide personalised support to students and doctors, leading to more efficient and equitable outcomes.

The podcast was a special dual-production episode between the AI and Education podcast, and the Data Revolution podcast, welcoming Ray Fleming and Kate Carruthers as the guests. The conversation centred around the transformation of the traditional data systems in education to incorporating AI. Kate Carruthers, the Chief Data and Insights Officer at the University of New South Wales, and Head of Business Intelligence for the UNSW AI Institute, discussed the use of data in the business and research-related aspects of higher education. On the other hand, Fleming, the Chief Education Officer at InnovateGPT, elaborated on the growth and potential of generative Artificial Intelligence (AI) in educational technology and its translation into successful business models in Australia. The guests pondered the potential for AI to change industries, especially higher education, and the existing barriers to AI adoption. The conversation revolved around adapting education to make use of unstructured data through AI and dealing with the implications of this paradigm shift in education. The Data Revolution podcast is available on Apple Podcasts, Google Podcasts and Spotify. 00:00 Introduction and Welcome 00:58 Guest Introductions and Backgrounds 01:56 The Role of Data in Education and AI 02:32 The Intersection of Data and AI in Education 04:11 The Importance of Data Quality and Governance 08:00 The Future of AI in Education 09:49 Generative AI as the Interface of the Future 10:20 The Potential of Generative AI in Business Processes 11:26 The Impact of AI on Traditional Roles and Skills 12:00 The Role of AI in Decision Making 13:46 The Future of AI in Email Communication 14:38 The Role of AI in Education and Career Guidance 16:34 The Impact of AI on Traditional Education Systems 18:18 The Role of AI in Academic Assessment 20:11 The Future of AI in Navigating Education Pathways 36:37 The Role of Unstructured Data in Generative AI 38:10 Conclusion and Farewell

Our final episode for 2024 is an absolutely fabulous Christmas gift, full of a lots of presents in the form of different AI tips and services Joe Dale, who's a UK-based education ICT & Modern Foreign Languages consultant, spends 50 lovely minutes sharing a huge list of AI tools for teachers and ideas for how to get the most out of AI in learning. We strongly recommend you find and follow Joe on LinkedIn or Twitter And if you're a language teacher, join Joe's Language Teaching with AI Facebook group Joe's also got an upcoming webinar series on using ChatGPT for language teachers: Resource Creation with ChatGPT on Mondays - 10.00, 19.00 and 21.30 GMT (UTC) in January - 8th, 15th, 22nd and 29th January 2024 Good news - 21:30 GMT is 8:30 AM and 10:00 GMT is 9PM in Sydney/Melbourne, so there's two times that work for Australia. And if you can't attend live, you get access to the recordings and all the prompts and guides that Joe shares on the webinars. There was a plethora of AI tools and resources mentioned in this episode: ChatGPT: https://chat.openai.com DALL-E: https://openai.com/dall-e-2 Voice Dictation in MS Word Online https://support.microsoft.com/en-au/office/dictate-your-documents-in-word-3876e05f-3fcc-418f-b8ab-db7ce0d11d3c Transcripts in Word Online https://support.microsoft.com/en-us/office/transcribe-your-recordings-7fc2efec-245e-45f0-b053-2a97531ecf57 AudioPen: https://audiopen.ai 'Live titles' in Apple Clips https://www.apple.com/uk/clips Scribble Diffusion: https://www.scribblediffusion.com Wheel of Names: https://wheelofnames.com Blockade Labs: https://blockadelabs.com Momento360: https://momento360.com Book Creator: https://app.bookcreator.com Bing Chat: https://www.bing.com/chat Voice Control for ChatGPT https://chrome.google.com/webstore/detail/voice-control-for-chatgpt/eollffkcakegifhacjnlnegohfdlidhn Joe Dale's Language Teaching with AI Facebook group https://www.facebook.com/groups/1364632430787941 TalkPal for Education https://talkpal.ai/talkpal-for-education Pi: https://pi.ai/talk ChatGPT and Azure https://azure.microsoft.com/en-us/blog/chatgpt-is-now-available-in-azure-openai-service Google Earth: https://www.google.com/earth Questionwell https://www.questionwell.org MagicSchool https://www.magicschool.ai Eduaide https://www.eduaide.ai "I can't draw' in Padlet: https://padlet.com

In todays epsiode, Inside the New Australian AI Frameworks with their Creators, we speak to Andrew Smith of ESA and AI guru Leon Furze. This should have been the rapid news rundown, and you may remember that 20 minutes before the last rapid news rundown (two weeks ago), the new Australian Framework for Generative Artificial Intelligence (AI) in Schools was published. So we ditched our plans to give you a full new rundown this week, and instead found a couple of brilliant guests to talk on the podcast about the new framework, and what it means for school leaders and teachers in Australian schools. Some key links from todays episode to learn more: Andrew Smith Andrew Smith | LinkedIn Home (esa.edu.au) Leon Furze http://Leonfurze.com https://www.linkedin.com/in/leonfurze/ https://ambapress.com.au/products/practical-ai-strategies Other useful reading VINE (Victorian ICT Network for Education) Generative Artificial Intelligence Guidelines Authored by Leon https://vine.vic.edu.au/resources/Documents/GAI_Guidelines/VINE%20Generative%20Artificial%20Intelligence%20Guidelines.pdf Finding the Right Balance: Reflections on Writing a School AI Policy https://matthewwemyss.wordpress.com/2023/08/15/writing-a-school-ai-policy/

Matt Esterman is Director of Innovation & Partnerships, and history teacher, at Our Lady of Mercy College Parramatta. An educational leader who's making things happen with AI in education in Australia, Matt created and ran the AI in Edcuation conference in Sydney in November 2023, where this interview with Dan and Ray was recorded. Part of Matt's role is to help his school on the journey to adopting and using generative AI. As an example, he spent time understanding the UNESCO AI Framework for education, and relating that to his own school. One of the interesting perspectives from Matt is the response to students using ChatGPT to write assignments and assessments - and the advice for teachers within his school on how to handle this well with them (which didn't involve changing their assessment policy!) "And so we didn't have to change our assessment policy. We didn't have to change our ICT acceptable use policy. We just apply the rules that should work no matter what. And just for the record, like I said, 99 percent of the students did the right thing anyway." This interview is full of common sense advice, and it's reassuring the hear the perspective of a leader, and school, that might be ahead on the journey. Follow Matt on Twitter and LinkedIn