Wittly by Classworks: Research-Backed AI-Assisted Learning for Better Outcomes

September 26, 2024

The educational technology landscape is rapidly evolving, and AI learning assistants are at the forefront of this revolution. A recent study by researchers from the University of Pennsylvania - The Wharton School has provided insights into the most effective ways to implement AI in learning environments. These findings strongly support the approach taken by Wittly, Classworks' AI Learning Assistant. Let's examine the study's key findings and see how they connect with Wittly's features.

The Wharton School Study: Key Findings

The study by Bastani et al. involved nearly a thousand high school students and compared two AI tutoring systems: an open-ended system (GPT Base) similar to ChatGPT, and a structured system (GPT Tutor) similar to Wittly's approach. 

Here are some of the critical findings:

Performance Improvement: GPT Tutor users showed a 127% improvement in practice problem performance, compared to only 48% for GPT Base users.

Long-term Learning: When AI assistance was removed for exams, GPT Base users performed 17% worse than the control group, while GPT Tutor users maintained their performance.

Engagement: Students spent about 13% more time interacting with the structured system than the open-ended one.

Quality of Interaction: Students using the structured system engaged more substantively with the AI tutor over time, asking for help or attempting to solve problems independently rather than simply requesting answers.

Error Rates: The open-ended system (GPT Base) often made mistakes, on average giving a correct answer only 51% of the time.

Impact of Errors: Interestingly, the study found that errors made by the AI didn't significantly impact exam performance, suggesting that students used the open-ended system as a "crutch" rather than a learning tool.

Student Perception: Students using the structured system perceived that they performed significantly better, even though their exam performance was similar to the control group. The study suggests improved confidence and engagement.

Wittly's Research-Backed Approach to AI-Assisted Learning

Wittly by Classworks incorporates many of the lessons from this study and takes the concept of structured AI tutoring to the next level. 

Here's how Wittly's features align with the research findings:

Structured, Skill-Specific Prompts

Like the successful GPT Tutor in the study, Wittly uses structured prompts tailored to the specific skill the student is working on in their Classworks activity. This ensures relevance and alignment with learning objectives, promoting the significant performance improvements seen in the study.

Guided Discovery, Not Direct Answers

Wittly is designed to provide incremental hints and guidance rather than giving away full solutions. This approach encourages critical thinking and helps students develop problem-solving skills, addressing the study's finding that open-ended systems can be used as a "crutch."

Common Misconception Prompts

After each interaction, Wittly generates three "common misconception" questions. This feature helps students overcome typical hurdles in their learning journey, potentially contributing to the maintained performance seen in the study when AI assistance was removed.

Simplified Interaction with Thumbs Up/Down

Wittly's straightforward feedback system lets students quickly indicate whether they found the explanation helpful. This efficient interaction method may contribute to the increased engagement time observed in the study for structured systems.

AI Power Management

Wittly incorporates an "AI Power" feature that limits daily usage to prevent over-reliance on AI. This functionality aligns with the study's finding that unrestricted access to AI can potentially harm learning outcomes.

Error Reduction Through Teacher Input

Unlike the open-ended system in the study, which had high error rates, Wittly's prompts include teacher-provided solutions and common student mistakes. This intentional design significantly reduces the likelihood of AI errors, addressing a primary concern highlighted in the study.

Enhancing Student Confidence

The study found that students using the structured system perceived better performance, indicating improved confidence. Wittly's approach, which guides without giving away answers, likely contributes to similar boosts in student confidence.

Teacher Oversight and Feedback

Wittly allows teachers to review AI tutoring sessions, a feature not present in the study's systems. This additional layer of oversight can help address any potential misunderstandings or misuse of the AI tutor.

Wittly by Classworks is an Effective AI Learning Assistant

The alignment between Wittly's approach and the findings of the Wharton School study underscores the importance of thoughtful AI implementations in education. By incorporating structured prompts, guided discovery, error reduction strategies, and teacher oversight, Wittly addresses the key benefits and concerns highlighted in the research.

As we continue integrating AI into education, tools like Wittly show us how to do so responsibly and effectively. By leveraging research-backed strategies, Wittly harnesses AI's potential to enhance student learning without compromising critical thinking and independent problem-solving skills.

The future of education lies in innovative, structured AI systems like Wittly that can provide personalized support while maintaining the integrity of the learning process. As this study shows, with the right approach, AI can be a powerful tool for improving educational outcomes and preparing students for the challenges of tomorrow.

To learn more about Classworks chat with us using the chat button on the right or email hello@classworks.com.

Related Posts