SignQuest: 2025 Apple Swift Student Challenge [Winner]

SignQuest is an interactive ASL (American Sign Language) alphabet learning app that helps users master ASL letter gestures through real-time hand gesture recognition, 3D model demonstrations, and gamified practice sessions.

Features

1. Sign School (Learning Module)

• Guides users through mastering each ASL letter gesture
• Provides structured, step-by-step learning with immediate feedback
• Features both 2D camera-based gesture recognition and 3D hand model viewing
• Offers detailed gesture instructions with textual descriptions and reference images

2. Word Play (Game Module)

• Gamifies the learning process through interactive word-spelling challenges
• Enhances engagement with visual feedback and celebratory animations for successful completions.

3. Hand Spell (Practice Module)

• Enables users to practice spelling any word using ASL signs
• Provides a text editor that converts signed gestures into text
• Includes a built-in dictionary for quick and easy reference

Technical Features

• SwiftUI
• CoreML & CreateML
• SceneKit & Reality Composer
• AVFoundation & Vision

Requirements

• Swift Playgrounds 4.0 or XCode 16.0 or later

Demo

Youtube

HomeScreen

SignSchool Mode

3D Hand Model