BioCoach AI Uses Your Phone Camera to Fix Exercise Form
BioCoach is a prototype AI fitness system that analyzes your body mechanics in real time and delivers precise, injury-preventing form corrections via phone came
During the pandemic, the US Consumer Product Safety Commission recorded a 48% spike in at-home exercise injuries. You might think the culprit was bad equipment, but it was bad form. People had no coach around to correct it.
Researchers at Drexel University and Michigan State University have built a prototype that addresses exactly that problem, in real time, using your phone camera, and there’s real potential for it to become a legitimate fitness app in the future (via Tech Xplore).
What Is BioCoach and How Does It Work?
The system, called BioCoach, was presented at the Conference on Computer Vision and Pattern Recognition in June 2026. It uses AI and live video to watch you exercise, analyze your body mechanics, and deliver specific, biomechanics-based corrections.
To do this, the system processes video through two parallel streams: the first uses a 3D convolutional neural network to capture your visual appearance and body movement patterns, while the second reconstructs your skeleton in three dimensions, analyzing your joint angles, range of motion, and the phase of the movement you’re in.
Before offering feedback, BioCoach identifies which joints are most involved in the exercise you’re performing. For instance, if you’re doing push-ups, it will specifically monitor your shoulders, elbows, and wrists, offering personalized corrections.
This goes well beyond the generic “keep your back straight” comments that most fitness apps offer. The prototype delivers anatomically precise guidance such as “increase elbow flexion to 90 degrees at the bottom.”
How Did It Perform Against the Competition?
The research team trained BioCoach on Qualcomm’s Exercise Video Dataset, with over 200 re-annotated videos and over 2,400 new notes, to teach BioCoach to explain not just what to fix, but why it matters.
BioCoach has already been tested against similar programs from Nvidia, ByteDance, Alibaba, Salesforce, OpenAI, and MIT, among others. It outperformed Stream-VLM, a program from MIT and Nvidia, on text quality and judged correctness, and showed improvements in anatomy-specific feedback accuracy as well.
For now, the system is still a prototype, but the team is working on adding the ability to estimate joint reaction forces and muscle activation patterns, all from a video feed.
The research was supported by the National Science Foundation, and the potential exists for BioCoach to be developed into a smartphone app that offers personalized corrective guidance, encourages proper form and posture, prevents injuries, and supports sustainable workout programs for people both indoors and outdoors.
BioCoach Is More Advanced Than Most AI-Based Fitness Coaches
Both Apple Fitness+ and Mirror offer video-based workout programs, but their feedback is pre-recorded and not dynamic like what BioCoach offers.
Peloton’s hardware offers a Movement-Tracking Camera that counts reps and flags issues, but it requires dedicated equipment like Bike+, Tread+, or Row+, and doesn’t explain the reasoning behind form corrections or how they benefit you.
Similarly, Google’s Health Coach and Samsung Health analyze biometric signals like heart rate and activity cadence to suggest improvements, but they can’t see you moving and therefore don’t provide any guidance on form.
BioCoach, in contrast, is the first system to combine 3D skeletal reconstruction with a language model that explains the mechanical consequence of each correction. If it ever reaches consumers as a smartphone app, it could make genuinely expert coaching accessible to anyone with a camera.
