Mode Fixed melody task

Current Note --

Articulation --

Dynamics --

Dynamic Trend --

Speed --

Direction --

Coordination --

Fingertips --

Turn movement into a musical task

Use articulation, dynamics, and phrase-line challenges so the body understands the music before returning to piano touch.

Chinese English

Module Submodule

Performance Analysis Flow Choose materials, start analysis, and review the report

Motion Music Record Phase one records whether the student can feel the musical task more easily. It is not a performance diagnosis.

Phase One Questions / Embodied Music

Session Stage Can the student distinguish legato and staccato? Can the student show rising and falling motion with the body? Can the student feel dynamics through movement? Can the student follow the cursor through a complete phrase? Is phrase direction easier to understand? Is practice more engaging and easier to enter musically?

Short Notes (Optional)

0 motion records saved.

Performance Analysis Workspace

Choose materials before starting analysis

Video is used for motion observation. Sound materials are used for pitch and rhythm screening. The system runs the modules that match the materials you upload.

Public Practice Library Original, public-domain, or licensed works only

Choose Practice Material

Library Rule

The public library does not contain pirated modern-method MIDI. The current choice is used as the practice task and note; precise pitch/rhythm review still needs a readable score or licensed built-in MIDI.

My Private Score Users or teachers upload legally authorized materials for private practice analysis only

I confirm that the uploaded material was legally obtained and that I have the right to use it for my own or my class's teaching analysis. The platform only provides private analysis and does not publicly display, download, or share user-uploaded score files. Score file (standard reference; MusicXML / MIDI preferred) Work / Excerpt Notes (Optional)

Performed Excerpt Range (Optional) Start Measure End Measure

Technical Diagnostics and Processing Details Expand when troubleshooting

Professional Alignment Engine

Score MIDI/MusicXML is the standard reference. Performance MIDI is compared directly with the score; performance audio can be transcribed to MIDI first and then compared; performance video is used only for motion observation.

Capture Setup Guide Expand when needed to review the primary angle and optional hand angle

Normal capture only needs primary angle A. Angle B is optional and used only when a closer look at the keyboard, hands, and forearm direction is needed.

Primary Angle

Prefer about 45 degrees from the performer's front-right side, positioned in front of the right end of the keyboard, where the performer's front-side profile and right-hand direction are visible. Keep the head, shoulders, torso, hips, elbows, wrists, both hands, and keyboard in frame, and avoid the right-rear side or only filming the back.

Hand Angle

Optional supplement. A second device may be placed near the keyboard center line for an overhead or oblique view to examine the keyboard, hands, wrists, and forearm direction.

Open-Source Hand Model

The system still uses MediaPipe Hands / hand-pose-detection to read hand landmarks. View B only improves finger and forearm detail; it is not required.

Sound Recording

Sound materials can be uploaded separately as needed: performance audio supports quick listening-based screening; audio/video-to-MIDI sends the recording to the server first, then into the same score-alignment engine; already-transcribed MIDI can also be reviewed with the audio-transcription evidence level; performance MIDI is compared directly with score MIDI/MusicXML. A quiet 10-30 second recording with little reverb is recommended.

Motion Material Performance Video

Phase one observes large-movement coordination, upper-body support, wrist height, hand path, and motion continuity. It is not used for pitch, rhythm, fine-muscle force, or medical judgment.

Motion Material Upload Performance Video

Used to observe large-movement coordination, upper-body support, wrist height, hand path, and motion continuity. Video itself does not judge wrong notes or rhythm; if score and sound materials are uploaded too, the system combines them into one report.

Performance Video (Motion Analysis)

Sound Materials Pitch and Rhythm Materials

The path depends on the material: performance audio gives a quick suspected screen; audio/video for transcription runs server Basic Pitch first, already-transcribed MIDI skips transcription, and both then use the core score-alignment standard; performance MIDI goes directly into the core alignment engine.

Performance Audio Quick Listening Screen

Quickly locates measures that need listening review by checking onset, energy, and spectral cues. It does not produce note-by-note wrong-note conclusions. Quiet recordings with little reverb and background noise work best.

Upload Performance Audio

Audio Transcription Audio to MIDI / Transcribed MIDI

Audio or video is transcribed on the server first. Already-transcribed MIDI skips Basic Pitch and is reviewed with the transcription evidence level against the score.

Upload Audio or Transcribed MIDI

Performance MIDI Performance MIDI

Compares directly with score MIDI/MusicXML. This remains the most stable path for pitch, wrong-note, extra-note, missing-note, and rhythm analysis.

Upload Performance MIDI

Hand Tracking

Waiting: after Start Analysis, the system will track wrists, fingertips, and left/right hand information.

Analyzing Sound / MIDI Materials 0%

The system is processing the current file.

Performance Analysis and Suggestions

Upload performance materials, then click Start Analysis. Basic information is optional; the system records this sample when analysis starts and generates teaching observations, reviewable issues, and next-step suggestions.

Sample Saving

Not saved yet. This sample will be recorded automatically after Start Analysis.

Professional Notes (Optional) For teachers or researchers; general users can read the report first

Evidence and Judgment Boundaries

Music and Teaching

Observe relationships among rhythm, phrasing, dynamics, articulation, and body motion.

Video Motion Observation

In phase one, compare sound results only with upper-body support, shoulder-hip coordination, wrist height, hand path, and movement continuity.

Health Boundary

Only records fatigue or discomfort as a review entry; it does not judge disease, injury risk, rehabilitation plans, or fine-muscle force use.

Review Principle

Camera angle, occlusion, audio quality, and model error can affect results; teacher review is needed.

Integrated Judgment Principle

A single video indicator does not decide the result. Phase one only outputs large-movement observation cues; more reliable judgment needs support across score task, sound/MIDI results, video, and teacher labels.

Basic Information Optional, used for sample grouping and later research comparison

Basic information is optional

Age Group Learning Stage What is being played Focus Area (Optional)

You can start analysis even without a teacher present. The system saves this sample, and basic information or teacher labels can be added later.

Additional Information (Optional) You can start analysis without filling this in

Years of Piano Study Typical Practice Time Any discomfort? (not diagnostic) Comparison Stage Discomfort Frequency When does it usually appear? Warm-up and Rest Habits Recent Practice Change Research Route Note

Additional information is only for later research grouping and review; the current system does not provide medical diagnosis.

Teacher Label Add after analysis to correct system judgments and form training samples

Teacher Review / Ground Truth Pitch Judgment Accuracy Rhythm Judgment Usefulness Video Motion Observation Wrist Downward-Motion Observation Teaching Decision Wrist State Forearm Rotation Body Support Release / Load Cue Teacher Score (Optional) Overall Review Result

This is not a student score. It lets the teacher separately confirm whether pitch, rhythm, and motion interpretation match real listening and performance observation, so future rules and training data can be corrected.

Teacher Notes

No training sample saved yet.

Melody Type Show fingertip tracking aid

Music Task Challenge Articulation Run: Hear the Obstacles Level 1 · Side-scroller · Legato glide / staccato jump

The character moves forward automatically: keep smooth legato motion on long green sections, and make one short downward press before red obstacles.

The backing track cues articulation: legato sections sound longer and more connected; obstacles are cued by short staccato sounds.

Goal: one clear downward press inside the staccato window jumps over an obstacle; sudden motion in a legato section counts as a broken line.

Current Challenge Legato Line Challenge

Completion --

Following Quality --

After tapping Start, complete the current musical task with one clear movement.

Not calibrated: using default movement criteria.

Staccato Sensitivity Tracking Mode

Articulation Practice: Smooth / Press

Begin with the right hand in a low position and listen as the fixed melody enters.
Keep legato during smooth arm movement.
Trigger staccato with a clear, fast downward action.
This module does not judge crescendo or diminuendo.

View Capture and Analysis Notes Camera angle, sound material, and model boundaries

Teaching Goal

First turn body motion into clear musical handling, then transfer it back to piano touch, weight shift, and release.

Performance Analysis Setup

Check Camera Placement First

This step helps the piano video, audio, and teacher labels line up for later review.

Normal capture only needs Primary Angle A. Angle B is optional.

A Primary Angle

Place it in front of the keyboard's right end, about 45 degrees from the performer's front-right side, showing the full upper body, hips, elbows, wrists, both hands, and keyboard. Avoid the right-rear side.

Optional Angle B

Use this only when you need a closer look at the keyboard, both hands, wrists, and forearm direction.

Open-Source Hand Model

MediaPipe Hands helps extract wrist, fingertip, finger opening, and handedness information.

Piano Motion Lab

Product Overview

From the Track to the Keyboard

Movement Background

Questions from Piano Teaching

Research Direction

Piano Motion Lab

User Notice and Risk Disclaimer

Turn movement into a musical task

Check Camera Placement First