Quick Start Guide
Adding a song:
-
Tap the “Add Song” button at the bottom of the screen.
-
The audio / midi file needs to be a piano solo.
-
If the midi file has left / right hands separated into two tracks (no notes in any other extra tracks), the AI will respect the separation and keep it. If the hands are not separated in the midi file, the AI will try to separate them.
-
Most song imports take around 10 seconds to process by our servers.
Choosing a view:
-
Once a song is imported, you can switch between different views by clicking the “Camera” button.
-
Top View and First Person cameras have a piano roll and LED lighting effects, other views have the 3D Scene where the piano and avatar are visible.
Tweaking the visuals:
-
Click the “Visuals” button to change different aspects of the rendering
-
Left / Right hand color options affect the color of the notes in Top and First Person Views
-
You can use the piano roll zoom slider to change the vertical size of the falling notes in top and chest cameras.
-
You can also select between different pianos. Selecting pianos is only available when you are in 3D views (all views except Top and First Person views, as those don’t have a piano to start with).
Editing the Playing
-
Click the “Edit Animation” Button
-
Click on the note you want to edit, then use the widget that appears in the bottom right corner of the screen to change the Finger / Hand assigned to it.
-
Important! Once you make edits to the fingering, you will need to hit the refresh button next to Edit Animation. This will send the edits to the AI and regenerate the animation based on your edits. It will also save your edits to the cloud.
-
After you hit the refresh button, you will need to wait for the animation to be processed and sent back to you. This usually takes 15 seconds each time you hit the refresh button.
-
Tip: To save time, We recommend making a couple of edits then hitting the refresh button instead of refreshing the animation at every edit / change.
Keyboard Shortcuts:
-
Use 1,2,3,4 and F keys to change the fingers for the left hand and 7,8,9,0 and H to change the fingers for the right hand
-
Left/Right arrow keys to go to next / previous notes in the same hand
-
Use the "Q" button to disable / enable any note selected. This is especially helpful for audio based imports.
Exporting the video:
- Tap the "Render" button at the top right corner of the screen.
- Choose resolution and frame rate for your export then hit Render.
Using the RTX version:
The RTX version requires a Windows PC with an RTX compatible NVIDIA graphics card. The RTX version will not run on any other machine without those specs. We highly recommend using the normal version otherwise.
The RTX version uses raytracing to compute hyper realistic visuals. Animations look the same in the RTX version. Only the visuals get an upgrade.
-
Performing real time path tracing is computationally expensive, hence why the realtime preview will always look noisy. To see how the image would look without noise, pause the song playback and let the frame render for a couple of seconds.
-
Since you can’t record the video without noise in realtime in the RTX version, you will need to render the video ahead of time. Rendering a song can take couple of hours depending on the length of the song and render quality.
Using Concert Creator in Virtual Reality (VR):
You can use Concert Creator to experience the generated performances in virtual reality, with full 6 degrees of freedom. You can work around the pianist or sit in their seat, and watch the performance from every angle!
Virtual Reality currently requires Windows based & VR compatible PC. To connect your VR headset:
If you are using Oculus Quest:
- Make sure you Oculus Quest is connected to your PC through Air Link (wirelessly) or through Oculus Link with Cable (USB cable) by following the official guide here:
https://support.oculus.com/airlink/
- Make sure Oculus Link / Air Link is launched and active from inside your Oculus before starting Concert Creator.
- After that, open Concert Creator and choose "Virtual Reality" from the camera menu, then wear your headset on.
If you are using Steam VR:
- Make sure Steam VR is active and your headset is connected to your PC before starting Concert Creator.
- After that, open Concert Creator and choose "Virtual Reality" from the camera menu, then wear your headset on.