Light musician is a tool to convert song to its light version. With Light Player, vocals in a song can be convert to other instruments using vst plugin.

Environments

• Python == 3.8
• Spleeter == 2.3.0
• Torch == 1.11.0+cu113

Vocal transcription

Modify Piano transcription for vocal transcription.

Pretrained model set-up

1. Download pretrained model here: https://pan.quark.cn/s/f61266573149
2. Put it as path "./test.pth"

Dataset

MIR-ST500 is used to train the vocal transcription network. see here for more information.

Usage

If you have any trouble running the projects, feel free to open a new issue.

from light_musician import Light_Musician

light_musician = Light_Musician()
light_musician.convert('晴天.mp4')

Use Pygame as gui

By this way, u will be using audio engine in pygame.
Set up instrument u want by its id (check "./midi_instrument.py")

from pygame_gui import gui

gui(vocal_midi_path, accompaniment_path)

Use Light Player

Light player is a midi file player hosting vst plugin. It's developed on Juce framework.
See here for more information.

Demos

See demons in my video in Bilibili.