Smart Music

Music Scoring is a rating solution to judge singing performances based on pitch, rhythm, and other dimensions.

Music Labeling analyzes music to understand its various elements such as intensity, mood, style, emotion, and other dimensions of music understanding. After analysis, the solution automatically generates labels for the music such as style, mood, intensity, presence of human vocals, instrumental music only, and more. There are currently more than 20 categories that the solution can label.

Prelude Skipping scans music and identifies the timestamp when the intro (prelude music) ends and the singing begins.

Drumbeat Recognition automates the process of scanning music to locate the time positions of the drum beats to determine the rhythm. Use this capability to quickly sync video tracks to the beat positions or use the recognized rhythm to generate drum beats to the music.

Pitch Recognition scans audio, whether vocal singing or musical instrument performance, to calculate in real-time the audio pitch. This solution also supports midi output for the audio to be used on mobile phones.

Highlights Recognition scans music to detect the climatic, emotional, or chorus highlights of a song. Users can skip directly to song highlights in karaoke apps. Editors can quickly create music highlights clips. Short video content creators can access a catalog of music highlights to complement their videos.

Source Separation takes complete audio tracks and separates the audio into distinct sources such as vocals, accompaniment, guitar, piano, drums, bass, and more. Scenarios to use audio separation include advertisements, games, marketing, and more.

Audio Denoising analyzes input audio to remove noisy background sounds to return the audio to a clear and polished state. Applications for this capability are to remove noise captured unintentionally during the filming process. Another application is to clean up the audio for further processing downstream.

Sheet Music Conversion analyzes piano performance music and identifies the instrument pitch and notes. The solution can then transcribe the notes to midi or sheet music files for sheet music libraries or provides sheet music for personal analysis and study.

Instrument Conversion uses deep learning for music understanding and identifies the instruments and notes used in the music composition. The music can then be converted to playback using one of 31 possible instruments from our API.

Style Conversion analyzes the input music to determine the composition and instruments used. The solution can then perform conversion with instrument substitution to fit a style selected by the user. Styles of music supported include opera, Chinese style, pop, ballad, sentimental, rock, electronic, R&B, and more.

Input the original music, strip the vocal part, calculate the pitch and interval of each note, and output a standard MIDI file.

Just enter a few notes or cues to automatically compose single-track music.

Input the video, automatically match the background music in the music library that matches the video content and atmosphere, and generate a video with BGM without manual editing. Support custom music library. It includes audio and video capabilities such as automatic score, music MV, etc., and supports access to the audio and video library of the business team, which can speed up content production and accelerate content distribution and dissemination.

Import the original movie, and automatically edit the best movie clips from the spatial and temporal dimensions, and match the climax of the music.

Enter the original music, recommend the most matching material in the video library for synthesis, find the video that best expresses its mood or rhythm for the music, and automatically make a wonderful music MV. Support custom video library to create exclusive MV. It includes audio and video capabilities such as automatic score, music MV, etc., and supports access to the audio and video library of the business team, which can speed up content production and accelerate content distribution and dissemination.

Identify the clips with richer content and more aesthetic features in the video, and automatically complete the editing and soundtrack work, and quickly generate Vlogs. It includes audio and video capabilities such as automatic score, music MV, etc., and supports access to the audio and video library of the business team, which can speed up content production and accelerate content distribution and dissemination.