Difference between revisions of "Music : Audio Analysis, Synchronization, And More"

From Tmplab
(Created page with " == Audio Analysis Libraries and Projects == === Aubio === aubio is a tool designed for the extraction of annotations from audio signals. Its features include segmenting a...")
 
(Examples & tutorials & learning material)
 
(6 intermediate revisions by the same user not shown)
Line 1: Line 1:
  
== Audio Analysis Libraries and Projects  ==
+
= Audio Analysis   =
 +
== Libraries ==
  
 +
=== MadMom ===
 +
 +
'''Links'''
 +
 +
* Source code : https://github.com/CPJKU/madmom
 +
 +
Madmom is an audio signal processing library written in Python with a strong focus on music information retrieval (MIR) tasks.
 +
 +
''''Features'''
 +
* core: signal, filters, comb_filters, stft, spectrogram, cepstrogram, chroma, hpss
 +
* features: beats, beats_crf, beats_hmm, chords, downbeats, key, notes, onsets, tempo
 +
* io : files, music files, midi
 +
* machine learning: crf, gmm, hmm, nn
 +
* Various utils
 +
 +
=== PyAudio ===
 +
 +
PyAudio provides Python bindings for PortAudio, the cross-platform audio I/O library. With PyAudio, you can easily use Python to play and record audio on a variety of platforms, such as GNU/Linux, Microsoft Windows, and Apple Mac OS X / macOS.
 +
 +
'''Links'''
 +
* Homepage https://people.csail.mit.edu/hubert/pyaudio/
 +
* Documentation https://madmom.readthedocs.io/en/latest/
 +
 +
 +
'''Features'''
 +
* Read and play audio
  
 
=== Aubio ===
 
=== Aubio ===
  
aubio is a tool designed for the extraction of annotations from audio signals. Its features include segmenting a sound file before each of its attacks, performing pitch detection, tapping the beat and producing midi streams from live audio.
+
'''Links'''
 +
* Project Homepage https://aubio.org/
 +
* Github https://github.com/aubio/aubio
 +
 
 +
aubio is a tool designed for the extraction of annotations from audio signals.
 +
 
 +
'''Features'''
 +
segmenting a sound file before each of its attacks,  
 +
* performing pitch detection,  
 +
* tapping the beat  
 +
* producing midi streams from live audio.
 +
 
 +
 
  
https://aubio.org/
+
=== pyAudioAnalysis ===
  
=== Aubio ===
+
'''Links'''
 +
* Gihtub https://github.com/tyiannak/pyAudioAnalysis
  
 
A Python library for audio feature extraction, classification, segmentation and applications
 
A Python library for audio feature extraction, classification, segmentation and applications
  
https://github.com/tyiannak/pyAudioAnalysis
+
 
 +
'''Features'''
 +
* Extract audio features and representations (e.g. mfccs, spectrogram, chromagram)
 +
* Classify unknown sounds
 +
* Train, parameter tune and evaluate classifiers of audio segments
 +
* Detect audio events and exclude silence periods from long recordings
 +
* Perform supervised segmentation (joint segmentation - classification)
 +
* Perform unsupervised segmentation (e.g. speaker diarization)
 +
* Extract audio thumbnails
 +
* Train and use audio regression models (example application: emotion recognition)
 +
* Apply dimensionality reduction to visualize audio data and content similarities
 +
 
 +
== Examples & tutorials & learning material ==
 +
 
 +
=== musicinformationretrieval.com ===
 +
 
 +
 
 +
'''Links'''
 +
* https://github.com/stevetjoa/musicinformationretrieval.com
 +
 
 +
Many examples about analyzing audio and doing Machine Learning with it
 +
 
 +
= Clock Synchronization Libraries  =
 +
 
 +
=== PyBeatSync ===
 +
 
 +
PyBeatSync is a python project that uses the madmom audio and music analysis library to cary out beat detection from a live audio stream and generate a syncronised beat response.
 +
 
 +
'''Links'''
 +
Source Code : https://github.com/louischaman/PyBeatSync
 +
 
 +
= Internal projects =
 +
 
 +
== Pad ==
 +
https://pads.usinette.org/p/sync-music

Latest revision as of 15:42, 12 June 2019

Audio Analysis

Libraries

MadMom

Links

Madmom is an audio signal processing library written in Python with a strong focus on music information retrieval (MIR) tasks.

'Features

  • core: signal, filters, comb_filters, stft, spectrogram, cepstrogram, chroma, hpss
  • features: beats, beats_crf, beats_hmm, chords, downbeats, key, notes, onsets, tempo
  • io : files, music files, midi
  • machine learning: crf, gmm, hmm, nn
  • Various utils

PyAudio

PyAudio provides Python bindings for PortAudio, the cross-platform audio I/O library. With PyAudio, you can easily use Python to play and record audio on a variety of platforms, such as GNU/Linux, Microsoft Windows, and Apple Mac OS X / macOS.

Links


Features

  • Read and play audio

Aubio

Links

aubio is a tool designed for the extraction of annotations from audio signals.

Features

  • segmenting a sound file before each of its attacks,
  • performing pitch detection,
  • tapping the beat
  • producing midi streams from live audio.


pyAudioAnalysis

Links

A Python library for audio feature extraction, classification, segmentation and applications


Features

  • Extract audio features and representations (e.g. mfccs, spectrogram, chromagram)
  • Classify unknown sounds
  • Train, parameter tune and evaluate classifiers of audio segments
  • Detect audio events and exclude silence periods from long recordings
  • Perform supervised segmentation (joint segmentation - classification)
  • Perform unsupervised segmentation (e.g. speaker diarization)
  • Extract audio thumbnails
  • Train and use audio regression models (example application: emotion recognition)
  • Apply dimensionality reduction to visualize audio data and content similarities

Examples & tutorials & learning material

musicinformationretrieval.com

Links

Many examples about analyzing audio and doing Machine Learning with it

Clock Synchronization Libraries

PyBeatSync

PyBeatSync is a python project that uses the madmom audio and music analysis library to cary out beat detection from a live audio stream and generate a syncronised beat response.

Links Source Code : https://github.com/louischaman/PyBeatSync

Internal projects

Pad

https://pads.usinette.org/p/sync-music