AMAAI Lab ORG

Text2midi is the first end-to-end model for generating MIDI files from textual descriptions. By leveraging pretrained large language models and a powerful autoregressive transformer decoder, text2midi allows users to create symbolic music that aligns with detailed textual prompts, including musical attributes like chords, tempo, and style.

Multimodal Generative AI course

Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model

JamendoMaxCaps is a large-scale dataset of 362,000 instrumental creative commons tracks

Mustango: Toward Controllable Text-to-Music Generation

SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering

A large-scale dataset of caption-annotated MIDI files.

A curated list of Datasets, Models and Papers for Music Emotion Recognition (MER)

Music2Emo: Towards Unified Music Emotion Recognition across Dimensional and Categorical Models

SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning

Music Information Retrieval Feature Library for Extraction

No description.

MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detection

No description.

A Python tool that compares two audio files across melody, rhythm, and timbre separately, returning three independent similarity scores instead of a single blended number.

Improving Symbolic Music Generation with Inference-Time Alignment

Predicting emotion from music videos: exploring the relative contribution of visual and auditory information on affective responses

Demo for DART, Audio Imagination workshop submission in NeurIPS 2024

This is a list of datasets consisting of speech, music, and sound effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications. It is mainly used for speech recognition, speech synthesis, singing voice synthesis, music information retrieval, music generation, etc.

This is the repo accompanying the paper: "A multimodal model with Twitter FinBERT embeddings for extreme price movement prediction of Bitcoin"

No description.

A Benchmark for Causal Question Answering on Music Videos

code for Leveraging LLM Embeddings for Cross Dataset Label Alignment and Zero Shot Music Emotion Prediction

APEX: Large-scale Multi-task Aesthetic-Informed Popularity Prediction for AI-Generated Music

Smart Timing for Mining: A Deep Learning Framework for Bitcoin Hardware ROI prediction

No description.

Resources for DisfluencySpeech

No description.

Scaffolded Vulnerability: Chatbot-Mediated Reciprocal Self-Disclosure and Need-Supportive Interaction in Couples

Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure

a list of demo websites for automatic music generation research

Audio processing by using pytorch 1D convolution network

1 st Workshop on Emerging AI Technologies for Music, part of AAAI

AMAAI Lab website

Repo for paper: To Embody or Not: The Effect Of Embodiment On User Perception Of LLM-based Conversational Agents

Website emotion guidance

An exploration of how generative text-to-music AI models can be used for emotion guidance

Repository for "Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval Systems: a Survey"

Web interface for AI music generation models

No description.

Conditional VAE for Accented Speech Generation

Code for paper A dataset and classification model for Malay, Hindi, Tamil and Chinese music

No description.

BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Features

Dataset and benchmark models for emotion prediction of music with profile info

Python MIDI track classifier and tonal tension calculation based on spiral array theory

Fundamental Music Embedding, FME

Conditional Drums Generation using Compound Word Representations

Code accompanying ML4MD ICML 2020 paper - "Generative Modelling for Controllable Audio Synthesis of Expressive Piano Performance".

Revisiting the Onsets and Frames Model with Additive Attention

Regression-based Music Emotion Prediction using Triplet Neural Networks

Demucs Lightning: A PyTorch lightning version of Demucs with Hydra and Tensorboard features

ReconVAT: a semi-supervised automatic music transcription (AMT) model

Official Implementation of Jointist

PyTorch Dataset for Speech and Music audio

PyTorch implementation of DiffRoll, a diffusion-based generative automatic music transcription (AMT) model

A variational autoencoder for music generation with tension control

A novel seq2seq framework where high-level musicalities (such us the valence of the chord progression) are fed to the Encoder, and they are "translated" to lead sheet events in the Decoder. For further details please read and cite our paper:

music inpainting control

No description.

No description.

This repository collects information about different data sets for Music Emotion Recognition.

Code accompanying ISMIR 2020 paper - "Music FaderNets: Controllable Music Generation Based On High-Level Features via Low-Level Feature Modelling".