Academic Survey Paper Generation.

Official implementation of Mozart's Touch: A Lightweight Multi-modal Music Generation Framework Based on Pre-Trained Large Models

Long-Term Rhythmic Video Soundtracker, ICML2023

Solve Visual Understanding with Reinforced VLMs

Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)

A paper list of some recent works about Token Compress for Vit and VLM

Mixture-of-Experts for Large Vision-Language Models

[ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models

The code repository of UniMoD

Video Background Music Generation Using Unpaired Audio-Visual Data

A Simple Aerial Detection Baseline of Multimodal Language Models.

A framework to enable multimodal models to operate a computer.

[ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer

[ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

This is the official repository for M2UGen

Some Conferences' accepted paper lists (including AI, ML, Robotic)

Official code of paper "DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution"

This is the repo for the paper "OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use".

A curated list of awesome Multimodal studies.

Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation: A framework for generating multimodal music by bridging different representations and enhancing generation with RAG.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/