Skip to content

Run Stable Diffusion on Android Devices with Snapdragon NPU acceleration. Also supports CPU inference.

Notifications You must be signed in to change notification settings

xororz/local-dream

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

Local Dream

Android Stable Diffusion with Snapdragon NPU acceleration. Also supports CPU inference.

About this Repo

This project is currently closed-source and this repository is only used for releasing binaries and discussing issues for now.

This project is completely free. Hope you enjoy it!

Usage

  • Download the APK from the Releases page
  • Open the app and download the model(s) you want to use

Technical Implementation

NPU Acceleration

  • Utilizes Qualcomm QNN SDK to leverage Hexagon NPU
  • W8A16 static quantization for optimal performance
  • Fixed model shape at 512x512
  • Extremely fast inference speed

CPU Inference

  • Powered by MNN framework
  • W8 dynamic quantization
  • Flexible output sizes: 128x128, 256x256, 384x384, 512x512
  • Relatively slower processing speed with slightly lower accuracy

Supported Devices

NPU Acceleration Support

  • Devices with Snapdragon 8 Gen 1
  • Devices with Snapdragon 8+Gen 1
  • Devices with Snapdragon 8 Gen 2
  • Devices with Snapdragon 8 Gen 3
  • Devices with Snapdragon 8 Gen 4

Note: Different phones have different default frequency limits for their NPUs, and the same chip from different manufacturers may have varying inference speeds.

Possibly Support (Not verified)

  • Snapdragon 6gen1 8sgen3 7+gen3 7gen1 7+gen2

CPU Support

  • Requires approximately 2GB RAM
  • Compatible with most Android phones from recent years

Available Models

  1. Anything V5.0

    • Specialized for anime/manga style image generation
  2. Stable Diffusion 2.1

    • General-purpose image generation
  3. Pony V5.5

    • Pony Diffusion series

Currently CPU version only provides Anything V5.0 model since it works fine at low resolutions.

Seed Settings

The application supports custom seed settings for reproducible results:

  • CPU Mode: Seeds guarantee identical results across different devices with the same parameters
  • NPU Mode: Seeds ensure consistent results only on devices with identical chipsets

Sponsorship

If you like this project, please consider sponsoring this it. Your support will help me implement:

  • Additional models
  • New features
  • Enhanced capabilities
Buy Me a Coffee at ko-fi.com 在爱发电支持我

Your sponsorship helps maintain and improve Local Dream for everyone!

About

Run Stable Diffusion on Android Devices with Snapdragon NPU acceleration. Also supports CPU inference.

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published