Skip to content

Commit

Permalink
[docs] update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
zhengzangw committed May 7, 2024
1 parent 258c527 commit 54e2988
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 9 deletions.
9 changes: 3 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,6 @@ With Open-Sora, our goal is to foster innovation, creativity, and inclusivity wi

[[中文文档]](/docs/zh_CN/README.md) [[潞晨云部署视频教程]](https://www.bilibili.com/video/BV141421R7Ag)

<h4>Open-Sora is still at an early stage and under active development.</h4>

## 📰 News

* **[2024.04.25]** 🤗 We released the [Gradio demo for Open-Sora](https://huggingface.co/spaces/hpcai-tech/open-sora) on Hugging Face Spaces.
Expand Down Expand Up @@ -109,13 +107,12 @@ see [here](/assets/texts/t2v_samples.txt) for full prompts.

### TODO list sorted by priority

* [ ] Training Video-VAE and adapt our model to new VAE. **[WIP]**
* [ ] Scaling model parameters and dataset size. **[WIP]**
* [ ] Incoporate a better scheduler, e.g., rectified flow in SD3. **[WIP]**

<details>
<summary>View more</summary>

* [x] Training Video-VAE and adapt our model to new VAE.
* [x] Scaling model parameters and dataset size.
* [x] Incoporate a better scheduler (rectified flow).
* [x] Evaluation pipeline.
* [x] Complete the data processing pipeline (including dense optical flow, aesthetics scores, text-image similarity, etc.).
* [x] Support image and video conditioning.
Expand Down
5 changes: 3 additions & 2 deletions opensora/utils/ckpt_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,6 @@
"PixArt-Sigma-XL-2-1024-MS.pth": hf_endpoint
+ "/PixArt-alpha/PixArt-Sigma/resolve/main/PixArt-Sigma-XL-2-1024-MS.pth",
"PixArt-Sigma-XL-2-2K-MS.pth": hf_endpoint + "/PixArt-alpha/PixArt-Sigma/resolve/main/PixArt-Sigma-XL-2-2K-MS.pth",
# "PixArt-1B-2.pth": "PixArt-1B-2.pth",
}


Expand Down Expand Up @@ -70,7 +69,9 @@ def reparameter(ckpt, name=None, model=None):
if "pos_embed" in ckpt:
del ckpt["pos_embed"]

if name in ["PixArt-1B-2.pth",]:
if name in [
"PixArt-1B-2.pth",
]:
ckpt = ckpt["state_dict"]
if "pos_embed" in ckpt:
del ckpt["pos_embed"]
Expand Down
2 changes: 1 addition & 1 deletion setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ def fetch_readme() -> str:

setup(
name="opensora",
version="1.1.0",
version="1.2.0",
packages=find_packages(
exclude=(
"assets",
Expand Down

0 comments on commit 54e2988

Please sign in to comment.