Skip to content

Commit

Permalink
Add our Huggingface address to documents (FlagAI-Open#94)
Browse files Browse the repository at this point in the history
Co-authored-by: zhaohu xing <[email protected]>
  • Loading branch information
BAAI-OpenPlatform and 920232796 authored Nov 11, 2022
1 parent bd81dbf commit 0cc600c
Show file tree
Hide file tree
Showing 12 changed files with 14 additions and 162 deletions.
11 changes: 6 additions & 5 deletions examples/AltCLIP/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ The model and weights have been open sourced on FlagAI ([https://github.com/Flag
<td>77.3 </td>
</tr>
<tr>
<td>AlterCLIP</td>
<td>AltCLIP</td>
<td>66.3 </td>
<td>87.8 </td>
<td>92.7 </td>
Expand All @@ -101,7 +101,7 @@ The model and weights have been open sourced on FlagAI ([https://github.com/Flag
<td>88.3 </td>
</tr>
<tr>
<td>AlterCLIP∗</td>
<td>AltCLIP∗</td>
<td>72.5 </td>
<td>91.6 </td>
<td>95.4 </td>
Expand Down Expand Up @@ -162,7 +162,7 @@ The model and weights have been open sourced on FlagAI ([https://github.com/Flag
<td>87.9 </td>
</tr>
<tr>
<td>AlterCLIP</td>
<td>AltCLIP</td>
<td>63.7 </td>
<td>86.3 </td>
<td>92.1 </td>
Expand All @@ -172,7 +172,7 @@ The model and weights have been open sourced on FlagAI ([https://github.com/Flag
<td>87.2 </td>
</tr>
<tr>
<td>AlterCLIP∗</td>
<td>AltCLIP∗</td>
<td>69.8 </td>
<td>89.9 </td>
<td>94.7 </td>
Expand All @@ -183,9 +183,10 @@ The model and weights have been open sourced on FlagAI ([https://github.com/Flag
</tr>
</table>

![image-20221111172255521](imgs/image.png)



![](imgs/imagenet.png)

# 可视化效果 Visualization effects

Expand Down
Binary file added examples/AltCLIP/imgs/image.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed examples/AltCLIP/imgs/imagenet.png
Binary file not shown.
8 changes: 7 additions & 1 deletion examples/AltDiffusion/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,12 @@ AltDiffusion 模型由名为 AltCLIP 的双语 CLIP 模型支持,该模型也

注意:模型推理要求一张至少10G以上的GPU。



同时,AltDiffusion的 web demo 也部署在huggingface spaces上,欢迎试用!网址为:[https://huggingface.co/spaces/BAAI/bilingual_stable_diffusion](https://huggingface.co/spaces/BAAI/bilingual_stable_diffusion)



We use the pre-trained bilingual language model as our text encoder and fine-tune it using the WuDao dataset (6M) with an aesthetic score above 5.5 and the Laion data (5M) with an aesthetic score above 5.5.

When fine-tuning, we use stable-diffusion v1-4 as initialization, freeze the bilingual language model, and only fine-tune the key module and vuale module of the Transformer Block in the Unet model.
Expand All @@ -23,7 +29,7 @@ AltDiffusion model is backed by a bilingual CLIP model named AltCLIP, which is a

Note that the model inference requires a GPU of at least 10G above.


Also, AltDiffusion's web demo is deployed on huggingface spaces, feel free to try it out! The web address is:[https://huggingface.co/spaces/BAAI/bilingual_stable_diffusion](https://huggingface.co/spaces/BAAI/bilingual_stable_diffusion)

# 示例 Example

Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
import torch
import torch.nn as nn
from flagai.model.mm.clip_cn.model import CLIP
from flagai.model.mm.clip_guohua.model import CLIP
from flagai.model.base_model import BaseModel


Expand Down
155 changes: 0 additions & 155 deletions flagai/model/mm/lm/dcn_clip.py

This file was deleted.

0 comments on commit 0cc600c

Please sign in to comment.