Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Awesome but... #1

Open
aminesoulaymani opened this issue May 4, 2022 · 14 comments
Open

Awesome but... #1

aminesoulaymani opened this issue May 4, 2022 · 14 comments

Comments

@aminesoulaymani
Copy link

Awesome but where is the code? FOMM is still the leader despite being 3yo!
Regards

@wyhsirius
Copy link
Owner

@aminesoulaymani Thanks for your interest of our work, the code will be released in this month.

@dvm-Omydoo
Copy link

I'll fully test it and send patches, I did the same with Paddlegan

@SSUHan
Copy link

SSUHan commented May 13, 2022

Thanks for your great work!
I'm really waiting for this code to be released asap :)

@zgxiangyang
Copy link

zgxiangyang commented Jun 16, 2022

Hello,the results of your paper are great. We can't wait for the code.

@wyhsirius
Copy link
Owner

Code has been released. Enjoy playing LIA.

@dvm-Omydoo
Copy link

Code has been released. Enjoy playing LIA.

Thanks a lot, I'll enjoy playing it. Cheers

@iperov
Copy link

iperov commented Sep 16, 2022

added this model to https://github.com/iperov/DeepFaceLive

@wyhsirius
Copy link
Owner

@iperov Hi, thanks! Please consider CLARIFYING on the github page that animation model is from our paper and pay attention that our model is only for NON-COMMERCIAL usage according to the license. Thanks!

@iperov
Copy link

iperov commented Sep 16, 2022

it's in the code
https://github.com/iperov/DeepFaceLive/blob/master/modelhub/onnx/LIA/LIA.py

class LIA:
    """
    Latent Image Animator: Learning to Animate Images via Latent Space Navigation
    https://github.com/wyhsirius/LIA

i will not write such info on main page.

By the way DeepFaceLive does not contain code from your repo.

@iperov
Copy link

iperov commented Sep 18, 2022

made with animator https://www.youtube.com/watch?v=Ng1C78Ceyxg

@linfang010
Copy link

@iperov can you share some insights on how to convert LIA from pytorch to onnx

@iperov
Copy link

iperov commented Mar 3, 2023

it's depend on how pytorch code is unfriendly with graph and what ops are not implemented in onnx

@linfang010
Copy link

it's depend on how pytorch code is unfriendly with graph and what ops are not implemented in onnx

@iperov I tried. But get this error

torch.onnx.errors.SymbolicValueError: Unsupported: ONNX export of convolution for kernel of unknown shape. [Caused by the value '17582 defined in (%17582 : Float(*, *, *, *, strides=[8192, 16, 4, 1], requires_grad=1, device=cpu) = onnx::Reshape(%17533, %17581), scope: networks.generator.Generator::/networks.styledecoder.Synthesis::dec/networks.styledecoder.StyledConv::conv1/networks.styledecoder.ModulatedConv2d::conv # /data/linfang/ONNXRuntime/LIA/networks/styledecoder.py:274:0
)' (type 'Tensor') in the TorchScript graph. The containing node has kind 'onnx::Reshape'.]

it's F.conv2d(input, weight, padding=self.padding, groups=batch) that cause the error. I am confused because kernel size is explicitly defined in weight. What should i do?

@Runist
Copy link

Runist commented Oct 16, 2023

it's depend on how pytorch code is unfriendly with graph and what ops are not implemented in onnx

@iperov I tried. But get this error

torch.onnx.errors.SymbolicValueError: Unsupported: ONNX export of convolution for kernel of unknown shape. [Caused by the value '17582 defined in (%17582 : Float(*, *, *, *, strides=[8192, 16, 4, 1], requires_grad=1, device=cpu) = onnx::Reshape(%17533, %17581), scope: networks.generator.Generator::/networks.styledecoder.Synthesis::dec/networks.styledecoder.StyledConv::conv1/networks.styledecoder.ModulatedConv2d::conv # /data/linfang/ONNXRuntime/LIA/networks/styledecoder.py:274:0
)' (type 'Tensor') in the TorchScript graph. The containing node has kind 'onnx::Reshape'.]

it's F.conv2d(input, weight, padding=self.padding, groups=batch) that cause the error. I am confused because kernel size is explicitly defined in weight. What should i do?

Do you slove it ? I meet same problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants