Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about segmentation #30

Open
accoutzzz opened this issue Nov 24, 2021 · 4 comments
Open

Questions about segmentation #30

accoutzzz opened this issue Nov 24, 2021 · 4 comments

Comments

@accoutzzz
Copy link

accoutzzz commented Nov 24, 2021

Thanks for your sharing! I benefit a lot from the code. However, I also meet some problems.
Based on the released segmentation code, I conducted the experiment on the S3DIS dataset and evaluated the network on Area5. The training pipeline is following the train_semseg.py
I got the result that the training_acc is 94.3% and the test_mIoU only achieve 54.3%. The result is lower than that in the paper about 7%. I have the following question.

  1. I used the SGD optimizer with LR = 0.01 and used the CosineAnnealing strategy to adjust the LR every epoch. I also used the random scale and rotation around the z-axis data argument. Did I use the correct training trick?
  2. When I experiment with the ShapePartNet dataset for part-segmentation tasks, I found that testing with a multi-scale strategy brings about a 5% improvement. I wonder that did you use the multi-scale test strategy on Area5 for the semantic segmentation?
  3. I also found that the experiment result of DGCNN on Table4 is from 6-fold cross-validation but not Area5.
@MenghaoGuo
Copy link
Owner

Thanks for your attention.

I do not use this repo to conduct experiment on the S3DIS dataset. If you want to reproduce the result on scene segmentation. you can adopt this repo.

There are many potential reasons that may lead to performance degradation such as data enhancement and tricks. As for the specific reason, I think a detailed ablation study should be done.

@accoutzzz
Copy link
Author

Thanks you for your reply. I will try my best to reproduce the it.

@h1063135843
Copy link

h1063135843 commented Feb 22, 2022

Thanks you for your reply. I will try my best to reproduce the it.

Have you reproduced it? I am also trying to do the same thing. But I get the worse performance on s3dis (48% miou). I delete the cls_label and corresponding lable_conv according to the #8 , and set the points number to 2048 according to the #22 . What is the next should I do to get the better performance.

@294coder
Copy link

294coder commented Feb 22, 2022 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants