Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some Reproducibility problems #4

Open
Michaeljurado42 opened this issue Feb 24, 2024 · 1 comment
Open

Some Reproducibility problems #4

Michaeljurado42 opened this issue Feb 24, 2024 · 1 comment

Comments

@Michaeljurado42
Copy link

Hello. I have found a couple reproducibility issues. Some are easier to fix on others.

In '/recipes/intel_ndns/spiking_fullsubnet/dataloader.py' it is written self.noisy_files = glob.glob(root + "noisy/**.wav"). On my machine, "noisy/*.wav" works instead.

In recipes/intel_ndns/spiking_fullsubnet_freeze_phase/trainer.py the code will not execute because the following import statement is broken

from audiozen.trainer_backup.base_trainer_gan_accelerate_ddp_validate import BaseTrainer

BaseTrainer does not seem to exist in the repository, however Trainer is present.

Also, IntelSISNR is missing as well from the repository.

Lastly, the "recipes/intel_ndns/spiking_fullsubnet/exp" is missing the checkpoint files I believe. So you cannot resume training or test the model.

@haoxiangsnr
Copy link
Owner

Hi, @Michaeljurado42. Thank you for your attention. Currently, our repo contains two versions of the code:

  1. The frozen version, which serves as a backup for the code used in a previous competition. However, due to a restructuring in the audiozen directory, this version can no longer be directly used for inference. If you need to verify the experimental results from that time, please refer to this specific commit: 38fe020. There you will find everything you need. After switching to this commit, you can place the checkpoints from the model_zoo into the exp directory and use -M test for inference or -M train to retrain the model.

  2. The latest version of the code has undergone some restructuring and optimization to make it more understandable for readers. We've also introduced acceleate to assist with better training practices. I believe you can follow the instructions in the help documentation to run the training code directly. The pre-trained model checkpoints and a more detailed paper will be released by next weekend, so please stay tuned for that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants