Is the code complete yet?

[zzzqqqyyy]

Hello author, I would like to reproduce your experiment, I'm still getting errors when I reproduce it so I wanted to make sure the code is complete!
Error Content:
AttributeError: Can't pickle local object 'ResidualBlock.init. . '

[AkaliKong]

Thank you for following our work. Please provide your complete error report, and I'll see if I can help resolve the issue.

[zzzqqqyyy]

Thanks for your reply, as I was firstly getting bitsandbytesbit errors after installing the environment of requirement.txt file.
CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!
If you cannot find any issues and suspect a bug, please open an issue with detals about your environment:
https://github.com/TimDettmers/bitsandbytes/issues
So I installed bitsandbytesbit to the latest version and when I rerun the script, the following error was reported

ps: my python version is 3.9.20, cuda version is 12.4

[AkaliKong]

Thank you again for your attention. Installing the version of PyTorch with CUDA 11.8 along with its corresponding toolkit may help resolve your issue.

[betoobusy]

The following model_kwargs are not used by the model: ['user_embeds', 'gate_weights'] (note: typos in the generate arguments will also show up in this list)
File "/root/iLoRA_init/model/peft/tuners/moelora.py", line 217, in generate
return self.self_model_generate(**kwargs)
File "/root/iLoRA_init/model/peft/peft_model.py", line 921, in generate
outputs = self.base_model.generate(**kwargs)
File "/root/iLoRA_init/model/model_interface.py", line 74, in generate
generate_ids = self.llama_model.generate(
File "/root/iLoRA_init/model/model_interface.py", line 160, in validation_step
generate_output = self.generate(batch)
File "/root/iLoRA_init/main.py", line 68, in main
trainer.fit(model=model, datamodule=data_module)
File "/root/iLoRA_init/main.py", line 149, in
main(args)
ValueError: The following model_kwargs are not used by the model: ['user_embeds', 'gate_weights'] (note: typos in the generate arguments will also show up in this list)

[AnNnnH3]

Thanks for your reply, as I was firstly getting bitsandbytesbit errors after installing the environment of requirement.txt file. CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment! If you cannot find any issues and suspect a bug, please open an issue with detals about your environment: https://github.com/TimDettmers/bitsandbytes/issues So I installed bitsandbytesbit to the latest version and when I rerun the script, the following error was reported ps: my python version is 3.9.20, cuda version is 12.4

Hello, I had the same problem, have you solved it now? If so can you tell me the method you used? I look forward to your reply.

[NowshinTasnim]

The following model_kwargs are not used by the model: ['user_embeds', 'gate_weights'] (note: typos in the generate arguments will also show up in this list) File "/root/iLoRA_init/model/peft/tuners/moelora.py", line 217, in generate return self.self_model_generate(**kwargs) File "/root/iLoRA_init/model/peft/peft_model.py", line 921, in generate outputs = self.base_model.generate(**kwargs) File "/root/iLoRA_init/model/model_interface.py", line 74, in generate generate_ids = self.llama_model.generate( File "/root/iLoRA_init/model/model_interface.py", line 160, in validation_step generate_output = self.generate(batch) File "/root/iLoRA_init/main.py", line 68, in main trainer.fit(model=model, datamodule=data_module) File "/root/iLoRA_init/main.py", line 149, in main(args) ValueError: The following model_kwargs are not used by the model: ['user_embeds', 'gate_weights'] (note: typos in the generate arguments will also show up in this list)

Hi, I'm getting the same problem. Have you solved this problem? If I remove these two "model_kwargs", I'm getting an error of tensor mismatch :

File "/network/rit/lab/chelmislab/Nowshin_s_folder/miniconda3/envs/iLoRAEnv/lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py", line 162, in forward
down_proj = self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x))
RuntimeError: The size of tensor a (11008) must match the size of tensor b (4096) at non-singleton dimension 2