You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py", line 332, in forward
hidden_states, self_attn_weights = self.self_attn(
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1749, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1760, in _call_impl
return forward_call(*args, **kwargs)
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1739, in _slow_forward
result = self.forward(*input, **kwargs)
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py", line 266, in forward
query_states = self.q_proj(hidden_states).view(hidden_shape).transpose(1, 2)
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1749, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1760, in _call_impl
return forward_call(*args, **kwargs)
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1739, in _slow_forward
result = self.forward(*input, **kwargs)
File "/home/vivekag/scratch/AIGShark/nodai/SharkTestSuite_nightly/nightly.env/lib/python3.10/site-packages/transformers/integrations/bitnet.py", line 184, in forward
w_quant = unpack_weights(w, dtype=self.dtype)
TypeError: DisableCompileContextManager.__enter__.<locals>.<lambda>.<locals>.<lambda>() got an unexpected keyword argument 'dtype'
The text was updated successfully, but these errors were encountered:
Steps to reproduce:
Tests failing:
Should get following Error/Stacktrace:
The text was updated successfully, but these errors were encountered: