Skip to content

Commit 14663c8

Browse files
committed
fix model conversion with 'blocks.0.att.v[0,1,2]' tensors
Signed-off-by: Molly Sophia <mollysophia379@gmail.com>
1 parent 4358e70 commit 14663c8

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

python/convert_pytorch_to_ggml.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,8 @@ def write_state_dict(state_dict: Dict[str, torch.Tensor], dest_path: str, data_t
5959
[state_dict_new[f'blocks.{l}.att.x_rwkvag'], state_dict[k]], dim=0)
6060
except KeyError:
6161
state_dict_new[f'blocks.{l}.att.x_rwkvag'] = state_dict[k]
62+
elif any(['blocks.0.att.v0' in k, 'blocks.0.att.v1' in k, 'blocks.0.att.v2' in k]):
63+
continue
6264
else:
6365
state_dict_new[k] = state_dict[k]
6466

0 commit comments

Comments
 (0)