Skip to content

Commit 2685bc7

Browse files
RyanMullinsRyanMullins
committed
revert: modeling changes
1 parent 7d863e5 commit 2685bc7

2 files changed

Lines changed: 2 additions & 2 deletions

File tree

‎src/transformers/models/gemma4/modeling_gemma4.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1367,9 +1367,9 @@ def forward(
13671367
hidden_states = self.input_layernorm(hidden_states)
13681368
hidden_states, _ = self.self_attn(
13691369
hidden_states=hidden_states,
1370-
shared_kv_states=shared_kv_states,
13711370
position_embeddings=position_embeddings,
13721371
attention_mask=attention_mask,
1372+
shared_kv_states=shared_kv_states,
13731373
position_ids=position_ids,
13741374
past_key_values=past_key_values,
13751375
**kwargs,

‎src/transformers/models/gemma4/modular_gemma4.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1101,9 +1101,9 @@ def forward(
11011101
hidden_states = self.input_layernorm(hidden_states)
11021102
hidden_states, _ = self.self_attn(
11031103
hidden_states=hidden_states,
1104-
shared_kv_states=shared_kv_states,
11051104
position_embeddings=position_embeddings,
11061105
attention_mask=attention_mask,
1106+
shared_kv_states=shared_kv_states,
11071107
position_ids=position_ids,
11081108
past_key_values=past_key_values,
11091109
**kwargs,

0 commit comments

Comments
 (0)