Skip to content

Fix the parameter name error.#61

Open
frankjiang wants to merge 1 commit intoSkyworkAI:mainfrom
frankjiang:feature/fix-param-error
Open

Fix the parameter name error.#61
frankjiang wants to merge 1 commit intoSkyworkAI:mainfrom
frankjiang:feature/fix-param-error

Conversation

@frankjiang
Copy link
Copy Markdown

Change fa_version -> version in wan/distributed/ulysses.py:distributed_attention

which is defined in the wan/modules/attention.py:attention

def attention(
    q,
    k,
    v,
    q_lens=None,
    k_lens=None,
    dropout_p=0.,
    softmax_scale=None,
    q_scale=None,
    causal=False,
    window_size=(-1, -1),
    deterministic=False,
    dtype=torch.bfloat16,
    version=None,  # Not `fa_version`
):

fa_version -> version
which is defined in the wan/modules/attention.py:attention
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant