Skip to content

Commit fb03eb2

Browse files
haoyuzfacebook-github-bot
authored andcommitted
Fix distributor class name typo in docstring (#190)
Summary: Pull Request resolved: #190 As titled. Reviewed By: hjmshi Differential Revision: D76954000 fbshipit-source-id: 3524c032925f381d44d417907941868c148e0e09
1 parent c608548 commit fb03eb2

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

distributed_shampoo/utils/shampoo_distributor.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -140,9 +140,9 @@ def _get_params_or_grads(
140140
def _get_params_or_grads(self, get_grad: bool = False) -> Iterable[Tensor | None]:
141141
"""Helper function that gets params or grads from the parameter group.
142142
143-
NOTE: The purpose of this function is for FullyShardShampooDistributor (supporting
144-
Shampoo on per-parameter FSDP, a.k.a. FSDP2 or FullyShard) to override, in order to
145-
get the local params/grads from DTensors.
143+
NOTE: The purpose of this function is for FullyShardDistributor (supporting Shampoo on
144+
per-parameter FSDP, a.k.a. FSDP2 or FullyShard) to override, in order to get the local
145+
params/grads from DTensors.
146146
147147
By default, we just return the original params/grads.
148148

0 commit comments

Comments
 (0)