Skip to content

Pull requests: pytorch/torchtitan

New pull request New
23 Open 276 Closed
23 Open 276 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

pipelining BC changes CLA Signed This label is managed by the Meta Open Source bot.
#385 opened Jun 7, 2024 by H-Huang • Draft
[POC] Showed more memory efficient FSDP wrapping CLA Signed This label is managed by the Meta Open Source bot.
#382 opened Jun 3, 2024 by awgu • Draft
Add PP tracer + DP test CLA Signed This label is managed by the Meta Open Source bot.
#379 opened Jun 1, 2024 by kwen2501 Loading…
4
IBM experimental dataloaders CLA Signed This label is managed by the Meta Open Source bot.
#376 opened May 31, 2024 by daviswer Loading…
28
expose optimizer params, log optimizer type and settings for the run CLA Signed This label is managed by the Meta Open Source bot.
#365 opened May 26, 2024 by lessw2020 Loading…
6
enable TritonFusedRMSNorm with local_map annotation CLA Signed This label is managed by the Meta Open Source bot.
#364 opened May 25, 2024 by XilunWu Loading…
12
Fix 1D PP tracer test CLA Signed This label is managed by the Meta Open Source bot.
#362 opened May 24, 2024 by wconstab Loading…
4
Remove PP+TP rmsnorm workaround CLA Signed This label is managed by the Meta Open Source bot.
#361 opened May 24, 2024 by wconstab Loading…
add todos mocking changes for looped PP support CLA Signed This label is managed by the Meta Open Source bot.
#358 opened May 23, 2024 by wconstab Loading…
9
use local_map to annotate fusedrmsnorm CLA Signed This label is managed by the Meta Open Source bot.
#346 opened May 18, 2024 by wanchaol • Draft
Add a 3-stage PP config CLA Signed This label is managed by the Meta Open Source bot.
#345 opened May 18, 2024 by wconstab Loading…
selective compilation - norm layers only CLA Signed This label is managed by the Meta Open Source bot.
#320 opened May 10, 2024 by lessw2020 Loading…
18
Add support of DDP and CompiledAutograd. CLA Signed This label is managed by the Meta Open Source bot.
#319 opened May 9, 2024 by fegin Loading…
6
[fused_rmsnorm] Register as a custom operator for tracing CLA Signed This label is managed by the Meta Open Source bot.
#303 opened May 3, 2024 by wconstab Loading…
13
[fused_rmsnorm] Avoid querying device inside forward CLA Signed This label is managed by the Meta Open Source bot.
#301 opened May 3, 2024 by wconstab Loading…
[fused_rmsnorm] Avoid conditional on dynamic stride CLA Signed This label is managed by the Meta Open Source bot.
#300 opened May 3, 2024 by wconstab Loading…
3
register fused rmsnorm as pytorch custom op CLA Signed This label is managed by the Meta Open Source bot.
#296 opened May 2, 2024 by tianyu-l • Draft
[wip] differentiate Rstd vs rstd CLA Signed This label is managed by the Meta Open Source bot.
#294 opened May 2, 2024 by lessw2020 Loading…
RFC for ckpt apis CLA Signed This label is managed by the Meta Open Source bot.
#226 opened Apr 13, 2024 by wconstab Loading…
9
[RFC] Sharded embeddings in separate FSDP group CLA Signed This label is managed by the Meta Open Source bot.
#182 opened Apr 1, 2024 by awgu • Draft
run sdpa with dtensor CLA Signed This label is managed by the Meta Open Source bot.
#180 opened Mar 30, 2024 by tianyu-l Loading…
5
[Draft] PP tracing works CLA Signed This label is managed by the Meta Open Source bot.
#155 opened Mar 20, 2024 by kwen2501 • Draft
Implement fast checkpoint path CLA Signed This label is managed by the Meta Open Source bot.
#127 opened Mar 12, 2024 by fegin Loading…
2
ProTip! Mix and match filters to narrow down what you’re looking for.