Megvii Engine Team
273c0e8745
fix(autodiff): fix some bugs in relation to 2nd order grad
1. implement double backward for batchnorm
2. fix grad attach in nested grad manager
3. pad empty tensor for unsatisfied output_has_grad
4. support double backward for jit subgraph
5. support double backward for autodiff.Function
6. readd debug flag MGE_LOG_OP_DISPATCH
GitOrigin-RevId: cd31ddc620
3 years ago
Megvii Engine Team
87f00232f2
fix(mge/gm): fix missing dtype checking while attach tensors
GitOrigin-RevId: f0aaea99b9
3 years ago
Megvii Engine Team
0bdd0b1467
refactor(dispatch): switch to new dispatch system
GitOrigin-RevId: 32dd49a23a
3 years ago
Megvii Engine Team
ab309eb5fc
feat(mgb/opr): let Split support empty IO
GitOrigin-RevId: aad6dc06bf
3 years ago
Megvii Engine Team
207a346351
chore(mge): run get_device_count("gpu") in subprocess
GitOrigin-RevId: 0f0dc001cf
4 years ago
Megvii Engine Team
5cef74a77e
feat(mge/amp): add GradScaler support
GitOrigin-RevId: 0ab4910360
4 years ago
Megvii Engine Team
0245594156
test(autograd): test jvp emulated by 2nd grad
GitOrigin-RevId: 47114fcd99
4 years ago
Megvii Engine Team
8480302da8
fix(autograd): make higher order grad experimental
GitOrigin-RevId: 81e1eb0ebf
4 years ago
Megvii Engine Team
72531f2b4a
test(autograd): add more tests for higher order grad
GitOrigin-RevId: 5fc308f87a
4 years ago
Megvii Engine Team
226f24fa8e
test(mge/distributed): add gather scatter reduce broadcast grad test
GitOrigin-RevId: 8245e11f1d
4 years ago
Megvii Engine Team
ff05667b48
test(dist): refactor distributed test with fixtures
GitOrigin-RevId: e69acb72da
4 years ago
Megvii Engine Team
364afec033
chore(mge): update copyright years
GitOrigin-RevId: 3c0690bcc1
4 years ago
Megvii Engine Team
de0742be25
refactor(mge): reopen passed assertions
GitOrigin-RevId: e0276e73e3
4 years ago
Megvii Engine Team
4d75f691a0
feat(mge): restore remote send/recv
GitOrigin-RevId: 8b78fd5591
4 years ago
Megvii Engine Team
645fc6f0c8
test(mge/autodiff): add test for weird error
GitOrigin-RevId: e95109b845
4 years ago
Megvii Engine Team
b5ec83c53f
test(mge/autodiff): validate grad is set to None when no dependency
GitOrigin-RevId: 01ad51a222
4 years ago
Megvii Engine Team
9d928e7f83
refactor(mge/distributed): sync interpreter for distribtued launcher
GitOrigin-RevId: 8a88c272a1
4 years ago
Megvii Engine Team
2ad8c5e1e9
fix(mge/io_remote): fix remote send/recv gradient at trace
GitOrigin-RevId: 7886efd0c1
4 years ago
Megvii Engine Team
6667100638
feat(mge): use weakref for GradManger.attach
GitOrigin-RevId: 6df336c3c1
4 years ago
Megvii Engine Team
544b798374
revert: feat(mge/grad_manager): add `clear_grad` method for GradManager
This reverts commit aa9540e090
.
GitOrigin-RevId: 2d15e503de
4 years ago
Megvii Engine Team
495472954d
fix(trace): link io-op to avoid deadlock
GitOrigin-RevId: 872cb6b715
4 years ago
Megvii Engine Team
094601e834
feat(mge/distributed): allow remote grad by using grad manager
GitOrigin-RevId: a890c206a5
4 years ago
Megvii Engine Team
b327822994
feat(mge/grad_manager): add `clear_grad` method for GradManager
GitOrigin-RevId: aa9540e090
4 years ago
Megvii Engine Team
2627e1f7df
fix(mge/grad_manager): allow multiple calls of `release`
GitOrigin-RevId: 38ca4c78ff
4 years ago
Megvii Engine Team
3af1056377
feat(mge/grad): attach grad immediately
GitOrigin-RevId: e3a168c03a
4 years ago