Megvii Engine Team
2c5a007a92
fix(mge/optimizer): allow lr to be 0
GitOrigin-RevId: dabd1fcc33
3 years ago
Megvii Engine Team
4e95c13617
feat(sgd): sgd supports nesterov momentum
GitOrigin-RevId: 13eda179da
3 years ago
Megvii Engine Team
c5f8b58385
docs(docstring): transfer to google style
GitOrigin-RevId: a71245c553
3 years ago
Megvii Engine Team
3103180456
fix(mge/optimizer): only disable convert inputs in build-in optimizers
GitOrigin-RevId: 1a48fe318d
3 years ago
Megvii Engine Team
259894250b
feat(imperative/autodiff): add grad clip
GitOrigin-RevId: f344f4a233
4 years ago
Megvii Engine Team
92e2ed6e2e
fix(mge/optimizer): fix optimizer update step inplace add grad
GitOrigin-RevId: d677d1ca6b
4 years ago
Megvii Engine Team
fe99cdc794
feat(interpreter): add dynamic sublinear
GitOrigin-RevId: 7de54fe743
4 years ago
Megvii Engine Team
7e22e9f06e
feat(optimzer): add AdamW
GitOrigin-RevId: e608b5d5b9
4 years ago
Megvii Engine Team
31e4bf2c34
fix(mge/optimizer): fix optimizer's state_dict bug
GitOrigin-RevId: 67fb112fb8
4 years ago
Megvii Engine Team
4917534b65
feat(mge/optimizer): save state's numpy value by default in `state_dict`
GitOrigin-RevId: ec7e4d56f5
4 years ago
Megvii Engine Team
30d6b4f65d
fix(mge): fix scalar parameter change to 1-dim parameter after backward and optimize
GitOrigin-RevId: 1794369a71
4 years ago
Megvii Engine Team
dbb3dd681f
refactor(profiler): integrate profiler into interpreter
GitOrigin-RevId: ccc984acbd
4 years ago
Megvii Engine Team
364afec033
chore(mge): update copyright years
GitOrigin-RevId: 3c0690bcc1
4 years ago
Megvii Engine Team
c49427d15a
feat(imperative): add inplace add_update option in optimizer
GitOrigin-RevId: b8feb49321
4 years ago
Megvii Engine Team
c294b9d18b
refactor(mge/tensor): remove old implementation
remove core.tensor, raw_tensor,TensorWrapper
avoid create tensor with zero-stride numpy ndarray
GitOrigin-RevId: 4fe5c4c5ba
4 years ago
Megvii Engine Team
1fed59293b
perf(mge/optimizer): close conver_inputs for optimizer step
GitOrigin-RevId: c710530d93
4 years ago
Megvii Engine Team
b309890c66
docs(mge): pytest for sphinx docstring
GitOrigin-RevId: 8bed12562a
4 years ago
Megvii Engine Team
b327822994
feat(mge/grad_manager): add `clear_grad` method for GradManager
GitOrigin-RevId: aa9540e090
4 years ago
Megvii Engine Team
026af62042
docs(mge): docs typo fix
GitOrigin-RevId: 851f6de02f
4 years ago
Megvii Engine Team
4ab259f558
refactor(mge): add some deprecation and migration guides
GitOrigin-RevId: 4793adf02b
4 years ago
Megvii Engine Team
10e942d952
refactor(mge): polish api
- refactor(mge): add support for optimizer.step().clear_grad() idiom
- refactor(mge): rename some methods of GradManager
- refactor(mge): remove tensor_nn and TensorDict
- refactor(mge): remove Buffer
- refactor(mge): remove requires_grad flag
- refactor(mge): add a default grad=None attribute to Tensor
- refactor(mge): deprecation for 1.0
GitOrigin-RevId: 3b723d9387
4 years ago
Megvii Engine Team
c7acba41fc
refactor(mge/optimizer): refine gradmanager api, record = __enter__
GitOrigin-RevId: 5376177237
4 years ago
Megvii Engine Team
e283663a02
fix(mge/imperative): update tests to new optimizer api
GitOrigin-RevId: 3d06e3db3c
4 years ago
Megvii Engine Team
b5016b9d29
feat(mge/parampack): add parampack in allreduce callback
GitOrigin-RevId: 73d53eeba1
4 years ago
Megvii Engine Team
5ae89c799b
refactor(mgb/grad): place grad at param.grad
GitOrigin-RevId: fddeace402
4 years ago
Megvii Engine Team
9faa32fcb7
fix(mge/imperative): fix grad callback
GitOrigin-RevId: 6f843b0106
4 years ago
Megvii Engine Team
6d4fd9384d
fix(mge/optimizer): remove distributed optimizer
GitOrigin-RevId: 3e5d0612f0
4 years ago
Megvii Engine Team
e50fa074cb
fix(mge/imperative): remove backward from optimizer
GitOrigin-RevId: ad6ad444fa
4 years ago
Megvii Engine Team
6b380e8965
feat(mge/imperative): run oss test and restore cmake list build items
GitOrigin-RevId: 11411b6964
4 years ago