Megvii Engine Team
111c150db1
docs(mge/functional): fix typo
GitOrigin-RevId: 9473f17970
3 years ago
Megvii Engine Team
273c0e8745
fix(autodiff): fix some bugs in relation to 2nd order grad
1. implement double backward for batchnorm
2. fix grad attach in nested grad manager
3. pad empty tensor for unsatisfied output_has_grad
4. support double backward for jit subgraph
5. support double backward for autodiff.Function
6. readd debug flag MGE_LOG_OP_DISPATCH
GitOrigin-RevId: cd31ddc620
3 years ago
Megvii Engine Team
a4327c4d25
perf(imperative): add dim_expansion transform for conv/bn1d
GitOrigin-RevId: d14a69424d
3 years ago
Megvii Engine Team
fa62f6c06e
perf(mge/utils): move convert_input into C++
GitOrigin-RevId: 0d1cd36251
3 years ago
Megvii Engine Team
d98be08030
perf(mge): move Const into C++
GitOrigin-RevId: 31a443cffd
3 years ago
Megvii Engine Team
729242f9f8
refactor(imperative): move typecvt code of sereval ops to c++
GitOrigin-RevId: 4ffaa376c1
3 years ago
Megvii Engine Team
3c3fc6f33c
refactor(imperative): move python code of elemwise/reduce/conv2d/bn to c++
GitOrigin-RevId: 01b5324392
3 years ago
Megvii Engine Team
90c8a58cca
docs(docstring): add pad docstring
GitOrigin-RevId: eaf6a87456
3 years ago
Megvii Engine Team
7bd848ce04
fix(subgraph): fix hand-written backward for serval jit-elemwise ops
GitOrigin-RevId: ea3a40d96e
3 years ago
Megvii Engine Team
21f5a7fcc0
fix(subgraph): fix device recognition and scalar propagate
GitOrigin-RevId: fd2fe8bec9
3 years ago
Megvii Engine Team
df3474ca1d
perf(functional): rewrite serval elemwise ops with jit subgraph
GitOrigin-RevId: 26247e21d9
3 years ago
Megvii Engine Team
406115dba0
fix(imperative): syncbn fp16 support
GitOrigin-RevId: 6059d5b76b
3 years ago
Megvii Engine Team
bebb2cf4c3
Merge pull request #428 from P2Oileen:fix-pad
GitOrigin-RevId: f33ea46ad6
3 years ago
Megvii Engine Team
5e17b3e4c6
Merge pull request #426 from Qsingle:fix-pixel_suffle
GitOrigin-RevId: db9a0f7551
3 years ago
Megvii Engine Team
cbbca5fb10
feat(mge): add softmax op use cudnn api
GitOrigin-RevId: 7734ebf8c4
3 years ago
Megvii Engine Team
0bdd0b1467
refactor(dispatch): switch to new dispatch system
GitOrigin-RevId: 32dd49a23a
3 years ago
Megvii Engine Team
fba544881b
fix(traced_module): add functional pad to __all__
GitOrigin-RevId: a4fdedfb7f
3 years ago
Megvii Engine Team
1999307015
feat(mgb/opr): add dropout kernel
GitOrigin-RevId: d248bd2005
3 years ago
Megvii Engine Team
a93741815b
feat(mgb/opr): add layernorm forward and backward kernel
GitOrigin-RevId: 0cd484e753
3 years ago
P2Oileen
5d755898fd
fix(funtional): correct the typo: witdth to width
3 years ago
Qsingle
14499e83d9
fix the type error of pixel shuffle
add the test of dtype float
3 years ago
Megvii Engine Team
7cb3ad8a3e
fix(mge/functional): fix one_hot irregular coding style
From GITHUB 399
ORIGINAL_AUTHOR=Asthestarsfalll <1186454801@qq.com>
COPYBARA_INTEGRATE_REVIEW=https://github.com/MegEngine/MegEngine/pull/399 from Asthestarsfalll:master 541bf3af29
GITHUB_PUBLIC_PR_NUMBER=399
GITHUB_PR_URL=https://github.com/MegEngine/MegEngine/pull/399
GitOrigin-RevId: 5df007207a
3 years ago
Megvii Engine Team
7ac693a882
docs(imperative): fix multiple target warning when cross-reference
GitOrigin-RevId: c5b4884c8a
3 years ago
Megvii Engine Team
ea3eb66e7f
docs(mge): modify some docstring about conv and tools
GitOrigin-RevId: 4833e78d71
3 years ago
Megvii Engine Team
5c94db16f2
feat(mge/functional): add groups support for conv_transpose2d & 3d
GitOrigin-RevId: b75b792fb4
3 years ago
Megvii Engine Team
8a222d2c9c
fix(mge): replace functional paramter
GitOrigin-RevId: af3c68c588
3 years ago
Megvii Engine Team
29f9935d92
fix(imperative/python): add layer_norm doc and rm useless param
GitOrigin-RevId: 1b15db621e
3 years ago
Megvii Engine Team
2108696588
feat(mge/imperative): add local response normalization
GitOrigin-RevId: 939a4d26dd
3 years ago
Megvii Engine Team
ca4c93dee7
fix(mge): fix layer norm amp bug
GitOrigin-RevId: dba691fcbf
3 years ago
Megvii Engine Team
c0ccd0ea7e
feat(mge/bn): add NHWC support for bn
GitOrigin-RevId: 0a5bb6f72d
3 years ago
chenjiahui
6b863cc53a
feat(imperative): add pixel_shuffle opr
Closes #211
GitOrigin-RevId: 1846714791
3 years ago
Megvii Engine Team
97b1b7774d
feat(mgb): add megbrain layer norm opr with subgraph
GitOrigin-RevId: 9b7fa821f8
3 years ago
Megvii Engine Team
4688bbabad
refactor(functional): hide functional.vision and replace with functional.nn
GitOrigin-RevId: b6888c7f65
3 years ago
Megvii Engine Team
8796586b89
refactor(functional): import all from metric in nn
GitOrigin-RevId: 41ab78d78d
3 years ago
Megvii Engine Team
bd817f3af2
perf(syncbn): fallback to bn when sync is not required
GitOrigin-RevId: e89fdd87b0
3 years ago
Megvii Engine Team
ffcb4dacd9
style(mge): change the pad opr doc and format
GitOrigin-RevId: 7b20e96519
3 years ago
Megvii Engine Team
43cb305e53
feat(mge): add imperative pad
GitOrigin-RevId: de79de536f
3 years ago
Megvii Engine Team
c5f8b58385
docs(docstring): transfer to google style
GitOrigin-RevId: a71245c553
3 years ago
Megvii Engine Team
76ce81e828
fix(mge): fix F.nn.dropout train and inference bugs
GitOrigin-RevId: 9d9f246d7b
3 years ago
Megvii Engine Team
d063d5774f
perf(functional): use fma to reduce elemwise but disable subgraph compilation
GitOrigin-RevId: c75a6e1a09
3 years ago
Megvii Engine Team
2a063f8e87
fix(subgraph): fix scope mismatch of subgraph content
GitOrigin-RevId: 6e23456250
3 years ago
Megvii Engine Team
8c47c1f149
perf(syncbn): reimplement with subgraph
GitOrigin-RevId: 13e7e3d3c0
3 years ago
Megvii Engine Team
77309609fa
perf(functional/dropout): add fastpath for dropout
GitOrigin-RevId: 3bf8546908
3 years ago
Megvii Engine Team
3f3a256e0f
fix(mge/functional): fix conv* dtype promotion
GitOrigin-RevId: 3f03790cfc
3 years ago
Megvii Engine Team
f76a2cc2c6
feat(mge/opr): add silu and gelu
GitOrigin-RevId: 75aa42947e
3 years ago
Megvii Engine Team
070c811732
fix(imperative): remove convert_inputs
GitOrigin-RevId: a3c43db746
3 years ago
Megvii Engine Team
5cef74a77e
feat(mge/amp): add GradScaler support
GitOrigin-RevId: 0ab4910360
4 years ago
Megvii Engine Team
1bf18252c4
feat(mge/amp): add mix precision autocast support
GitOrigin-RevId: 6fbffc4845
4 years ago
Megvii Engine Team
75eb04c559
feat(mge/experimental): add WeightScaler support
GitOrigin-RevId: a1d5b68498
4 years ago
Megvii Engine Team
43098fb8f1
feat(mge): add SlidingWindowTranspose opr
BREAKING CHANGE:
GitOrigin-RevId: 54d726d2fe
4 years ago