Megvii Engine Team
2faa6ea5a9
Merge pull request #213 from kxz18:rnn
GitOrigin-RevId: 9e9215c115
3 years ago
Megvii Engine Team
1999307015
feat(mgb/opr): add dropout kernel
GitOrigin-RevId: d248bd2005
3 years ago
Megvii Engine Team
32717b0ca4
fix(build): split some cpp, which consume two many mem when build
make build possible at 8G ddr env, when -j8
GitOrigin-RevId: d0c442b41d
3 years ago
Megvii Engine Team
a93741815b
feat(mgb/opr): add layernorm forward and backward kernel
GitOrigin-RevId: 0cd484e753
3 years ago
Megvii Engine Team
f6d9909460
feat(dnn): add elemwise multi type support i16xf32 and u8xf32
GitOrigin-RevId: 2fe469bb4e
3 years ago
kxz@thumt102-1
8f48da7ffe
feat(mgb/opr): add cell level rnn/lstm and sequence level rnn/lstm
3 years ago
Megvii Engine Team
2881934cb8
feat(dnn/check_non_finite): addmul scale to check_non_finite opr
GitOrigin-RevId: c35a219e52
3 years ago
Megvii Engine Team
6bb5409976
feat(dnn/src): add images2neibs kernel of opencl and related test
GitOrigin-RevId: 82242b7437
3 years ago
Megvii Engine Team
2696e4efaa
feat(dnn): add float16 for remap backward
GitOrigin-RevId: 0263030051
3 years ago
Megvii Engine Team
1f0cc891b0
feat(dnn): enable eye to support bool
GitOrigin-RevId: 76d874d5b7
3 years ago
Megvii Engine Team
11d75fecb5
feat(dnn/check_non_finite): add batch check_non_finite
GitOrigin-RevId: e108133282
3 years ago
Megvii Engine Team
2318ea3f15
fix(dnn): fix naive average pooling overflow bug for int8 type
GitOrigin-RevId: b60a7b6cf8
3 years ago
Megvii Engine Team
c85631aa77
feat(dnn): use ref ptr interface for all backends
GitOrigin-RevId: f65feae5cc
3 years ago
Megvii Engine Team
89186edc5d
fix(dnn): correct reduce/argmxx/fakequant calculation with nan
GitOrigin-RevId: 7e78bdae91
3 years ago
Megvii Engine Team
68cdabd288
feat(opr): indexing_multi_axis_vec support nd index
GitOrigin-RevId: 07b1248bdc
3 years ago
Megvii Engine Team
5885b137fa
feat(dnn/arm): support layout like NHWC channel like broadcast on arm
GitOrigin-RevId: fb4300004c
3 years ago
Megvii Engine Team
369c2ccc5a
style(all): reformat c++ code
GitOrigin-RevId: 3ffd1b211f
3 years ago
Megvii Engine Team
177dec94c5
feat(mgb/opr): add bgr2gray mode for cvtcolor opr
GitOrigin-RevId: d50415b236
3 years ago
Megvii Engine Team
f5cb21ed3a
fix(mgb/opr): add non finite check
GitOrigin-RevId: a9fcd0a350
3 years ago
Megvii Engine Team
b3e54eade1
feat(dnn/bn): use new cudnn BN kernel to support NHWC
GitOrigin-RevId: 9d80f2009d
3 years ago
Megvii Engine Team
3977b7aa0b
feat(mgb/shuffle): add shuffle opr
GitOrigin-RevId: 80490a6f84
3 years ago
Megvii Engine Team
d69b59035d
feat(dnn): add an get_all_algorithms_safe interface
GitOrigin-RevId: e3734e4531
3 years ago
Megvii Engine Team
694aa1bd92
feat(dnn): add heuristic cache
GitOrigin-RevId: 35e942b5e3
3 years ago
Megvii Engine Team
bc9cfc277a
feat(mgb): add arm resize nchwxx and naive nearest interp
GitOrigin-RevId: d5fbd59a30
3 years ago
Megvii Engine Team
67575d582c
feat(mge/opr): add interpolate bilinear mode
GitOrigin-RevId: f7023a3fd3
3 years ago
Megvii Engine Team
0558b2123d
feat(mge/opr): add interpolate nearest mode
GitOrigin-RevId: d384b87f50
3 years ago
Megvii Engine Team
eab6afab47
feat(mgb): add padding opr for megbrain
GitOrigin-RevId: 490e0c5d5a
4 years ago
Megvii Engine Team
1af350c6d2
feat(dnn): add fill kernel
GitOrigin-RevId: d2cee3a7a0
3 years ago
Megvii Engine Team
c68e669530
feat(bazel/windows/xp/sp2/inference): implement inference on windows xp
(os vesion >= sp2) build with bazel
* bazel build support(define __DEPLOY_ON_XP_SP2__ when deploy on xp sp2):
(dbg)./bazel build //brain/megbrain:load_and_run --cpu='x86_windows_xp'
--compiler='clang_cl' -c dbg --copt "-D__DEPLOY_ON_XP_SP2__=1"
(opt)./bazel build //brain/megbrain:load_and_run --cpu='x86_windows_xp'
--compiler='clang_cl' -c opt --copt "-D__DEPLOY_ON_XP_SP2__=1"
* internal behavior:
will define MGB_HAVE_THREAD=0 when enable __DEPLOY_ON_XP_SP2__
* refer to
https://docs.microsoft.com/en-us/cpp/build/configuring-programs-for-windows-xp?view=msvc-160
xp sp2(x86) do not support vc runtime fully, casused by KERNEL32.dll do not
implement some base apis for c++ std function, for example,
std::mutex/std::thread/std::condition_variable as a workround, we will
disable some MegEngine features on xp sp2 env, for exampe, multi-thread etc!
* about DNN_MUTEX/MGB_MUTEX, if your code will build in inference
code (even CPU backends), please replace std::mutex to DNN_MUTEX/MGB_MUTEX,
* about multi-thread, if you code need multi-thread support, please
enable it when MGB_HAVE_THREAD=1
* about test build env status
1: Visual Studio 2019(MSVC version <= 14.26.28801)---- pass
2: Visual Studio 2019(MSVC version > 14.26.28801) ---- failed
caused by this 'new' version will put VCR depends on win7
KERNEL32.DLL, this may be fixed at Visual Studio 2019 later version
but we do not test at this MR merge point
3: Visual Studio 2017 ---------- pass
4: Visual Studio 2014 ---------- pass
GitOrigin-RevId: 65ac48b95e
3 years ago
Megvii Engine Team
f76a2cc2c6
feat(mge/opr): add silu and gelu
GitOrigin-RevId: 75aa42947e
3 years ago
Megvii Engine Team
66f70578c2
feat(dnn/cuda): add convolution with i8 input and i4 output
GitOrigin-RevId: 10512645d5
4 years ago
Megvii Engine Team
43098fb8f1
feat(mge): add SlidingWindowTranspose opr
BREAKING CHANGE:
GitOrigin-RevId: 54d726d2fe
4 years ago
Megvii Engine Team
b078dda90b
feat(mge/random): add some random op and remove random/distrbution.py
GitOrigin-RevId: 4c05ebc266
4 years ago
Megvii Engine Team
f30c0e06a6
feat(mgb/opr): add lsq opr
GitOrigin-RevId: 45494a2b57
4 years ago
Megvii Engine Team
1cfdbc565c
feat(dnn): add deterministic max pooling
GitOrigin-RevId: 9ab4c7a748
4 years ago
Megvii Engine Team
a5060a2bfe
feat(mgb/opr): add check_has_inf kernel and opr
GitOrigin-RevId: 0d042dbfce
4 years ago
Megvii Engine Team
d915c5a3fd
refactor(mgb): make convolution3D handle noncontiguous tensors
GitOrigin-RevId: 3d3c31b021
4 years ago
Megvii Engine Team
44376f702a
refactor(mgb): make conv-backward-data handle noncontiguous tensors
GitOrigin-RevId: 0a8f66f9d3
4 years ago
Megvii Engine Team
7b2a76d1ee
refactor(mgb): make conv handle noncontiguous tensors
GitOrigin-RevId: 86282709b3
4 years ago
Megvii Engine Team
47dcdf3e17
fix(mgb/core): fix dtype and resize modifiers for tensor
GitOrigin-RevId: a9d95a4cd8
4 years ago
Megvii Engine Team
606540bef4
feat(dnn/cuda): add nhwc 4bit warp perspective
GitOrigin-RevId: fbec4a4a1f
4 years ago
Megvii Engine Team
19919384fc
feat(dnn/cuda): add cuda uint warp perspective
GitOrigin-RevId: 2aec72010f
4 years ago
Megvii Engine Team
86b69cacd0
fix(dnn): fixes for int4
GitOrigin-RevId: 845e164fd3
4 years ago
Megvii Engine Team
4a802d21ca
feat(dnn/cuda): add conv u4xs4 sass kernel
GitOrigin-RevId: 4defcf5f1f
4 years ago
Megvii Engine Team
4fe68ac9ed
feat(dnn/cuda): support transforming layout between nchw and nchw64 when channel not aligned to 64
GitOrigin-RevId: e9ecbcf2e2
4 years ago
Megvii Engine Team
12a0e61542
feat(dnn/cuda): add cuda elemwise int4
GitOrigin-RevId: 8a9aaec328
4 years ago
Megvii Engine Team
df1af59b5c
feat(dnn): warp perspective support int4
GitOrigin-RevId: 826a43b349
4 years ago
Megvii Engine Team
2398df079c
feat(dnn/cuda): add cuda int4 pooling
GitOrigin-RevId: 14ed4e6f00
4 years ago
Megvii Engine Team
2a2a7f4552
test(mgb/opr): add testcase for conv bias int4
GitOrigin-RevId: e3fff5e30b
4 years ago
Megvii Engine Team
e250afb08f
feat(dnn/cuda): support conv_bias for nchw64 and qint4
GitOrigin-RevId: 1c65ba87d7
4 years ago