x54-729
|
668430d33d
|
修正 paddle 多卡下替换 sampler 的逻辑及测试
|
2 years ago |
x54-729
|
28db704f70
|
初步修正了多卡情况下 evaluate_dataloader 使用定制 batch_sampler 会报错的问题,改为给出 warning
|
2 years ago |
x54-729
|
6a99e2fa8c
|
test_metric 添加torch标签
|
2 years ago |
x54-729
|
9f60246749
|
test_fsdp device 统一为[0,1]
|
2 years ago |
x54-729
|
babf4b2f19
|
修复测试的一些bug
|
2 years ago |
x54-729
|
82fe167ea3
|
限制测试时使用的设备;为fsdp的测试添加版本限制
|
2 years ago |
MorningForest
|
46b94002af
|
增加metric测试用例,修改metric的 setattr方法
|
2 years ago |
x54-729
|
749415970e
|
1. fix bugs of DataSet.from_dataset 2. fix bugs of some tests 3. add to OneflowDriver.load_model
|
2 years ago |
x54-729
|
09a558c2c9
|
small change for tests
|
2 years ago |
x54-729
|
5a41cca483
|
seq_len_to_mask 添加oneflow部分;完善oneflow的测试标签
|
2 years ago |
MorningForest
|
12a3c45344
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
2 years ago |
MorningForest
|
a3adafea34
|
add dataset method
|
2 years ago |
YWMditto
|
4b6e455247
|
更新了文档
|
2 years ago |
YWMditto
|
b1e23de8f7
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
2 years ago |
YWMditto
|
0506fc2fcb
|
添加了 TorchFSDPDriver;修改了 ddp 中的部分细节;删除了 topksaveer 的 rank_zero_only 修饰器
|
2 years ago |
x54-729
|
79b42a91ce
|
调整 fastNLP/core/drivers 的文档
|
2 years ago |
x54-729
|
f5005e1e8b
|
fix conflict
|
3 years ago |
x54-729
|
eb218f3def
|
调整 driver 的部分文档
|
3 years ago |
x54-729
|
4cdfdc77c7
|
oneflow 动态图 单卡和ddp部分及测试
|
3 years ago |
x54-729
|
ad6ada2487
|
small
|
3 years ago |
x54-729
|
a495bb938a
|
1.修复模型会被移动到rank对应设备的问题 2.更改 deepspeed driver æ命名 3.为 deepspeed 添加 logging_level
|
3 years ago |
x54-729
|
2735d2d10c
|
DeepSpeedDriver现在可以通过 deepspeed 命令拉起;添加了相关 trainer 的简单测试
|
3 years ago |
x54-729
|
7023ea550c
|
deepspeed的save load功能
|
3 years ago |
x54-729
|
22d95be007
|
Merge branch 'dev0.8.0' into deepspeed
|
3 years ago |
x54-729
|
b60621f3d1
|
small
|
3 years ago |
x54-729
|
cbee1c6cbc
|
deepspeed test init
|
3 years ago |
x54-729
|
a39d3011e8
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
YWMditto
|
bb68856f85
|
添加对 overfit 多卡的测试
|
3 years ago |
YWMditto
|
024fecfbf3
|
添加了 overfit 的功能
|
3 years ago |
x54-729
|
cd0957fb5b
|
跟进paddle jittor 关于 set_dist_repro_dataloader函数中的修改
|
3 years ago |
yhcc
|
dd1c5ca035
|
修复设置了global seed的bug
|
3 years ago |
yhcc
|
7283bf27b2
|
在私有定制Sampler的情况下,多卡不替换
|
3 years ago |
x54-729
|
c99315f79e
|
修复新增的set_dist_repro_dataloader函数测试例在paddle情况下的问题
|
3 years ago |
yhcc
|
47b7c4e832
|
增加set_dist_repro_dataloader测试
|
3 years ago |
x54-729
|
4cc8a29926
|
1.为element测试添加torch标签 2.解决torch版本导致的int张量无法对整数使用除法的问题
|
3 years ago |
yhcc
|
24092e3114
|
增加pipe相关的测试
|
3 years ago |
MorningForest
|
ec17562f20
|
修改fdl 的prepare_*_dataloader,使其支持fastnlp的dataset
|
3 years ago |
MorningForest
|
af6300e816
|
修改element,计算值转为非tensor形式
|
3 years ago |
yhcc
|
057806de7d
|
将total_batches改名为n_batches,以和n_epochs对应;增加n_batches作为Trainer的初始化参数
|
3 years ago |
yhcc
|
64c7ce5468
|
1.修复rich在jupyter的时候不打印的问题;2.修复若干其他bug
|
3 years ago |
x54-729
|
809b83b6c0
|
small
|
3 years ago |
x54-729
|
9b0a30c8fb
|
small bug
|
3 years ago |
yh
|
1d665c9480
|
unrepeatedSampler支持chunk_split
|
3 years ago |
x54-729
|
f7b3fe6a06
|
small
|
3 years ago |
x54-729
|
75a3278d69
|
1. 完成JittorSingleDriver的功能,并添加测试用例 2.在Sampler中添加属性num_samplers 用于动态获取dataset的长度 3.添加便于测试断点重训的数据集 4.修改jittor其它测试的一些bug,统一ArgMaxDataset 的命名
|
3 years ago |
x54-729
|
a6cfc4086f
|
修改seq_len_to_mask的jittor实现及测试例中的一处传参错误
|
3 years ago |
x54-729
|
999520e4b0
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
x54-729
|
28eb1a5836
|
添加了对tensor_to_numeric reduce 参数的测试
|
3 years ago |
yh
|
7a7d75d100
|
Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0
|
3 years ago |
yh
|
dcdd484eb2
|
增加seq_len_to_mask
|
3 years ago |