310 Commits (master)

Author SHA1 Message Date
  x54-729 668430d33d 修正 paddle 多卡下替换 sampler 的逻辑及测试 2 years ago
  x54-729 28db704f70 初步修正了多卡情况下 evaluate_dataloader 使用定制 batch_sampler 会报错的问题,改为给出 warning 2 years ago
  x54-729 6a99e2fa8c test_metric 添加torch标签 2 years ago
  x54-729 9f60246749 test_fsdp device 统一为[0,1] 2 years ago
  x54-729 babf4b2f19 修复测试的一些bug 2 years ago
  x54-729 82fe167ea3 限制测试时使用的设备;为fsdp的测试添加版本限制 2 years ago
  MorningForest 46b94002af 增加metric测试用例,修改metric的 setattr方法 2 years ago
  x54-729 749415970e 1. fix bugs of DataSet.from_dataset 2. fix bugs of some tests 3. add to OneflowDriver.load_model 2 years ago
  x54-729 09a558c2c9 small change for tests 2 years ago
  x54-729 5a41cca483 seq_len_to_mask 添加oneflow部分;完善oneflow的测试标签 2 years ago
  MorningForest 12a3c45344 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2 years ago
  MorningForest a3adafea34 add dataset method 2 years ago
  YWMditto 4b6e455247 更新了文档 2 years ago
  YWMditto b1e23de8f7 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2 years ago
  YWMditto 0506fc2fcb 添加了 TorchFSDPDriver;修改了 ddp 中的部分细节;删除了 topksaveer 的 rank_zero_only 修饰器 2 years ago
  x54-729 79b42a91ce 调整 fastNLP/core/drivers 的文档 2 years ago
  x54-729 f5005e1e8b fix conflict 3 years ago
  x54-729 eb218f3def 调整 driver 的部分文档 3 years ago
  x54-729 4cdfdc77c7 oneflow 动态图 单卡和ddp部分及测试 3 years ago
  x54-729 ad6ada2487 small 3 years ago
  x54-729 a495bb938a 1.修复模型会被移动到rank对应设备的问题 2.更改 deepspeed driver æ˜命名 3.为 deepspeed 添加 logging_level 3 years ago
  x54-729 2735d2d10c DeepSpeedDriver现在可以通过 deepspeed 命令拉起;添加了相关 trainer 的简单测试 3 years ago
  x54-729 7023ea550c deepspeed的save load功能 3 years ago
  x54-729 22d95be007 Merge branch 'dev0.8.0' into deepspeed 3 years ago
  x54-729 b60621f3d1 small 3 years ago
  x54-729 cbee1c6cbc deepspeed test init 3 years ago
  x54-729 a39d3011e8 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 3 years ago
  YWMditto bb68856f85 添加对 overfit 多卡的测试 3 years ago
  YWMditto 024fecfbf3 添加了 overfit 的功能 3 years ago
  x54-729 cd0957fb5b 跟进paddle jittor 关于 set_dist_repro_dataloader函数中的修改 3 years ago
  yhcc dd1c5ca035 修复设置了global seed的bug 3 years ago
  yhcc 7283bf27b2 在私有定制Sampler的情况下,多卡不替换 3 years ago
  x54-729 c99315f79e 修复新增的set_dist_repro_dataloader函数测试例在paddle情况下的问题 3 years ago
  yhcc 47b7c4e832 增加set_dist_repro_dataloader测试 3 years ago
  x54-729 4cc8a29926 1.为element测试添加torch标签 2.解决torch版本导致的int张量无法对整数使用除法的问题 3 years ago
  yhcc 24092e3114 增加pipe相关的测试 3 years ago
  MorningForest ec17562f20 修改fdl 的prepare_*_dataloader,使其支持fastnlp的dataset 3 years ago
  MorningForest af6300e816 修改element,计算值转为非tensor形式 3 years ago
  yhcc 057806de7d 将total_batches改名为n_batches,以和n_epochs对应;增加n_batches作为Trainer的初始化参数 3 years ago
  yhcc 64c7ce5468 1.修复rich在jupyter的时候不打印的问题;2.修复若干其他bug 3 years ago
  x54-729 809b83b6c0 small 3 years ago
  x54-729 9b0a30c8fb small bug 3 years ago
  yh 1d665c9480 unrepeatedSampler支持chunk_split 3 years ago
  x54-729 f7b3fe6a06 small 3 years ago
  x54-729 75a3278d69 1. 完成JittorSingleDriver的功能,并添加测试用例 2.在Sampler中添加属性num_samplers 用于动态获取dataset的长度 3.添加便于测试断点重训的数据集 4.修改jittor其它测试的一些bug,统一ArgMaxDataset 的命名 3 years ago
  x54-729 a6cfc4086f 修改seq_len_to_mask的jittor实现及测试例中的一处传参错误 3 years ago
  x54-729 999520e4b0 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 3 years ago
  x54-729 28eb1a5836 添加了对tensor_to_numeric reduce 参数的测试 3 years ago
  yh 7a7d75d100 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 3 years ago
  yh dcdd484eb2 增加seq_len_to_mask 3 years ago