hummingbird
/
fastNLP
Not watched
2
0
Fork 0
Code
Releases 13 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain

Commit Graph

  • *
  • *
  • | *
  • | |\
  • | * |
  • * | |
  • |\ \ \
  • | | |/
  • | |/|
  • * | |
  • | * |
  • * | |
  • |/ /
  • * |
  • * |
  • * |
  • * |
  • * |
  • |\ \
  • | |/
  • | *
  • | |\
  • | * |
  • * | |
  • |/ /
  • | *
  • | |\
  • | |/
  • |/|
  • | *
  • * |
  • |\ \
  • | |/
  • * |
  • | *
  • | *
  • | |\
  • | * |
  • * | |
  • |\ \ \
  • | | |/
  • | |/|
  • | * |
  • | |\ \
  • | | |/
  • | * |
  • * | |
  • * | |
  • | |/
  • |/|
  • * |
  • |\ \
  • * | |
  • | * |
  • | * |
  • | |\ \
  • | | |/
  • | * |
  • | | *
  • | |/
  • | *
  • | *
  • | *
  • | |\
  • | | *
  • | | |\
  • | |_|/
  • |/| |
  • | | *
  • | * |
  • * | |
  • * | |
  • * | |
  • |\ \ \
  • | |/ /
  • * | |
  • | |/
  • |/|
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • * |
  • * |
  • | *
  • | *
  • | *
  • |/
  • *
  • *
  • |\
  • * |
  • * |
  • | *
  • * |
  • * |
  • |/
  • *
  • *
  • *
  • *
  • *
  • |\
  • * \
  • |\ \
  • * | |
  • | | *
  • | | |\
  • | | |/
  • | |/|
  • | | *
  • | |/
  • |/|
  • | *
  • |/
  • *
  • *
  • *
  • |\
  • * |
  • | *
  • | *
  • | *
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • | *
  • | |\
  • | |/
  • |/|
  • * |
  • | *
  • | |\
  • | |/
  • |/|
  • | *
  • * |
  • |/
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • |\
  • * |
  • | *
  • | |\
  • | * |
  • | | *
  • | |/
  • |/|
  • * |
  • |\ \
  • * | |
  • | * |
  • | * |
  • |/ /
  • * |
  • * |
  • * |
  • |\ \
  • 28eb1a58 添加了对tensor_to_numeric reduce 参数的测试 by x54-729 2022-05-25 17:14:01 +0000
  • efc26757 1.修改Driver.py的小部分文档；2.完善 JittorDriver JittorSingleDriver 的部分基础函数 by x54-729 2022-05-25 17:03:12 +0000
  • 7a7d75d1 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-26 00:05:42 +0800
  • dcdd484e 增加seq_len_to_mask by yh 2022-05-26 00:05:36 +0800
  • abeb22c7 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-25 15:30:35 +0000
  • e734d11d transformers 添加 AutoTokenizer by x54-729 2022-05-25 15:30:14 +0000
  • 005b0e05 实现 jittor driver 多卡训练 (#418) by Letian Li 2022-05-25 12:09:09 +0100
  • 296c1acc 修复mixdataloader在torch1.6下参数不匹配的问题 by x54-729 2022-05-25 08:21:33 +0000
  • 5425095c [bugfix] 修复 tests/core/controllers/_test_trainer_jittor.py，使其可以正常运行 (#415) by Letian Li 2022-05-25 07:07:37 +0100
  • da0b747b 修改test_mixdataloader中的工具函数名，防止被pytest执行 by x54-729 2022-05-23 14:38:49 +0000
  • 756bd09d 1.删除不必要的测试标签 2.为test_mixdataloader添加torch标签 by x54-729 2022-05-23 13:17:45 +0000
  • f3330901 1.删掉不必要的temp标签 2.为test_mixdataloader添加torch标签 by x54-729 2022-05-23 13:06:35 +0000
  • b43e2196 fastNLP/core/dataset/dataset.py by x54-729 2022-05-23 11:46:21 +0000
  • 388baf58 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-23 19:43:35 +0800
  • ff504377 1.修复数据处理的时候，多进程print会报错的问题;2.Trainer/Evaluator增加check_dataloader_legality by yh 2022-05-23 19:43:29 +0800
  • dd0e02b2 1.tokenization_utils_base.py中一处logger.warn改为warning_once 2. mix_modules/utils.py torch转换时添加.cpu() 3. dataset中将输出重定向到DEVNULL而不是Null by x54-729 2022-05-22 16:07:58 +0000
  • a9316b02 dataset增加set_pad, set_ignore by MorningForest 2022-05-22 21:21:36 +0800
  • b9be645e dataset 增加 set_pad, set_ignore by MorningForest 2022-05-22 21:12:42 +0800
  • cfe38963 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-22 12:57:55 +0000
  • 639de995 为transformers 添加AutoModel by x54-729 2022-05-22 12:57:38 +0000
  • a788fd17 增加metric文档 by MorningForest 2022-05-22 19:50:10 +0800
  • e0f49d88 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-05-22 19:12:55 +0800
  • 724b112a 增加dataset, collator文档 by MorningForest 2022-05-22 19:12:47 +0800
  • a03558a5 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-22 08:42:48 +0000
  • 099b5b59 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-22 16:29:52 +0800
  • 653b129e Evaluator新增load_model函数 by yh 2022-05-22 16:29:45 +0800
  • 70b0aaa7 调整文档侧边栏的显示 by x54-729 2022-05-21 07:51:11 +0000
  • 1a1b1e8c 迁移transformers的modeling_auto by x54-729 2022-05-21 07:50:53 +0000
  • 7ca1abfb Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-05-20 18:04:09 +0800
  • 9bb1ed4c 增加 mixdataloader 文档， 修改mix_sampler, mixdataloader代码， 增加相应测试用例 by MorningForest 2022-05-20 18:04:00 +0800
  • 1ccb200c 1.为Jenkins添加30min的超时时间 2.跟进driver关于checkpoint的改动 by x54-729 2022-05-20 08:02:25 +0000
  • f8015d05 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-20 07:28:00 +0000
  • 06551964 paddle 不再为非fp16的driver加载fp16状态 by x54-729 2022-05-20 07:27:48 +0000
  • 466e924d 1.修复classify_f1_pre_rec_metric在batch中target不包含某类class时的计算错误;2.增加对FairScale的支持, 同时修改TorchDriver以实现兼容 by yh 2022-05-20 01:57:06 +0800
  • 54556630 1.修改.Jenkinsfile移动html页面的步骤至post中 2.修改torch_dataloader/test_fdl.py的部分测试例 3.在torch版本较低时跳过worker_inif_function的测试 by x54-729 2022-05-19 13:34:46 +0000
  • cb8eb804 集成测试时添加对飞书bot的支持和生成结果的html页面 by x54-729 2022-05-19 12:00:31 +0000
  • 08385298 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-19 10:15:32 +0000
  • c04fc2dc Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-19 17:07:51 +0800
  • 4d3a9396 修复ClassifyFPreRecMetric代码中的bug by yh 2022-05-19 17:07:39 +0800
  • be94e5b6 1.增加构建多分支文档的命令和文件 2.重命名Jenkinsfile为.Jenkinsfile by x54-729 2022-05-19 09:04:58 +0000
  • 916c1133 修改增加 jittor fdl 的文档 by MorningForest 2022-05-19 01:47:53 +0800
  • 744f6de6 修改 fdl 文档 by MorningForest 2022-05-19 01:37:55 +0800
  • 6592794d Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by MorningForest 2022-05-19 01:08:37 +0800
  • 10aed5a3 torch fdl的文档修改 by MorningForest 2022-05-19 01:08:29 +0800
  • 1096fd8b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-18 14:08:16 +0000
  • d2672c62 修改fdl train_sampler by MorningForest 2022-05-18 21:54:12 +0800
  • 696f6b89 修改参数train_batch_size by yh 2022-05-18 21:49:47 +0800
  • b76c6816 增加fdl文档 by MorningForest 2022-05-18 20:52:03 +0800
  • f183c59c 修改torch_dataloader/test_fdl.py的test_Version_111测试例的参数；删除一处不必要的temp标签 by x54-729 2022-05-18 12:33:57 +0000
  • e21589a0 暂时跳过jittor的测试；增加torch1.11的共享内存 by x54-729 2022-05-18 10:03:18 +0000
  • 3143cc76 修改dataloaders/test_utils.py by x54-729 2022-05-18 09:33:07 +0000
  • 0a5a4fde 让DataLoader兼容1.6版本 by yh 2022-05-18 17:13:45 +0800
  • 4387172b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-18 08:33:59 +0000
  • af368132 1. test_fleet.py 和 test_ddp.py 中的 load_checkpoint 相关的测试例添加同步 2.修改 Jenkinsfile 中 Test Other 的 pytest 标签形式 by x54-729 2022-05-18 08:33:43 +0000
  • daac74f2 1.为torch1.11的测试增加共享内存为256M 2.prepare_dataloader判断backend时添加dist-packages路径 by x54-729 2022-05-18 07:58:42 +0000
  • 0998b0a3 update tutorial-23 lxr 220518 by lxr-tech 2022-05-18 15:41:24 +0800
  • e9bc2bf4 1. 为test_paddle_utils添加paddle标签；2.修改test_set_backend测试例适应没有conda的情况 by x54-729 2022-05-18 06:48:25 +0000
  • 75370990 paddle jittor的测试添加--co，仅测试能否import成功 by x54-729 2022-05-18 06:47:22 +0000
  • 60f98538 update jenkins by x54-729 2022-05-18 05:03:48 +0000
  • c977d3be 补充需要 _NEED_IMPORT_TORCH 的地方 by x54-729 2022-05-17 18:08:36 +0000
  • 46aede49 更新 Jenkinsfile 执行全部的测试 by x54-729 2022-05-17 17:06:57 +0000
  • 51a44397 torch test_dist_utils.py中torch.full添加dtype以兼容不同的torchban蹦 by x54-729 2022-05-17 17:05:19 +0000
  • 49eb1fcc Merge branch 'dev0.8.0' of gitee.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-17 16:30:42 +0000
  • baffa63b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-17 16:28:45 +0000
  • e8579356 添加 Jenkinsfile 实现自动测试 by x54-729 2022-05-17 16:28:26 +0000
  • d5a4c7aa Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-17 22:42:11 +0800
  • 42251028 增加pytorch版本限制为1.6以上 by yh 2022-05-17 22:39:19 +0800
  • 2c804525 update tutorial-12 lxr 220517 by lxr-tech 2022-05-17 18:04:15 +0800
  • 6d2dca42 修改测试中需要超过2个gpu的 by yh 2022-05-17 13:21:16 +0800
  • e813aeaa 删掉一些测试内容 by yh 2022-05-16 14:20:28 +0800
  • d9e1991a merge by yh 2022-05-16 11:28:48 +0800
  • b5b48d58 fix some bug by yh 2022-05-16 11:28:07 +0800
  • 06743caa 1. 在 PaddleBackend 中添加 is_distributed 函数 2. 在 paddle 多卡的主进程添加 FASTNLP_GLOBAL_RANK by x54-729 2022-05-16 03:06:31 +0000
  • a000c477 减少部分测试的数据集大小和epochs以加快测试速度 by x54-729 2022-05-15 17:37:02 +0000
  • 266caaaf 文档ç添加文档的依赖库 by x54-729 2022-05-16 00:44:18 +0800
  • 66cb72c0 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-15 14:42:01 +0000
  • b1ba42e8 修复若干微小的bug by yh 2022-05-15 22:33:30 +0800
  • 7c873ac5 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-15 09:12:26 +0000
  • 6b56d8a0 merge callback test to speed up by yh 2022-05-15 17:09:28 +0800
  • 9b4ea335 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by x54-729 2022-05-15 07:41:11 +0000
  • 3cdb1fb4 将部分:class:引用改为:class: by x54-729 2022-05-15 07:40:17 +0000
  • d4bccf3f 修复Evaluator的evaluate_use_dist_sampler在Trainer中的bug by yh 2022-05-15 15:37:08 +0800
  • b7ff2d1b 删除不必要的文件pad_val by x54-729 2022-05-15 06:04:44 +0000
  • c4af9f21 paddle 和测试例跟进 set_dist_repro_dataloader 函数；修改test_trainer_wo_evaluator_torch.py的bug by x54-729 2022-05-14 11:13:26 +0000
  • efaec85c 1. 处理 topk_saver topk 参数为 None 的情况 2.Trainer on_exception 函数参数判断调整 3. 处理各类型 padder 中数据的 batch_size 为1 的情况 4. ReproducibleBatchSampler和ReproducibleSampler 对参数 length 的判断 5.TorchDataLoader 初始化参数调整 6.部分测试例跟进版本 by x54-729 2022-05-14 11:01:37 +0000
  • 6e66fb89 修正 JittorDataLoader 读取 jittor Dataset 无法进行索引的问题 by x54-729 2022-05-14 10:56:30 +0000
  • 0f9d0758 update tutorial-12 lxr 220514 by lxr-tech 2022-05-14 15:53:14 +0800
  • 24236410 新增TqdmProgressBar by yh 2022-05-14 15:49:37 +0800
  • 4b5d89c3 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 by yh 2022-05-13 23:16:19 +0800
  • 36ba69a8 完善一下pdb by yh 2022-05-13 23:16:10 +0800
  • 6488f5e0 修改fdl冲突 by MorningForest 2022-05-13 20:23:45 +0800
  • 5945c3f9 增加voc, dl的文档 by MorningForest 2022-05-13 20:20:02 +0800
  • 655e48de 1.修改torch测试例中多卡的driver参数 2.修改测试例中的driver.save driver.load为driver.save_checkpoint driver.load_checkpoint 3.添加lstm by x54-729 2022-05-13 11:19:31 +0000
  • 20be6d5e merge by yh_cc 2022-05-13 12:38:43 +0800
  • 97b504c0 修改Trainer.save/Driver.save为Trainer.save_checkpoint/Driver.save_checkpoint by yh_cc 2022-05-13 12:32:44 +0800
  • c2b39634 update tutorial-01 lxr 220513 by lxr-tech 2022-05-13 11:49:44 +0800
  • f4c284a6 进一步完善了文档 by YWMditto 2022-05-12 20:10:52 +0800
  • 8de1477a controllers.utils 的文档基本完成 by YWMditto 2022-05-12 16:10:17 +0800
  • 6665fee7 Loop 的文档基本完成 by YWMditto 2022-05-12 15:52:44 +0800
  • 1aa41a9e Evaluator 的文档基本完成 by YWMditto 2022-05-12 15:10:47 +0800