Coet
13faa2b410
Merge pull request #132 from FengZiYjun/v0.3.1
fastNLP V0.3.1
6 years ago
FengZiYjun
b66d7b8f51
update API introduction
6 years ago
FengZiYjun
d1b5adabc4
add codecov fix
6 years ago
FengZiYjun
0c5630bd16
Ready for V0.3.1
* 升级parser API和模型
* update docs: add new pages for tutorials
* upgrade CWS api download source
* add a new method for dataset field access
* add introduction for bert
* add more unit tests for api/processor
* remove unused test data. Add new test data.
6 years ago
FengZiYjun
986541139a
整理所有dataset loader,建立单元测试
6 years ago
FengZiYjun
bfaf09df8c
add BERT model
* load pre-trained BERT weights from local binary
* add tests
6 years ago
FengZiYjun
887fc9281f
update callbacks:
* rename callback methods. Use fastai's notation.
* add a new callback method - on_valid_begin
6 years ago
xuyige
e0d6a259ae
skip training while n_epoch in trainer is not greater than 0
6 years ago
xuyige
d4b4ffa28b
add testing tutorial
6 years ago
yunfan
9474ab4b34
remove device in batch
6 years ago
yunfan
c02980e006
Merge branch 'yyff' into dev
6 years ago
yunfan
a37de4344d
add batch device
6 years ago
yunfan
e93c6f0053
Merge branch 'dev' of https://github.com/choosewhatulike/fastNLP-private into dev
6 years ago
yh
47ec69ea96
trainer根据syf的多进程batch进行修改
6 years ago
FengZiYjun
f3cb812554
将tesorboardX处理为callback, 从trainer移除tensorboardX相关代码
6 years ago
yunfan
03f49c8264
- batch with multiprocessing
6 years ago
FengZiYjun
b14dd58828
Update POS API
6 years ago
FengZiYjun
62ea4f7fed
添加LR finder,用第一个epoch找最佳lr,从第二个epoch开始训练
6 years ago
yunfan
a7f3701bdf
- revert batch
6 years ago
yunfan
de856fb8eb
update reproduction
6 years ago
yunfan
eb55856c78
- fix parser train
6 years ago
FengZiYjun
ab953b43ab
* 重构POS API,改成接受word作为输入
* 添加两类Callback
* 完善Trainer对error的捕捉
6 years ago
yh_cc
d9ac334409
减少batch中不断创建多进程的开销
6 years ago
yh_cc
2e3ef52a7d
将batch增强为多进程batch
6 years ago
FengZiYjun
864c2238f8
添加FieldArray对list of np.array的支持
6 years ago
FengZiYjun
b93ca9bb30
* FieldArray添加对list of np.array的支持
* 添加测试:FieldArray的初始化
6 years ago
FengZiYjun
e4f997d52a
refactor type system in FieldArray:
* 重构dtype的检测代码,在FieldArray的初始化和append两处,达到更好的代码复用
* 类型检测的责任完全落在FieldArray,DataSet与之配合
测试:
* 整理dtype相关的测试代码
* 给所有tutorial添加测试
其他:
* 完善一个完整的Conll dataset loader
* 升级POS tag model训练脚本
6 years ago
yh
73dd35dabf
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
6 years ago
yh
3e33a23042
修改Padder的测试用例
6 years ago
yh
8091a734ee
1. 将pad的功能从FieldArray中剥离出来,使用Padder完成各种padding操作。
2. FieldArray默认使用AutoPadder, AutoPadder的行为与之前不使用padder是一致的的
3. 为了解决二维padding的问题,引入了EngChar2dPadder用于对character进行padding
4. 增加一份padding的tutorial。
6 years ago
FengZiYjun
d80d944e40
* 添加callbacks:EarlyStopCallback
* 将dataset.py中的assert改为raise error
* 给trainer添加try-except,捕捉EarlyStopError
* 优化trainer代码
* 给callbacks添加测试
6 years ago
yh
1f50b01ffa
conflict solved
6 years ago
yh
6a0a1ed4ad
train增加注释;attention增加注释;新增transformer分词
6 years ago
FengZiYjun
1fdaf236d2
Updates:
* 改名: chinese_word_segment ---> Chinese_word_segmentation
* 改名: pos_tag_model ---> POS_tagging
* 添加4个对Batch的测试
* 删除无用的chinese_word_segment/run.py
6 years ago
FengZiYjun
c4ba75d160
code optimization
* move used readers from reproduction to io/dataset_loader.py
(API shall not call anything from reproduction/)
6 years ago
ChenXin
a6dbbe9812
remove the gpu_id info when saving
6 years ago
yunfan
2e9e6c6c20
- fix trainer with validate_every > 0
- refine & fix Transformer Encoder
- refine & speed up biaffine parser
6 years ago
Coet
3fa95b6cfc
Update README.md
fix tutorial link
6 years ago
Coet
3219b9da33
Merge pull request #123 from FengZiYjun/v0.3.0
fastNLP V0.3.0
6 years ago
FengZiYjun
094a566155
add syntactic parsing API
6 years ago
FengZiYjun
8df5bce938
fastNLP V0.3
6 years ago
FengZiYjun
eca0c6f8c4
Prepare for release.
* pass all tests
* prepare CWS & POS API
* update tutorials
* add README.md in tutorials/ & api/
6 years ago
yunfan
62a7556a04
Merge remote-tracking branch 'private/dev' into dev
# Conflicts:
# fastNLP/api/api.py
# fastNLP/modules/encoder/variational_rnn.py
6 years ago
yunfan
ba28702e68
update Biaffine Parser, Variational RNN
add parser API
6 years ago
FengZiYjun
7eb02f1762
update code comments in CRF
6 years ago
FengZiYjun
751fe2768e
Merge branch 'master' of https://github.com/fastnlp/fastNLP into current branch
# Conflicts solved:
# fastNLP/io/dataset_loader.py
# fastNLP/io/embed_loader.py
# fastNLP/modules/aggregator/attention.py
# fastNLP/modules/decoder/CRF.py
6 years ago
FengZiYjun
c0b67a2bc9
fix tests
6 years ago
FengZiYjun
806364b5be
* update travis config
* update README
6 years ago
yh
a1fe24c49d
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
6 years ago
yh
145125feb4
支持CWS的高级api“
6 years ago