diff --git a/sigs/data/README.md b/sigs/data/README.md new file mode 100644 index 0000000..9e68a9e --- /dev/null +++ b/sigs/data/README.md @@ -0,0 +1,25 @@ +# MindSpore Data Special Interest Group (SIG) + +This is the working repo for the Data special interest group (SIG). This repo contains all the artifacts, materials, meeting notes and proposals regarding **dataset - data processing** and **mindrecord - data format** in MindSpore. Feedbacks and contributions are welcome. +1. **Data Processing**: You can understand it as a Dataset, which is mainly responsible for reading the user's data into a Dataset, then performing related data enhancement operations (such as: resize, onehot, rotate, shuffle, batch ...), and finally provide the Dataset to the training process. +2. **Data Format**: It can conveniently normalize the user's training data to a unified format (MindRecord). The specific operation steps are as follows: The user can easily convert the training data into MindRecrod data by defining the training data schema and calling the Python API interface. The format is then read into a Dataset through MindDataset and provided to the training process. + +# SIG Leads + +* Liu Cunwei (Huawei) + +# Logistics + +* SIG leads will drive the meeting. +* Meeting annoucement will be posted on our gitee channel: https://gitee.com/mindspore/community/sigs/data +* Feedbacks and topic requests are welcome by all. + +# Discussion + +* Slack channel https://app.slack.com/client/TUKCY4QDR/C010RPN6QNP?cdn_fallback=2 +* Documents and artifacts: https://gitee.com/mindspore/community/sigs/data + +# Meeting notes + +* [Thursday April 2, 2020](./meetings/001-20200402.md) + diff --git a/sigs/data/docs/design-template.md b/sigs/data/docs/design-template.md new file mode 100644 index 0000000..e69de29 diff --git a/sigs/data/meetings/001-20200402.md b/sigs/data/meetings/001-20200402.md new file mode 100644 index 0000000..6c0d975 --- /dev/null +++ b/sigs/data/meetings/001-20200402.md @@ -0,0 +1,24 @@ +# Thursday April 2, 2020 at 21:30pm GMT+8 + +## Agenda +* Need to change old api to new api, PR: https://gitee.com/mindspore/mindspore/pulls/22 +* Discuss how to avoid such problems when subsequent interface changes + +## Conference links +* https://meet.jit.si/MindSporeDataSIG + +## Attendees +* Liu Cunwei (Huawei) +* Pan Fengfeng (Huawei) +* Guo Zhijian (Huawei) +* He Leiwang (Huawei) +* Huang Zhipeng (Huawei) +* Nattavut Sutyanyong (Huawei) +* Robin Grosman (Huawei) +* Michael Feng (Huawei) + +## Notes +* TODO + +## Action items +* TODO