Browse Source

add Data sigs

pull/2/head
jonyguo jonyguo 5 years ago
parent
commit
38a835bbef
3 changed files with 49 additions and 0 deletions
  1. +25
    -0
      sigs/data/README.md
  2. +0
    -0
      sigs/data/docs/design-template.md
  3. +24
    -0
      sigs/data/meetings/001-20200402.md

+ 25
- 0
sigs/data/README.md View File

@@ -0,0 +1,25 @@
# MindSpore Data Special Interest Group (SIG)

This is the working repo for the Data special interest group (SIG). This repo contains all the artifacts, materials, meeting notes and proposals regarding **dataset - data processing** and **mindrecord - data format** in MindSpore. Feedbacks and contributions are welcome.
1. **Data Processing**: You can understand it as a Dataset, which is mainly responsible for reading the user's data into a Dataset, then performing related data enhancement operations (such as: resize, onehot, rotate, shuffle, batch ...), and finally provide the Dataset to the training process.
2. **Data Format**: It can conveniently normalize the user's training data to a unified format (MindRecord). The specific operation steps are as follows: The user can easily convert the training data into MindRecrod data by defining the training data schema and calling the Python API interface. The format is then read into a Dataset through MindDataset and provided to the training process.

# SIG Leads

* Liu Cunwei (Huawei)

# Logistics

* SIG leads will drive the meeting.
* Meeting annoucement will be posted on our gitee channel: https://gitee.com/mindspore/community/sigs/data
* Feedbacks and topic requests are welcome by all.

# Discussion

* Slack channel https://app.slack.com/client/TUKCY4QDR/C010RPN6QNP?cdn_fallback=2
* Documents and artifacts: https://gitee.com/mindspore/community/sigs/data

# Meeting notes

* [Thursday April 2, 2020](./meetings/001-20200402.md)


+ 0
- 0
sigs/data/docs/design-template.md View File


+ 24
- 0
sigs/data/meetings/001-20200402.md View File

@@ -0,0 +1,24 @@
# Thursday April 2, 2020 at 21:30pm GMT+8

## Agenda
* Need to change old api to new api, PR: https://gitee.com/mindspore/mindspore/pulls/22
* Discuss how to avoid such problems when subsequent interface changes

## Conference links
* https://meet.jit.si/MindSporeDataSIG

## Attendees
* Liu Cunwei (Huawei)
* Pan Fengfeng (Huawei)
* Guo Zhijian (Huawei)
* He Leiwang (Huawei)
* Huang Zhipeng (Huawei)
* Nattavut Sutyanyong (Huawei)
* Robin Grosman (Huawei)
* Michael Feng (Huawei)

## Notes
* TODO

## Action items
* TODO

Loading…
Cancel
Save