Browse Source

Add course introduction, some references, imporve circle dataset

pull/1/MERGE
bushuhui 5 years ago
parent
commit
43e233511d
16 changed files with 2588 additions and 2761 deletions
  1. +0
    -171
      0_python/0_Introduction.ipynb
  2. +1
    -1
      0_python/README.md
  3. +73
    -53
      4_logistic_regression/Least_squares.ipynb
  4. +8
    -8
      4_logistic_regression/Logistic_regression.ipynb
  5. +13
    -12
      5_nn/Perceptron.ipynb
  6. +2060
    -2037
      5_nn/mlp_bp.ipynb
  7. BIN
      6_pytorch/2_CNN/CNN_Introduction.pptx
  8. BIN
      CourseIntroduction.pdf
  9. +14
    -14
      README.md
  10. +3
    -1
      References.md
  11. +1
    -1
      tips/InstallPython.md
  12. +400
    -400
      tips/dataset_circles.csv
  13. +6
    -4
      tips/datasets.ipynb
  14. +4
    -4
      tips/notebook_tips.ipynb
  15. +0
    -55
      tips/requirements.txt
  16. +5
    -0
      tips/构建深度神经网络的一些实战建议.md

+ 0
- 171
0_python/0_Introduction.ipynb View File

@@ -1,171 +0,0 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"All the IPython Notebooks in this lecture series are available at https://github.com/rajathkumarmp/Python-Lectures"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Python-Lectures"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Introduction"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Python is a modern, robust, high level programming language. It is very easy to pick up even if you are completely new to programming."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Installation"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Mac OS X and Linux comes pre installed with python. Windows users can download python from https://www.python.org/downloads/ .\n",
"\n",
"To install IPython run,\n",
"\n",
" $ pip install ipython[all]\n",
" \n",
"This will install all the necessary dependencies for the notebook, qtconsole, tests etc."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Installation from unofficial distributions"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Installing all the necessary libraries might prove troublesome. Anaconda and Canopy comes pre packaged with all the necessary python libraries and also IPython."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"#### Anaconda"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Download Anaconda from https://www.continuum.io/downloads\n",
"\n",
"Anaconda is completely free and includes more than 300 python packages. Both python 2.7 and 3.4 options are available."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"#### Canopy"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Download Canopy from https://store.enthought.com/downloads/#default\n",
"\n",
"Canopy has a premium version which offers 300+ python packages. But the free version works just fine. Canopy as of now supports only 2.7 but it comes with its own text editor and IPython environment."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Launching IPython Notebook"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"From the terminal\n",
"\n",
" ipython notebook\n",
"\n",
"In Canopy and Anaconda, Open the respective terminals and execute the above."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## How to learn from this resource?"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Download all the ipython notebooks from this repository https://github.com/rajathkumarmp/Python-Lectures\n",
"\n",
"Launch ipython notebook from the folder which contains the notebooks. Open each one of them\n",
"\n",
" Cell > All Output > Clear\n",
" \n",
"This will clear all the outputs and now you can understand each statement and learn interactively."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## License"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"This work is licensed under the Creative Commons Attribution 3.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/3.0/"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.5.2"
}
},
"nbformat": 4,
"nbformat_minor": 1
}

+ 1
- 1
0_python/README.md View File

@@ -32,4 +32,4 @@ Python 是一门上手简单、功能强大、通用型的脚本编程语言。P
* [廖雪峰的Python教程](https://www.liaoxuefeng.com/wiki/1016959663602400)
* [智能系统实验室入门教程-Python](https://gitee.com/pi-lab/SummerCamp/tree/master/python)
* [Python tips](../tips/python)
* [Get Started with Python](Python.pdf)

+ 73
- 53
4_logistic_regression/Least_squares.ipynb
File diff suppressed because it is too large
View File


+ 8
- 8
4_logistic_regression/Logistic_regression.ipynb View File

@@ -24,7 +24,7 @@
},
{
"cell_type": "code",
"execution_count": 2,
"execution_count": 1,
"metadata": {},
"outputs": [
{
@@ -180,7 +180,7 @@
},
{
"cell_type": "code",
"execution_count": 1,
"execution_count": 2,
"metadata": {},
"outputs": [],
"source": [
@@ -196,7 +196,7 @@
},
{
"cell_type": "code",
"execution_count": 2,
"execution_count": 3,
"metadata": {},
"outputs": [
{
@@ -222,7 +222,7 @@
"Text(0.5, 1.0, 'Original Data')"
]
},
"execution_count": 2,
"execution_count": 3,
"metadata": {},
"output_type": "execute_result"
},
@@ -252,7 +252,7 @@
},
{
"cell_type": "code",
"execution_count": 3,
"execution_count": 4,
"metadata": {},
"outputs": [],
"source": [
@@ -280,7 +280,7 @@
},
{
"cell_type": "code",
"execution_count": 4,
"execution_count": 5,
"metadata": {},
"outputs": [],
"source": [
@@ -324,7 +324,7 @@
},
{
"cell_type": "code",
"execution_count": 5,
"execution_count": 6,
"metadata": {},
"outputs": [
{
@@ -355,7 +355,7 @@
},
{
"cell_type": "code",
"execution_count": 6,
"execution_count": 7,
"metadata": {},
"outputs": [
{


+ 13
- 12
5_nn/Perceptron.ipynb View File

@@ -18,9 +18,9 @@
"\n",
"心理学家Rosenblatt构想了感知机,它作为简化的数学模型解释大脑神经元如何工作:它取一组二进制输入值(附近的神经元),将每个输入值乘以一个连续值权重(每个附近神经元的突触强度),并设立一个阈值,如果这些加权输入值的和超过这个阈值,就输出1,否则输出0(同理于神经元是否放电)。对于感知机,绝大多数输入值不是一些数据,就是别的感知机的输出值。\n",
"\n",
"麦卡洛克-皮兹模型缺乏一个对AI而言至关重要的学习机制。这就是感知机更出色的地方所在——罗森布拉特受到唐纳德·赫布(Donald Hebb) 基础性工作的启发,想出一个让这种人工神经元学习的办法。赫布提出了一个出人意料并影响深远的想法,称知识和学习发生在大脑主要是通过神经元间突触的形成与变化,简要表述为赫布法则:\n",
"唐纳德·赫布提出了一个出人意料并影响深远的想法,称知识和学习发生在大脑主要是通过神经元间突触的形成与变化,简要表述为赫布法则:\n",
"\n",
">当细胞A的轴突足以接近以激发细胞B,并反复持续地对细胞B放电,一些生长过程或代谢变化将发生在某一个或这两个细胞内,以致A作为对B放电的细胞中的一个,效率增加。\n",
"> 当细胞A的轴突足以接近以激发细胞B,并反复持续地对细胞B放电,一些生长过程或代谢变化将发生在某一个或这两个细胞内,以致A作为对B放电的细胞中的一个,效率增加。\n",
"\n",
"\n",
"感知机并没有完全遵循这个想法,**但通过调输入值的权重,可以有一个非常简单直观的学习方案:给定一个有输入输出实例的训练集,感知机应该「学习」一个函数:对每个例子,若感知机的输出值比实例低太多,则增加它的权重,否则若设比实例高太多,则减少它的权重。**\n"
@@ -32,13 +32,13 @@
"source": [
"## 1. 感知机模型\n",
"\n",
"假设输入空间(特征向量)为X⊆Rn,输出空间为Y={-1, +1}。输入x∈X表示实例的特征向量,对应于输入空间的点;输出y∈Y表示示例的类别。由输入空间到输出空间的函数为\n",
"假设输入空间(特征向量)为$X \\subseteq R^n$,输出空间为$Y=\\{-1, +1\\}$。输入$x \\in X$ 表示实例的特征向量,对应于输入空间的点;输出$y \\in Y$表示示例的类别。由输入空间到输出空间的函数为\n",
"\n",
"$$\n",
"f(x) = sign(w x + b)\n",
"$$\n",
"\n",
"称为感知机。其中,参数w叫做权值向量,b称为偏置。w·x表示w和x的内积。sign为符号函数,即\n",
"称为感知机。其中,参数$w$叫做权值向量,$b$称为偏置。$w·x$表示$w$$x$的内积。$sign$为符号函数,即\n",
"![sign_function](images/sign.png)\n",
"\n",
"### 1.1 几何解释 \n",
@@ -66,7 +66,7 @@
"\\frac{1}{||w||} | w \\cdot xo + b |\n",
"$$\n",
"\n",
"其次,对于误分类点(xi,yi)来说 -yi(w·xi+b)>0\n",
"其次,对于误分类点$(x_i,y_i)$来说 $-y_i(w \\cdot x_i + b) > 0$\n",
"\n",
"这样,假设超平面S的总的误分类点集合为M,那么所有误分类点到S的距离之和为\n",
"$$\n",
@@ -76,7 +76,7 @@
"\n",
"### 经验风险函数\n",
"\n",
"给定数据集T={(x1,y1),(x2,y2)...(xN,yN)}(其中xi∈X=Rn,yi∈Y={-1, +1},i=1,2...N),感知机sign(w·x+b)学习的损失函数定义为\n",
"给定数据集$T = \\{(x_1,y_1), (x_2, y_2), ... (x_N, y_N)\\}$(其中$x_i \\in R^n$, $y_i \\in \\{-1, +1\\},i=1,2...N$),感知机sign(w·x+b)学习的损失函数定义为\n",
"$$\n",
"L(w, b) = - \\sum_{x_i \\in M} y_i (w \\cdot x_i + b)\n",
"$$\n",
@@ -92,13 +92,13 @@
"## 3. 感知机学习算法\n",
"\n",
"\n",
"最优化问题:给定数据集T={(x1,y1),(x2,y2)...(xN,yN)}(其中xi∈X=Rn,yi∈Y={-1, +1},i=1,2...N),求参数w,b,使其成为损失函数的解(M为误分类的集合):\n",
"最优化问题:给定数据集$T = \\{(x_1,y_1), (x_2, y_2), ... (x_N, y_N)\\}$(其中$x_i \\in R^n$, $y_i \\in \\{-1, +1\\},i=1,2...N$),求参数w,b,使其成为损失函数的解(M为误分类的集合):\n",
"\n",
"$$\n",
"min_{w,b} L(w, b) = - \\sum_{x_i \\in M} y_i (w \\cdot x_i + b)\n",
"$$\n",
"\n",
"感知机学习是误分类驱动的,具体采用[随机梯度下降法](https://blog.csdn.net/zbc1090549839/article/details/38149561)。首先,任意选定$w_0$、$b_0$,然后用梯度下降法不断极小化目标函数,极小化的过程不一次性的把M中的所有误分类点梯度下降,而是一次随机选取一个误分类点使其梯度下降。\n",
"感知机学习是误分类驱动的,具体采用[随机梯度下降法](https://blog.csdn.net/zbc1090549839/article/details/38149561)。首先,任意选定$w_0$、$b_0$,然后用梯度下降法不断极小化目标函数,极小化的过程不一次性的把M中的所有误分类点梯度下降,而是一次随机选取一个误分类点使其梯度下降。\n",
"\n",
"假设误分类集合M是固定的,那么损失函数L(w,b)的梯度为\n",
"$$\n",
@@ -150,10 +150,11 @@
"name": "stdout",
"output_type": "stream",
"text": [
"update weight and bias: 1.0 2.5 0.5\n",
"update weight and bias: -2.0 1.5 0.0\n",
"w = [-2.0, 1.5]\n",
"b = 0.0\n",
"update weight and bias: 1.0 3.0 0.5\n",
"update weight and bias: -0.5 2.5 0.0\n",
"update weight and bias: -2.5 2.0 -0.5\n",
"w = [-2.5, 2.0]\n",
"b = -0.5\n",
"[ 1 1 1 1 -1 -1 -1 -1]\n",
"[1, 1, 1, 1, -1, -1, -1, -1]\n"
]


+ 2060
- 2037
5_nn/mlp_bp.ipynb
File diff suppressed because it is too large
View File


BIN
6_pytorch/2_CNN/CNN_Introduction.pptx View File


BIN
CourseIntroduction.pdf View File


+ 14
- 14
README.md View File

@@ -1,13 +1,14 @@
# 机器学习

本教程主要讲解机器学习的基本原理与实现,通过本教程的引导来快速学习Python、Python常用库、机器学习的理论知识与实际编程,并学习如何解决实际问题。
本教程主要讲解机器学习的基本原理与实现,通过本教程的引导来快速学习Python、Python常用库、机器学习的理论知识与实际编程,并学习如何解决实际问题。

由于**本课程需要大量的编程练习才能取得比较好的学习效果**,因此需要认真去[作业和报告](https://gitee.com/pi-lab/machinelearning_homework),写作业的过程可以查阅网上的资料,但是不能直接照抄,需要自己独立思考并独立写出代码。
由于**本课程需要大量的编程练习才能取得比较好的学习效果**,因此需要认真去完成[作业和报告](https://gitee.com/pi-lab/machinelearning_homework),写作业的过程可以查阅网上的资料,但是不能直接照抄,需要自己独立思考并独立写出代码。



## 1. 内容
1. [Python](0_python/)
1. [课程简介](CourseIntroduction.pdf)
2. [Python](0_python/)
- [Install Python](tips/InstallPython.md)
- [Introduction](0_python/0_Introduction.ipynb)
- [Python Basics](0_python/1_Basics.ipynb)
@@ -17,20 +18,20 @@
- [Control Flow](0_python/5_Control_Flow.ipynb)
- [Function](0_python/6_Function.ipynb)
- [Class](0_python/7_Class.ipynb)
2. [numpy & matplotlib](1_numpy_matplotlib_scipy_sympy/)
3. [numpy & matplotlib](1_numpy_matplotlib_scipy_sympy/)
- [numpy](1_numpy_matplotlib_scipy_sympy/numpy_tutorial.ipynb)
- [matplotlib](1_numpy_matplotlib_scipy_sympy/matplotlib_simple_tutorial.ipynb)
- [ipython & notebook](1_numpy_matplotlib_scipy_sympy/ipython_notebook.ipynb)
3. [knn](2_knn/knn_classification.ipynb)
4. [kMenas](3_kmeans/k-means.ipynb)
5. [Logistic Regression](4_logistic_regression/)
4. [knn](2_knn/knn_classification.ipynb)
5. [kMenas](3_kmeans/k-means.ipynb)
6. [Logistic Regression](4_logistic_regression/)
- [Least squares](4_logistic_regression/Least_squares.ipynb)
- [Logistic regression](4_logistic_regression/Logistic_regression.ipynb)
6. [Neural Network](5_nn/)
7. [Neural Network](5_nn/)
- [Perceptron](5_nn/Perceptron.ipynb)
- [Multi-layer Perceptron & BP](5_nn/mlp_bp.ipynb)
- [Softmax & cross-entroy](5_nn/softmax_ce.ipynb)
7. [PyTorch](6_pytorch/)
8. [PyTorch](6_pytorch/)
- Basic
- [short tutorial](6_pytorch/PyTorch_quick_intro.ipynb)
- [basic/Tensor-and-Variable](6_pytorch/0_basic/Tensor-and-Variable.ipynb)
@@ -67,18 +68,18 @@



## 2. 其他参考
## 2. 其他参考资料
* 资料速查
* [相关学习参考资料](References.md)
* [相关学习参考资料汇总](References.md)
* [一些速查手册](tips/cheatsheet)

* 机器学习方面
* 机器学习方面技巧等
* [Confusion Matrix](tips/confusion_matrix.ipynb)
* [Datasets](tips/datasets.ipynb)
* [构建深度神经网络的一些实战建议](tips/构建深度神经网络的一些实战建议.md)
* [Intro to Deep Learning](tips/Intro_to_Deep_Learning.pdf)

* Python
* Python技巧等
* [安装Python环境](tips/InstallPython.md)
* [Python tips](tips/python)

@@ -90,4 +91,3 @@
* Markdown
* [Markdown——入门指南](https://www.jianshu.com/p/1e402922ee32)



+ 3
- 1
References.md View File

@@ -5,6 +5,7 @@

## Python & IPython

* [Python Numpy Tutorial - 简明Python, Numpy, Matplotlib教程](http://cs231n.github.io/python-numpy-tutorial/)
* [Python教程](https://www.liaoxuefeng.com/wiki/0014316089557264a6b348958f449949df42a6d3a2e542c000)
* [Python-Lectures](https://github.com/rajathkmp/Python-Lectures)
* [A gallery of interesting Jupyter Notebooks](https://github.com/jupyter/jupyter/wiki/A-gallery-of-interesting-Jupyter-Notebooks)
@@ -28,8 +29,9 @@



## Machine learning
## Notebook, Book, Tutorial

* [Machine Learning Yearning 中文版 - 《机器学习训练秘籍》](https://github.com/deeplearning-ai/machine-learning-yearning-cn) ([在线阅读](https://deeplearning-ai.github.io/machine-learning-yearning-cn/))
* [ipython-notebooks: A collection of IPython notebooks covering various topics](https://github.com/jdwittenauer/ipython-notebooks)
* [Learn Data Science](http://learnds.com/)
* [AM207 2016](https://github.com/AM207/2016/tree/master)


+ 1
- 1
tips/InstallPython.md View File

@@ -1,4 +1,4 @@
# Installing Python environments
# Installing Python Environments

由于Python的库比较多,并且依赖关系比较复杂,所以请仔细阅读下面的说明,使用下面的说明来安装能够减少问题的可能。*不过所列的安装方法,里面存在较多的细节,也许和你的系统并不适配,所以会遇到问题。如果遇到问题请通过搜索引擎去查找解决的办法*,通过这个方式锻炼自己解决问题的能力。



+ 400
- 400
tips/dataset_circles.csv View File

@@ -1,400 +1,400 @@
9.862597006109558251e+00,4.388945920860357397e+00,0.000000000000000000e+00
2.877170945049199346e+00,1.202827750793628248e+01,0.000000000000000000e+00
3.337256239136289437e+00,-5.220370923066885105e+00,0.000000000000000000e+00
6.493095562032711321e+00,-1.113144595320488328e+01,0.000000000000000000e+00
9.160816030038004598e+00,-1.009779300537452151e+01,0.000000000000000000e+00
1.041802753742201126e+01,1.894574992636611332e+00,0.000000000000000000e+00
-9.011386818141570387e+00,7.113786261861553051e+00,0.000000000000000000e+00
8.634194767050646035e+00,6.044937306977867797e-01,0.000000000000000000e+00
-8.310295927199726762e+00,-1.184857079692059001e+00,0.000000000000000000e+00
1.317546095251883154e+00,-1.129096844315353998e+01,0.000000000000000000e+00
9.529257864350787699e+00,1.736339478767750633e+00,0.000000000000000000e+00
-9.437763538148617570e+00,-2.872208646559228029e+00,0.000000000000000000e+00
5.815080874493489205e+00,-8.314022581206840457e+00,0.000000000000000000e+00
-1.288892096908664797e+01,-1.122402541491438477e+00,0.000000000000000000e+00
-7.491945439414098296e+00,-1.046310837836343666e+01,0.000000000000000000e+00
6.971623436910721061e+00,-3.713812314908092826e+00,0.000000000000000000e+00
-3.647715279401396060e+00,-8.566426635858620742e+00,0.000000000000000000e+00
-5.963933774842476332e+00,-5.215555684133276415e+00,0.000000000000000000e+00
5.649964657621771913e+00,-5.369954314422594521e+00,0.000000000000000000e+00
1.172710561955023145e+01,-2.754936843545676695e+00,0.000000000000000000e+00
1.672264154472602238e+00,-1.071807032527019565e+01,0.000000000000000000e+00
-3.443717408141795389e+00,1.250380032886874737e+01,0.000000000000000000e+00
5.863452362896988568e+00,-8.186611721106453743e+00,0.000000000000000000e+00
4.991164283632463672e+00,1.139369901458018042e+01,0.000000000000000000e+00
8.838997710199558711e+00,6.044714573548058967e-01,0.000000000000000000e+00
1.639030475559324795e+00,7.915238715166661443e+00,0.000000000000000000e+00
3.758705824661268569e+00,-8.090773260493815400e+00,0.000000000000000000e+00
-9.394967210155567017e+00,-5.137130325801137154e+00,0.000000000000000000e+00
-6.288288633339392142e+00,1.433786837462863506e+00,0.000000000000000000e+00
-9.604286351326987159e+00,-8.457016591349884038e+00,0.000000000000000000e+00
4.404554230019639860e+00,7.498658012125457795e+00,0.000000000000000000e+00
1.251066075969001723e+01,2.403854004526353894e+00,0.000000000000000000e+00
-6.625366638525115981e+00,-4.034266053666308416e+00,0.000000000000000000e+00
5.745785337741070364e+00,-4.064766044917044852e+00,0.000000000000000000e+00
-7.111819117251069855e+00,2.937469414945817370e+00,0.000000000000000000e+00
1.188200659083437927e+01,-3.459560370844172006e+00,0.000000000000000000e+00
3.763980582232898886e+00,6.079997397875869680e+00,0.000000000000000000e+00
-2.444132686299686608e+00,8.655025186859889530e+00,0.000000000000000000e+00
3.827248176924319178e+00,7.780625034062842005e+00,0.000000000000000000e+00
-2.518060036469188523e-01,1.345001652707794726e+01,0.000000000000000000e+00
-1.062124752956786367e+01,3.788639253029340459e+00,0.000000000000000000e+00
6.914686308755981337e+00,2.517928331085216964e+00,0.000000000000000000e+00
4.819454929706679991e+00,4.305957988922500590e+00,0.000000000000000000e+00
9.308607156157549412e+00,1.018017507427041402e+01,0.000000000000000000e+00
-2.644229094526551638e+00,1.308185169274385018e+01,0.000000000000000000e+00
-8.110820419917877944e-01,1.373132883726502484e+01,0.000000000000000000e+00
-7.336981746187526632e+00,2.633628829714826036e+00,0.000000000000000000e+00
-7.304144561890504761e+00,-4.985228209873077354e+00,0.000000000000000000e+00
-3.942089524730379768e+00,7.429147677138015382e+00,0.000000000000000000e+00
-1.563940960823078541e+00,-1.226771652324130102e+01,0.000000000000000000e+00
7.752633583239491699e+00,1.606933591460645960e+00,0.000000000000000000e+00
-4.644020567309505410e+00,-1.260416337454934776e+01,0.000000000000000000e+00
9.559905872637479263e+00,-2.069167693554651688e+00,0.000000000000000000e+00
6.510524870183760804e+00,1.055846542430648682e+01,0.000000000000000000e+00
7.709822285798955122e+00,2.414004778121223715e+00,0.000000000000000000e+00
-7.112111243945566486e+00,-9.955758248422416301e+00,0.000000000000000000e+00
2.826837256620440275e-01,9.890510484957566462e+00,0.000000000000000000e+00
3.043287967173990527e+00,-8.571990423685743821e+00,0.000000000000000000e+00
9.569832822923251214e+00,-3.349889908766237046e+00,0.000000000000000000e+00
2.825239466651834896e-01,8.493236936762546208e+00,0.000000000000000000e+00
-3.456625845444592837e+00,-1.112489309506036506e+01,0.000000000000000000e+00
4.009169731782363577e+00,1.000783306149301488e+01,0.000000000000000000e+00
4.688796243646584649e+00,1.281843321647803968e+01,0.000000000000000000e+00
-1.998966439837163600e+00,1.351012796539344230e+01,0.000000000000000000e+00
-5.633144883347592113e+00,-2.976004791943957617e+00,0.000000000000000000e+00
-1.071777719431886666e+01,8.746724717809167160e+00,0.000000000000000000e+00
6.933072615037868758e+00,-2.014502580037639490e+00,0.000000000000000000e+00
-3.996300934160016194e+00,-7.669085547264026914e+00,0.000000000000000000e+00
6.057410272621098102e+00,-2.652565982981485160e-01,0.000000000000000000e+00
-1.211110506752794613e+01,3.213092951287801480e+00,0.000000000000000000e+00
-2.660457520427601530e+00,9.541749783643794558e+00,0.000000000000000000e+00
5.677396269346377089e+00,-8.181021821215502143e+00,0.000000000000000000e+00
8.025138318366114021e+00,-1.384302439837393317e+00,0.000000000000000000e+00
7.007870666149849104e-01,-8.332889101745662330e+00,0.000000000000000000e+00
-2.561600053427863344e+00,-9.743204526040658564e+00,0.000000000000000000e+00
-7.680125944110861802e+00,7.501834896431613053e+00,0.000000000000000000e+00
-5.990419838503080463e+00,-1.634517124985244374e+00,0.000000000000000000e+00
-3.408750904602412479e+00,-1.011555207509729293e+01,0.000000000000000000e+00
-7.466990342399484781e+00,4.972154832211821862e+00,0.000000000000000000e+00
-1.385863376104194344e+01,-1.569697443999104047e+00,0.000000000000000000e+00
1.016630480502666245e+01,-5.786895095791383170e+00,0.000000000000000000e+00
2.138339060813499781e+00,9.235897157296232507e+00,0.000000000000000000e+00
9.784654375427050965e+00,3.223452669892223899e+00,0.000000000000000000e+00
-7.160947322329206166e+00,4.315264819978651897e-03,0.000000000000000000e+00
1.069526264501631019e+01,2.146676049265247688e+00,0.000000000000000000e+00
1.352531737671455403e+01,5.341317125800683074e-01,0.000000000000000000e+00
-8.204380562754867157e+00,2.958040506654077695e-01,0.000000000000000000e+00
-7.700927136434255083e+00,3.450173937237375643e+00,0.000000000000000000e+00
-6.162063854688403453e+00,-1.039351804719752614e+01,0.000000000000000000e+00
-7.622924349294661006e+00,-8.395757258940216516e+00,0.000000000000000000e+00
-4.781299924855306749e+00,-4.300113418931317710e+00,0.000000000000000000e+00
1.273936254270339319e+01,4.444056568979243949e+00,0.000000000000000000e+00
-6.212029468907783070e+00,6.412488301479442043e-01,0.000000000000000000e+00
-8.598454550560376219e+00,-9.505732040174901698e+00,0.000000000000000000e+00
-6.551844072080291070e+00,-2.597153824509962572e+00,0.000000000000000000e+00
5.406244662529976486e-01,-1.180744558537000977e+01,0.000000000000000000e+00
-1.223328107698617728e+01,2.534270081704574018e+00,0.000000000000000000e+00
-1.234205194892152413e+01,1.643521855276022237e+00,0.000000000000000000e+00
-9.493836137915996787e+00,9.746672478642727455e+00,0.000000000000000000e+00
-8.420488306810536727e+00,9.741715891244462355e+00,0.000000000000000000e+00
3.814812252424179650e+00,-1.095530939520013547e+01,0.000000000000000000e+00
7.408768607650642934e+00,-1.598252129266272581e+00,0.000000000000000000e+00
-8.954549145432116219e+00,-8.716215395331682103e+00,0.000000000000000000e+00
6.750393096483064959e+00,-8.732504927011085272e+00,0.000000000000000000e+00
-4.786803561513118588e+00,-8.222241820233284315e+00,0.000000000000000000e+00
-7.346628433171869865e+00,-5.200293638609803537e+00,0.000000000000000000e+00
1.416856726047263759e+00,1.122018551024202893e+01,0.000000000000000000e+00
7.209540291555192049e+00,3.896096344772451925e+00,0.000000000000000000e+00
-4.818795573205335359e+00,1.275527076454161524e+01,0.000000000000000000e+00
-3.600791011231857741e+00,-5.685619246095143353e+00,0.000000000000000000e+00
-1.303337576890614358e+01,1.454981134345443294e-01,0.000000000000000000e+00
-5.668879881725418457e+00,4.265559882994224949e+00,0.000000000000000000e+00
-1.336677225502713995e+01,-3.333565427677156023e+00,0.000000000000000000e+00
6.380063124213702253e+00,-8.694515196234624099e+00,0.000000000000000000e+00
7.958495857862243561e+00,5.662910911325223395e+00,0.000000000000000000e+00
4.971861734308737013e+00,-7.650823140952451418e+00,0.000000000000000000e+00
7.413214733587544458e+00,3.314437518815265271e+00,0.000000000000000000e+00
-8.665573289299810966e+00,2.579632707896181820e+00,0.000000000000000000e+00
9.929397321851664016e-01,1.355034933325041813e+01,0.000000000000000000e+00
5.360547077905177815e+00,-6.588248171721820867e+00,0.000000000000000000e+00
5.084186669565729844e+00,3.833783430598022512e+00,0.000000000000000000e+00
1.002670917279956520e+01,7.517106438066921470e+00,0.000000000000000000e+00
-4.992627975094395154e+00,-4.021636687013394607e+00,0.000000000000000000e+00
-1.072877553404850737e+01,3.393035849131368575e+00,0.000000000000000000e+00
-3.801811713125446524e+00,6.401279054144701774e+00,0.000000000000000000e+00
1.050052476588508199e+01,-2.890999409234909390e+00,0.000000000000000000e+00
1.004219115274414342e+01,-4.302461600016681542e-01,0.000000000000000000e+00
8.126291864264146625e+00,-2.062137138477090570e+00,0.000000000000000000e+00
8.532036146140371535e-01,-1.077703138089397683e+01,0.000000000000000000e+00
-7.709349249077324551e+00,-8.402083930252045363e+00,0.000000000000000000e+00
-3.158019423283696003e+00,-8.622525955647978080e+00,0.000000000000000000e+00
4.368821578430113206e+00,-9.280167433647054764e+00,0.000000000000000000e+00
-4.339665761257628596e+00,-9.873795252064214267e+00,0.000000000000000000e+00
-3.975662970089751114e-01,8.778761114131237164e+00,0.000000000000000000e+00
-1.005816644696833784e+01,2.676157423149173376e+00,0.000000000000000000e+00
7.976759622447467279e+00,1.488112982960128061e+00,0.000000000000000000e+00
-1.115846173131786756e+01,2.347405448698627328e+00,0.000000000000000000e+00
1.828795701256797024e+00,7.084758587571729826e+00,0.000000000000000000e+00
-8.182845482922107561e-01,-8.837635696617843095e+00,0.000000000000000000e+00
-1.216592766927463565e+01,4.182020621616657330e+00,0.000000000000000000e+00
7.545136762876549774e+00,9.945150848296330892e+00,0.000000000000000000e+00
1.296725766555409187e+01,2.779679035545373100e+00,0.000000000000000000e+00
-7.649802069554393569e+00,-7.912731844844135054e+00,0.000000000000000000e+00
1.450029305422914083e+00,6.154506368128457972e+00,0.000000000000000000e+00
1.126182752393684439e+01,3.820055905771543081e+00,0.000000000000000000e+00
4.114692346497415443e+00,-1.153298607052224334e+01,0.000000000000000000e+00
-2.985702422723075955e+00,-1.147272148740606212e+01,0.000000000000000000e+00
-8.817811375181157985e+00,-3.921949061901613298e+00,0.000000000000000000e+00
-6.137022608944259439e+00,-3.670673919963554521e+00,0.000000000000000000e+00
4.848399268197606027e+00,-8.253359306310066756e+00,0.000000000000000000e+00
3.710181045897119834e+00,-5.714956939008809300e+00,0.000000000000000000e+00
4.404261556429599267e+00,-5.179156225369094813e+00,0.000000000000000000e+00
8.480423471650485823e+00,5.505935081293400479e+00,0.000000000000000000e+00
2.676682092765721332e+00,6.755568695663916934e+00,0.000000000000000000e+00
1.349602128878756702e+01,-2.760280205910110141e+00,0.000000000000000000e+00
-6.354333628858702454e+00,1.566935815149126388e+00,0.000000000000000000e+00
9.652499414980560744e+00,-6.998124216434617573e+00,0.000000000000000000e+00
9.109090814919925450e+00,-2.885739466264036324e+00,0.000000000000000000e+00
9.424729913805274251e+00,-7.615755732057966298e+00,0.000000000000000000e+00
-2.298718457690322570e+00,-9.940854626658103044e+00,0.000000000000000000e+00
6.943235844908800303e+00,6.566408021322475363e+00,0.000000000000000000e+00
-1.179297227185062624e+01,3.148610988692310375e+00,0.000000000000000000e+00
5.675240778019130516e+00,-1.061068463254039251e+01,0.000000000000000000e+00
-9.296491368779978615e+00,-6.171290820394590426e+00,0.000000000000000000e+00
3.039700743392670379e+00,8.477483981078608011e+00,0.000000000000000000e+00
-8.279794421336692523e+00,-2.803017026074221985e+00,0.000000000000000000e+00
3.278886571257194849e+00,5.347735189350168561e+00,0.000000000000000000e+00
1.863827422845622195e+00,-1.290070719733525451e+01,0.000000000000000000e+00
-1.072330165521738898e+01,-3.802489649366284086e-01,0.000000000000000000e+00
-1.073258780920207656e+00,-6.213274218993801057e+00,0.000000000000000000e+00
-3.426478986566940055e+00,9.716814665952153263e+00,0.000000000000000000e+00
7.202327952088109164e+00,5.121600172933984396e+00,0.000000000000000000e+00
1.047836588896138110e+01,-6.382333863074792113e+00,0.000000000000000000e+00
5.811234604184800645e+00,-8.319298986500051285e+00,0.000000000000000000e+00
6.397475790321884404e+00,9.488321600312806581e+00,0.000000000000000000e+00
1.195201120691531926e+01,-5.297988414364907861e+00,0.000000000000000000e+00
7.727243630985335621e+00,7.010923292377260196e+00,0.000000000000000000e+00
5.752351514067115090e+00,6.369432858600823977e+00,0.000000000000000000e+00
1.044615088095522815e+01,6.462810993168848661e+00,0.000000000000000000e+00
-1.303394241626110395e+00,1.196422018477452553e+01,0.000000000000000000e+00
-8.135030836916312680e+00,1.024645229885290831e+00,0.000000000000000000e+00
1.839659788413228469e-01,-8.364308881586348221e+00,0.000000000000000000e+00
-5.300267485194837924e+00,1.161095589778359027e+01,0.000000000000000000e+00
-7.885508602691148283e+00,7.688147706153779737e+00,0.000000000000000000e+00
9.408419234037580736e+00,1.319904500240061340e+00,0.000000000000000000e+00
-8.887580366717934055e+00,6.848370446358720720e+00,0.000000000000000000e+00
1.484191788366077569e+00,-6.441161925269415001e+00,0.000000000000000000e+00
-1.230709578968634865e+01,-2.439418675346519461e+00,0.000000000000000000e+00
-4.264629326115078278e+00,9.834984899885139242e+00,0.000000000000000000e+00
1.346987501589731018e+01,-2.903988687159458237e+00,0.000000000000000000e+00
3.227677578327154517e+00,-9.940449883403619680e+00,0.000000000000000000e+00
6.497666163166413433e+00,1.081058228256788922e+01,0.000000000000000000e+00
-9.859128189279788401e+00,9.895946349967440270e+00,0.000000000000000000e+00
7.301566174542353238e+00,-8.244922402723963373e+00,0.000000000000000000e+00
-7.580699915211076778e+00,-1.591836124550713549e+00,0.000000000000000000e+00
-9.505532154825969471e+00,-7.032476220821989088e+00,0.000000000000000000e+00
1.340531295051455984e+01,-1.594081706516784713e+00,0.000000000000000000e+00
1.179244973371897842e+01,5.709177596323251613e+00,0.000000000000000000e+00
-6.487131766302675295e+00,2.093036300507789688e-02,0.000000000000000000e+00
3.427985069410309116e+00,-1.187787974618283648e+01,0.000000000000000000e+00
-1.408581976741892205e+01,1.625550970238727899e+01,1.000000000000000000e+00
-1.881043151933305424e+01,-2.621960441323269109e+00,1.000000000000000000e+00
-2.322581527025400305e+01,-2.667811322111456995e+00,1.000000000000000000e+00
-1.773818831811092167e+01,1.385242284258890422e+01,1.000000000000000000e+00
1.387531676297662742e+01,-1.674031384786129451e+01,1.000000000000000000e+00
1.524986377891802292e+01,-1.478608052582741550e+01,1.000000000000000000e+00
2.084600916661210945e+01,-7.837637204688920889e+00,1.000000000000000000e+00
-3.335846368905910797e+00,-1.661355464770509371e+01,1.000000000000000000e+00
-1.531546407337876659e+01,1.389103285498575069e+01,1.000000000000000000e+00
-5.862798124093491658e+00,-1.895705090151678007e+01,1.000000000000000000e+00
1.830567439264983065e+01,1.515095846689039405e+01,1.000000000000000000e+00
-7.641068875385179204e+00,1.491360609394572379e+01,1.000000000000000000e+00
-1.906664659447316978e+01,1.428824374903993499e+00,1.000000000000000000e+00
-7.634730107177073677e+00,2.021852265839935114e+01,1.000000000000000000e+00
-8.946142480307802458e+00,1.834914057483182859e+01,1.000000000000000000e+00
-1.841892096560701120e+01,3.968763401385180689e+00,1.000000000000000000e+00
-1.190606992324205393e+01,-1.480237550559005122e+01,1.000000000000000000e+00
-1.768958485332136732e+01,1.038413696695125665e+01,1.000000000000000000e+00
-8.501571361773706315e+00,-1.717272805437283267e+01,1.000000000000000000e+00
-5.775465720724419327e+00,2.002395286480275516e+01,1.000000000000000000e+00
2.134699125170529044e+01,-7.251398575296883031e+00,1.000000000000000000e+00
1.781413832072523107e+01,7.056121174639669036e+00,1.000000000000000000e+00
-1.649961768692056197e+01,-1.152300038742184007e+01,1.000000000000000000e+00
-2.199533523781454036e+01,-5.240369637901090449e+00,1.000000000000000000e+00
-2.022220219640516348e+01,5.295586840647683147e+00,1.000000000000000000e+00
7.274107302903876082e-01,2.027846444687708782e+01,1.000000000000000000e+00
-1.819994910579366376e+01,-1.401824275971767175e+00,1.000000000000000000e+00
-1.485594191132518915e+01,6.027297875184268960e+00,1.000000000000000000e+00
6.578620336695827575e+00,1.883714939585484771e+01,1.000000000000000000e+00
-1.627021459970769612e+01,-4.918490433325404254e+00,1.000000000000000000e+00
6.466932279519650884e+00,2.083347368624722407e+01,1.000000000000000000e+00
2.114204413327044207e+01,6.294073669553609918e+00,1.000000000000000000e+00
-1.524418191809297873e+01,-1.508795587492252821e+01,1.000000000000000000e+00
2.187864861441643072e+01,-7.572218157049059428e+00,1.000000000000000000e+00
-7.366372618457587285e-01,1.632196831778809454e+01,1.000000000000000000e+00
1.891861621373580959e+01,-9.648249362280228780e+00,1.000000000000000000e+00
-1.313160444416345385e+01,1.632701131849736598e+01,1.000000000000000000e+00
-1.934693546659212160e+01,-1.326870036449994394e+01,1.000000000000000000e+00
2.147968744797048402e+01,6.687445991361102848e+00,1.000000000000000000e+00
1.575066236102569661e+01,9.629654206912119818e+00,1.000000000000000000e+00
6.786805557994117777e+00,1.506120831288941808e+01,1.000000000000000000e+00
1.330151895443178311e+01,1.137041975833180629e+01,1.000000000000000000e+00
2.195150842243708489e+00,-1.760728806651117750e+01,1.000000000000000000e+00
2.200035505632448007e+01,-7.998043075783540345e+00,1.000000000000000000e+00
-1.082657318041693628e+00,2.030545540994938847e+01,1.000000000000000000e+00
-1.775421853022066188e+01,-8.550442106904826645e+00,1.000000000000000000e+00
1.659819141816188548e+01,-1.298883742117128470e+01,1.000000000000000000e+00
-1.855075329425867636e+01,-8.270103260125782896e+00,1.000000000000000000e+00
1.476912249740130001e+01,-1.043225192715721761e+01,1.000000000000000000e+00
2.164518554409495721e+01,3.836524661536647063e+00,1.000000000000000000e+00
-8.078122985740316508e+00,-1.381988479693678151e+01,1.000000000000000000e+00
1.783941024006371734e+01,-1.387961998757027970e+01,1.000000000000000000e+00
2.005823843660326133e+01,-7.994747011677134640e-01,1.000000000000000000e+00
9.751475655640280404e-01,-1.681306880565960427e+01,1.000000000000000000e+00
1.482893081542048463e+01,6.627858565599247243e+00,1.000000000000000000e+00
-1.488228819116111268e+01,-9.884994691517903220e+00,1.000000000000000000e+00
1.858342179644801462e+01,-1.320545419153004296e+01,1.000000000000000000e+00
4.031313603555224390e+00,2.069737823722174141e+01,1.000000000000000000e+00
-1.871196510041764682e+01,6.679055498330213059e-01,1.000000000000000000e+00
-8.187043865690890598e+00,-1.692392184362027052e+01,1.000000000000000000e+00
1.847298008645853074e+01,-1.092935052323345646e+00,1.000000000000000000e+00
-1.217784293794317962e+00,-1.958808310337123615e+01,1.000000000000000000e+00
1.177626505768050968e+01,-1.879290668870535796e+01,1.000000000000000000e+00
7.707126339575352425e+00,-1.829951136840453429e+01,1.000000000000000000e+00
1.505558382543773455e+01,8.480463032162875336e+00,1.000000000000000000e+00
-2.119393794989089130e+01,-9.816193422288213455e+00,1.000000000000000000e+00
4.384412174196432588e+00,-1.705187614748492564e+01,1.000000000000000000e+00
1.904163303190937739e+01,1.025881051909351527e+00,1.000000000000000000e+00
1.201792025011094012e+01,1.740326982067275097e+01,1.000000000000000000e+00
6.457082462408918033e+00,-1.559966047720136650e+01,1.000000000000000000e+00
2.105947251379482665e+01,-4.066524050310797556e+00,1.000000000000000000e+00
1.787357580991723438e+01,-2.135419503673841923e+00,1.000000000000000000e+00
1.955848548793692743e+01,7.401194442349940950e+00,1.000000000000000000e+00
-3.079446174618643006e+00,1.913038719229226814e+01,1.000000000000000000e+00
-9.217172216359992731e+00,1.527217041406997211e+01,1.000000000000000000e+00
8.224705590183873483e+00,2.017261461282702584e+01,1.000000000000000000e+00
-1.749777942338765868e+01,-1.151539351924551902e+01,1.000000000000000000e+00
1.034680190611704020e+01,-1.963754488396148545e+01,1.000000000000000000e+00
1.763095589337911662e+01,1.672278254557209687e+00,1.000000000000000000e+00
6.598337664677481840e+00,-1.977406797872303201e+01,1.000000000000000000e+00
1.042042874765041738e+01,-1.275830591034056560e+01,1.000000000000000000e+00
7.112518493809214526e+00,-1.462910665470060678e+01,1.000000000000000000e+00
-1.513599595923272645e+01,1.521037463861764927e+01,1.000000000000000000e+00
1.900245304385011735e+01,-2.367845735173759625e+00,1.000000000000000000e+00
3.696622127364966315e-01,-2.208322951401586565e+01,1.000000000000000000e+00
-1.674446563614008809e+01,4.548141850778240958e+00,1.000000000000000000e+00
-1.560169366657280854e+01,8.564550568764795813e+00,1.000000000000000000e+00
-1.358193781909342590e+01,-1.097790552661601460e+01,1.000000000000000000e+00
-2.240185634211720611e+01,-5.603200611514385088e+00,1.000000000000000000e+00
1.954452574678360932e+01,1.336835013392262539e+01,1.000000000000000000e+00
-2.858794153315326270e+00,-2.302730339878763388e+01,1.000000000000000000e+00
-2.455911165895627413e+00,-1.989143206333796599e+01,1.000000000000000000e+00
1.584364903763910171e+01,9.646518995433194021e+00,1.000000000000000000e+00
2.050691415187010591e+01,9.107882609707594890e-01,1.000000000000000000e+00
-1.798215621574233225e+01,-3.840035114518217885e+00,1.000000000000000000e+00
-5.218030398042513340e+00,-1.852003062825603408e+01,1.000000000000000000e+00
-1.626195615182393794e+01,7.999579969871203566e+00,1.000000000000000000e+00
-3.885580139627898166e+00,-2.126363182176448419e+01,1.000000000000000000e+00
1.622631703332194064e+01,-9.112886568774294815e+00,1.000000000000000000e+00
3.289233406699478834e+00,-1.578293616309770719e+01,1.000000000000000000e+00
-1.570206197463574149e+01,-8.112347071513182684e+00,1.000000000000000000e+00
-2.110023557641758885e+01,-3.414887568059537859e+00,1.000000000000000000e+00
-1.171737626436313207e+01,1.684019628289640735e+01,1.000000000000000000e+00
-8.229232676902782373e+00,2.025828909402180145e+01,1.000000000000000000e+00
-4.411049605760258174e+00,2.281047539610623431e+01,1.000000000000000000e+00
-1.361908495722199852e+01,-1.162599818090166970e+01,1.000000000000000000e+00
9.069239175919369345e+00,1.525657976920708592e+01,1.000000000000000000e+00
1.371782330866971433e+00,2.222735932935401237e+01,1.000000000000000000e+00
-1.631174401698077858e+01,1.912446542368404945e+00,1.000000000000000000e+00
1.586417992501583818e+01,1.720846638598678169e+01,1.000000000000000000e+00
-6.100250645849026654e+00,2.043729798858883839e+01,1.000000000000000000e+00
-1.514274173120179756e-01,2.396069878730597935e+01,1.000000000000000000e+00
-1.866751544404865371e+01,2.590085678608596620e+00,1.000000000000000000e+00
1.722152128357636514e+01,1.532105592989684695e+01,1.000000000000000000e+00
1.632359579219197698e+01,3.070645410049057666e-01,1.000000000000000000e+00
-8.919678180244551058e+00,-1.406553559794046571e+01,1.000000000000000000e+00
1.798477547300765522e+01,-5.923235847477148042e+00,1.000000000000000000e+00
2.199583586046353645e+01,-6.432991015706561733e+00,1.000000000000000000e+00
-1.210606087628472949e+01,2.056880706205652487e+01,1.000000000000000000e+00
-1.567761440016490049e+01,-3.755054263113921653e+00,1.000000000000000000e+00
-1.181109540423527449e+01,1.897725652574823130e+01,1.000000000000000000e+00
1.526917652603902731e+01,-7.398945499213142263e+00,1.000000000000000000e+00
1.830250107970536533e+01,6.669530402613020215e+00,1.000000000000000000e+00
1.603129138567219059e+01,-6.510980790719353983e+00,1.000000000000000000e+00
-1.087233064207762645e+01,-1.800804546254688887e+01,1.000000000000000000e+00
9.696425322760605425e+00,-1.842533650807427037e+01,1.000000000000000000e+00
-1.097641534077534509e+01,-1.950583983611138450e+01,1.000000000000000000e+00
8.940813979789155042e+00,-1.605524738886916225e+01,1.000000000000000000e+00
6.324123844534630834e+00,2.030224064707331166e+01,1.000000000000000000e+00
-5.771326940266628291e+00,-2.149899821913217934e+01,1.000000000000000000e+00
-1.640349684038727318e+01,8.764427348820412078e+00,1.000000000000000000e+00
-1.196200090186676768e+01,1.233173970011232612e+01,1.000000000000000000e+00
6.672753526427372961e+00,-1.613010582011700222e+01,1.000000000000000000e+00
-8.470705943984732755e+00,1.372223920783005191e+01,1.000000000000000000e+00
3.136527504609972095e+00,-1.574731525821545297e+01,1.000000000000000000e+00
8.779430717828166308e+00,-2.220454785260612240e+01,1.000000000000000000e+00
-1.975899624168256485e+00,1.647258011430297842e+01,1.000000000000000000e+00
1.230965878216300702e+01,1.843755303784963573e+01,1.000000000000000000e+00
1.198961865782439773e+01,1.906339524862348256e+01,1.000000000000000000e+00
-4.369594976406253051e-01,-2.136814521627741215e+01,1.000000000000000000e+00
-1.153596650343871488e+01,-1.746458284267908212e+01,1.000000000000000000e+00
-1.056519752895748177e+01,-1.354953930252310634e+01,1.000000000000000000e+00
-1.592817793746197097e+01,6.187303876972833905e+00,1.000000000000000000e+00
1.093463168032933197e+01,2.132341045954430214e+01,1.000000000000000000e+00
-8.235602869193467512e+00,-1.865641389752591550e+01,1.000000000000000000e+00
-1.454006125251376780e+01,-1.123985805024244300e+01,1.000000000000000000e+00
-2.565505190490253273e+00,-2.340626388938940394e+01,1.000000000000000000e+00
1.665974385519901801e+01,-1.374618648548013411e+00,1.000000000000000000e+00
-1.335309305414386571e+01,-1.796550630458822440e+01,1.000000000000000000e+00
-4.722899374382690141e+00,-1.892603425152083219e+01,1.000000000000000000e+00
-1.489728628889070983e+01,-1.687008779615263876e+01,1.000000000000000000e+00
-1.980491475369140275e+01,6.117387954710057585e+00,1.000000000000000000e+00
1.854552807015078386e+01,5.656321833644797792e+00,1.000000000000000000e+00
-3.308639090088201229e-01,-1.940405230026158279e+01,1.000000000000000000e+00
-2.159815288257910382e+01,4.646469071929907990e+00,1.000000000000000000e+00
-2.943940135645302991e+00,1.736966318086229322e+01,1.000000000000000000e+00
-2.142856753274137915e+01,-9.898798358668107866e+00,1.000000000000000000e+00
9.776476702853923229e+00,1.634405660464478061e+01,1.000000000000000000e+00
-1.177230338354111261e+01,2.016922706826369449e+01,1.000000000000000000e+00
1.906215669925919087e+01,-2.941195507582941918e-02,1.000000000000000000e+00
1.748929608461976670e+01,9.131879119712111859e+00,1.000000000000000000e+00
7.300506941667010530e+00,1.469949163685404514e+01,1.000000000000000000e+00
8.473729594218674777e+00,1.914678500486009227e+01,1.000000000000000000e+00
-1.499523124705943644e+01,-1.030882184404770996e+01,1.000000000000000000e+00
-1.629646418763191207e+01,1.348569901444114372e+00,1.000000000000000000e+00
2.035982484527372804e+01,9.022390579586556214e+00,1.000000000000000000e+00
2.137410489751234266e+01,7.494069355040792857e+00,1.000000000000000000e+00
1.597308023387855869e+01,6.080482802867658521e+00,1.000000000000000000e+00
1.443262597851837548e+01,-1.896843317146863228e+01,1.000000000000000000e+00
-4.315842059365481376e+00,1.705446539686293761e+01,1.000000000000000000e+00
1.319916894392426521e+01,1.805744511264430585e+01,1.000000000000000000e+00
-1.759058978629317949e+01,-1.548474985972600138e+01,1.000000000000000000e+00
2.082462611587753898e+01,6.607463476821727077e+00,1.000000000000000000e+00
-3.363806796273415944e+00,2.343131705141279042e+01,1.000000000000000000e+00
5.954366534199434291e+00,-2.066555709222398107e+01,1.000000000000000000e+00
-2.102278354426128715e+01,8.011343166285978867e+00,1.000000000000000000e+00
7.718584304440787136e+00,-1.437599354633448456e+01,1.000000000000000000e+00
1.385456135098922203e+01,1.074151357564068121e+01,1.000000000000000000e+00
1.994484467906970337e+01,1.235510224107671640e+01,1.000000000000000000e+00
-1.484191764160719273e+01,-1.012110610923690146e+01,1.000000000000000000e+00
3.244618917909689593e+00,2.051327067488236722e+01,1.000000000000000000e+00
-1.938406729755708113e+01,-8.688565304893570485e+00,1.000000000000000000e+00
1.478513249063537671e+01,-8.772792061643697181e+00,1.000000000000000000e+00
1.567437276707519622e+01,-8.946857092930706301e+00,1.000000000000000000e+00
1.282292163424287956e+01,2.002178021613681835e+01,1.000000000000000000e+00
-1.309994103974544366e+01,-1.530540351584944325e+01,1.000000000000000000e+00
2.065284590031502532e+01,8.986394708865578451e+00,1.000000000000000000e+00
-3.799884320062938858e+00,2.100214796945848050e+01,1.000000000000000000e+00
4.185996418896004712e-01,-1.932272879562866308e+01,1.000000000000000000e+00
-8.014643663295325515e-01,-2.145741140803774627e+01,1.000000000000000000e+00
3.867347210815940350e+00,2.090780355591596518e+01,1.000000000000000000e+00
1.799263625130667421e+01,9.927385959331937570e+00,1.000000000000000000e+00
3.886771499111138173e+00,1.791094324980342378e+01,1.000000000000000000e+00
-9.773760806932845213e+00,1.303976848378022702e+01,1.000000000000000000e+00
3.595550202052158473e-01,1.684261645691217524e+01,1.000000000000000000e+00
-2.032489831597553831e+01,1.152621995555932521e+01,1.000000000000000000e+00
-2.195941645981185886e+01,-8.896624415963758636e+00,1.000000000000000000e+00
-3.549846791126267220e+00,-1.636916020825658791e+01,1.000000000000000000e+00
-6.539620984264148396e-01,-2.384220191946839407e+01,1.000000000000000000e+00
-2.261051931966515216e+00,-1.609144845481474206e+01,1.000000000000000000e+00
9.062095432950300733e+00,8.410568609122412553e+00,0.000000000000000000e+00
-1.343405517875576327e-01,9.609814870236448314e+00,0.000000000000000000e+00
-1.176738926012567887e+01,4.803147976205272840e-02,0.000000000000000000e+00
-8.187928226885320404e-01,1.049254653793298786e+01,0.000000000000000000e+00
4.191120791997052564e+00,-4.859337353049694386e+00,0.000000000000000000e+00
7.278099468846941811e+00,4.440088331048181125e+00,0.000000000000000000e+00
-1.900275675122245822e+00,-6.757950269983900249e+00,0.000000000000000000e+00
-1.160051532664573593e+01,1.280720324354462258e+00,0.000000000000000000e+00
-6.734042851045059841e+00,-9.662029276543851353e+00,0.000000000000000000e+00
-1.590917618471234363e+00,-6.644126612710519630e+00,0.000000000000000000e+00
-9.658061682157873307e+00,-5.631666951657030573e+00,0.000000000000000000e+00
6.546514702885141146e-01,6.904946644254467358e+00,0.000000000000000000e+00
5.825089114426075909e+00,-2.076091058228922481e+00,0.000000000000000000e+00
-9.910757689306716856e+00,-5.394888599354432657e+00,0.000000000000000000e+00
-1.066332396060839649e+01,-3.174463528066445495e+00,0.000000000000000000e+00
-1.099429752168805585e+01,-5.286987975574418464e+00,0.000000000000000000e+00
8.375759989492184587e+00,6.733285003867059082e+00,0.000000000000000000e+00
8.244104799198593625e+00,-1.003506301778202925e+01,0.000000000000000000e+00
9.942981682567344492e+00,-8.636124563447859614e+00,0.000000000000000000e+00
8.033997548512344267e+00,2.515512562581684874e-01,0.000000000000000000e+00
-6.428504738220388148e+00,-5.097581256039596553e+00,0.000000000000000000e+00
-6.314421031249486838e+00,-5.175909050362075270e-01,0.000000000000000000e+00
1.164619887502898354e+00,-1.320994498120528782e+01,0.000000000000000000e+00
6.696829444560168376e+00,7.182729888738806245e+00,0.000000000000000000e+00
-4.235246305491734198e+00,-7.159356454934342473e+00,0.000000000000000000e+00
5.383052664452613989e+00,6.014628330823282631e+00,0.000000000000000000e+00
-7.446474143451298211e+00,-3.072619184086839539e+00,0.000000000000000000e+00
6.760530300065351383e+00,6.491756034733043634e+00,0.000000000000000000e+00
2.734445225180177186e+00,-6.903850617524835087e+00,0.000000000000000000e+00
-1.253932770562744814e+01,2.506102182116135779e+00,0.000000000000000000e+00
-8.312994495650205096e+00,-9.668901686019307107e+00,0.000000000000000000e+00
3.575184886406485685e+00,9.829701914520594386e+00,0.000000000000000000e+00
9.210873348198441946e+00,-4.658467065733349899e-01,0.000000000000000000e+00
2.294493514654305955e+00,-1.135717565800940143e+01,0.000000000000000000e+00
7.417559270330603916e+00,-4.122257939560736162e+00,0.000000000000000000e+00
7.852285329993975438e-01,-1.377764842065872308e+01,0.000000000000000000e+00
-8.592381094680053621e+00,-1.036725741900020736e+01,0.000000000000000000e+00
-9.463897506708443430e+00,-3.630513378318991791e+00,0.000000000000000000e+00
2.926882716663875783e+00,5.282811617135619642e+00,0.000000000000000000e+00
6.636824917046443950e+00,-6.325590953010028272e+00,0.000000000000000000e+00
-3.206988557987293653e+00,7.029410513631201063e+00,0.000000000000000000e+00
-4.483462085384717355e+00,-1.248765239318190368e+01,0.000000000000000000e+00
-8.204039706532734400e+00,-8.828124739392466225e+00,0.000000000000000000e+00
-4.491149550111644961e-01,-1.294422352630821038e+01,0.000000000000000000e+00
7.584652864309679998e+00,-5.780844478800141850e+00,0.000000000000000000e+00
-8.397574930127827741e+00,-6.072174091712802202e+00,0.000000000000000000e+00
9.536024040617339992e+00,-4.885791167647323796e+00,0.000000000000000000e+00
6.204913449369826139e+00,3.534932823231177856e+00,0.000000000000000000e+00
5.343362143920028728e+00,8.020288325263983609e+00,0.000000000000000000e+00
-1.100612678432352354e+01,8.711273195141605585e-01,0.000000000000000000e+00
4.041258899744661015e+00,-4.531661311465215114e+00,0.000000000000000000e+00
-1.081323332747492927e+01,-3.850249842643757026e-01,0.000000000000000000e+00
-1.651469177720229942e+00,9.092961241515524762e+00,0.000000000000000000e+00
-3.598983124757430652e+00,6.034186070324961015e+00,0.000000000000000000e+00
4.857977932252491193e+00,-4.455138316533950871e+00,0.000000000000000000e+00
-8.556999694314926685e+00,-9.276087351455689856e+00,0.000000000000000000e+00
1.646002476627940636e+00,5.914559167101281822e+00,0.000000000000000000e+00
-6.747697232463481853e+00,1.166916843249992475e+01,0.000000000000000000e+00
1.119233611961231745e+01,-7.945378535110935836e+00,0.000000000000000000e+00
-4.891468942769719774e+00,5.718555798419916236e+00,0.000000000000000000e+00
-5.016619212735019540e-01,6.283371595425017553e+00,0.000000000000000000e+00
-7.914146529220673187e+00,2.297769580684648982e+00,0.000000000000000000e+00
-6.976824699389136519e+00,-7.473491510144525840e+00,0.000000000000000000e+00
2.279976267026866676e-01,6.685022805602209850e+00,0.000000000000000000e+00
2.775182125658465004e+00,-6.530772876454421727e+00,0.000000000000000000e+00
-1.152484573953299751e+01,-3.781685492550360461e+00,0.000000000000000000e+00
-7.665724454478979766e+00,1.061841609529312258e+01,0.000000000000000000e+00
-6.050947749312078017e+00,-8.308928997465619304e+00,0.000000000000000000e+00
1.127772297836719950e+01,5.211296464343789125e+00,0.000000000000000000e+00
-1.113470689407102654e+01,6.260234650393305067e+00,0.000000000000000000e+00
2.341543601664675567e+00,7.532088552934100179e+00,0.000000000000000000e+00
-4.151751846745349361e+00,-7.490335637551074122e+00,0.000000000000000000e+00
-7.805147815211818774e+00,3.243245274640753184e+00,0.000000000000000000e+00
4.336434630574473204e+00,6.006705659813466269e+00,0.000000000000000000e+00
2.212679442407554653e+00,7.218280668172093684e+00,0.000000000000000000e+00
5.220755351664055688e+00,-4.094926467596918584e+00,0.000000000000000000e+00
1.112747926534001941e+01,3.850834041798686602e+00,0.000000000000000000e+00
-2.595587501786106532e+00,-9.806357366695770850e+00,0.000000000000000000e+00
-9.028343948742850955e+00,8.915749548117700485e+00,0.000000000000000000e+00
1.126634632652508117e+01,-6.482595170923743488e+00,0.000000000000000000e+00
-3.286842484116981655e+00,-7.646127648092450713e+00,0.000000000000000000e+00
7.419845811945131153e+00,9.565847320886607719e+00,0.000000000000000000e+00
5.978018377910639281e+00,1.217238176923184412e+01,0.000000000000000000e+00
-6.711146678585069303e+00,-4.722415378405640851e+00,0.000000000000000000e+00
-8.485783184510578891e+00,5.672952800632031334e+00,0.000000000000000000e+00
-1.144014291076578083e+01,-3.478202066131522052e+00,0.000000000000000000e+00
4.384873230300504687e+00,-5.549646589217950066e+00,0.000000000000000000e+00
-1.168300744153292747e+01,-5.194818386960251999e+00,0.000000000000000000e+00
-9.644136031176124835e-01,1.049805166565995762e+01,0.000000000000000000e+00
-6.536842892201116584e+00,5.345306757313686319e+00,0.000000000000000000e+00
8.438989962482976281e+00,-3.475208865011710557e+00,0.000000000000000000e+00
6.506186462480673782e+00,-3.744626303119004684e-01,0.000000000000000000e+00
-3.862160515126369820e+00,5.446476112276574355e+00,0.000000000000000000e+00
6.134051169689144878e+00,-1.978516060449600378e+00,0.000000000000000000e+00
1.185204996490637264e+01,-6.124766316013841028e+00,0.000000000000000000e+00
-4.859569339875388749e+00,6.353425638518374718e+00,0.000000000000000000e+00
-1.519343617847903394e+00,-1.248943950276429504e+01,0.000000000000000000e+00
-1.144861509135489541e+01,6.053286005181219842e+00,0.000000000000000000e+00
4.331788290673597608e+00,-6.109292230414607339e+00,0.000000000000000000e+00
3.334070762472415517e+00,5.456281297241006634e+00,0.000000000000000000e+00
-1.065870788968298122e+01,-2.340567870836013586e+00,0.000000000000000000e+00
-1.463630422294582845e+00,-1.001221660907637023e+01,0.000000000000000000e+00
-3.258706257441662313e+00,-1.088106300955284844e+01,0.000000000000000000e+00
6.275135646820408475e+00,-1.534938715019705135e+00,0.000000000000000000e+00
2.021073821693852857e+00,-8.018368767233782890e+00,0.000000000000000000e+00
-3.182102089242570653e+00,-1.088037918116285319e+01,0.000000000000000000e+00
5.481629019877129139e+00,1.022320040714743250e+01,0.000000000000000000e+00
-8.330105300232894194e+00,-8.288555228352629811e+00,0.000000000000000000e+00
-2.755674768703163746e+00,1.187433721777218132e+01,0.000000000000000000e+00
-4.683040648747073043e+00,8.164208797263796669e+00,0.000000000000000000e+00
1.119515335900578279e-01,1.335746486991257598e+01,0.000000000000000000e+00
6.700119633932653862e+00,1.082193885842432124e+01,0.000000000000000000e+00
-8.550301619333071201e+00,3.419675931901079213e+00,0.000000000000000000e+00
7.176748453521003768e+00,-1.025820308032380268e+01,0.000000000000000000e+00
-5.041595214606491737e+00,9.063531739248613661e+00,0.000000000000000000e+00
1.194486108691321880e+00,-1.044990485316076168e+01,0.000000000000000000e+00
-9.686906870031076977e+00,-3.619449339125635490e+00,0.000000000000000000e+00
-1.313845064569455801e+01,-8.365893417087570949e-01,0.000000000000000000e+00
4.065075556680537439e+00,-5.805028193121499314e+00,0.000000000000000000e+00
8.590045804906507598e+00,-1.083068171753233067e+01,0.000000000000000000e+00
5.126125837069420932e+00,-4.406654442924812010e+00,0.000000000000000000e+00
1.353837046348684758e+01,-5.790225488579785473e-01,0.000000000000000000e+00
1.111931563740836282e+01,-2.045835439299618752e+00,0.000000000000000000e+00
8.023788031578961366e+00,8.147772272168204211e+00,0.000000000000000000e+00
-7.017294184359236908e+00,5.831118776551057259e+00,0.000000000000000000e+00
-1.141949019659495335e+01,3.877836369592378762e+00,0.000000000000000000e+00
-6.568151289332938014e-02,1.385097687202117989e+01,0.000000000000000000e+00
1.198497403418259211e+01,5.562064536545864579e-02,0.000000000000000000e+00
-8.044794464020926128e+00,7.363341681713536646e-01,0.000000000000000000e+00
-1.338591590468644377e+01,-4.094229452548190373e+00,0.000000000000000000e+00
5.673372417420740055e-01,8.086269673969569638e+00,0.000000000000000000e+00
3.516308154983770695e+00,-6.695867415477852802e+00,0.000000000000000000e+00
1.281549230629557101e+01,5.502104265343782608e+00,0.000000000000000000e+00
6.978521281232607620e+00,4.489103854629955315e+00,0.000000000000000000e+00
-9.492072557224918938e+00,-2.860723420255278260e+00,0.000000000000000000e+00
6.435965292187971976e+00,-2.007430821741474691e+00,0.000000000000000000e+00
9.787301848081414235e+00,-3.385987285381478085e+00,0.000000000000000000e+00
-2.560272080421012397e+00,-1.060761918876632492e+01,0.000000000000000000e+00
-5.741879482881461882e+00,7.675351118488469737e+00,0.000000000000000000e+00
4.909833311186836191e+00,-7.884078238568854147e+00,0.000000000000000000e+00
8.530059544583025399e+00,-8.271604816591201725e+00,0.000000000000000000e+00
-8.137833035927506842e+00,4.752299354840485712e+00,0.000000000000000000e+00
-2.945364290828344167e+00,1.181024110146612216e+01,0.000000000000000000e+00
6.413013358841276101e+00,2.686811429118250771e+00,0.000000000000000000e+00
-4.330576883415815814e+00,-4.312151816386741388e+00,0.000000000000000000e+00
7.819651364870956911e+00,5.581944049584605771e+00,0.000000000000000000e+00
6.374923678964727003e+00,-3.591063433682733397e+00,0.000000000000000000e+00
3.920317473054968804e+00,-1.285867128337139675e+01,0.000000000000000000e+00
5.969112688202600658e+00,-1.199043474049174485e+01,0.000000000000000000e+00
2.206761741887119044e+00,1.231498183866549212e+01,0.000000000000000000e+00
-4.493238306901402301e-02,-1.241246581439543739e+01,0.000000000000000000e+00
-1.229500249305082527e+01,-3.152142610476000417e+00,0.000000000000000000e+00
-4.249457240746512987e+00,9.692207951492818552e+00,0.000000000000000000e+00
1.124606336305911114e+01,-7.885118833499940028e-01,0.000000000000000000e+00
-1.059106427242662107e+01,7.468063051536828034e+00,0.000000000000000000e+00
2.281377873306516868e+00,8.258766252373336059e+00,0.000000000000000000e+00
2.776342194763606885e-01,1.145304502140566072e+01,0.000000000000000000e+00
-1.779778342255576185e+00,1.103845161819147513e+01,0.000000000000000000e+00
-1.138825413050090596e+01,1.875254253119878145e+00,0.000000000000000000e+00
6.794503066116404089e-01,6.595367984622427571e+00,0.000000000000000000e+00
4.977831129044696823e+00,-4.344026277914559309e+00,0.000000000000000000e+00
1.741129599087095914e-01,-6.894034268664321452e+00,0.000000000000000000e+00
2.475097088111755106e+00,-1.093174226816173800e+01,0.000000000000000000e+00
3.991853833727508238e+00,1.121533736074506393e+01,0.000000000000000000e+00
-1.686119504345058084e+00,1.009423236139700819e+01,0.000000000000000000e+00
-1.317728548656465115e+01,4.029926630934554055e+00,0.000000000000000000e+00
-7.730210435536935876e+00,-3.848806311305841277e+00,0.000000000000000000e+00
-5.953807133460072620e+00,-6.561968042369668019e+00,0.000000000000000000e+00
4.341106468164319665e+00,5.866644648406567519e+00,0.000000000000000000e+00
-1.305998549861713798e+01,-3.139159220886123869e+00,0.000000000000000000e+00
-6.907088887148628231e+00,2.993819425329168560e+00,0.000000000000000000e+00
-7.307345974834201563e+00,-4.562759938513091029e+00,0.000000000000000000e+00
6.485560801850815515e+00,9.021112597985857517e-01,0.000000000000000000e+00
-9.370938668690817153e+00,-5.994195588713087552e+00,0.000000000000000000e+00
9.617050841017174889e+00,-8.612082699874843428e+00,0.000000000000000000e+00
9.409055950093341281e+00,-4.741431344911000156e-01,0.000000000000000000e+00
-2.289336158713492608e+00,-7.659638808729879678e+00,0.000000000000000000e+00
-1.380307893247301410e+00,-1.191093891786717762e+01,0.000000000000000000e+00
9.393772070883024128e+00,1.529664323780117297e+00,0.000000000000000000e+00
-1.516956642220887330e+00,-1.318124950821260200e+01,0.000000000000000000e+00
-7.540611170155883336e+00,-6.656209192745754955e+00,0.000000000000000000e+00
6.043360171054082741e+00,2.972465656442218052e+00,0.000000000000000000e+00
1.043883027536696773e+01,-9.223050403079646742e+00,0.000000000000000000e+00
-6.494305285412059980e+00,-9.357575042166038637e-01,0.000000000000000000e+00
-8.233458392848859830e+00,5.152019730950110343e+00,0.000000000000000000e+00
-8.182185219358300898e+00,2.576432004853596691e+00,0.000000000000000000e+00
-7.296388033822859498e+00,-9.827599822187037759e+00,0.000000000000000000e+00
1.086329745254326973e+01,-5.918393716619380074e-01,0.000000000000000000e+00
3.517974198525071650e+00,-6.776790760325667407e+00,0.000000000000000000e+00
-4.619640812695988252e+00,4.293083132292331072e+00,0.000000000000000000e+00
-7.575960827573930523e+00,1.906506832631534865e+00,0.000000000000000000e+00
4.216280904076635139e+00,-9.501055347552291863e+00,0.000000000000000000e+00
-3.913629666268576557e+00,-1.058803850666876833e+01,0.000000000000000000e+00
-5.407697948813054545e+00,9.037098612814480347e+00,0.000000000000000000e+00
-9.573363214934863308e+00,5.940753943407081294e+00,0.000000000000000000e+00
-4.206161487099325136e+00,-1.309635619914643634e+01,0.000000000000000000e+00
-1.847425878338489147e+00,-1.136719147233808869e+01,0.000000000000000000e+00
-6.538610721752731614e+00,6.888582381247962516e+00,0.000000000000000000e+00
7.392422157939151361e+00,-2.466102574943974446e+00,0.000000000000000000e+00
1.481439456830948798e+00,1.123186173935424748e+01,0.000000000000000000e+00
1.573273104063076921e+01,1.868971488131447956e+01,1.000000000000000000e+00
-1.099399377759256780e+01,2.390619522460748669e+01,1.000000000000000000e+00
2.147678989689537588e+01,-8.599456107960150586e-01,1.000000000000000000e+00
-2.627270035353325994e+01,-1.252577732524266185e+00,1.000000000000000000e+00
-2.818139029858682676e+01,-3.649359736607879157e+00,1.000000000000000000e+00
-2.628880642668411927e+00,2.321951252726932324e+01,1.000000000000000000e+00
4.756784474337030666e+00,2.277609552632346990e+01,1.000000000000000000e+00
1.085358516551754704e+01,2.244033595971868067e+01,1.000000000000000000e+00
9.953077736469481351e+00,2.433413308722969148e+01,1.000000000000000000e+00
7.897350785936433581e+00,-2.511574616187301956e+01,1.000000000000000000e+00
-2.686822103988273369e+01,-6.847214913897639477e+00,1.000000000000000000e+00
-2.281779599215670640e+00,-2.525501734479204430e+01,1.000000000000000000e+00
1.939928400570243738e+01,-1.464288091459299856e+01,1.000000000000000000e+00
-2.137322440460813056e+01,-4.253473020316800857e-01,1.000000000000000000e+00
-2.801982415469146659e+01,6.797937345022894706e-02,1.000000000000000000e+00
1.580530092266972098e+01,-1.944844405031079404e+01,1.000000000000000000e+00
8.514232141761185702e+00,2.578196439746885105e+01,1.000000000000000000e+00
9.161537436501838716e-01,2.126087176747068952e+01,1.000000000000000000e+00
-2.100910930376482355e+01,5.187756086794577115e+00,1.000000000000000000e+00
-1.887413186880452898e+01,-9.446453231504504444e+00,1.000000000000000000e+00
-1.244973267290554908e+01,-2.376720011280642453e+01,1.000000000000000000e+00
-8.636428179695197827e+00,-2.346212683200547389e+01,1.000000000000000000e+00
-2.000836523737761397e+01,-1.425301495177956035e+01,1.000000000000000000e+00
1.940837366976037259e+01,-1.393076839654248467e+01,1.000000000000000000e+00
-1.833469807838950416e+01,-1.346167122655688431e+01,1.000000000000000000e+00
2.494705394044481750e+01,-5.494995405026316782e+00,1.000000000000000000e+00
-1.665557705744208761e+01,-1.798221914000725263e+01,1.000000000000000000e+00
2.572752693938492641e+01,-1.311370549041896538e+01,1.000000000000000000e+00
-8.244290646775706222e+00,2.084206231459166858e+01,1.000000000000000000e+00
-7.885354738212532411e+00,2.116800800201663435e+01,1.000000000000000000e+00
-2.003647125145762686e+01,-6.608417731861560895e+00,1.000000000000000000e+00
6.209578562958157910e+00,-2.452260025417416500e+01,1.000000000000000000e+00
-2.173539700526108120e+01,-9.535163494027462106e-01,1.000000000000000000e+00
-1.224412708268634908e+01,-2.009421260915946306e+01,1.000000000000000000e+00
-1.075840330797242572e+01,1.858300890695775820e+01,1.000000000000000000e+00
-2.600534803198775435e+01,1.591213249083642367e+00,1.000000000000000000e+00
9.361088087715186745e+00,2.230199633678528315e+01,1.000000000000000000e+00
2.624073342088111715e+01,5.375489823808733192e+00,1.000000000000000000e+00
5.292561881430067672e+00,2.830901784997630344e+01,1.000000000000000000e+00
2.078059335633197335e+01,-5.406876312280275876e+00,1.000000000000000000e+00
1.797212134077285128e+01,1.974674511194298177e+01,1.000000000000000000e+00
1.418423831415259961e+00,2.824393733375810811e+01,1.000000000000000000e+00
-2.523700214170278855e+01,-1.302431052248969046e+01,1.000000000000000000e+00
-2.359325729631554225e+01,1.193588174281041958e+01,1.000000000000000000e+00
4.894404473767219876e+00,2.115271000609101293e+01,1.000000000000000000e+00
-1.569787656706957790e+01,-2.226072207802415903e+01,1.000000000000000000e+00
2.768855825457124098e+01,5.605075740675674822e+00,1.000000000000000000e+00
-2.387485343307933405e+01,8.035087859152445944e+00,1.000000000000000000e+00
2.228670073867370860e+01,-1.148109322020260592e+01,1.000000000000000000e+00
-1.585909433097451071e+01,2.303658854092108399e+01,1.000000000000000000e+00
2.357944877093274982e+01,-1.175374184082949114e+01,1.000000000000000000e+00
-1.480393836152355291e+01,2.187304118659174179e+01,1.000000000000000000e+00
1.913088892130262053e+01,-9.150390103571130140e+00,1.000000000000000000e+00
1.376147828505578374e+01,2.459517012664668911e+01,1.000000000000000000e+00
1.443518228384972168e+01,1.539166840543182602e+01,1.000000000000000000e+00
-1.093411572583228342e+01,2.157779792143726638e+01,1.000000000000000000e+00
1.457084675867774415e+01,2.058110886110986470e+01,1.000000000000000000e+00
1.456059238093794583e+01,-2.130944108185470753e+01,1.000000000000000000e+00
-8.355501425562577023e-01,-2.281181486053621299e+01,1.000000000000000000e+00
2.704093247153310031e+01,-8.429506993953767235e+00,1.000000000000000000e+00
-2.124312453800017408e+01,-1.526040990890658122e+01,1.000000000000000000e+00
-2.136641894209649095e+01,3.040648060253774432e-01,1.000000000000000000e+00
-2.612199279305723820e+01,2.209045858016001618e-01,1.000000000000000000e+00
-1.850413196330870136e+01,-1.133828795179985072e+01,1.000000000000000000e+00
2.110676114344656895e+01,-1.966560125193576170e+01,1.000000000000000000e+00
-1.065571376892860300e+01,-2.383858015746411851e+01,1.000000000000000000e+00
-2.481993646286784028e+01,-5.096020447884035853e+00,1.000000000000000000e+00
2.623216441805807619e+01,1.074989474234195796e+01,1.000000000000000000e+00
2.147028827385963012e+01,1.653440992215027450e+01,1.000000000000000000e+00
-9.217202701913098650e+00,2.489761654565133853e+01,1.000000000000000000e+00
-1.937546768872905290e+01,2.127878701127900740e+01,1.000000000000000000e+00
-5.924662594668204108e+00,-2.798573897331829130e+01,1.000000000000000000e+00
1.249879505486993736e+01,2.054501486018938294e+01,1.000000000000000000e+00
-1.429705926472585453e+01,1.731857462323765162e+01,1.000000000000000000e+00
2.506288393682114446e+01,1.023037004319879095e+00,1.000000000000000000e+00
-2.374518316171267429e+01,-4.110056212841346479e+00,1.000000000000000000e+00
-4.685801268652608265e+00,2.681770544346142415e+01,1.000000000000000000e+00
-1.636465900606647139e+01,-1.400104502066578860e+01,1.000000000000000000e+00
-3.820694096413083773e+00,-2.344946840684222877e+01,1.000000000000000000e+00
-2.730718148408208990e+01,-5.702233129672412026e+00,1.000000000000000000e+00
1.526350021196561180e+01,-2.195423474625367533e+01,1.000000000000000000e+00
-2.310367333743900531e+01,-3.529448810485903198e+00,1.000000000000000000e+00
2.214294872855819918e+01,-2.554368757533279410e+00,1.000000000000000000e+00
2.515511456743908880e+01,5.638475578451005443e-01,1.000000000000000000e+00
-2.610666366339259170e+01,6.393728951851616493e+00,1.000000000000000000e+00
-2.613636115978982843e+01,2.234408800128391270e+00,1.000000000000000000e+00
2.072443839280482791e+01,-4.241044169515961748e+00,1.000000000000000000e+00
-2.179363306807708511e+01,-2.219080654082041804e+00,1.000000000000000000e+00
-5.755683200863610516e+00,-2.649364343689698842e+01,1.000000000000000000e+00
-5.857497203861713686e+00,-2.647591147085865870e+01,1.000000000000000000e+00
-5.459558693088531811e+00,2.788104381472268400e+01,1.000000000000000000e+00
3.427184099803823325e-01,-2.407137911651751949e+01,1.000000000000000000e+00
1.061809394417809038e+01,-1.913013651650792468e+01,1.000000000000000000e+00
-6.170046215751034957e+00,2.688331541601552033e+01,1.000000000000000000e+00
2.677989002899861504e+01,3.021183912819540573e+00,1.000000000000000000e+00
1.083062130122765510e+01,-1.830172721846291850e+01,1.000000000000000000e+00
3.580835672240723522e+00,-2.239452967733392796e+01,1.000000000000000000e+00
-3.044557199432845529e+00,-2.688141071009908600e+01,1.000000000000000000e+00
-2.583745747369688672e+01,8.347225757017310954e+00,1.000000000000000000e+00
1.762724598409085175e+01,1.726998052121857441e+01,1.000000000000000000e+00
1.643060907548389693e+01,1.973520095431023336e+01,1.000000000000000000e+00
2.741842920091284341e+01,-2.610174934885582942e+00,1.000000000000000000e+00
-2.672059870628813272e+01,3.910225727005835900e-02,1.000000000000000000e+00
1.605260460268317502e+01,2.345994894291840183e+01,1.000000000000000000e+00
-2.049497282996839687e+01,-1.594388950125812521e+01,1.000000000000000000e+00
-2.638077417794028179e+01,-7.506860614897715500e+00,1.000000000000000000e+00
1.135912814594559705e+01,2.263410882293552362e+01,1.000000000000000000e+00
-2.131198135157140072e+01,5.342497366994218844e-01,1.000000000000000000e+00
-2.493192955221257279e+01,-3.390420038797758551e+00,1.000000000000000000e+00
-1.920154011348070000e+01,-1.668775834010846637e+01,1.000000000000000000e+00
-2.373950481351785768e+01,-1.189906327932049734e+01,1.000000000000000000e+00
1.720133100073515919e+01,-1.298798646107649546e+01,1.000000000000000000e+00
1.032928046222053275e+01,-2.109396432727021065e+01,1.000000000000000000e+00
1.632802282077261680e+01,2.024775105547126941e+01,1.000000000000000000e+00
1.994211809924351186e+01,2.077471006435687784e+01,1.000000000000000000e+00
2.568300097148087247e+01,-8.861716607679204216e+00,1.000000000000000000e+00
-2.239700074240493777e+01,3.534284268236923765e+00,1.000000000000000000e+00
-1.004781490610434602e+01,1.987594221138026285e+01,1.000000000000000000e+00
-2.291267046192328394e+01,-1.312952385196898675e+01,1.000000000000000000e+00
-2.083400139916478011e+01,1.367840467092887025e+01,1.000000000000000000e+00
-3.221901391570413331e+00,2.319656316993572887e+01,1.000000000000000000e+00
-1.615965062141641084e+01,-1.387331136271443199e+01,1.000000000000000000e+00
2.069747316736948761e+01,-1.147884159567122353e+01,1.000000000000000000e+00
2.486770183110991184e+01,-2.339728497108470862e-01,1.000000000000000000e+00
2.149483025993792040e+01,-5.457067273154549980e+00,1.000000000000000000e+00
2.178731583466868216e+01,-8.611277695152226741e+00,1.000000000000000000e+00
-2.819828929677607476e+01,1.494550304680388964e+00,1.000000000000000000e+00
2.497391257077165960e+01,-2.050764603404877651e+00,1.000000000000000000e+00
2.271904439997901903e+01,-5.323111949980447122e+00,1.000000000000000000e+00
-2.328784573925989676e+01,6.785810459573639042e-01,1.000000000000000000e+00
-2.848732005134823453e+01,-4.982707054711080219e-01,1.000000000000000000e+00
-2.165765020607312863e+01,1.352688804656367871e+01,1.000000000000000000e+00
7.967025472762848004e+00,-2.433312685834100009e+01,1.000000000000000000e+00
-2.119818411541692527e+01,-2.418414204064400330e+00,1.000000000000000000e+00
-1.558443623565947433e+01,1.641174419907369142e+01,1.000000000000000000e+00
-2.082915539559499862e+01,-7.437332431993692872e+00,1.000000000000000000e+00
2.559979330876547721e+01,-3.001953567538953926e+00,1.000000000000000000e+00
-1.360557447237118245e+00,-2.281304107613448906e+01,1.000000000000000000e+00
2.120883803732100858e+01,-1.446018697744938741e+01,1.000000000000000000e+00
1.391155978732186327e+01,-1.747318229034387826e+01,1.000000000000000000e+00
1.144475890863789580e+01,-1.972159647135347171e+01,1.000000000000000000e+00
-1.535318812347566109e+01,-2.144716578645262572e+01,1.000000000000000000e+00
-2.607594731370153074e+00,2.701312253739854796e+01,1.000000000000000000e+00
-1.334053456404284077e+01,-2.084889283182081599e+01,1.000000000000000000e+00
1.998640594085265221e+01,1.720332962609349536e+01,1.000000000000000000e+00
2.600535599273910492e+01,-1.276148460329973844e+01,1.000000000000000000e+00
2.053596390340138811e+01,6.685120048962751582e+00,1.000000000000000000e+00
2.218491300901504459e+01,2.621424574218144343e+00,1.000000000000000000e+00
2.422636853488194930e+01,-9.948171788084671618e+00,1.000000000000000000e+00
-2.033677988510935464e+01,1.620601851879276722e+01,1.000000000000000000e+00
1.779272758076690408e+01,1.297545655685749999e+01,1.000000000000000000e+00
1.170332534869767827e+01,2.323496705447028177e+01,1.000000000000000000e+00
1.943385226906604757e+01,-9.425801367760476168e+00,1.000000000000000000e+00
1.772384009512879643e+01,-1.820490739410527681e+01,1.000000000000000000e+00
1.840152047079322983e+01,-1.589728872981584828e+01,1.000000000000000000e+00
3.254618704199605528e+00,-2.694420946928563154e+01,1.000000000000000000e+00
-2.027940100142528124e+00,-2.357110419141051239e+01,1.000000000000000000e+00
-2.079785053187988808e+01,6.969151913322670033e+00,1.000000000000000000e+00
1.333160136635900805e+01,1.955228905670615447e+01,1.000000000000000000e+00
-2.337230297711032279e+01,4.946199771144971002e+00,1.000000000000000000e+00
2.824049165135675921e+01,2.421501932209903785e-01,1.000000000000000000e+00
-1.924952663450711654e+01,1.001865500041339097e+01,1.000000000000000000e+00
1.161828018995340273e+01,-2.316147917217766761e+01,1.000000000000000000e+00
-2.115519342857973228e+01,9.507389082689076787e+00,1.000000000000000000e+00
-1.631523968261841162e+01,1.663595577256764457e+01,1.000000000000000000e+00
2.478598127000429940e+01,-1.099951470185801483e+01,1.000000000000000000e+00
2.714127299805003801e+01,-4.214881301056182750e+00,1.000000000000000000e+00
-2.031208480873932842e+01,5.489224324605968874e+00,1.000000000000000000e+00
1.131393395507636335e+01,-1.911809820478688593e+01,1.000000000000000000e+00
9.872220307355086266e-01,2.477132951265166483e+01,1.000000000000000000e+00
2.368443361556522220e+01,6.908070614196779147e+00,1.000000000000000000e+00
-6.550111289632817524e+00,-2.362637227568149356e+01,1.000000000000000000e+00
7.142292479753053591e+00,-2.807003130402094726e+01,1.000000000000000000e+00
9.220217262888104059e+00,2.318491894192909797e+01,1.000000000000000000e+00
-1.278070362574096563e+01,2.491815532847987313e+01,1.000000000000000000e+00
1.544822472767310906e+01,-1.905927650362333736e+01,1.000000000000000000e+00
-1.782148007375803545e+01,-1.270499655956880680e+01,1.000000000000000000e+00
-2.598083105734318821e+01,-1.166340717489061873e+01,1.000000000000000000e+00
-2.115329431705612961e+01,1.922103940750838902e+01,1.000000000000000000e+00
-8.572106253750373384e+00,2.167156366831950720e+01,1.000000000000000000e+00
-2.222844308368978616e+01,1.216371128338294305e+01,1.000000000000000000e+00
-1.460159793703849296e+01,-1.873375216063436000e+01,1.000000000000000000e+00
-2.171765776703275463e+01,-1.476020540458901920e+01,1.000000000000000000e+00
-4.238550116190669570e+00,-2.389972003984688698e+01,1.000000000000000000e+00
6.165939327369154732e+00,-2.683570375136353903e+01,1.000000000000000000e+00
1.719572832923617156e+01,1.677410597119486368e+01,1.000000000000000000e+00
1.873103075511164661e+01,1.918492263728331793e+01,1.000000000000000000e+00
-9.227368178597460613e+00,-2.473440238093422394e+01,1.000000000000000000e+00
-1.831003118936073193e+01,2.071120293221047959e+01,1.000000000000000000e+00
1.351990022808921310e+01,-2.261653460112551173e+01,1.000000000000000000e+00
2.850165519451800833e+01,4.157533834040251897e+00,1.000000000000000000e+00
-1.993243840613153850e+01,8.919474195504907499e+00,1.000000000000000000e+00
2.363463868162161319e+01,1.369461759608625684e+01,1.000000000000000000e+00
-2.178992915483502557e+01,1.301881154832546628e+00,1.000000000000000000e+00
2.022320544459192959e+01,-1.805379750173514708e+01,1.000000000000000000e+00
-7.998643143606845918e+00,-2.319610733875643760e+01,1.000000000000000000e+00
2.618081162402923923e+01,1.037024573479389034e+01,1.000000000000000000e+00
2.127632507298599407e+01,8.437198622827882799e-01,1.000000000000000000e+00
-1.407077715450147792e+01,-2.020577296356315955e+01,1.000000000000000000e+00
2.293969907863483115e+01,-1.194796862278524108e+00,1.000000000000000000e+00

+ 6
- 4
tips/datasets.ipynb
File diff suppressed because it is too large
View File


+ 4
- 4
tips/notebook_tips.ipynb View File

@@ -10,7 +10,7 @@
},
{
"cell_type": "code",
"execution_count": 7,
"execution_count": 1,
"metadata": {},
"outputs": [
{
@@ -48,7 +48,7 @@
"<IPython.core.display.HTML object>"
]
},
"execution_count": 7,
"execution_count": 1,
"metadata": {},
"output_type": "execute_result"
}
@@ -87,7 +87,7 @@
},
{
"cell_type": "code",
"execution_count": 6,
"execution_count": 2,
"metadata": {},
"outputs": [
{
@@ -104,7 +104,7 @@
"<IPython.core.display.Latex object>"
]
},
"execution_count": 6,
"execution_count": 2,
"metadata": {},
"output_type": "execute_result"
}


+ 0
- 55
tips/requirements.txt View File

@@ -1,55 +0,0 @@
#
# pre-requirements (use python3.5 for better compability)
# sudo apt-get install python3.5 python3.5-dev
# sudo apt-get install python3-tk
#

#
# pip
# sudo apt-get install python-pip python3-pip
# pip install pip -U
# pip config set global.index-url 'https://mirrors.ustc.edu.cn/pypi/web/simple'
#

#
# Install virtualenv
# pip install setuptools
# pip install virtualenv
# pip install virtualenvwrapper
# pip install virtualenvwrapper-win  #Windows使用该命令
#
# Add following lines to `~/.bashrc`
# # virtualenv
# export VIRTUALENVWRAPPER_PYTHON=/usr/bin/python
# export WORKON_HOME=/home/bushuhui/virtualenv
# source /usr/local/bin/virtualenvwrapper.sh 
#
# Usage:
# # create virtual env
# mkvirtualenv --python=/usr/local/python3.5.3/bin/python venv
#
# # active virtual env
# workon venv
#

#
# Install this list packages:
# pip install -r requirements.txt
#


numpy
matplotlib==3.0.3
sklearn
statsmodels
pandas==0.24.2
ipython
jupyter

fire
torchvision
visdom
jieba
ipdb
tqdm


+ 5
- 0
tips/构建深度神经网络的一些实战建议.md View File

@@ -6,6 +6,11 @@



更多详细的深度学习技巧等可以参考:
* [Machine Learning Yearning 中文版 - 《机器学习训练秘籍》](https://github.com/deeplearning-ai/machine-learning-yearning-cn) ([在线阅读](https://deeplearning-ai.github.io/machine-learning-yearning-cn/))



## 常见的一些tips

**1、使用Adam作为优化器。** Adam优化效果非常好。与传统的优化器(optimizer),如传统的梯度下降法,它应该是首选。Tensorflow实践笔记:当保存和回复模型参数时,设置AdamOptimizer之后,一定记得设置Saver,因为Adam有些state也需要恢复(即每个weight的学习率)。


Loading…
Cancel
Save