OpenI
/
graphkit-learn
Not watched
1
0
Fork 0
Code
Releases 2 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
Tree: 933a51a12f
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '933a51a12f'
${ noResults }
graphkit-learn/docs/_build/html/_modules/pygraph/utils/trie.html

300 lines
21 kB
Raw Blame History 

  1. 

  2. 

  3. <!DOCTYPE html>

  4. <!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->

  5. <!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->

  6. <head>

  7.   <meta charset="utf-8">

  8.   

  9.   <meta name="viewport" content="width=device-width, initial-scale=1.0">

  10.   

  11.   <title>pygraph.utils.trie &mdash; py-graph  documentation</title>

  12.   

  13. 

  14.   

  15.   

  16.   

  17.   

  18. 

  19.   

  20.   <script type="text/javascript" src="../../../_static/js/modernizr.min.js"></script>

  21.   

  22.     

  23.       <script type="text/javascript" id="documentation_options" data-url_root="../../../" src="../../../_static/documentation_options.js"></script>

  24.         <script type="text/javascript" src="../../../_static/jquery.js"></script>

  25.         <script type="text/javascript" src="../../../_static/underscore.js"></script>

  26.         <script type="text/javascript" src="../../../_static/doctools.js"></script>

  27.         <script async="async" type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.1/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>

  28.     

  29.     <script type="text/javascript" src="../../../_static/js/theme.js"></script>

  30. 

  31.     

  32. 

  33.   

  34.   <link rel="stylesheet" href="../../../_static/css/theme.css" type="text/css" />

  35.   <link rel="stylesheet" href="../../../_static/pygments.css" type="text/css" />

  36.     <link rel="index" title="Index" href="../../../genindex.html" />

  37.     <link rel="search" title="Search" href="../../../search.html" /> 

  38. </head>

  39. 

  40. <body class="wy-body-for-nav">

  41. 

  42.    

  43.   <div class="wy-grid-for-nav">

  44.     

  45.     <nav data-toggle="wy-nav-shift" class="wy-nav-side">

  46.       <div class="wy-side-scroll">

  47.         <div class="wy-side-nav-search" >

  48.           

  49. 

  50.           

  51.             <a href="../../../index.html" class="icon icon-home"> py-graph

  52.           

  53. 

  54.           

  55.           </a>

  56. 

  57.           

  58.             

  59.             

  60.               <div class="version">

  61.                 1.0

  62.               </div>

  63.             

  64.           

  65. 

  66.           

  67. <div role="search">

  68.   <form id="rtd-search-form" class="wy-form" action="../../../search.html" method="get">

  69.     <input type="text" name="q" placeholder="Search docs" />

  70.     <input type="hidden" name="check_keywords" value="yes" />

  71.     <input type="hidden" name="area" value="default" />

  72.   </form>

  73. </div>

  74. 

  75.           

  76.         </div>

  77. 

  78.         <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">

  79.           

  80.             

  81.             

  82.               

  83.             

  84.             

  85.               <!-- Local TOC -->

  86.               <div class="local-toc"></div>

  87.             

  88.           

  89.         </div>

  90.       </div>

  91.     </nav>

  92. 

  93.     <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">

  94. 

  95.       

  96.       <nav class="wy-nav-top" aria-label="top navigation">

  97.         

  98.           <i data-toggle="wy-nav-top" class="fa fa-bars"></i>

  99.           <a href="../../../index.html">py-graph</a>

  100.         

  101.       </nav>

  102. 

  103. 

  104.       <div class="wy-nav-content">

  105.         

  106.         <div class="rst-content">

  107.         

  108.           

  109. 

  110. 

  111. 

  112. 

  113. 

  114. 

  115. 

  116. 

  117. 

  118. 

  119. 

  120. 

  121. 

  122. 

  123. 

  124. <div role="navigation" aria-label="breadcrumbs navigation">

  125. 

  126.   <ul class="wy-breadcrumbs">

  127.     

  128.       <li><a href="../../../index.html">Docs</a> &raquo;</li>

  129.         

  130.           <li><a href="../../index.html">Module code</a> &raquo;</li>

  131.         

  132.       <li>pygraph.utils.trie</li>

  133.     

  134.     

  135.       <li class="wy-breadcrumbs-aside">

  136.         

  137.       </li>

  138.     

  139.   </ul>

  140. 

  141.   

  142.   <hr/>

  143. </div>

  144.           <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">

  145.            <div itemprop="articleBody">

  146.             

  147.   <h1>Source code for pygraph.utils.trie</h1><div class="highlight"><pre>

  148. <span></span><span class="ch">#!/usr/bin/env python3</span>

  149. <span class="c1"># -*- coding: utf-8 -*-</span>

  150. <span class="sd">&quot;&quot;&quot;</span>

  151. <span class="sd">Created on Wed Jan 30 10:48:49 2019</span>

  152. 

  153. <span class="sd">Trie (prefix tree)</span>

  154. <span class="sd">@author: ljia</span>

  155. <span class="sd">@references:</span>

  156. <span class="sd">        https://viblo.asia/p/nlp-build-a-trie-data-structure-from-scratch-with-python-3P0lPzroKox, 2019.1</span>

  157. <span class="sd">&quot;&quot;&quot;</span>

  158. 

  159. <span class="kn">import</span> <span class="nn">pickle</span>

  160. <span class="kn">import</span> <span class="nn">json</span>

  161. 

  162. <span class="sd">&quot;&quot;&quot; Trie class</span>

  163. <span class="sd">&quot;&quot;&quot;</span>

  164. <div class="viewcode-block" id="Trie"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie">[docs]</a><span class="k">class</span> <span class="nc">Trie</span><span class="p">:</span>

  165.     <span class="c1"># init Trie class</span>

  166.     <span class="k">def</span> <span class="nf">__init__</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>

  167.         <span class="bp">self</span><span class="o">.</span><span class="n">root</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">getNode</span><span class="p">()</span>

  168. 

  169. <div class="viewcode-block" id="Trie.getNode"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.getNode">[docs]</a>    <span class="k">def</span> <span class="nf">getNode</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>

  170.         <span class="k">return</span> <span class="p">{</span><span class="s2">&quot;isEndOfWord&quot;</span><span class="p">:</span> <span class="kc">False</span><span class="p">,</span> <span class="s2">&quot;children&quot;</span><span class="p">:</span> <span class="p">{}}</span></div>

  171. 

  172. <div class="viewcode-block" id="Trie.insertWord"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.insertWord">[docs]</a>    <span class="k">def</span> <span class="nf">insertWord</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">word</span><span class="p">):</span>

  173.         <span class="n">current</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">root</span>

  174.         <span class="k">for</span> <span class="n">ch</span> <span class="ow">in</span> <span class="n">word</span><span class="p">:</span>

  175. 

  176.             <span class="k">if</span> <span class="n">ch</span> <span class="ow">in</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">]:</span>

  177.                 <span class="n">node</span> <span class="o">=</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">][</span><span class="n">ch</span><span class="p">]</span>

  178.             <span class="k">else</span><span class="p">:</span>

  179.                 <span class="n">node</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">getNode</span><span class="p">()</span>

  180.                 <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">][</span><span class="n">ch</span><span class="p">]</span> <span class="o">=</span> <span class="n">node</span>

  181. 

  182.             <span class="n">current</span> <span class="o">=</span> <span class="n">node</span>

  183.         <span class="n">current</span><span class="p">[</span><span class="s2">&quot;isEndOfWord&quot;</span><span class="p">]</span> <span class="o">=</span> <span class="kc">True</span>

  184.         <span class="k">if</span> <span class="s1">&#39;count&#39;</span> <span class="ow">in</span> <span class="n">current</span><span class="p">:</span>

  185.             <span class="n">current</span><span class="p">[</span><span class="s1">&#39;count&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="mi">1</span>

  186.         <span class="k">else</span><span class="p">:</span>

  187.             <span class="n">current</span><span class="p">[</span><span class="s1">&#39;count&#39;</span><span class="p">]</span> <span class="o">=</span> <span class="mi">1</span></div>

  188. 

  189. <div class="viewcode-block" id="Trie.searchWord"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.searchWord">[docs]</a>    <span class="k">def</span> <span class="nf">searchWord</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">word</span><span class="p">):</span>

  190.         <span class="n">current</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">root</span>

  191.         <span class="k">for</span> <span class="n">ch</span> <span class="ow">in</span> <span class="n">word</span><span class="p">:</span>

  192.             <span class="k">if</span> <span class="n">ch</span> <span class="ow">not</span> <span class="ow">in</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">]:</span>

  193.                 <span class="k">return</span> <span class="mi">0</span>

  194.             <span class="n">node</span> <span class="o">=</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">][</span><span class="n">ch</span><span class="p">]</span>

  195. 

  196.             <span class="n">current</span> <span class="o">=</span> <span class="n">node</span>

  197.         <span class="k">if</span> <span class="s1">&#39;count&#39;</span> <span class="ow">in</span> <span class="n">current</span><span class="p">:</span>

  198.             <span class="k">return</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;count&quot;</span><span class="p">]</span>

  199.         <span class="k">else</span><span class="p">:</span>

  200.             <span class="k">return</span> <span class="mi">0</span></div>

  201. 

  202. <div class="viewcode-block" id="Trie.searchWordPrefix"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.searchWordPrefix">[docs]</a>    <span class="k">def</span> <span class="nf">searchWordPrefix</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">word</span><span class="p">):</span>

  203.         <span class="n">current</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">root</span>

  204.         <span class="k">for</span> <span class="n">ch</span> <span class="ow">in</span> <span class="n">word</span><span class="p">:</span>

  205.             <span class="k">if</span> <span class="ow">not</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">]</span><span class="o">.</span><span class="n">has_key</span><span class="p">(</span><span class="n">ch</span><span class="p">):</span>

  206.                 <span class="k">return</span> <span class="kc">False</span>

  207.             <span class="n">node</span> <span class="o">=</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">][</span><span class="n">ch</span><span class="p">]</span>

  208. 

  209.             <span class="n">current</span> <span class="o">=</span> <span class="n">node</span>

  210.         <span class="c1"># return True if children contain keys and values</span>

  211.         <span class="k">return</span> <span class="nb">bool</span><span class="p">(</span><span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">])</span></div>

  212. 

  213. <div class="viewcode-block" id="Trie.deleteWord"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.deleteWord">[docs]</a>    <span class="k">def</span> <span class="nf">deleteWord</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">word</span><span class="p">):</span>

  214.         <span class="bp">self</span><span class="o">.</span><span class="n">_delete</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">root</span><span class="p">,</span> <span class="n">word</span><span class="p">,</span> <span class="mi">0</span><span class="p">)</span></div>

  215. 

  216.     <span class="k">def</span> <span class="nf">_delete</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">current</span><span class="p">,</span> <span class="n">word</span><span class="p">,</span> <span class="n">index</span><span class="p">):</span>

  217.         <span class="k">if</span><span class="p">(</span><span class="n">index</span> <span class="o">==</span> <span class="nb">len</span><span class="p">(</span><span class="n">word</span><span class="p">)):</span>

  218.             <span class="k">if</span> <span class="ow">not</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;isEndOfWord&quot;</span><span class="p">]:</span>

  219.                 <span class="k">return</span> <span class="kc">False</span>

  220.             <span class="n">current</span><span class="p">[</span><span class="s2">&quot;isEndOfWord&quot;</span><span class="p">]</span> <span class="o">=</span> <span class="kc">False</span>

  221.             <span class="k">return</span> <span class="nb">len</span><span class="p">(</span><span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">]</span><span class="o">.</span><span class="n">keys</span><span class="p">())</span> <span class="o">==</span> <span class="mi">0</span>

  222. 

  223.         <span class="n">ch</span> <span class="o">=</span> <span class="n">word</span><span class="p">[</span><span class="n">index</span><span class="p">]</span>

  224.         <span class="k">if</span> <span class="ow">not</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">]</span><span class="o">.</span><span class="n">has_key</span><span class="p">(</span><span class="n">ch</span><span class="p">):</span>

  225.             <span class="k">return</span> <span class="kc">False</span>

  226.         <span class="n">node</span> <span class="o">=</span> <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">][</span><span class="n">ch</span><span class="p">]</span>

  227. 

  228.         <span class="n">should_delete_current_node</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">_delete</span><span class="p">(</span><span class="n">node</span><span class="p">,</span> <span class="n">word</span><span class="p">,</span> <span class="n">index</span> <span class="o">+</span> <span class="mi">1</span><span class="p">)</span>

  229. 

  230.         <span class="k">if</span> <span class="n">should_delete_current_node</span><span class="p">:</span>

  231.             <span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">]</span><span class="o">.</span><span class="n">pop</span><span class="p">(</span><span class="n">ch</span><span class="p">)</span>

  232.             <span class="k">return</span> <span class="nb">len</span><span class="p">(</span><span class="n">current</span><span class="p">[</span><span class="s2">&quot;children&quot;</span><span class="p">]</span><span class="o">.</span><span class="n">keys</span><span class="p">())</span> <span class="o">==</span> <span class="mi">0</span>

  233. 

  234.         <span class="k">return</span> <span class="kc">False</span>

  235. 

  236. <div class="viewcode-block" id="Trie.save_to_pickle"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.save_to_pickle">[docs]</a>    <span class="k">def</span> <span class="nf">save_to_pickle</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">file_name</span><span class="p">):</span>

  237.         <span class="n">f</span> <span class="o">=</span> <span class="nb">open</span><span class="p">(</span><span class="n">file_name</span> <span class="o">+</span> <span class="s2">&quot;.pkl&quot;</span><span class="p">,</span> <span class="s2">&quot;wb&quot;</span><span class="p">)</span>

  238.         <span class="n">pickle</span><span class="o">.</span><span class="n">dump</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">root</span><span class="p">,</span> <span class="n">f</span><span class="p">)</span>

  239.         <span class="n">f</span><span class="o">.</span><span class="n">close</span><span class="p">()</span></div>

  240. 

  241. <div class="viewcode-block" id="Trie.load_from_pickle"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.load_from_pickle">[docs]</a>    <span class="k">def</span> <span class="nf">load_from_pickle</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">file_name</span><span class="p">):</span>

  242.         <span class="n">f</span> <span class="o">=</span> <span class="nb">open</span><span class="p">(</span><span class="n">file_name</span> <span class="o">+</span> <span class="s2">&quot;.pkl&quot;</span><span class="p">,</span> <span class="s2">&quot;rb&quot;</span><span class="p">)</span>

  243.         <span class="bp">self</span><span class="o">.</span><span class="n">root</span> <span class="o">=</span> <span class="n">pickle</span><span class="o">.</span><span class="n">load</span><span class="p">(</span><span class="n">f</span><span class="p">)</span>

  244.         <span class="n">f</span><span class="o">.</span><span class="n">close</span><span class="p">()</span></div>

  245.         

  246. <div class="viewcode-block" id="Trie.to_json"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.to_json">[docs]</a>    <span class="k">def</span> <span class="nf">to_json</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>

  247.         <span class="k">return</span> <span class="n">json</span><span class="o">.</span><span class="n">dump</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">root</span><span class="p">)</span></div>

  248. 

  249. <div class="viewcode-block" id="Trie.save_to_json"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.save_to_json">[docs]</a>    <span class="k">def</span> <span class="nf">save_to_json</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">file_name</span><span class="p">):</span>

  250.         <span class="n">json_data</span> <span class="o">=</span> <span class="n">json</span><span class="o">.</span><span class="n">dumps</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">root</span><span class="p">)</span>

  251.         <span class="n">f</span> <span class="o">=</span> <span class="nb">open</span><span class="p">(</span><span class="n">file_name</span> <span class="o">+</span> <span class="s2">&quot;.json&quot;</span><span class="p">,</span> <span class="s2">&quot;w&quot;</span><span class="p">)</span>

  252.         <span class="n">f</span><span class="o">.</span><span class="n">write</span><span class="p">(</span><span class="n">json_data</span><span class="p">)</span>

  253.         <span class="n">f</span><span class="o">.</span><span class="n">close</span><span class="p">()</span></div>

  254. 

  255. <div class="viewcode-block" id="Trie.load_from_json"><a class="viewcode-back" href="../../../pygraph.utils.html#pygraph.utils.trie.Trie.load_from_json">[docs]</a>    <span class="k">def</span> <span class="nf">load_from_json</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">file_name</span><span class="p">):</span>

  256.         <span class="n">json_file</span> <span class="o">=</span> <span class="nb">open</span><span class="p">(</span><span class="n">file_name</span> <span class="o">+</span> <span class="s2">&quot;.json&quot;</span><span class="p">,</span> <span class="s2">&quot;r&quot;</span><span class="p">)</span>

  257.         <span class="bp">self</span><span class="o">.</span><span class="n">root</span> <span class="o">=</span> <span class="n">json</span><span class="o">.</span><span class="n">load</span><span class="p">(</span><span class="n">json_file</span><span class="p">)</span>

  258.         <span class="n">json_file</span><span class="o">.</span><span class="n">close</span><span class="p">()</span></div></div>

  259. </pre></div>

  260. 

  261.            </div>

  262.            

  263.           </div>

  264.           <footer>

  265.   

  266. 

  267.   <hr/>

  268. 

  269.   <div role="contentinfo">

  270.     <p>

  271.         &copy; Copyright 2020, Linlin Jia

  272. 

  273.     </p>

  274.   </div>

  275.   Built with <a href="http://sphinx-doc.org/">Sphinx</a> using a <a href="https://github.com/rtfd/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>. 

  276. 

  277. </footer>

  278. 

  279.         </div>

  280.       </div>

  281. 

  282.     </section>

  283. 

  284.   </div>

  285.   

  286. 

  287. 

  288.   <script type="text/javascript">

  289.       jQuery(function () {

  290.           SphinxRtdTheme.Navigation.enable(true);

  291.       });

  292.   </script>

  293. 

  294.   

  295.   

  296.     

  297.    

  298. 

  299. </body>

  300. </html>