Text file normalization and pattern matching
<p>I got a file written in a kind of metalanguage, which describes the procedure which is needed to validate some data.
I need to generate validation functions to validate the data.
Data are already stored in a structure</p>

<p><p>Steps I made:</p>

<ol>

<li>Split text into string[], using char like(' . , ; == >= )</li>
<li>Remove articles, prepositions...</li>
<li>Normalize text(how?)</li>
<li>Match words with tokens using Regex or text matching</li>
<li>Match patern using Token type</li>
<li>Generate functions based on the matched pattern rule</li>

</ol>

<p><br/></p>

<p>What would you use in step 3 or in general to improve this procedure?</p>