TSFRESH library for python is taking way too long to process
<p>I came across the TSfresh library as a way to featurize time series data. The documentation is great, and it seems like the perfect fit for the project I am working on. </p>

<p>I wanted to implement the following code that was shared in the quick start section of the TFresh documentation. And it seems simple enough.</p>

<pre><code>from tsfresh import extract_relevant_features
feature_filtered_direct=extract_relevant_features(result,y,column_id=0,column_sort=1)
</code></pre>

<p>My data included 400 000 rows of sensor data, with 6 sensors each for 15 different id's. I started running the code, and 17 hours later it still had not finished. I figured this might be too large of a data set to run through the relevant feature extractor, so I trimmed it down to 3000, and then further down to 300. None of these actions made the code run under an hour, and I just ended up shutting it down after an hour or so of waiting. I tried the standard feature extractor as well</p>

<pre><code>extracted_features = extract_features(timeseries, column_id="id", column_sort="time")
</code></pre>

<p>Along with trying the example dataset that TSfresh presents on their quick start section. Which includes a dataset that is very similar to my orginal data, with about the same amount of data points as I reduced to. </p>

<p>Does anybody have any experience with this code? How would you go about making it work faster? I'm using Anaconda for python 2.7. </p>

<p><strong>Update</strong>
It seems to be related to multiprocessing. Because I am on windows, using the multiprocess code requires to be protected by</p>

<pre><code>if __name__ == "__main__":
    main()
</code></pre>

<p>Once I added</p>

<pre><code>if __name__ == "__main__":

    extracted_features = extract_features(timeseries, column_id="id", column_sort="time")
</code></pre>

<p>To my code, the example data worked. I'm still having some issues with running the extract_relevant_features function and running the extract features module on my own data set. It seems as though it continues to run slowly. I have a feeling its related to the multiprocess freeze as well, but without any errors popping up its impossible to tell. Its taking me about 30 minutes to run to extract features on less than 1% of my dataset. </p>