Python correct encoding of Website (Beautiful Soup)
<p>I am trying to load a html-page and output the text, even though i am getting the webpage correctly, BeautifulSoup destroys somehow the encoding. </p>

<p><strong>Source:</strong> </p>

<pre><code># -*- coding: utf-8 -*-
import requests
from BeautifulSoup import BeautifulSoup

url = "http://www.columbia.edu/~fdc/utf8/"
r = requests.get(url)

encodedText = r.text.encode("utf-8")
soup = BeautifulSoup(encodedText)
text =  str(soup.findAll(text=True))
print text.decode("utf-8")
</code></pre>

<p><strong>Excerpt Output:</strong></p>

<pre><code>...Odenw\xc3\xa4lderisch...
</code></pre>

<p>this should be <strong>Odenwälderisch</strong></p>