How to solve the error when Python 2.7 outputs Chinese strings?

Python 2.7 Encoding problem in outputting Chinese strings

Why is the error "UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-1: ordinal not in range(128)" reported? This article will study this issue.

The internal representation of strings in Python is unicode encoding. Therefore, when doing encoding conversion, it is usually necessary to use unicode as the intermediate encoding, that is, first decode strings in other encodings into unicode. , and then encode from unicode to another encoding.

The function of decode is to convert other encoded strings into unicode encoding, such as str1.decode('gb2312'), which means converting the gb2312 encoded string str1 into unicode encoding.

The function of encode is to convert unicode encoding into other encoded strings, such as str2.encode('gb2312'), which means converting unicode encoded string str2 into gb2312 encoding.

Therefore, when transcoding, you must first understand what encoding the string str is, then decode it into unicode, and then encode it into other encodings

The default encoding of the string in the code is the same as The encoding of the code file itself is consistent.

For example: s='Chinese'

If it is in a utf8 file, the string is utf8 encoded. If it is in a gb2312 file, its encoding is gb2312. In this case, to perform encoding conversion, you need to first use the decode method to convert it to unicode encoding, and then use the encode method to convert it to other encodings. Usually, when no specific encoding method is specified, the code file created using the system default encoding is used.

If the string is defined like this: s=u'Chinese'

The encoding of the string is specified as unicode, which is python's internal encoding, and is different from the code file itself. Encoding has nothing to do with it. Therefore, for encoding conversion in this case, you only need to directly use the encode method to convert it to the specified encoding.

If a string is already unicode, an error will occur when decoding it, so it is usually necessary to judge whether its encoding method is unicode:

isinstance(s, unicode) #Used Determine whether it is unicode

Using str in non-unicode encoding form to encode will result in an error

How to obtain the system's default encoding?

#!/usr/bin/env python
#coding=utf-8
import sys
print sys.getdefaultencoding()

The output of this program on English Windows The station itself cannot display the encoding of the string, and it is not a problem with the program itself.

If you run the following code in UliPad:

s=u"中文"
print s

will prompt: UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-1: ordinal not in range(128). This is because UliPad's console information output window on English Windows

Change the last sentence to: print s.encode('gb2312')

The word "Chinese" can be correctly output.

If the last sentence is changed to: print s.encode('utf8')

, the output will be: \xe4\xb8\xad\xe6\x96\x87, this is the console information output window Output the result of UTF8 encoded string according to ASCII encoding.

unicode(str,'gb2312') is the same as str.decode('gb2312'), both convert gb2312 encoded str into unicode encoding

Use str.__class__ Check the encoding form of str

After talking about the principle for a long time, let’s finally come up with a cure-all:)

#!/usr/bin/env python #coding=utf-8 s="中文" if isinstance(s, unicode): #s=u"中文" print s.encode('gb2312') else: #s="中文" print s.decode('utf-8').encode('gb2312')

The above is the detailed content of How to solve the error when Python 2.7 outputs Chinese strings?. For more information, please follow other related articles on the PHP Chinese website!