def getCoding(strInput):
'''
获取编码格式
'''
if isinstance(strInput, unicode):
return "unicode"
try:
strInput.decode("utf8")
return 'utf8'
except:
pass
try:
strInput.decode("gbk")
return 'gbk'
except:
pass
def tran2UTF8(strInput):
'''
转化为utf8格式
'''
strCodingFmt = getCoding(strInput)
if strCodingFmt == "utf8":
return strInput
elif strCodingFmt == "unicode":
return strInput.encode("utf8")
elif strCodingFmt == "gbk":
return strInput.decode("gbk").encode("utf8")
def tran2GBK(strInput):
'''
转化为gbk格式
'''
strCodingFmt = getCoding(strInput)
if strCodingFmt == "gbk":
return strInput
elif strCodingFmt == "unicode":
return strInput.encode("gbk")
elif strCodingFmt == "utf8":
return strInput.decode("utf8").encode("gbk")
编码判断和编码转换
标签:
  更新于:
2018/04/25
阅读:873
最近热门
- 美团DGIN模型:Deep Group Interest Modeling of Full Lifelong User Behaviors for CTR Prediction
- BPE(Byte pair encoding)分词
- jQuery字符串替换
- SSB - Sample Selection Bias - 样本选择偏差问题
- markdown \mathbb 黑板粗体(Blackboard bold)字符
- thriftpy2:一个用于 Python 的 Thrift 协议实现库
- 如何理解阿里Qwen3的发布,意味着大模型赛道迎来新变革?
- 华为昇腾910B:华为自主研发的高性能人工智能处理器芯片
- Graphormer:一种基于Transformer架构的图深度学习模型
- Minimum Detectable Effect(MDE)最小可检测效应
最常浏览
- 016 推荐系统 | 排序学习(LTR - Learning To Rank)
- 偏微分符号
- i.i.d(又称IID)
- 利普希茨连续条件(Lipschitz continuity)
- (error) MOVED 原因和解决方案
- TextCNN详解
- 找不到com.google.protobuf.GeneratedMessageV3的类文件
- Deployment failed: repository element was not specified in the POM inside distributionManagement
- cannot access com.google.protobuf.GeneratedMessageV3 解决方案
- CLUSTERDOWN Hash slot not served 问题原因和解决办法
×