Home  >  Article  >  Backend Development  >  How to save customer data in python

How to save customer data in python

coldplay.xixi
coldplay.xixiOriginal
2020-08-27 14:30:402198browse

How to save customer data in python: 1. Use [with open()] to create a new object and write the data; 2. Use the pandas package to save, the code is [import pandas as pd #import pandas].

How to save customer data in python

Related learning recommendations: python tutorial

Methods for python to always save customer data:

1. Save with open function

Use with open() to create a new object

Write data (here we use the Douban short review of a book in Douban Reading as an example)

import requests
from lxml import etree
 
#发送Request请求
url = 'https://book.douban.com/subject/1054917/comments/'
head = {'User-Agent':'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36'}
 
#解析HTML
r = requests.get(url, headers=head)
s = etree.HTML(r.text)
comments = s.xpath('//div[@class="comment"]/p/text()')
#print(str(comments))#在写代码的时候可以将读取的内容打印一下
 
#保存数据open函数
with open('D:/PythonWorkSpace/TestData/pinglun.txt','w',encoding='utf-8') as f:#使用with open()新建对象f
    for i in comments:
        print(i)
        f.write(i+'\n')#写入数据,文件保存在上面指定的目录,加\n为了换行更方便阅读

What we refer to here is: the open mode of the open function

Parameter Usage

  • #r read read only. If the file does not exist, an error will be reported.

  • w write only writes. If the file does not exist, it will be created automatically.

  • a apend is appended to the end of the file.

  • rb, wb, ab operate binary

  • r open read and write mode

2. Saving pandas package

Speaking of Pandas, I have to talk about the two data analysis tool packages related to it (note: pandas, numpy and matplotlib all need to be installed in advance. For detailed installation, please see the previous blog post About the pip installation package)

  • numpy: (short for Numerical Python), is a basic package for high-performance scientific computing and data analysis

  • pandas: A Python package based on Numpy that contains advanced data structures and manipulation tools that make data analysis easier

  • matplotlib: is a plotting package for creating publication-quality charts (Mainly 2D)

import pandas as pd #导入pandas
import numpy as np #导入numpy
import matplotlib.pypolt as plt #导入matplotlib  

Next, I will demonstrate pandas saving data to CSV and Excel

#导入包
import pandas as pd
import numpy as np
 
df = pd.DataFrame(np.random.randn(10,4))#创建随机值
 
#print(df.head(2))#查看数据框的头部数据,默认不写为前5行,小于5行时全部显示;也可以自定义查看几行
print(df.tail())##查看数据框的尾部数据,默认不写为倒数5行,小于5行时全部显示;也可以自定义查看倒数几行
 
df.to_csv('D:/PythonWorkSpace/TestData/PandasNumpy.csv')#存储到CSV中
#df.to_excel('D:/PythonWorkSpace/TestData/PandasNumpy.xlsx')#存储到Excel中(需要提前导入库 pip install openpyxl)
实例中保存豆瓣读书的短评代码如下:
import requests
from lxml import etree
 
#发送Request请求
url = 'https://book.douban.com/subject/1054917/comments/'
head = {'User-Agent':'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36'}
 
#解析HTML
r = requests.get(url, headers=head)
s = etree.HTML(r.text)
comments = s.xpath('//div[@class="comment"]/p/text()')
#print(str(comments))#在写代码的时候可以将读取的内容打印一下
 
'''
#保存数据open函数
with open('D:/PythonWorkSpace/TestData/pinglun.txt','w',encoding='utf-8') as f:#使用with open()新建对象f
    for i in comments:
        print(i)
        f.write(i+'\n')#写入数据,文件保存在上面指定的目录,加\n为了换行更方便阅读
'''
 
#保存数据pandas函数   到CSV 和Excel
import pandas as pd
df = pd.DataFrame(comments)
#print(df.head())#head()默认为前5行
df.to_csv('D:/PythonWorkSpace/TestData/PandasNumpyCSV.csv')
#df.to_excel('D:/PythonWorkSpace/TestData/PandasNumpyEx.xlsx')

If you want to know more related learning, please pay attention php training column!

The above is the detailed content of How to save customer data in python. For more information, please follow other related articles on the PHP Chinese website!

Statement:
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn