一、在豆瓣電影網(wǎng)爬取影片的短評(píng)以及相關(guān)的信息：

二、參考代碼

            
              import requests
from bs4 import BeautifulSoup
import pandas as pd

url_list = []
for i in range(5):
    url_list.append('https://movie.douban.com/subject/26794435/comments?start=%s&limit=20&sort=new_score&status=P'%(i*20))

n = 0
commentInfo_list =[]
for url in url_list:
    txt = requests.get(url).text # 網(wǎng)頁的獲取
    soup = BeautifulSoup(txt,'lxml')  # 網(wǎng)頁的解析

    divs = soup.find('div',id='comments').find_all('div',class_='comment')        
    for div in divs:
        comments_dict ={}        
        comments_dict['用戶名'] = div.find('span',class_ = 'comment-info').find('a').text
        comments_dict['評(píng)論時(shí)間'] = div.find('span',class_= 'comment-time').text.replace(' ','').replace('\n','')
        comments_dict['有用數(shù)量'] = div.find('span',class_= 'votes').text
        comments_dict['評(píng)論內(nèi)容'] = div.find('span',class_='short').text
        
        commentInfo_list.append(comments_dict)            
        n += 1        
print('已成功采集%s條評(píng)論'%n)    

df = pd.DataFrame(commentInfo_list)
            
          

三、查看爬取下來的短評(píng)以及相關(guān)的信息：