python提取网页数据
生活随笔
收集整理的這篇文章主要介紹了
python提取网页数据
小編覺得挺不錯(cuò)的,現(xiàn)在分享給大家,幫大家做個(gè)參考.
#coding:utf-8
import urllib2
import os
import re
def dow(url):return urllib2.urlopen(url).read()
str=dow('http://theater.mtime.com/China_Beijing/')
lst=re.findall('\d+家影院上映\d+場(chǎng)',str)
url = 'http://theater.mtime.com/China_Beijing'
req = urllib2.Request(url,headers={'User-Agent' : "Magic Browser"})
webpage = urllib2.urlopen(req)
strw = webpage.read()
#print strw
tg_start = strw.find('hotplaySvList = [')
#print tg_start#開始
if tg_start == -1:print 'not find start tag'os._exit(0)
tmp = strw[tg_start:-1]
tg_end = tmp.find(';')if tg_end == -1 :print 'not find end tag'os._exit(0)
tmp = tmp[len('hotplaySvList = ['):tg_end]tar_ls = tmp.split("},{")dict_film = {}
i=0
for t0 in tar_ls:ls_t = t0.split(',')id = ls_t[0].split(':')[-1].strip()film = ls_t[-1].split('"')[-2].strip()print id,film,lst[i]i=i+1dict_film[id] = film
print len(dict_film)
?
轉(zhuǎn)載于:https://www.cnblogs.com/doublekai/p/6933119.html
總結(jié)
以上是生活随笔為你收集整理的python提取网页数据的全部?jī)?nèi)容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 一款免费好用的代码在线比较工具
- 下一篇: 测试实例