利用bs4获取58同城城市分类,bs4获取58同城,python beaut
利用bs4获取58同城城市分类,bs4获取58同城,python beaut
python beautifulsoup
# -*- coding:utf-8 -*-#! /usr/bin/pythonimport urllibimport os, datetime, sysfrom bs4 import BeautifulSoupreload(sys) sys.setdefaultencoding( "utf-8" ) __BASEURL__ = "http://bj.58.com/"__INITURL__ = "http://bj.58.com/hezu/"soup=BeautifulSoup(urllib.urlopen(__INITURL__))lv1Elements = soup.html.body.section.find('div', 'relative').find('dl', 'secitem')('a',href=True)f=open('data.txt', 'w')for element in lv1Elements[1:]: f.write((element.get_text() + '\r\n')) print element.get_text() url = __BASEURL__ + element.get('href') print url soup=BeautifulSoup(urllib.urlopen(url)) lv2Elements = soup.html.body.section.find('div', 'relative').find('dl', 'secitem').find('div', 'subarea').find_all('a') texts = [t.get_text() for t in lv2Elements] f.write(' '.join(texts) + '\r\n\r\n')f.close()
相关内容
- Python 处理图像几何变换,python图像几何变换,[Python]代码
- python urllib2和httplib请求的速度比较实例测试,urllib2ht
- 使用python下载网页上的flash,pythonflash,[Python]代码''
- Python 批量获取《oschina》高亮代码区域源码!,python《
- Find bridges of graph,bridgesgraph,[Python]代码#
- 用Python实现一个简单的算术游戏,python实现算术,#!/us
- 绑定修改网卡绑定关系脚本,修改网卡绑定脚本,[Pyth
- 判断图片分辨率并修改,判断图片分辨率,[Python]代码
- 调节图片亮度和饱和度,图片亮度饱和度,[Python]代码
- 九九乘法表,乘法,[Python]代码im
评论关闭