python + bs4

언어/python2017. 12. 28. 17:53
from bs4 import BeautifulSoup
import requests as rq
import pprint
def main():
url = 'https://www.google.co.kr/search'
for page in range(0, 20):
params = {
'q':'color interior',
'start':(page-1)*10
}
response = rq.get(url, params=params)
html = response.text

soup = BeautifulSoup(html, 'html.parser')

title_list = soup.select('h3.r')
for v in title_list:
print (v.text)

if __name__ == "__main__":
main()


'언어 > python' 카테고리의 다른 글

python + mongodb_2  (0) 2017.12.28
python + mysql  (2) 2017.12.28
python + watchdog  (0) 2017.12.28
프로젝트 (데이터 시각화에 관한)  (0) 2017.12.27
python_elasticSearch  (0) 2017.12.27