scrapy中的request对象
生活随笔
收集整理的這篇文章主要介紹了
scrapy中的request对象
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
1. Requtes
注意?method = 'GET'? ?headers = None? 為字典類型? ?cookies = None? 為字典類型
class Request(object_ref):def __init__(self, url, callback=None, method='GET', headers=None, body=None,cookies=None, meta=None, encoding='utf-8', priority=0,dont_filter=False, errback=None, flags=None):self._encoding = encoding # this one has to be set firstself.method = str(method).upper()self._set_url(url)self._set_body(body)assert isinstance(priority, int), "Request priority not an integer: %r" % priorityself.priority = priorityassert callback or not errback, "Cannot use errback without a callback"self.callback = callbackself.errback = errbackself.cookies = cookies or {} self.headers = Headers(headers or {}, encoding=encoding)self.dont_filter = dont_filterself._meta = dict(meta) if meta else Noneself.flags = [] if flags is None else list(flags)2. FormRequest
注意: method = 'POST'? formdata 為字典類型
class FormRequest(Request):def __init__(self, *args, **kwargs):formdata = kwargs.pop('formdata', None)if formdata and kwargs.get('method') is None:kwargs['method'] = 'POST'super(FormRequest, self).__init__(*args, **kwargs) # 指的就是requestif formdata:items = formdata.items() if isinstance(formdata, dict) else formdataquerystr = _urlencode(items, self.encoding)if self.method == 'POST':self.headers.setdefault(b'Content-Type', b'application/x-www-form-urlencoded')self._set_body(querystr)else:self._set_url(self.url + ('&' if '?' in self.url else '?') + querystr)?
轉載于:https://www.cnblogs.com/yugengde/p/8027524.html
總結
以上是生活随笔為你收集整理的scrapy中的request对象的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: [Unity3D]关于NaN(Not a
- 下一篇: Go基础之--数组和切片