quora是一個(gè)比較知名的社區(qū)問(wèn)答網(wǎng)站，對(duì)于目前比較流行的cqa問(wèn)題，通過(guò)quora提供的搜索工具來(lái)找到相似的問(wèn)題進(jìn)而抽取答案。

事實(shí)上，quora的搜索大致是根據(jù)關(guān)鍵詞匹配的。

String s=HttpRequest.sendGet("https://www.quora.com/search","q=Have%20you%20ever%20done%20the%20NoFap%20Challenge?"); Document doc = Jsoup.parse(s); List<String> answer_url = new ArrayList<String>(); Elements ctag = doc.select("div.pagedlist_item"); System.out.println(s); for(Element question : ctag){Element href = question.select("a.question_link").first();if(href != null){System.out.println("www.quora.com" + href.attr("href"));answer_url.add("https://www.quora.com" + href.attr("href"));} } for(String url : answer_url){//url = "http://www.quora.com/What-is-the-craziest-thing-you-have-ever-said-or-done-at-an-interview-and-still-got-the-job";String page = HttpRequest.sendGet(url,"");//System.out.println(page);SolveAnswerPage sol = new SolveAnswerPage();List<String> iRes = sol.solve(page);//for(String tem : iRes){// System.out.println(tem);//}//break; } System.out.println("done");

public class SolveAnswerPage {public List<String> solve(String s){List<String> res = new ArrayList<String>();Document doc = Jsoup.parse(s);Elements answers = doc.select("div.pagedlist_item");System.out.println(answers.size());for(Element answer : answers){res.add(answer.text());System.out.println(answer.text());}return res;} }

主要是借助HttpRequest類實(shí)現(xiàn)對(duì)給定問(wèn)題的相似問(wèn)題的抓取，主要分為兩個(gè)步驟：

1.首先通過(guò)給定問(wèn)題的相似問(wèn)題搜索頁(yè)面，得到排名前面的問(wèn)題的url鏈接列表

2.根據(jù)第一步的url列表，抓取相應(yīng)問(wèn)題頁(yè)面的answer，并返回抓取結(jié)果

總結(jié)

以上是生活随笔為你收集整理的Quora cqa问题抓取的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問(wèn)題。

如果覺(jué)得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。