如何用scrapy抓取数据时使用Xpath获得全部文本

使用的是
item['description'] = app.select('./li//text()').extract_unquoted()
得到
{"description": ["\n I visited the local ", "robotic", " club and recorded the preparation for the up-coming competition. I was invited to make a speech there\u00a0", "...", "\n "]

请教应该怎么写，才能得到
{"description": ["I visited the local robotic club and recorded the preparation for the up-coming competition. I was invited to make a speech there...“]
这样的形式，就是只需要保留文本的部分？

Description

was

visited

4 replies • 1970-01-01 08:00:00 +08:00

beordle

Aug 30, 2013

"".join(app.select('./li//text()').extract_unquoted())

brucebot

Aug 30, 2013

@beordle 这样出来的结果是
{"description": "\n I visited the local robotic club and recorded the preparation for the up-coming competition. I was invited to make a speech there...\n“
[]不见了？

beordle

Aug 30, 2013

加上就好了嘛~
item['description'] = ["".join(app.select('./li//text()').extract_unquoted())]
如果需要/n换行的话
item['description'] = "".join(app.select('./li//text()').extract_unquoted()).split('\n')
可能还有一些细节问题。hack下即可

brucebot

Aug 30, 2013

@beordle 非常感谢