为什么想起来做这个功能?是因为前段时间在做一个淘客网站的时候,想到是否能抓取到淘宝商品的买家秀呢?经过一番折腾发现,淘宝商品用户评价信息是通过Ajax来调取的,通过嗅探网址发现,评论数据的请求接口是:
https://rate.tmall.com/list_detail_rate.htm?itemId=524394294771&spuId=341564036&sellerId=100414600&order=3¤tPage=1&append=0&content=1&tagId=&posi=&picture=1&callback=jsonp2339
其实上面很多参数也很容易理解,itemId是商品的ID,currentPage是当前页,picture为1时显示有图的评价,既然是抓取买家秀,那么picture参数一定要为1了。
如果你直接去访问上面的接口时,会得到如下图所示的请求结果:
看到请求结果是jsonp格式我就蛋碎了,我不知道如何去解析,但是换种思路,直接用PHP的正则去解析也未尝不可嘛,通过尝试,已经正确的能够解析到评论内容和买家秀的图片内容,如图:
效果不错,代码实现了评论内容的抓取、买家秀图片的抓取,代码奉上:
<?php $url = "https://rate.tmall.com/list_detail_rate.htm?itemId=524394294771&spuId=341564036&sellerId=100414600&order=3¤tPage=1&append=0&content=1&tagId=&posi=&picture=1&callback=jsonp2339"; $ch2 = curl_init(); curl_setopt($ch2, CURLOPT_URL, $url); curl_setopt($ch2, CURLOPT_FOLLOWLOCATION, TRUE); curl_setopt($ch2, CURLOPT_SSL_VERIFYHOST, FALSE); curl_setopt($ch2, CURLOPT_SSL_VERIFYPEER, false); curl_setopt($ch2, CURLOPT_RETURNTRANSFER, TRUE); $texts = curl_exec($ch2); curl_close($ch2); //echo $texts; $pattern = \'/"pics"(.+?)","reply"/is\'; preg_match_all($pattern, $texts, $match); for($i=0;$i<count($match[0]);$i++){ $pattern2 = \'/"rateContent":"(.+?)."reply"/is\'; preg_match($pattern2, $match[0][$i], $matchcomments_only); echo "<p>".str_replace(\'","rateDate":"\',\' \',str_replace(\'","reply"\',\'\',str_replace(\'"rateContent":"\',\'\',$matchcomments_only[0])))."</p>"; $pattern3 = \'/img.alicdn(.+?).jpg/is\'; preg_match($pattern3, $match[0][$i], $matchpic_only); echo \'<img src="http://\'.$matchpic_only[0].\'" width=120>\'; } /*匹配一张图片 $pattern = \'/"pics"(.+?)","position"/is\'; preg_match_all($pattern, $texts, $matchpic); for($i=0;$i<count($matchpic[0]);$i++){ $pattern3 = \'/img.alicdn(.+?).jpg/is\'; preg_match($pattern3, $matchpic[0][$i], $matchpic_only); echo "<p>".$matchpic_only[0]."</p>"; }*/ /*匹配所有图片 $pattern = \'/"pics"(.+?)","position"/is\'; preg_match_all($pattern, $texts, $matchpic); for($i=0;$i<count($matchpic[0]);$i++){ $pics_str=str_replace(\'"pics":["//\',\'\',str_replace(\'"],"picsSmall":"","position"\',\'\',$matchpic[0][$i])); $arr = explode(\'","//\',$pics_str); echo "<p>"; foreach($arr as $newstr){ echo \'<img src=http://\'.$newstr.\' width=100 >\'; } echo "</p>"; }*/ ?>
有什么解析jsonp格式的好方法呢?求大神~~~
请发表评论