Skip to content

Commit

Permalink
【修复】PageSelect注解取数值逻辑修复;
Browse files Browse the repository at this point in the history
  • Loading branch information
xuxueli committed Jan 5, 2025
1 parent b56e628 commit f802477
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 3 deletions.
5 changes: 4 additions & 1 deletion doc/XXL-CRAWLER官方文档.md
Original file line number Diff line number Diff line change
Expand Up @@ -313,7 +313,10 @@ public abstract int getUrlNum(); | 获取待采集URL数量;
- 3、【重构】重构核心功能模块,提升扩展性;修复历史代码隐藏问题,提升系统稳定习惯。
- 4、【升级】多个依赖升级至更新版本,如jsoup、selenium等。

### v1.4.1 Release Notes[迭代中]
### v1.4.1 Release Notes[2024-01-06]
- 1、【修复】PageSelect注解取数值逻辑修复;

### v1.4.2 Release Notes[迭代中]
- 1、【TODO】爬虫扩散规则抽象,支持自定义;包括深度、URL正则、以及自定义编码等;


Expand Down
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
<modelVersion>4.0.0</modelVersion>
<groupId>com.xuxueli</groupId>
<artifactId>xxl-crawler</artifactId>
<version>1.4.1-SNAPSHOT</version>
<version>1.4.1</version>
<packaging>jar</packaging>

<name>xxl-crawler</name>
Expand Down
2 changes: 1 addition & 1 deletion src/main/java/com/xxl/crawler/thread/CrawlerThread.java
Original file line number Diff line number Diff line change
Expand Up @@ -198,7 +198,7 @@ private Response loadAndParsePage(Request request) throws IllegalAccessException
String pageVoCssQuery = (pageVoSelect!=null && pageVoSelect.cssQuery()!=null && pageVoSelect.cssQuery().trim().length()>0)?pageVoSelect.cssQuery():"html";
Elements pageVoElements = html.select(pageVoCssQuery);

if (pageVoElements!=null && pageVoElements.hasText()) {
if (pageVoElements!=null && !pageVoElements.isEmpty()) {
for (Element pageVoElement : pageVoElements) {

// build pageVo
Expand Down

0 comments on commit f802477

Please sign in to comment.