03817233b0
Merge pull request #1785 from projectdiscovery/dev
...
v2.14.0 (prep)
2026-04-27 09:27:26 +07:00
0ed1b0b622
chore(deps): bump github.com/projectdiscovery/cdncheck ( #1783 )
...
Bumps the modules group with 1 update: [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ).
Updates `github.com/projectdiscovery/cdncheck` from 1.2.31 to 1.2.32
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.31...v1.2.32 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.32
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-25 16:37:21 +07:00
4a45eedd9b
chore(runner): bump version to v2.14.0
...
Signed-off-by: Dwi Siswanto <git@dw1.io >
2026-04-25 16:36:27 +07:00
1cdef03a90
Merge pull request #1776 from x-stp/fix/netlas-community-cap
...
fix(netlas): cap dl size to Community limits.
2026-04-20 08:29:53 +03:00
e96530f0f2
Merge pull request #1777 from x-stp/fix/mortal-combat-round-one
...
fix(sources): hackertarget, intelx, shodan, c99, chinaz control-flow bugs
2026-04-20 08:20:34 +03:00
3206a8b244
fix(netlas): close body on err path, drop unreachable status checks
...
Addresses CodeRabbit review.
2026-04-18 15:37:55 +02:00
c61d1e9be6
fix(chinaz): accept empty arrays, check ValueType over truthiness
...
Addresses CodeRabbit review: jsoniter's ToBool returns false for empty arrays as well as missing keys, so a valid response with ContributingSubdomainList: [] would incorrectly trip the shape-mismatch branch. Switch to ValueType() != ArrayValue; the iteration loop handles empty arrays naturally (0 results, no error emitted).
2026-04-18 15:29:57 +02:00
664f5b740f
Merge branch 'dev' into fix/mortal-combat-round-one
2026-04-18 14:57:34 +02:00
b9ef679344
fix(chinaz): check ReadAll err, report shape mismatch instead of stale nil
...
Two bugs in one spot: io.ReadAll's error was never checked, so a partial/empty body fell into the else branch unnoticed; and that else branch emitted Error: err where err was whatever ReadAll returned — almost always nil. The real signal ("response didn't contain Result.ContributingSubdomainList") was lost. Check ReadAll up front and synthesize a real error for the shape-mismatch case. Also flattens the happy path.
2026-04-18 14:55:16 +02:00
01569ae344
fix(c99): surface transport errors to results channel
...
Same bug as shodan: SimpleGet error path returned without sending an Error result. Emit it and increment s.errors.
2026-04-18 14:55:16 +02:00
9760a965dd
fix(shodan): surface transport errors to results channel
...
On session.SimpleGet failure the source returned without emitting an Error result, so stats under-reported and callers saw a silent zero. Emit the error and bump s.errors like every other source does.
2026-04-18 14:55:16 +02:00
75f3c283f0
fix(intelx): remove dead read after decoder drained body
...
jsoniter.NewDecoder(resp.Body).Decode(...) drains the body, so the subsequent io.ReadAll read 0 bytes and its error branch was unreachable. Delete the dead read and drop the now-unused io import.
2026-04-18 14:55:16 +02:00
14103b5433
fix(hackertarget): drop duplicate apikey query param
2026-04-18 14:50:35 +02:00
d58cda0aec
Merge branch 'dev' into fix/netlas-community-cap
2026-04-18 14:42:13 +02:00
7fc6da453d
fix(netlas): cap dl size to Community limits.
...
Widens two 429-only branches to any non-200, moves status status check before ReadAll, and addresses "ressponse" typos; no compat breaking introductions; see #1765 .
2026-04-18 14:37:51 +02:00
0a40086a2b
Merge pull request #1774 from projectdiscovery/dependabot/go_modules/dev/modules-944d9be2db
...
chore(deps): bump the modules group across 1 directory with 6 updates
2026-04-18 09:13:33 +03:00
89664fdda2
Merge pull request #1771 from x-stp/feat/submd-dev
...
feat: intro sub.md passive sub dm source
2026-04-18 09:11:24 +03:00
2d58630cbe
chore(deps): bump the modules group across 1 directory with 6 updates
...
Bumps the modules group with 6 updates in the / directory:
| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) | `0.0.84` | `0.0.85` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ) | `0.10.0` | `0.10.1` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) | `1.2.28` | `1.2.31` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ) | `0.5.4` | `0.5.6` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy ) | `0.1.34` | `0.1.36` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go ) | `1.3.6` | `1.3.8` |
Updates `github.com/projectdiscovery/ratelimit` from 0.0.84 to 0.0.85
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.84...v0.0.85 )
Updates `github.com/projectdiscovery/utils` from 0.10.0 to 0.10.1
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.10.0...v0.10.1 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.28 to 1.2.31
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.28...v1.2.31 )
Updates `github.com/projectdiscovery/fastdialer` from 0.5.4 to 0.5.6
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.5.4...v0.5.6 )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.34 to 0.1.36
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.34...v0.1.36 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.3.6 to 1.3.8
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.3.6...v1.3.8 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.85
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.10.1
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.31
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.6
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.36
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.3.8
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
2026-04-15 14:25:13 +00:00
d6282b0a89
refactor(submd): extract ctx-aware send helpers, flatten Run()
2026-04-13 13:45:46 +02:00
9ea2b18e41
fix(submd): guard non-200 response, ctx-aware error send
2026-04-13 08:54:58 +02:00
c64aa32dbd
Merge branch 'dev' of github.com:x-stp/subfinder into feat/submd-dev
...
# Conflicts:
# pkg/passive/sources.go
# pkg/passive/sources_test.go
2026-04-09 09:29:37 +02:00
ae1c9a6e32
feat: intro sub.md passive sub dm source
...
Works anonymously out of the box; can work with api for more parallel req
2026-04-09 08:32:04 +02:00
85929ab9ee
Merge pull request #1769 from projectdiscovery/dependabot/go_modules/dev/modules-366a3d4240
...
chore(deps): bump the modules group with 8 updates
2026-04-07 14:55:05 +03:00
4de1ddee7e
chore(deps): bump the modules group with 8 updates
...
Bumps the modules group with 8 updates:
| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) | `0.0.83` | `0.0.84` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go ) | `1.3.2` | `1.3.6` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ) | `0.9.0` | `0.10.0` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) | `1.2.27` | `1.2.28` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ) | `0.5.2` | `0.5.4` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap ) | `0.0.99` | `0.0.100` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy ) | `0.1.33` | `0.1.34` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns ) | `1.0.113` | `1.0.114` |
Updates `github.com/projectdiscovery/ratelimit` from 0.0.83 to 0.0.84
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.83...v0.0.84 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.3.2 to 1.3.6
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.3.2...v1.3.6 )
Updates `github.com/projectdiscovery/utils` from 0.9.0 to 0.10.0
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.9.0...v0.10.0 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.27 to 1.2.28
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.27...v1.2.28 )
Updates `github.com/projectdiscovery/fastdialer` from 0.5.2 to 0.5.4
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.5.2...v0.5.4 )
Updates `github.com/projectdiscovery/hmap` from 0.0.99 to 0.0.100
- [Release notes](https://github.com/projectdiscovery/hmap/releases )
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.99...v0.0.100 )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.33 to 0.1.34
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.33...v0.1.34 )
Updates `github.com/projectdiscovery/retryabledns` from 1.0.113 to 1.0.114
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases )
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.113...v1.0.114 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.84
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.3.6
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.10.0
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.28
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.4
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
dependency-version: 0.0.100
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.34
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
dependency-version: 1.0.114
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
2026-03-25 14:23:05 +00:00
e6ed1e1b72
Chore - Code cleanup in workflows ( #1768 )
...
* Change file extension to .yml for consistency
* Move permissions for clarity and consistency
* Change compat-checks action from @master to @v1
The action should be pinned to a stable ref such as @v1, consistent with
the documentation and how other PD projects reference it.
* Fix indentations and whitespaces in workflows
2026-03-24 02:26:08 +01:00
4d9e07828b
Remove dead facebook source ( #1727 ) ( #1732 )
...
The Meta CT API has been discontinued.
2026-03-20 23:40:42 +01:00
bb5a68a23c
chore(deps): bump the modules group with 10 updates ( #1716 )
...
Bumps the modules group with 10 updates:
| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/gologger](https://github.com/projectdiscovery/gologger ) | `1.1.62` | `1.1.67` |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) | `0.0.82` | `0.0.83` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go ) | `1.1.0` | `1.1.1` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ) | `0.7.3` | `0.8.0` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) | `1.2.13` | `1.2.20` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ) | `0.4.19` | `0.5.2` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap ) | `0.0.98` | `0.0.99` |
| [github.com/projectdiscovery/machineid](https://github.com/projectdiscovery/machineid ) | `0.0.0-20240226150047-2e2c51e35983` | `0.0.0-20250715113114-c77eb3567582` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy ) | `0.1.31` | `0.1.33` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns ) | `1.0.111` | `1.0.112` |
Updates `github.com/projectdiscovery/gologger` from 1.1.62 to 1.1.67
- [Release notes](https://github.com/projectdiscovery/gologger/releases )
- [Commits](https://github.com/projectdiscovery/gologger/compare/v1.1.62...v1.1.67 )
Updates `github.com/projectdiscovery/ratelimit` from 0.0.82 to 0.0.83
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.82...v0.0.83 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.1.0 to 1.1.1
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.1.0...v1.1.1 )
Updates `github.com/projectdiscovery/utils` from 0.7.3 to 0.8.0
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.7.3...v0.8.0 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.13 to 1.2.20
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.13...v1.2.20 )
Updates `github.com/projectdiscovery/fastdialer` from 0.4.19 to 0.5.2
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.4.19...v0.5.2 )
Updates `github.com/projectdiscovery/hmap` from 0.0.98 to 0.0.99
- [Release notes](https://github.com/projectdiscovery/hmap/releases )
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.98...v0.0.99 )
Updates `github.com/projectdiscovery/machineid` from 0.0.0-20240226150047-2e2c51e35983 to 0.0.0-20250715113114-c77eb3567582
- [Commits](https://github.com/projectdiscovery/machineid/commits )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.31 to 0.1.33
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.31...v0.1.33 )
Updates `github.com/projectdiscovery/retryabledns` from 1.0.111 to 1.0.112
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases )
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.111...v1.0.112 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/gologger
dependency-version: 1.1.67
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.83
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.1.1
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.8.0
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.20
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.2
dependency-type: indirect
update-type: version-update:semver-minor
dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
dependency-version: 0.0.99
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/machineid
dependency-version: 0.0.0-20250715113114-c77eb3567582
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.33
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
dependency-version: 1.0.112
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-20 23:38:36 +01:00
2636330d22
chore(deps): bump github.com/refraction-networking/utls ( #1746 )
...
Bumps [github.com/refraction-networking/utls](https://github.com/refraction-networking/utls ) from 1.7.1 to 1.8.2.
- [Release notes](https://github.com/refraction-networking/utls/releases )
- [Commits](https://github.com/refraction-networking/utls/compare/v1.7.1...v1.8.2 )
---
updated-dependencies:
- dependency-name: github.com/refraction-networking/utls
dependency-version: 1.8.2
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-20 23:31:00 +01:00
8aa8653757
chore(deps): bump github.com/cloudflare/circl from 1.6.1 to 1.6.3 ( #1751 )
...
Bumps [github.com/cloudflare/circl](https://github.com/cloudflare/circl ) from 1.6.1 to 1.6.3.
- [Release notes](https://github.com/cloudflare/circl/releases )
- [Commits](https://github.com/cloudflare/circl/compare/v1.6.1...v1.6.3 )
---
updated-dependencies:
- dependency-name: github.com/cloudflare/circl
dependency-version: 1.6.3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-20 23:24:42 +01:00
61b85f2ec3
Merge pull request #1733 from PontusLindblom/chore/update-workflow-dependencies
...
Chore - Update workflow dependencies
2026-03-20 23:22:32 +01:00
7bd72ff7f7
use org actions
2026-03-20 23:09:48 +01:00
775a7eb5f1
Merge pull request #1764 from CharlesWong/fix/rate-limit-options
...
fix(ratelimit): honour -rl global fallback and -rls duration (#1434 )
2026-03-20 22:55:23 +01:00
240305b985
test: add edge case coverage for resolveSourceRateLimit
...
- PerSourceExceedsGlobal: per-source limit > global should be honoured
(verifies sourceRateLimitOrDefault returns source, not global)
- CaseInsensitive: source names stored lowercase must match mixed-case
lookups (documents and verifies the ToLower normalization contract)
2026-03-11 09:21:31 -07:00
cf0b8017c4
test: remove dead math.MaxUint32 no-op and unused math import
...
Per CodeRabbit nitpick: the blank identifier assignment and math import
in TestBuildMultiRateLimiter_UnlimitedWhenNoLimits served no purpose.
The test already verifies correct behavior via NoError + NotNil assertions.
2026-03-11 09:12:06 -07:00
cca10d8c9c
fix: initialize CustomRateLimit maps to prevent nil map panic
...
CodeRabbit identified that the zero-valued CustomRateLimit struct
left Custom.Map and CustomDuration.Map as nil, which could cause
a panic when resolveSourceRateLimit calls .Get() on these maps.
Mirror the initialization pattern from runner.go by explicitly
creating the underlying maps.
2026-03-11 04:06:42 -07:00
6f0e11ef05
refactor: rename misleading test per review feedback
2026-03-10 14:09:07 -07:00
c1ce78eac9
fix(ratelimit): honour -rl global fallback and -rls duration ( #1434 )
...
Two bugs in rate limit handling:
1. Global -rl flag was ignored for sources without a per-source override.
Only sources explicitly listed in -rls got rate-limited; all others
ran unlimited, defeating the purpose of -rl.
2. Per-source duration from -rls (e.g. hackertarget=2/m) was silently
dropped. runner.go stored MaxCount but discarded Duration, so all
sources defaulted to per-second regardless of the /m or /s suffix.
Root cause: runner.go converted goflags.RateLimitMap → CustomRateLimit
but only copied MaxCount. buildMultiRateLimiter only checked per-source
limits, never falling back to the global rate.
Changes:
- Add CustomDuration field to CustomRateLimit struct
- Store both MaxCount and Duration from -rls in runner.go
- Add resolveSourceRateLimit() with clear priority:
per-source > global > unlimited
- Guard against nil rateLimit in buildMultiRateLimiter
- Add 9 unit tests covering all combinations
Fixes #1434
2026-03-10 09:47:09 -07:00
f316b50756
Merge pull request #1758 from projectdiscovery/dev
...
release subfinder v2.13.0
2026-03-09 23:56:54 +03:00
13e5db7500
bump version
2026-03-05 14:48:23 +03:00
0dfd80add5
Update workflow dependencies
2026-02-07 08:21:53 +01:00
2d4f804894
Merge pull request #1723 from recepgunes1/fix/timeout-flag-not-working
...
Fix/timeout flag not working
2026-02-05 10:47:00 +03:00
a740540b8c
Merge pull request #1709 from spameier/fix/leakix-require-key
...
fix: mark LeakIX as requiring an API key
2026-02-04 16:35:01 +03:00
a349b9e34a
Merge pull request #1720 from PontusLindblom/fix/sources-in-alphabetical-order
...
Sort sources alphabetically
2026-02-04 15:21:40 +03:00
ab19329f86
Merge branch 'dev' into fix/sources-in-alphabetical-order
...
Resolve conflict by adding urlscan source in alphabetical order.
2026-02-04 15:04:45 +03:00
3286f09e73
Merge branch 'projectdiscovery:dev' into fix/timeout-flag-not-working
2026-02-03 21:01:21 +03:00
8a57c4f446
Merge pull request #1710 from projectdiscovery/add-urlscan-source
...
feat: add URLScan.io as passive subdomain source
2026-02-03 20:12:44 +03:00
0b51762608
Add PR template ( #1729 )
2026-02-03 15:25:54 +05:30
fba1cc3d27
fix timeout flag not working for crtsh source
2026-02-02 18:13:11 +03:00
58c1e5ac82
refactor: simplify urlscan source to use session rate limiting
...
Remove custom pagination delay and retry logic since the session
already handles rate limiting via MultiRateLimiter. This aligns
with how other sources (shodan, virustotal) are implemented.
2026-01-30 18:05:47 +05:30
675be65d47
test: skip flaky sources in TestSourcesWithoutKeys
...
Add leakix, reconeer, and sitedossier to ignored sources list:
- leakix: now requires API key (returns 401)
- reconeer: now requires API key (returns 401)
- sitedossier: flaky, returns no results in CI
2026-01-30 17:57:10 +05:30
Dwi Siswanto