292032eef4
fix(crtsh): drop unused certificate metadata from SQL query ( #1773 ) ( #1787 )
...
The Postgres query inherited the verbatim form crt.sh's web UI uses to
render its certificate browser. subfinder consumes NAME_VALUE only, so
GROUP BY sub.CERTIFICATE on multi-KB DER blobs, the four x509_*
function calls per group, the correlated LEFT JOIN LATERAL into
ct_log_entry, and the trailing ORDER BY ENTRY_TIMESTAMP are all
discarded.
Replacing the WITH/JOIN with a direct DISTINCT NAME_VALUE preserves the
result set (verified parity on iana.org: 24 unique names from both
queries) and lets the LIMIT 10000 clause bound unique subdomains
instead of raw certificate rows. The downstream SplitSeq + Extractor
path is unchanged.
Co-authored-by: Chris (ChrisJr404) <11917633+ChrisJr404@users.noreply.github.com >
2026-06-16 15:29:27 +02:00
2a8ce2f3e6
feat: add shodanct passive source ( #1796 )
...
* feat: add shodanct passive source
* fix lint
---------
Co-authored-by: Mzack9999 <mzack9999@protonmail.com >
2026-06-16 15:24:59 +02:00
640befe540
Merge pull request #1794 from projectdiscovery/dependabot/go_modules/dev/modules-b2655d9150
...
chore(deps): bump the modules group across 1 directory with 9 updates
2026-06-16 13:05:11 +03:00
49652eca6f
chore(deps): bump the modules group across 1 directory with 9 updates
...
Bumps the modules group with 7 updates in the / directory:
| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/gologger](https://github.com/projectdiscovery/gologger ) | `1.1.68` | `1.1.69` |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) | `0.0.86` | `0.0.87` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ) | `0.11.0` | `0.11.1` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) | `1.2.35` | `1.2.37` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ) | `0.5.7` | `0.5.8` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap ) | `0.0.100` | `0.0.101` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns ) | `1.0.114` | `1.0.115` |
Updates `github.com/projectdiscovery/gologger` from 1.1.68 to 1.1.69
- [Release notes](https://github.com/projectdiscovery/gologger/releases )
- [Commits](https://github.com/projectdiscovery/gologger/compare/v1.1.68...v1.1.69 )
Updates `github.com/projectdiscovery/ratelimit` from 0.0.86 to 0.0.87
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.86...v0.0.87 )
Updates `github.com/projectdiscovery/utils` from 0.11.0 to 0.11.1
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.11.0...v0.11.1 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.35 to 1.2.37
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.35...v1.2.37 )
Updates `github.com/projectdiscovery/fastdialer` from 0.5.7 to 0.5.8
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.5.7...v0.5.8 )
Updates `github.com/projectdiscovery/hmap` from 0.0.100 to 0.0.101
- [Release notes](https://github.com/projectdiscovery/hmap/releases )
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.100...v0.0.101 )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.37 to 0.1.38
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.37...v0.1.38 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.3.9 to 1.3.11
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.3.9...v1.3.11 )
Updates `github.com/projectdiscovery/retryabledns` from 1.0.114 to 1.0.115
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases )
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.114...v1.0.115 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/gologger
dependency-version: 1.1.69
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.87
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.11.1
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.37
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.8
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
dependency-version: 0.0.101
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.38
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.3.11
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
dependency-version: 1.0.115
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
2026-05-27 17:06:34 +00:00
ea69703c4e
chore(deps): bump the modules group across 1 directory with 6 updates ( #1789 )
...
Bumps the modules group with 4 updates in the / directory: [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ), [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ), [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) and [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ).
Updates `github.com/projectdiscovery/ratelimit` from 0.0.85 to 0.0.86
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.85...v0.0.86 )
Updates `github.com/projectdiscovery/utils` from 0.10.1 to 0.11.0
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.10.1...v0.11.0 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.32 to 1.2.35
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.32...v1.2.35 )
Updates `github.com/projectdiscovery/fastdialer` from 0.5.6 to 0.5.7
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.5.6...v0.5.7 )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.36 to 0.1.37
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.36...v0.1.37 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.3.8 to 1.3.9
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.3.8...v1.3.9 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.86
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.11.0
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.35
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.7
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.37
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.3.9
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-19 23:25:45 +02:00
0ed1b0b622
chore(deps): bump github.com/projectdiscovery/cdncheck ( #1783 )
...
Bumps the modules group with 1 update: [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ).
Updates `github.com/projectdiscovery/cdncheck` from 1.2.31 to 1.2.32
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.31...v1.2.32 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.32
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-25 16:37:21 +07:00
4a45eedd9b
chore(runner): bump version to v2.14.0
...
Signed-off-by: Dwi Siswanto <git@dw1.io >
2026-04-25 16:36:27 +07:00
1cdef03a90
Merge pull request #1776 from x-stp/fix/netlas-community-cap
...
fix(netlas): cap dl size to Community limits.
2026-04-20 08:29:53 +03:00
e96530f0f2
Merge pull request #1777 from x-stp/fix/mortal-combat-round-one
...
fix(sources): hackertarget, intelx, shodan, c99, chinaz control-flow bugs
2026-04-20 08:20:34 +03:00
3206a8b244
fix(netlas): close body on err path, drop unreachable status checks
...
Addresses CodeRabbit review.
2026-04-18 15:37:55 +02:00
c61d1e9be6
fix(chinaz): accept empty arrays, check ValueType over truthiness
...
Addresses CodeRabbit review: jsoniter's ToBool returns false for empty arrays as well as missing keys, so a valid response with ContributingSubdomainList: [] would incorrectly trip the shape-mismatch branch. Switch to ValueType() != ArrayValue; the iteration loop handles empty arrays naturally (0 results, no error emitted).
2026-04-18 15:29:57 +02:00
664f5b740f
Merge branch 'dev' into fix/mortal-combat-round-one
2026-04-18 14:57:34 +02:00
b9ef679344
fix(chinaz): check ReadAll err, report shape mismatch instead of stale nil
...
Two bugs in one spot: io.ReadAll's error was never checked, so a partial/empty body fell into the else branch unnoticed; and that else branch emitted Error: err where err was whatever ReadAll returned — almost always nil. The real signal ("response didn't contain Result.ContributingSubdomainList") was lost. Check ReadAll up front and synthesize a real error for the shape-mismatch case. Also flattens the happy path.
2026-04-18 14:55:16 +02:00
01569ae344
fix(c99): surface transport errors to results channel
...
Same bug as shodan: SimpleGet error path returned without sending an Error result. Emit it and increment s.errors.
2026-04-18 14:55:16 +02:00
9760a965dd
fix(shodan): surface transport errors to results channel
...
On session.SimpleGet failure the source returned without emitting an Error result, so stats under-reported and callers saw a silent zero. Emit the error and bump s.errors like every other source does.
2026-04-18 14:55:16 +02:00
75f3c283f0
fix(intelx): remove dead read after decoder drained body
...
jsoniter.NewDecoder(resp.Body).Decode(...) drains the body, so the subsequent io.ReadAll read 0 bytes and its error branch was unreachable. Delete the dead read and drop the now-unused io import.
2026-04-18 14:55:16 +02:00
14103b5433
fix(hackertarget): drop duplicate apikey query param
2026-04-18 14:50:35 +02:00
d58cda0aec
Merge branch 'dev' into fix/netlas-community-cap
2026-04-18 14:42:13 +02:00
7fc6da453d
fix(netlas): cap dl size to Community limits.
...
Widens two 429-only branches to any non-200, moves status status check before ReadAll, and addresses "ressponse" typos; no compat breaking introductions; see #1765 .
2026-04-18 14:37:51 +02:00
0a40086a2b
Merge pull request #1774 from projectdiscovery/dependabot/go_modules/dev/modules-944d9be2db
...
chore(deps): bump the modules group across 1 directory with 6 updates
2026-04-18 09:13:33 +03:00
89664fdda2
Merge pull request #1771 from x-stp/feat/submd-dev
...
feat: intro sub.md passive sub dm source
2026-04-18 09:11:24 +03:00
2d58630cbe
chore(deps): bump the modules group across 1 directory with 6 updates
...
Bumps the modules group with 6 updates in the / directory:
| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) | `0.0.84` | `0.0.85` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ) | `0.10.0` | `0.10.1` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) | `1.2.28` | `1.2.31` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ) | `0.5.4` | `0.5.6` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy ) | `0.1.34` | `0.1.36` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go ) | `1.3.6` | `1.3.8` |
Updates `github.com/projectdiscovery/ratelimit` from 0.0.84 to 0.0.85
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.84...v0.0.85 )
Updates `github.com/projectdiscovery/utils` from 0.10.0 to 0.10.1
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.10.0...v0.10.1 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.28 to 1.2.31
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.28...v1.2.31 )
Updates `github.com/projectdiscovery/fastdialer` from 0.5.4 to 0.5.6
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.5.4...v0.5.6 )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.34 to 0.1.36
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.34...v0.1.36 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.3.6 to 1.3.8
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.3.6...v1.3.8 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.85
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.10.1
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.31
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.6
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.36
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.3.8
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
2026-04-15 14:25:13 +00:00
d6282b0a89
refactor(submd): extract ctx-aware send helpers, flatten Run()
2026-04-13 13:45:46 +02:00
9ea2b18e41
fix(submd): guard non-200 response, ctx-aware error send
2026-04-13 08:54:58 +02:00
c64aa32dbd
Merge branch 'dev' of github.com:x-stp/subfinder into feat/submd-dev
...
# Conflicts:
# pkg/passive/sources.go
# pkg/passive/sources_test.go
2026-04-09 09:29:37 +02:00
ae1c9a6e32
feat: intro sub.md passive sub dm source
...
Works anonymously out of the box; can work with api for more parallel req
2026-04-09 08:32:04 +02:00
85929ab9ee
Merge pull request #1769 from projectdiscovery/dependabot/go_modules/dev/modules-366a3d4240
...
chore(deps): bump the modules group with 8 updates
2026-04-07 14:55:05 +03:00
4de1ddee7e
chore(deps): bump the modules group with 8 updates
...
Bumps the modules group with 8 updates:
| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) | `0.0.83` | `0.0.84` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go ) | `1.3.2` | `1.3.6` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ) | `0.9.0` | `0.10.0` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) | `1.2.27` | `1.2.28` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ) | `0.5.2` | `0.5.4` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap ) | `0.0.99` | `0.0.100` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy ) | `0.1.33` | `0.1.34` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns ) | `1.0.113` | `1.0.114` |
Updates `github.com/projectdiscovery/ratelimit` from 0.0.83 to 0.0.84
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.83...v0.0.84 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.3.2 to 1.3.6
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.3.2...v1.3.6 )
Updates `github.com/projectdiscovery/utils` from 0.9.0 to 0.10.0
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.9.0...v0.10.0 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.27 to 1.2.28
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.27...v1.2.28 )
Updates `github.com/projectdiscovery/fastdialer` from 0.5.2 to 0.5.4
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.5.2...v0.5.4 )
Updates `github.com/projectdiscovery/hmap` from 0.0.99 to 0.0.100
- [Release notes](https://github.com/projectdiscovery/hmap/releases )
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.99...v0.0.100 )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.33 to 0.1.34
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.33...v0.1.34 )
Updates `github.com/projectdiscovery/retryabledns` from 1.0.113 to 1.0.114
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases )
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.113...v1.0.114 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.84
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.3.6
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.10.0
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.28
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.4
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
dependency-version: 0.0.100
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.34
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
dependency-version: 1.0.114
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
2026-03-25 14:23:05 +00:00
e6ed1e1b72
Chore - Code cleanup in workflows ( #1768 )
...
* Change file extension to .yml for consistency
* Move permissions for clarity and consistency
* Change compat-checks action from @master to @v1
The action should be pinned to a stable ref such as @v1, consistent with
the documentation and how other PD projects reference it.
* Fix indentations and whitespaces in workflows
2026-03-24 02:26:08 +01:00
4d9e07828b
Remove dead facebook source ( #1727 ) ( #1732 )
...
The Meta CT API has been discontinued.
2026-03-20 23:40:42 +01:00
bb5a68a23c
chore(deps): bump the modules group with 10 updates ( #1716 )
...
Bumps the modules group with 10 updates:
| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/gologger](https://github.com/projectdiscovery/gologger ) | `1.1.62` | `1.1.67` |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) | `0.0.82` | `0.0.83` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go ) | `1.1.0` | `1.1.1` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils ) | `0.7.3` | `0.8.0` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck ) | `1.2.13` | `1.2.20` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer ) | `0.4.19` | `0.5.2` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap ) | `0.0.98` | `0.0.99` |
| [github.com/projectdiscovery/machineid](https://github.com/projectdiscovery/machineid ) | `0.0.0-20240226150047-2e2c51e35983` | `0.0.0-20250715113114-c77eb3567582` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy ) | `0.1.31` | `0.1.33` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns ) | `1.0.111` | `1.0.112` |
Updates `github.com/projectdiscovery/gologger` from 1.1.62 to 1.1.67
- [Release notes](https://github.com/projectdiscovery/gologger/releases )
- [Commits](https://github.com/projectdiscovery/gologger/compare/v1.1.62...v1.1.67 )
Updates `github.com/projectdiscovery/ratelimit` from 0.0.82 to 0.0.83
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.82...v0.0.83 )
Updates `github.com/projectdiscovery/retryablehttp-go` from 1.1.0 to 1.1.1
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases )
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.1.0...v1.1.1 )
Updates `github.com/projectdiscovery/utils` from 0.7.3 to 0.8.0
- [Release notes](https://github.com/projectdiscovery/utils/releases )
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md )
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.7.3...v0.8.0 )
Updates `github.com/projectdiscovery/cdncheck` from 1.2.13 to 1.2.20
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases )
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.13...v1.2.20 )
Updates `github.com/projectdiscovery/fastdialer` from 0.4.19 to 0.5.2
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases )
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.4.19...v0.5.2 )
Updates `github.com/projectdiscovery/hmap` from 0.0.98 to 0.0.99
- [Release notes](https://github.com/projectdiscovery/hmap/releases )
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.98...v0.0.99 )
Updates `github.com/projectdiscovery/machineid` from 0.0.0-20240226150047-2e2c51e35983 to 0.0.0-20250715113114-c77eb3567582
- [Commits](https://github.com/projectdiscovery/machineid/commits )
Updates `github.com/projectdiscovery/networkpolicy` from 0.1.31 to 0.1.33
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases )
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.31...v0.1.33 )
Updates `github.com/projectdiscovery/retryabledns` from 1.0.111 to 1.0.112
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases )
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.111...v1.0.112 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/gologger
dependency-version: 1.1.67
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-version: 0.0.83
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
dependency-version: 1.1.1
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
dependency-version: 0.8.0
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
dependency-version: 1.2.20
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
dependency-version: 0.5.2
dependency-type: indirect
update-type: version-update:semver-minor
dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
dependency-version: 0.0.99
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/machineid
dependency-version: 0.0.0-20250715113114-c77eb3567582
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
dependency-version: 0.1.33
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
dependency-version: 1.0.112
dependency-type: indirect
update-type: version-update:semver-patch
dependency-group: modules
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-20 23:38:36 +01:00
2636330d22
chore(deps): bump github.com/refraction-networking/utls ( #1746 )
...
Bumps [github.com/refraction-networking/utls](https://github.com/refraction-networking/utls ) from 1.7.1 to 1.8.2.
- [Release notes](https://github.com/refraction-networking/utls/releases )
- [Commits](https://github.com/refraction-networking/utls/compare/v1.7.1...v1.8.2 )
---
updated-dependencies:
- dependency-name: github.com/refraction-networking/utls
dependency-version: 1.8.2
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-20 23:31:00 +01:00
8aa8653757
chore(deps): bump github.com/cloudflare/circl from 1.6.1 to 1.6.3 ( #1751 )
...
Bumps [github.com/cloudflare/circl](https://github.com/cloudflare/circl ) from 1.6.1 to 1.6.3.
- [Release notes](https://github.com/cloudflare/circl/releases )
- [Commits](https://github.com/cloudflare/circl/compare/v1.6.1...v1.6.3 )
---
updated-dependencies:
- dependency-name: github.com/cloudflare/circl
dependency-version: 1.6.3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-20 23:24:42 +01:00
61b85f2ec3
Merge pull request #1733 from PontusLindblom/chore/update-workflow-dependencies
...
Chore - Update workflow dependencies
2026-03-20 23:22:32 +01:00
7bd72ff7f7
use org actions
2026-03-20 23:09:48 +01:00
775a7eb5f1
Merge pull request #1764 from CharlesWong/fix/rate-limit-options
...
fix(ratelimit): honour -rl global fallback and -rls duration (#1434 )
2026-03-20 22:55:23 +01:00
240305b985
test: add edge case coverage for resolveSourceRateLimit
...
- PerSourceExceedsGlobal: per-source limit > global should be honoured
(verifies sourceRateLimitOrDefault returns source, not global)
- CaseInsensitive: source names stored lowercase must match mixed-case
lookups (documents and verifies the ToLower normalization contract)
2026-03-11 09:21:31 -07:00
cf0b8017c4
test: remove dead math.MaxUint32 no-op and unused math import
...
Per CodeRabbit nitpick: the blank identifier assignment and math import
in TestBuildMultiRateLimiter_UnlimitedWhenNoLimits served no purpose.
The test already verifies correct behavior via NoError + NotNil assertions.
2026-03-11 09:12:06 -07:00
cca10d8c9c
fix: initialize CustomRateLimit maps to prevent nil map panic
...
CodeRabbit identified that the zero-valued CustomRateLimit struct
left Custom.Map and CustomDuration.Map as nil, which could cause
a panic when resolveSourceRateLimit calls .Get() on these maps.
Mirror the initialization pattern from runner.go by explicitly
creating the underlying maps.
2026-03-11 04:06:42 -07:00
6f0e11ef05
refactor: rename misleading test per review feedback
2026-03-10 14:09:07 -07:00
c1ce78eac9
fix(ratelimit): honour -rl global fallback and -rls duration ( #1434 )
...
Two bugs in rate limit handling:
1. Global -rl flag was ignored for sources without a per-source override.
Only sources explicitly listed in -rls got rate-limited; all others
ran unlimited, defeating the purpose of -rl.
2. Per-source duration from -rls (e.g. hackertarget=2/m) was silently
dropped. runner.go stored MaxCount but discarded Duration, so all
sources defaulted to per-second regardless of the /m or /s suffix.
Root cause: runner.go converted goflags.RateLimitMap → CustomRateLimit
but only copied MaxCount. buildMultiRateLimiter only checked per-source
limits, never falling back to the global rate.
Changes:
- Add CustomDuration field to CustomRateLimit struct
- Store both MaxCount and Duration from -rls in runner.go
- Add resolveSourceRateLimit() with clear priority:
per-source > global > unlimited
- Guard against nil rateLimit in buildMultiRateLimiter
- Add 9 unit tests covering all combinations
Fixes #1434
2026-03-10 09:47:09 -07:00
13e5db7500
bump version
2026-03-05 14:48:23 +03:00
0dfd80add5
Update workflow dependencies
2026-02-07 08:21:53 +01:00
2d4f804894
Merge pull request #1723 from recepgunes1/fix/timeout-flag-not-working
...
Fix/timeout flag not working
2026-02-05 10:47:00 +03:00
a740540b8c
Merge pull request #1709 from spameier/fix/leakix-require-key
...
fix: mark LeakIX as requiring an API key
2026-02-04 16:35:01 +03:00
a349b9e34a
Merge pull request #1720 from PontusLindblom/fix/sources-in-alphabetical-order
...
Sort sources alphabetically
2026-02-04 15:21:40 +03:00
ab19329f86
Merge branch 'dev' into fix/sources-in-alphabetical-order
...
Resolve conflict by adding urlscan source in alphabetical order.
2026-02-04 15:04:45 +03:00
3286f09e73
Merge branch 'projectdiscovery:dev' into fix/timeout-flag-not-working
2026-02-03 21:01:21 +03:00
8a57c4f446
Merge pull request #1710 from projectdiscovery/add-urlscan-source
...
feat: add URLScan.io as passive subdomain source
2026-02-03 20:12:44 +03:00
0b51762608
Add PR template ( #1729 )
2026-02-03 15:25:54 +05:30
ChrisJr404