admin/projectdiscovery-subfinder
1
0
Fork 0
mirror of https://github.com/projectdiscovery/subfinder synced 2026-06-21 14:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,181 Commits 5 Branches 61 Tags
75f3c283f0fdaf3239c53edbbc7ddc908428b97b
Commit Graph

2181 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
x-stp 75f3c283f0 fix(intelx): remove dead read after decoder drained body 
jsoniter.NewDecoder(resp.Body).Decode(...) drains the body, so the subsequent io.ReadAll read 0 bytes and its error branch was unreachable. Delete the dead read and drop the now-unused io import.
 2026-04-18 14:55:16 +02:00
x-stp 14103b5433 fix(hackertarget): drop duplicate apikey query param 2026-04-18 14:50:35 +02:00
Dogan Can Bakir 85929ab9ee Merge pull request #1769 from projectdiscovery/dependabot/go_modules/dev/modules-366a3d4240 
chore(deps): bump the modules group with 8 updates
 2026-04-07 14:55:05 +03:00
dependabot[bot] 4de1ddee7e chore(deps): bump the modules group with 8 updates 
Bumps the modules group with 8 updates:

| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit) | `0.0.83` | `0.0.84` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) | `1.3.2` | `1.3.6` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) | `0.9.0` | `0.10.0` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck) | `1.2.27` | `1.2.28` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) | `0.5.2` | `0.5.4` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap) | `0.0.99` | `0.0.100` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy) | `0.1.33` | `0.1.34` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns) | `1.0.113` | `1.0.114` |


Updates `github.com/projectdiscovery/ratelimit` from 0.0.83 to 0.0.84
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases)
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.83...v0.0.84)

Updates `github.com/projectdiscovery/retryablehttp-go` from 1.3.2 to 1.3.6
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.3.2...v1.3.6)

Updates `github.com/projectdiscovery/utils` from 0.9.0 to 0.10.0
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.9.0...v0.10.0)

Updates `github.com/projectdiscovery/cdncheck` from 1.2.27 to 1.2.28
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases)
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.27...v1.2.28)

Updates `github.com/projectdiscovery/fastdialer` from 0.5.2 to 0.5.4
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.5.2...v0.5.4)

Updates `github.com/projectdiscovery/hmap` from 0.0.99 to 0.0.100
- [Release notes](https://github.com/projectdiscovery/hmap/releases)
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.99...v0.0.100)

Updates `github.com/projectdiscovery/networkpolicy` from 0.1.33 to 0.1.34
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases)
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.33...v0.1.34)

Updates `github.com/projectdiscovery/retryabledns` from 1.0.113 to 1.0.114
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases)
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.113...v1.0.114)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
  dependency-version: 0.0.84
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-version: 1.3.6
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
  dependency-version: 0.10.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
  dependency-version: 1.2.28
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-version: 0.5.4
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
  dependency-version: 0.0.100
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
  dependency-version: 0.1.34
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
  dependency-version: 1.0.114
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-03-25 14:23:05 +00:00
Pontus Lindblom e6ed1e1b72 Chore - Code cleanup in workflows (#1768) 
* Change file extension to .yml for consistency

* Move permissions for clarity and consistency

* Change compat-checks action from @master to @v1

The action should be pinned to a stable ref such as @v1, consistent with
the documentation and how other PD projects reference it.

* Fix indentations and whitespaces in workflows
 2026-03-24 02:26:08 +01:00
Pontus Lindblom 4d9e07828b Remove dead facebook source (#1727) (#1732) 
The Meta CT API has been discontinued.
 2026-03-20 23:40:42 +01:00
dependabot[bot] bb5a68a23c chore(deps): bump the modules group with 10 updates (#1716) 
Bumps the modules group with 10 updates:

| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/gologger](https://github.com/projectdiscovery/gologger) | `1.1.62` | `1.1.67` |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit) | `0.0.82` | `0.0.83` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) | `1.1.0` | `1.1.1` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) | `0.7.3` | `0.8.0` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck) | `1.2.13` | `1.2.20` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) | `0.4.19` | `0.5.2` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap) | `0.0.98` | `0.0.99` |
| [github.com/projectdiscovery/machineid](https://github.com/projectdiscovery/machineid) | `0.0.0-20240226150047-2e2c51e35983` | `0.0.0-20250715113114-c77eb3567582` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy) | `0.1.31` | `0.1.33` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns) | `1.0.111` | `1.0.112` |


Updates `github.com/projectdiscovery/gologger` from 1.1.62 to 1.1.67
- [Release notes](https://github.com/projectdiscovery/gologger/releases)
- [Commits](https://github.com/projectdiscovery/gologger/compare/v1.1.62...v1.1.67)

Updates `github.com/projectdiscovery/ratelimit` from 0.0.82 to 0.0.83
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases)
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.82...v0.0.83)

Updates `github.com/projectdiscovery/retryablehttp-go` from 1.1.0 to 1.1.1
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.1.0...v1.1.1)

Updates `github.com/projectdiscovery/utils` from 0.7.3 to 0.8.0
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.7.3...v0.8.0)

Updates `github.com/projectdiscovery/cdncheck` from 1.2.13 to 1.2.20
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases)
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.2.13...v1.2.20)

Updates `github.com/projectdiscovery/fastdialer` from 0.4.19 to 0.5.2
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.4.19...v0.5.2)

Updates `github.com/projectdiscovery/hmap` from 0.0.98 to 0.0.99
- [Release notes](https://github.com/projectdiscovery/hmap/releases)
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.98...v0.0.99)

Updates `github.com/projectdiscovery/machineid` from 0.0.0-20240226150047-2e2c51e35983 to 0.0.0-20250715113114-c77eb3567582
- [Commits](https://github.com/projectdiscovery/machineid/commits)

Updates `github.com/projectdiscovery/networkpolicy` from 0.1.31 to 0.1.33
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases)
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.31...v0.1.33)

Updates `github.com/projectdiscovery/retryabledns` from 1.0.111 to 1.0.112
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases)
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.111...v1.0.112)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/gologger
  dependency-version: 1.1.67
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/ratelimit
  dependency-version: 0.0.83
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-version: 1.1.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
  dependency-version: 0.8.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
  dependency-version: 1.2.20
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-version: 0.5.2
  dependency-type: indirect
  update-type: version-update:semver-minor
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
  dependency-version: 0.0.99
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/machineid
  dependency-version: 0.0.0-20250715113114-c77eb3567582
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
  dependency-version: 0.1.33
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
  dependency-version: 1.0.112
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-03-20 23:38:36 +01:00
dependabot[bot] 2636330d22 chore(deps): bump github.com/refraction-networking/utls (#1746) 
Bumps [github.com/refraction-networking/utls](https://github.com/refraction-networking/utls) from 1.7.1 to 1.8.2.
- [Release notes](https://github.com/refraction-networking/utls/releases)
- [Commits](https://github.com/refraction-networking/utls/compare/v1.7.1...v1.8.2)

---
updated-dependencies:
- dependency-name: github.com/refraction-networking/utls
  dependency-version: 1.8.2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-03-20 23:31:00 +01:00
dependabot[bot] 8aa8653757 chore(deps): bump github.com/cloudflare/circl from 1.6.1 to 1.6.3 (#1751) 
Bumps [github.com/cloudflare/circl](https://github.com/cloudflare/circl) from 1.6.1 to 1.6.3.
- [Release notes](https://github.com/cloudflare/circl/releases)
- [Commits](https://github.com/cloudflare/circl/compare/v1.6.1...v1.6.3)

---
updated-dependencies:
- dependency-name: github.com/cloudflare/circl
  dependency-version: 1.6.3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-03-20 23:24:42 +01:00
Mzack9999 61b85f2ec3 Merge pull request #1733 from PontusLindblom/chore/update-workflow-dependencies 
Chore - Update workflow dependencies
 2026-03-20 23:22:32 +01:00
Mzack9999 7bd72ff7f7 use org actions 2026-03-20 23:09:48 +01:00
Mzack9999 775a7eb5f1 Merge pull request #1764 from CharlesWong/fix/rate-limit-options 
fix(ratelimit): honour -rl global fallback and -rls duration (#1434)
 2026-03-20 22:55:23 +01:00
Charles Wong 240305b985 test: add edge case coverage for resolveSourceRateLimit 
- PerSourceExceedsGlobal: per-source limit > global should be honoured
  (verifies sourceRateLimitOrDefault returns source, not global)
- CaseInsensitive: source names stored lowercase must match mixed-case
  lookups (documents and verifies the ToLower normalization contract)
 2026-03-11 09:21:31 -07:00
Charles Wong cf0b8017c4 test: remove dead math.MaxUint32 no-op and unused math import 
Per CodeRabbit nitpick: the blank identifier assignment and math import
in TestBuildMultiRateLimiter_UnlimitedWhenNoLimits served no purpose.
The test already verifies correct behavior via NoError + NotNil assertions.
 2026-03-11 09:12:06 -07:00
Charles Wong cca10d8c9c fix: initialize CustomRateLimit maps to prevent nil map panic 
CodeRabbit identified that the zero-valued CustomRateLimit struct
left Custom.Map and CustomDuration.Map as nil, which could cause
a panic when resolveSourceRateLimit calls .Get() on these maps.

Mirror the initialization pattern from runner.go by explicitly
creating the underlying maps.
 2026-03-11 04:06:42 -07:00
Charles Wong 6f0e11ef05 refactor: rename misleading test per review feedback 2026-03-10 14:09:07 -07:00
Charles Wong c1ce78eac9 fix(ratelimit): honour -rl global fallback and -rls duration (#1434) 
Two bugs in rate limit handling:

1. Global -rl flag was ignored for sources without a per-source override.
   Only sources explicitly listed in -rls got rate-limited; all others
   ran unlimited, defeating the purpose of -rl.

2. Per-source duration from -rls (e.g. hackertarget=2/m) was silently
   dropped. runner.go stored MaxCount but discarded Duration, so all
   sources defaulted to per-second regardless of the /m or /s suffix.

Root cause: runner.go converted goflags.RateLimitMap → CustomRateLimit
but only copied MaxCount. buildMultiRateLimiter only checked per-source
limits, never falling back to the global rate.

Changes:
- Add CustomDuration field to CustomRateLimit struct
- Store both MaxCount and Duration from -rls in runner.go
- Add resolveSourceRateLimit() with clear priority:
  per-source > global > unlimited
- Guard against nil rateLimit in buildMultiRateLimiter
- Add 9 unit tests covering all combinations

Fixes #1434
 2026-03-10 09:47:09 -07:00
Doğan Can Bakır 13e5db7500 bump version 2026-03-05 14:48:23 +03:00
PontusLindblom 0dfd80add5 Update workflow dependencies 2026-02-07 08:21:53 +01:00
Dogan Can Bakir 2d4f804894 Merge pull request #1723 from recepgunes1/fix/timeout-flag-not-working 
Fix/timeout flag not working
 2026-02-05 10:47:00 +03:00
Dogan Can Bakir a740540b8c Merge pull request #1709 from spameier/fix/leakix-require-key 
fix: mark LeakIX as requiring an API key
 2026-02-04 16:35:01 +03:00
Dogan Can Bakir a349b9e34a Merge pull request #1720 from PontusLindblom/fix/sources-in-alphabetical-order 
Sort sources alphabetically
 2026-02-04 15:21:40 +03:00
Doğan Can Bakır ab19329f86 Merge branch 'dev' into fix/sources-in-alphabetical-order 
Resolve conflict by adding urlscan source in alphabetical order.
 2026-02-04 15:04:45 +03:00
Recep Gunes 3286f09e73 Merge branch 'projectdiscovery:dev' into fix/timeout-flag-not-working 2026-02-03 21:01:21 +03:00
Dogan Can Bakir 8a57c4f446 Merge pull request #1710 from projectdiscovery/add-urlscan-source 
feat: add URLScan.io as passive subdomain source
 2026-02-03 20:12:44 +03:00
Dogan Can Bakir 0b51762608 Add PR template (#1729) 2026-02-03 15:25:54 +05:30
Recep Gunes fba1cc3d27 fix timeout flag not working for crtsh source 2026-02-02 18:13:11 +03:00
Jigardjain 58c1e5ac82 refactor: simplify urlscan source to use session rate limiting 
Remove custom pagination delay and retry logic since the session
already handles rate limiting via MultiRateLimiter. This aligns
with how other sources (shodan, virustotal) are implemented.
 2026-01-30 18:05:47 +05:30
Jigardjain 675be65d47 test: skip flaky sources in TestSourcesWithoutKeys 
Add leakix, reconeer, and sitedossier to ignored sources list:
- leakix: now requires API key (returns 401)
- reconeer: now requires API key (returns 401)
- sitedossier: flaky, returns no results in CI
 2026-01-30 17:57:10 +05:30
Jigardjain e8c0e16d6d fix: replace deprecated errorutil with fmt.Errorf in facebook source 
Replace deprecated github.com/projectdiscovery/utils/errors package
with standard Go error wrapping using fmt.Errorf to fix staticcheck
SA1019 linter errors.
 2026-01-30 17:42:20 +05:30
Jigardjain 978addb8bd feat: add URLScan.io as passive subdomain source 
Add URLScan.io as a new passive subdomain enumeration source with full
pagination support and robust rate limiting handling.

Features:
- Fetches subdomains from URLScan.io Search API
- Implements cursor-based pagination using search_after parameter
- Extracts domains from task.domain, task.url, page.domain, page.url fields
- Requires API key (free tier available at urlscan.io)

Rate Limiting:
- Conservative pagination delay (10s between pages) to respect strict burst limits
- Exponential backoff retry logic for 429/503 responses
- Respects X-Rate-Limit-Reset-After header for dynamic backoff
- Limited to 5 pages max (500 results) to avoid quota exhaustion

Configuration:
- Max 5 pages per enumeration (configurable via maxPages constant)
- 100 results per page (configurable via maxPerPage constant)
- 2 retry attempts for rate-limited requests
- 20 second initial backoff, doubles on each retry

Changes:
- pkg/subscraping/sources/urlscan/urlscan.go: New URLScan source implementation
- pkg/passive/sources.go: Register URLScan source
- pkg/passive/sources_test.go: Add URLScan to test lists
- pkg/runner/options.go: Add urlscan to source options
- .github/workflows/build-test.yml: Add URLSCAN_API_KEY secret

Closes: Feature request for URLScan.io integration
 2026-01-30 17:02:44 +05:30
PontusLindblom b71a21bd9b Sort sources alphabetically 
Ensure the order of -ls matches provider-config.yaml to
avoid confusion when comparing them.
 2026-01-29 18:04:58 +01:00
dependabot[bot] 227ef90b2f chore(deps): bump the modules group with 10 updates (#1714) 
Bumps the modules group with 10 updates:

| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/dnsx](https://github.com/projectdiscovery/dnsx) | `1.2.2` | `1.2.3` |
| [github.com/projectdiscovery/gologger](https://github.com/projectdiscovery/gologger) | `1.1.54` | `1.1.62` |
| [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit) | `0.0.81` | `0.0.82` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) | `1.0.115` | `1.1.0` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) | `0.4.21` | `0.7.3` |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck) | `1.1.24` | `1.2.13` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) | `0.4.1` | `0.4.19` |
| [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap) | `0.0.90` | `0.0.98` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy) | `0.1.16` | `0.1.31` |
| [github.com/projectdiscovery/retryabledns](https://github.com/projectdiscovery/retryabledns) | `1.0.102` | `1.0.111` |


Updates `github.com/projectdiscovery/dnsx` from 1.2.2 to 1.2.3
- [Release notes](https://github.com/projectdiscovery/dnsx/releases)
- [Commits](https://github.com/projectdiscovery/dnsx/compare/v1.2.2...v1.2.3)

Updates `github.com/projectdiscovery/gologger` from 1.1.54 to 1.1.62
- [Release notes](https://github.com/projectdiscovery/gologger/releases)
- [Commits](https://github.com/projectdiscovery/gologger/compare/v1.1.54...v1.1.62)

Updates `github.com/projectdiscovery/ratelimit` from 0.0.81 to 0.0.82
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases)
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.81...v0.0.82)

Updates `github.com/projectdiscovery/retryablehttp-go` from 1.0.115 to 1.1.0
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.115...v1.1.0)

Updates `github.com/projectdiscovery/utils` from 0.4.21 to 0.7.3
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.4.21...v0.7.3)

Updates `github.com/projectdiscovery/cdncheck` from 1.1.24 to 1.2.13
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases)
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.1.24...v1.2.13)

Updates `github.com/projectdiscovery/fastdialer` from 0.4.1 to 0.4.19
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.4.1...v0.4.19)

Updates `github.com/projectdiscovery/hmap` from 0.0.90 to 0.0.98
- [Release notes](https://github.com/projectdiscovery/hmap/releases)
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.90...v0.0.98)

Updates `github.com/projectdiscovery/networkpolicy` from 0.1.16 to 0.1.31
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases)
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.16...v0.1.31)

Updates `github.com/projectdiscovery/retryabledns` from 1.0.102 to 1.0.111
- [Release notes](https://github.com/projectdiscovery/retryabledns/releases)
- [Commits](https://github.com/projectdiscovery/retryabledns/compare/v1.0.102...v1.0.111)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/dnsx
  dependency-version: 1.2.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/gologger
  dependency-version: 1.1.62
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/ratelimit
  dependency-version: 0.0.82
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-version: 1.1.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
  dependency-version: 0.7.3
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/cdncheck
  dependency-version: 1.2.13
  dependency-type: indirect
  update-type: version-update:semver-minor
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-version: 0.4.19
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/hmap
  dependency-version: 0.0.98
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
  dependency-version: 0.1.31
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryabledns
  dependency-version: 1.0.111
  dependency-type: indirect
  update-type: version-update:semver-patch
  dependency-group: modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-01-24 15:11:49 +05:30
Mikel Olasagasti Uranga d9f08bdc64 dependanbot: change path after #1613 (#1708) 2026-01-24 15:06:27 +05:30
spameier 1eac4a2b13 fix: mark LeakIX as requiring an API key 2026-01-21 21:38:35 +01:00
Dogan Can Bakir c846de75ac Merge pull request #1696 from projectdiscovery/dev 
v2.12.0
v2.12.0 		2026-01-12 15:24:30 +07:00
Mzack9999 4984bfb3a7 Merge pull request #1699 from projectdiscovery/feature/request-tracking-stats 
Add request tracking to -stats flag
 2026-01-07 18:10:35 +04:00
Mzack9999 4bba544dfe Merge branch 'dev' into feature/request-tracking-stats 2026-01-07 18:07:37 +04:00
Dogan Can Bakir a2615faa73 Merge pull request #1700 from projectdiscovery/feature/optional-api-key-support 
Add optional API key support for sources
 2026-01-06 01:01:22 +07:00
Doğan Can Bakır 1ca2a67f92 add optional API key support for sources 
- add KeyRequirement enum with three states: NoKey, OptionalKey, RequiredKey
- add KeyRequirement() method to Source interface
- update config generation to include optional sources
- update env var loading for optional sources
- update source listing with ~ marker for optional sources
- mark hackertarget, leakix, reconeer as OptionalKey
- fix hackertarget and reconeer to work without API key

closes #1695
 2026-01-05 15:00:59 +03:00
Doğan Can Bakır 9b4705252e fix race condition in github and gitlab sources 
use atomic.Int32 for counter fields to prevent data races when
multiple goroutines concurrently increment requests/results/errors
 2026-01-05 14:23:20 +03:00
Doğan Can Bakır e96320ec38 add request tracking to -stats flag 
Adds request counting to all sources to help users monitor API usage
and debug quota consumption issues like #1562.

Changes:
- Add Requests field to Statistics struct
- Track HTTP requests in all 53 sources
- Display request count in stats output

Closes #1698
 2026-01-05 14:14:20 +03:00
Dogan Can Bakir c1977c0315 Merge pull request #1694 from projectdiscovery/add_reconeer 
add reconeer
 2026-01-05 17:29:41 +07:00
Doğan Can Bakır 8eacfb143a bump version 2026-01-05 11:42:17 +03:00
Dogan Can Bakir 9d815b78a4 Merge pull request #1622 from projectdiscovery/1576_add_apikey_support_for_hackertarget 
add apikey support for hackertarget
 2026-01-04 22:29:27 +07:00
Dogan Can Bakir e5a61a6db7 Merge branch 'dev' into 1576_add_apikey_support_for_hackertarget 2026-01-04 22:26:01 +07:00
Doğan Can Bakır fe41f49040 add reconeer 2026-01-04 15:56:45 +03:00
Dogan Can Bakir 933918a3cb Merge pull request #1689 from projectdiscovery/dev 
v2.11.0
v2.11.0 		2025-12-20 00:29:28 +07:00
Dogan Can Bakir 2e0982cb0e Merge pull request #1683 from nohehf/main 
feat: add merklemap source
 2025-12-20 00:12:02 +07:00
nohehf 322a4336ed Merge branch 'dev' into main 2025-12-19 17:33:49 +01:00