admin/projectdiscovery-httpx
1
0
Fork 0
mirror of https://github.com/projectdiscovery/httpx synced 2026-06-08 16:50:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,774 Commits 15 Branches 65 Tags
dev
Commit Graph

126 Commits

Author SHA1 Message Date
Dogan Can Bakir 4311f8b736 Merge pull request #2363 from projectdiscovery/feature/database-output 
feat: add database output support for storing scan results
 2026-03-03 21:01:43 +03:00
Adel Assakaf fa950239f2 fix: prevent data loss on interrupt by implementing graceful shutdown 2026-02-05 05:03:40 +01:00
Doğan Can Bakır 2ea576f175 feat: add database output support for storing scan results 
Add support for storing httpx scan results directly to databases with
both CLI flags and YAML config file options.

Supported databases:
- MongoDB
- PostgreSQL
- MySQL

Features:
- Batched writes for performance (configurable batch size)
- Auto-flush with configurable interval
- Individual columns for each Result field (not JSON blob)
- Support for environment variable HTTPX_DB_CONNECTION_STRING
- Option to omit raw request/response data (-rdbor)

New CLI flags under OUTPUT group:
- -rdb, -result-db: enable database storage
- -rdbc, -result-db-config: path to YAML config file
- -rdbt, -result-db-type: database type (mongodb, postgres, mysql)
- -rdbcs, -result-db-conn: connection string
- -rdbn, -result-db-name: database name (default: httpx)
- -rdbtb, -result-db-table: table/collection name (default: results)
- -rdbbs, -result-db-batch-size: batch size (default: 100)
- -rdbor, -result-db-omit-raw: omit raw data

Closes #1973
Closes #2360
Closes #2361
Closes #2362
 2026-01-12 12:25:22 +03:00
Mzack9999 6ddf7ca9ac Enable screenshot upload (#2307) 
enable screenshot upload
 2025-11-14 23:51:58 +05:30
Mzack9999 27a22c6ac6 Fixing custom asset id upload (#2305) 
fixing custom asset id
 2025-11-08 02:23:37 +05:30
dependabot[bot] f973821811 chore(deps): bump the modules group with 7 updates (#2216) 
* chore(deps): bump the modules group with 7 updates

Bumps the modules group with 7 updates:

| Package | From | To |
| --- | --- | --- |
| [github.com/projectdiscovery/cdncheck](https://github.com/projectdiscovery/cdncheck) | `1.1.27` | `1.1.28` |
| [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) | `0.4.1` | `0.4.2` |
| [github.com/projectdiscovery/networkpolicy](https://github.com/projectdiscovery/networkpolicy) | `0.1.17` | `0.1.18` |
| [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) | `1.0.117` | `1.0.118` |
| [github.com/projectdiscovery/tlsx](https://github.com/projectdiscovery/tlsx) | `1.1.9` | `1.2.0` |
| [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) | `0.4.21` | `0.4.22` |
| [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) | `0.2.37` | `0.2.38` |


Updates `github.com/projectdiscovery/cdncheck` from 1.1.27 to 1.1.28
- [Release notes](https://github.com/projectdiscovery/cdncheck/releases)
- [Changelog](https://github.com/projectdiscovery/cdncheck/blob/main/.goreleaser.yaml)
- [Commits](https://github.com/projectdiscovery/cdncheck/compare/v1.1.27...v1.1.28)

Updates `github.com/projectdiscovery/fastdialer` from 0.4.1 to 0.4.2
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.4.1...v0.4.2)

Updates `github.com/projectdiscovery/networkpolicy` from 0.1.17 to 0.1.18
- [Release notes](https://github.com/projectdiscovery/networkpolicy/releases)
- [Commits](https://github.com/projectdiscovery/networkpolicy/compare/v0.1.17...v0.1.18)

Updates `github.com/projectdiscovery/retryablehttp-go` from 1.0.117 to 1.0.118
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.117...v1.0.118)

Updates `github.com/projectdiscovery/tlsx` from 1.1.9 to 1.2.0
- [Release notes](https://github.com/projectdiscovery/tlsx/releases)
- [Changelog](https://github.com/projectdiscovery/tlsx/blob/main/.goreleaser.yml)
- [Commits](https://github.com/projectdiscovery/tlsx/compare/v1.1.9...v1.2.0)

Updates `github.com/projectdiscovery/utils` from 0.4.21 to 0.4.22
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.4.21...v0.4.22)

Updates `github.com/projectdiscovery/wappalyzergo` from 0.2.37 to 0.2.38
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.2.37...v0.2.38)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/cdncheck
  dependency-version: 1.1.28
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-version: 0.4.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/networkpolicy
  dependency-version: 0.1.18
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-version: 1.0.118
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/tlsx
  dependency-version: 1.2.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/utils
  dependency-version: 0.4.22
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-version: 0.2.38
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: modules
...

Signed-off-by: dependabot[bot] <support@github.com>

* lint

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2025-07-22 13:27:25 +05:30
Ramana Reddy eb2b540324 Add team-id option (#1886) 
add team-id option
 2024-08-22 19:26:31 +05:30
Tarun Koyalwar 63b64cb4e6 feat: httpx results dashboard (#1834) 
* misc updates

* WIP: add dashboard support

* feat dashboard support

* screenshot with upload validation

* misc textual update

* interactive api key login

* feat: add -pdu local results file upload

* fix missing tech info in dashboard

* update flag description

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
 2024-07-26 20:57:19 +05:30
Tarun Koyalwar c7456929b4 fix integration tests and upgrade deps 2023-02-08 19:50:03 +05:30
Ice3man e236531eac Added profile-mem flag for memory profiling (#738) 2022-08-30 17:05:14 +05:30
mzack b7afe803c3 Adding stop-resume support 2021-08-06 12:38:42 +02:00
mzack a786957e19 Making runner public 
Implements #258
 2021-05-06 10:35:02 +02:00
Ice3man543 63cb1277fe Fix conflict 2021-04-06 18:33:40 +05:30
Ice3man543 07bff31c45 Added wappalyzer based technology detection 2021-04-06 18:13:55 +05:30
Mzack9999 dcb7ee9adc gologger syntax refactor 2021-02-16 23:40:01 +01:00
Mzack9999 8389bef8c0 fixing go lint 2020-11-16 20:23:34 +01:00
Mzack9999 976fe3940e code refactor 2020-10-20 20:17:02 +02:00
Mzack9999 8289f46867 making string matching case insensitive 2020-10-20 19:54:09 +02:00
Víctor Zamanillo 2b3b9ab349 Fixed appendAssign 2020-10-14 22:40:35 +02:00
bauthard c3962a518f Merge pull request #139 from projectdiscovery/feature-ipv6-dns 
adding support for ipv6
 2020-10-14 01:31:29 +05:30
Mzack9999 eb3cfdafc7 changed duration => response time 2020-10-13 20:09:47 +02:00
Mzack9999 28f630cefd adding support for ipv6 2020-10-13 19:35:18 +02:00
Mzack9999 ffb1b97559 Merge branch 'master' into bugfix-full-rawhttp 2020-10-13 01:44:55 +02:00
bauthard 18ecbc79c3 version update 2020-10-07 16:00:06 +05:30
bauthard 49347f50fe Merge pull request #130 from projectdiscovery/remove-automatic-cdn 
making cdn check optional
 2020-10-04 13:08:09 +05:30
Mzack9999 d4e72d805b making cdn check optional 2020-10-02 22:39:37 +02:00
Mzack9999 605735afbb fixing golint 2020-10-02 16:53:41 +02:00
Mzack9999 2c44440bad adding skipping HTTP if HTTPS is found 2020-09-30 22:50:06 +02:00
Mzack9999 56f2df861d Merge branch 'master' into bugfix-full-rawhttp 2020-09-30 20:54:22 +02:00
bauthard f4d155f927 Merge pull request #126 from projectdiscovery/feature-response-time 
adding response time
 2020-09-30 11:15:01 +05:30
Mzack9999 f02c58a855 adding automatic content-length 2020-09-30 00:44:20 +02:00
Mzack9999 389b50ea9f adding response time 2020-09-30 00:22:03 +02:00
Mzack9999 79a5b01e7b removed unused constant 2020-09-29 22:10:13 +02:00
Mzack9999 6497301abf full raw http control 2020-09-29 22:07:50 +02:00
Víctor Zamanillo 7689153466 Fixed reading input file 
Fixes #123.

This bug was introduced on #117, closing the input file has to be deferred or we will try to read from a closed stream.
 2020-09-29 10:21:41 +02:00
Víctor Zamanillo 0821eaa5a8 Fixed errcheck issues 2020-09-26 22:13:03 +02:00
Víctor Zamanillo afca2fe629 gofmt 2020-09-26 20:42:32 +02:00
Víctor Zamanillo e9aa081544 Fixed gomnd issues 2020-09-26 19:56:17 +02:00
Víctor Zamanillo 18e5dae704 Fixed goconst issues 2020-09-25 19:27:19 +02:00
Víctor Zamanillo cd4e59ce27 Fixed maligned issues 2020-09-25 18:55:32 +02:00
Víctor Zamanillo 9e8e88540f Fixed whitespace issues 2020-09-25 18:40:36 +02:00
Víctor Zamanillo c1df31cb49 Fixed gocritic issues 2020-09-25 18:39:35 +02:00
Víctor Zamanillo d184548c29 Fixed golint issues 2020-09-25 18:30:38 +02:00
bauthard 4129b88c92 readme update 2020-09-22 12:04:58 +05:30
Mzack9999 f71cb971a4 avoid fatal on store response error 2020-09-22 00:31:42 +02:00
Mzack9999 dc008dd956 case insensitive string filter/match 2020-09-16 07:38:48 +02:00
Mzack9999 fc3edabe3b Merge branch 'master' into feature-string-regex-match 2020-09-16 07:12:38 +02:00
Mzack9999 d5e0b89f0f Merge branch 'master' into feature-string-regex-match 2020-09-15 20:01:00 +02:00
Mzack9999 5522467a0f Merge branch 'master' into feature-ips-cnames 2020-09-15 19:59:10 +02:00
Mzack9999 4756a77cce printing first cname 2020-09-15 19:56:51 +02:00