Commit Graph

242 Commits

Author SHA1 Message Date
Ramana Reddy 5e8d15e9e3 Use standard slices lib 2024-02-01 21:38:38 +05:30
Ramana Reddy e8b6207809 exlcude cdn on custom ports 2024-01-25 19:37:33 +05:30
Ramana Reddy 42ea49399a Fix exclude cdn option 2024-01-25 18:41:25 +05:30
mzack 2a26a32d2e increase error verbosity on asn failure 2024-01-21 21:07:24 +01:00
Yoshino-s b57c8c31db feat(flags): add screenshot-timeout flag (#1516)
* chore(deps): bump golang.org/x/net from 0.14.0 to 0.17.0 (#1400)

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.14.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump golang.org/x/crypto from 0.14.0 to 0.17.0 (#1493)

Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/crypto/compare/v0.14.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* feat(flags): add screenshot-timeout flag

* misc update

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2024-01-16 04:08:04 +05:30
CyberStryk 6af95a5a84 Update -tls-probe option to probe extracted TLS dns_names from all targets (#1461)
* chore(deps): bump golang.org/x/net from 0.14.0 to 0.17.0 (#1400)

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.14.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Updates the -tls-probe scan option to probe all extracted TLS domains.

* chore(deps): bump golang.org/x/crypto from 0.14.0 to 0.17.0 (#1493)

Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/crypto/compare/v0.14.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump github.com/cloudflare/circl from 1.3.3 to 1.3.7 (#1526)

Bumps [github.com/cloudflare/circl](https://github.com/cloudflare/circl) from 1.3.3 to 1.3.7.
- [Release notes](https://github.com/cloudflare/circl/releases)
- [Commits](https://github.com/cloudflare/circl/compare/v1.3.3...v1.3.7)

---
updated-dependencies:
- dependency-name: github.com/cloudflare/circl
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump github.com/quic-go/quic-go from 0.37.4 to 0.37.7 (#1531)

Bumps [github.com/quic-go/quic-go](https://github.com/quic-go/quic-go) from 0.37.4 to 0.37.7.
- [Release notes](https://github.com/quic-go/quic-go/releases)
- [Changelog](https://github.com/quic-go/quic-go/blob/master/Changelog.md)
- [Commits](https://github.com/quic-go/quic-go/compare/v0.37.4...v0.37.7)

---
updated-dependencies:
- dependency-name: github.com/quic-go/quic-go
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: CyberStryk <cyberstryk0@gmail.com>
2024-01-15 17:56:11 +05:30
Ramana Reddy 64b6a0789c Fix: Pipeline and Websocket not working for some targets (#1528)
* Fix pipeline issue for port included targets

* Add more checks to websocket
2024-01-15 15:06:28 +05:30
mzack e557bf8662 using fastdialer deny 2024-01-07 21:10:56 +01:00
Doğan Can Bakır af5909bcac introduce -exclude flag 2024-01-04 15:16:02 +03:00
Dogan Can Bakir 712f8545f6 fix existing response dir issue (#1451)
* fix existing response dir issue

* misc update

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-11-29 11:53:15 +05:30
seeyarh 91139dbc91 Fix chrome unsafe port err by setting explicitly-allowed-ports (#1343)
* Update headless.go

* adding headless generic option

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2023-11-28 18:18:29 +05:30
Dogan Can Bakir 7b08aaf803 fix windows path issue (#1431)
* fix windows path issue

* remove `file:///`
2023-11-13 12:35:53 +05:30
Cody Cline 7dee9988ca Feature: optional flag to skip a host if it has a private IP address. (#1408)
* feat: Implement flag which when enabled, will skip any host with a private ip address instead of timing out.

* fix: Amend private ip check to include loopback and link-local addresses

* fix: Amend debug message to be more concise

* fix: Account for port numbers in skipPrivateHosts feature

* docs: Remove uncessary  debug statement

* readme update

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-11-02 14:21:22 +05:30
Ramana Reddy 0153b45144 Add SNI to json output (#1423)
add sni to json output
2023-11-02 14:04:35 +05:30
Mzack9999 af1898ce79 Merge pull request #1373 from secinto/updateRedirectChainStorage
Update redirect chain storage
2023-10-16 14:31:23 +02:00
Stefan Kraxberger 9685ffccba Updated storing the chain so that also the reponse body is stored 2023-09-20 11:51:57 +02:00
Doğan Can Bakır 0f1b51b6c8 introduce visual recon clusters 2023-09-20 08:31:30 +00:00
Doğan Can Bakır e5d8036ec0 add phash calculation for screenshot 2023-09-18 08:27:21 +00:00
Mzack9999 88fa321dc4 Restoring https://github.com/projectdiscovery/httpx/pull/1331 (#1360)
* Restoring https://github.com/projectdiscovery/httpx/pull/1331

* updating readme
2023-09-14 17:51:38 +05:30
kz0ltan cb522ce69d Fixed DNS resolving A records when -ports is set (#1347)
* Fixed DNS resolving A records when -ports is set

* fixed ineffectual assignment

* fmt

---------

Co-authored-by: kzoltan <zoltan.koszo@gmail.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2023-09-13 22:39:43 +05:30
Dogan Can Bakir ddad7c8eb7 fix minor screenshot issues (#1353)
* fix minor screenshot issues

* fix no file or dir err
2023-09-13 16:35:30 +05:30
JoMar 11fa743dd9 Allow to show response headers in json output without using -irh option (#1326)
* Show responses headers in JSON output

* Update ident

* Update options name

* Update option & README

* Add missing 's'

* Add missing 's'

* updated headers to header for user facing variable to keep it uniform

* updating doc

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-09-12 03:37:54 +05:30
Mzack9999 8d32c15701 restoring code 2023-09-11 17:58:59 +02:00
Mzack9999 0f6edb50be refactor hsts implementation 2023-09-11 17:53:26 +02:00
Mzack9999 8b5dc7bc0f merge conflict 2023-09-11 16:58:31 +02:00
Ramana Reddy 76adadfeb4 Add flag to preview first N characters (#1316)
* Add flag to preview first N characters

* use dynamic var for body-preview flag

* strip html tags from response

* add stripe option to remove html or xml tags

* typo

* resolve merge conflicts

* add test and update readme

* update readme

* typo

* typo no 2

* small refactor

* include body preview in jsonl output

* minor changes

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-09-07 15:26:54 +05:30
Dogan Can Bakir e9893a836e fix screenshot path issue (#1340) 2023-09-07 14:50:19 +05:30
Dogan Can Bakir d8142602cd fix favicon host header issue (#1339) 2023-09-07 14:48:21 +05:30
Dogan Can Bakir f36a2c05e9 remove fullurl from req-res (#1337)
* remove fullurl from req-res

* add fullurl at the end
2023-09-06 23:24:59 +05:30
Stefan Kraxberger 964cc3bbd0 Implemented a redirect strategy which respects HSTS headers and modifies the URL accordingly if necessary 2023-08-31 10:58:51 +02:00
Stefan Kraxberger 2ad958cf91 Modified storing of response chains, because it was not correct 2023-08-30 16:16:56 +02:00
Stefan Kraxberger 9f6c9d0804 Modified storing of response chains, because it was not correct 2023-08-30 16:15:41 +02:00
Stefan Kraxberger 13f78bc302 Modified storing of response chains, because it was not correct 2023-08-30 16:06:45 +02:00
secinto d463b3bcda Merge branch 'dev' into feature_1330 2023-08-27 16:09:40 +02:00
Stefan Kraxberger 9be9fb59cb Implementation of feature request #1330 2023-08-24 11:42:10 +02:00
Dogan Can Bakir 33709e6adb fix DSL filter and matcher (#1313) 2023-08-09 18:44:03 +05:30
Erik Owen 104a2f212a Bugfix: Responses With Different HTTP Methods Are Written to Same File (#1298)
fix bug where responses from different http methods would be saved to the same file
2023-07-23 02:30:22 +05:30
Ivan Novikov 9e1242d7e0 Make output response fields public (#1266)
* Make output response fields public so they can be specified if httpx used as a library.

* Fix runner.go to use renamed params.

* renaming var

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2023-07-19 18:26:53 +05:30
sandeep 366a98493b Merge branch 'dev' into pr/1245 2023-07-17 16:43:04 +05:30
Dogan Can Bakir c3eb8897e7 Support multiple output format (#1242)
* support multiple output format

* output plain text when -oA

* separate the conditions

* fail output-all when it's not used with output

* update doc

* remove hashes for plain output when -hash isn't used

* add integration test

* use filepath

* fix no hash std output

* remove json/csv extension for json/csv only output

* add ext when both -csv and -json is used

* fix assertion

* commit to last commit

* print filenames

* no tmpdir

* remove files

* remove prints

* lowercase options

* test update

---------

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-07-17 16:09:10 +05:30
Doğan Can Bakır 82c7e5d6b1 Merge branch 'dev' into error_page_classifier 2023-07-17 09:57:02 +03:00
Bugra Kocabay 12db59a1d0 Feat screenshot html (#1226)
* create basic html indexing functionality

* change html style

* populate response info

* matched html response info with flags

* implement html template for screenshots

* remove unused func

* removing unused loop

* moving summary to static folder

* using file prefix on windows

* removing test output

---------

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-07-10 17:18:19 +05:30
Doğan Can Bakır 68736aee37 log filtered error pages 2023-07-03 11:39:31 +03:00
mzack bd65442056 fixing lint issues 2023-06-22 07:09:50 +02:00
mzack 4cfaadca16 fixing tests 2023-06-22 06:52:53 +02:00
mzack 4c8ac6703e Merge branch 'dev' into pr/1245 2023-06-22 06:11:46 +02:00
Doğan Can Bakır 900f5623e8 add error page classifier 2023-06-20 14:13:48 +03:00
Bugra Kocabay db30da1b51 delete duplicate onresult option (#1234) 2023-06-20 16:28:08 +05:30
Shubham Rasal c11993908b Merge pull request #1236 from anhnmt/dev
fix rateLimiter not stop
2023-06-19 11:29:02 +05:30
dependabot[bot] fbf5ef2b0b chore(deps): bump github.com/projectdiscovery/clistats from 0.0.12 to 0.0.18 (#1190)
* chore(deps): bump github.com/projectdiscovery/clistats

Bumps [github.com/projectdiscovery/clistats](https://github.com/projectdiscovery/clistats) from 0.0.12 to 0.0.18.
- [Release notes](https://github.com/projectdiscovery/clistats/releases)
- [Commits](https://github.com/projectdiscovery/clistats/compare/v0.0.12...v0.0.18)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/clistats
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix showing stats on clistat update

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ramana Reddy <ramanaredy.manda@gmail.com>
2023-06-17 19:54:58 +05:30