Commit Graph

1518 Commits

Author SHA1 Message Date
Mzack9999 8d32c15701 restoring code 2023-09-11 17:58:59 +02:00
Mzack9999 0f6edb50be refactor hsts implementation 2023-09-11 17:53:26 +02:00
Mzack9999 8b5dc7bc0f merge conflict 2023-09-11 16:58:31 +02:00
Dogan Can Bakir d702f639f8 fix filter and match (#1346) 2023-09-07 21:28:13 +05:30
Ramana Reddy 76adadfeb4 Add flag to preview first N characters (#1316)
* Add flag to preview first N characters

* use dynamic var for body-preview flag

* strip html tags from response

* add stripe option to remove html or xml tags

* typo

* resolve merge conflicts

* add test and update readme

* update readme

* typo

* typo no 2

* small refactor

* include body preview in jsonl output

* minor changes

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-09-07 15:26:54 +05:30
Dogan Can Bakir e9893a836e fix screenshot path issue (#1340) 2023-09-07 14:50:19 +05:30
Dogan Can Bakir d8142602cd fix favicon host header issue (#1339) 2023-09-07 14:48:21 +05:30
Dogan Can Bakir f36a2c05e9 remove fullurl from req-res (#1337)
* remove fullurl from req-res

* add fullurl at the end
2023-09-06 23:24:59 +05:30
JoMar 179678581d Exclude WAF (#1341)
* Exclude WAF

* Add missing 's'

* Revert "Add missing 's'"

This reverts commit 467ceca320.
2023-09-05 19:53:06 +05:30
Stefan Kraxberger 964cc3bbd0 Implemented a redirect strategy which respects HSTS headers and modifies the URL accordingly if necessary 2023-08-31 10:58:51 +02:00
Stefan Kraxberger 0b702c5713 Revert "Added redirect policy which takes HSTS into account, so that even if the location would go from HTTPs to HTTP it would follow to HTTPs if an HTSTS header is present"
This reverts commit c4810ffbb7.
2023-08-31 10:44:09 +02:00
Stefan Kraxberger c4810ffbb7 Added redirect policy which takes HSTS into account, so that even if the location would go from HTTPs to HTTP it would follow to HTTPs if an HTSTS header is present 2023-08-31 10:41:20 +02:00
Stefan Kraxberger 2ad958cf91 Modified storing of response chains, because it was not correct 2023-08-30 16:16:56 +02:00
Stefan Kraxberger 9f6c9d0804 Modified storing of response chains, because it was not correct 2023-08-30 16:15:41 +02:00
Stefan Kraxberger 13f78bc302 Modified storing of response chains, because it was not correct 2023-08-30 16:06:45 +02:00
secinto d463b3bcda Merge branch 'dev' into feature_1330 2023-08-27 16:09:40 +02:00
Stefan Kraxberger 9be9fb59cb Implementation of feature request #1330 2023-08-24 11:42:10 +02:00
Gwyn 34762b092a Update integration.go (#1319)
Fixed minor mistakes in the comments
2023-08-15 17:27:11 +05:30
Dogan Can Bakir 33709e6adb fix DSL filter and matcher (#1313) 2023-08-09 18:44:03 +05:30
sandeep 44d0cffc57 workflow fixes 2023-08-04 16:21:10 +05:30
DroidKali bf1f88438d runner/options.go: Fixed typo. (#1310)
Signed-off-by: DroidKali <DroidKali@users.noreply.github.com>
Co-authored-by: DroidKali <DroidKali@users.noreply.github.com>
2023-08-04 15:52:07 +05:30
Sandeep Singh b14f64a9e1 Rename release-test.yaml to release-test.yml v1.3.4 2023-07-23 02:56:54 +05:30
sandeep ef305f02c8 removed duplicate step 2023-07-23 02:43:59 +05:30
sandeep 938962617d misc update 2023-07-23 02:42:15 +05:30
sandeep e4b1efb2eb version update + release test 2023-07-23 02:41:39 +05:30
Erik Owen 104a2f212a Bugfix: Responses With Different HTTP Methods Are Written to Same File (#1298)
fix bug where responses from different http methods would be saved to the same file
2023-07-23 02:30:22 +05:30
dependabot[bot] 6a77eaba51 chore(deps): bump github.com/go-rod/rod from 0.113.4 to 0.114.0 (#1300)
Bumps [github.com/go-rod/rod](https://github.com/go-rod/rod) from 0.113.4 to 0.114.0.
- [Release notes](https://github.com/go-rod/rod/releases)
- [Commits](https://github.com/go-rod/rod/compare/v0.113.4...v0.114.0)

---
updated-dependencies:
- dependency-name: github.com/go-rod/rod
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-19 18:28:45 +05:30
dependabot[bot] 2768121d0c chore(deps): bump github.com/microcosm-cc/bluemonday from 1.0.24 to 1.0.25 (#1301)
chore(deps): bump github.com/microcosm-cc/bluemonday

Bumps [github.com/microcosm-cc/bluemonday](https://github.com/microcosm-cc/bluemonday) from 1.0.24 to 1.0.25.
- [Release notes](https://github.com/microcosm-cc/bluemonday/releases)
- [Commits](https://github.com/microcosm-cc/bluemonday/compare/v1.0.24...v1.0.25)

---
updated-dependencies:
- dependency-name: github.com/microcosm-cc/bluemonday
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-19 18:27:50 +05:30
dependabot[bot] 2adcb5a552 chore(deps): bump github.com/projectdiscovery/retryablehttp-go from 1.0.18 to 1.0.19 (#1295)
chore(deps): bump github.com/projectdiscovery/retryablehttp-go

Bumps [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) from 1.0.18 to 1.0.19.
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.18...v1.0.19)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-07-19 18:27:29 +05:30
Ivan Novikov 9e1242d7e0 Make output response fields public (#1266)
* Make output response fields public so they can be specified if httpx used as a library.

* Fix runner.go to use renamed params.

* renaming var

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2023-07-19 18:26:53 +05:30
Mzack9999 b3de0bc9d7 Merge pull request #1245 from dogancanbakir/error_page_classifier
Error page classifier
2023-07-19 14:50:16 +02:00
dependabot[bot] a3073df243 chore(deps): bump github.com/projectdiscovery/utils from 0.0.43 to 0.0.44 (#1297)
chore(deps): bump github.com/projectdiscovery/utils

Bumps [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) from 0.0.43 to 0.0.44.
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.0.43...v0.0.44)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-19 02:10:38 +05:30
dependabot[bot] 005390f2b4 chore(deps): bump github.com/go-rod/rod from 0.113.3 to 0.113.4 (#1296)
Bumps [github.com/go-rod/rod](https://github.com/go-rod/rod) from 0.113.3 to 0.113.4.
- [Release notes](https://github.com/go-rod/rod/releases)
- [Commits](https://github.com/go-rod/rod/compare/v0.113.3...v0.113.4)

---
updated-dependencies:
- dependency-name: github.com/go-rod/rod
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-19 02:10:27 +05:30
dependabot[bot] aa6da766a2 chore(deps): bump github.com/projectdiscovery/rawhttp from 0.1.17 to 0.1.18 (#1294)
chore(deps): bump github.com/projectdiscovery/rawhttp

Bumps [github.com/projectdiscovery/rawhttp](https://github.com/projectdiscovery/rawhttp) from 0.1.17 to 0.1.18.
- [Release notes](https://github.com/projectdiscovery/rawhttp/releases)
- [Commits](https://github.com/projectdiscovery/rawhttp/compare/v0.1.17...v0.1.18)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/rawhttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-19 02:08:45 +05:30
sandeep 1c15cc3595 Update README.md 2023-07-18 01:41:26 +05:30
dependabot[bot] 5ed2fab4e1 chore(deps): bump github.com/projectdiscovery/dsl from 0.0.12 to 0.0.14 (#1286)
* chore(deps): bump github.com/projectdiscovery/dsl from 0.0.12 to 0.0.14

Bumps [github.com/projectdiscovery/dsl](https://github.com/projectdiscovery/dsl) from 0.0.12 to 0.0.14.
- [Release notes](https://github.com/projectdiscovery/dsl/releases)
- [Commits](https://github.com/projectdiscovery/dsl/compare/v0.0.12...v0.0.14)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/dsl
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* bump go version

* updating readme

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2023-07-17 20:59:12 +05:30
Doğan Can Bakır e90a4346fa update example 2023-07-17 15:37:43 +03:00
sandeep 1e7aff9dfd Merge branch 'dev' into pr/1245 2023-07-17 16:46:01 +05:30
sandeep 366a98493b Merge branch 'dev' into pr/1245 2023-07-17 16:43:04 +05:30
Sandeep Singh ac5348bcb9 Workflow update (#1290)
* added auto dep merge

* added release test in build workflow

* workflow update

* Added Disclaimer
2023-07-17 16:31:08 +05:30
dependabot[bot] 243e61cf1f chore(deps): bump github.com/projectdiscovery/wappalyzergo from 0.0.102 to 0.0.105 (#1288)
chore(deps): bump github.com/projectdiscovery/wappalyzergo

Bumps [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) from 0.0.102 to 0.0.105.
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.0.102...v0.0.105)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-07-17 16:30:47 +05:30
dependabot[bot] b4485c880a chore(deps): bump github.com/projectdiscovery/utils from 0.0.40 to 0.0.43 (#1289)
chore(deps): bump github.com/projectdiscovery/utils

Bumps [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) from 0.0.40 to 0.0.43.
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.0.40...v0.0.43)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-07-17 16:28:43 +05:30
dependabot[bot] 1c60c9a120 chore(deps): bump golang from 1.20.5-alpine to 1.20.6-alpine (#1291)
Bumps golang from 1.20.5-alpine to 1.20.6-alpine.

---
updated-dependencies:
- dependency-name: golang
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 16:25:35 +05:30
dependabot[bot] 170e824f1b chore(deps): bump github.com/projectdiscovery/fastdialer from 0.0.32 to 0.0.35 (#1287)
chore(deps): bump github.com/projectdiscovery/fastdialer

Bumps [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) from 0.0.32 to 0.0.35.
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.0.32...v0.0.35)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 16:22:24 +05:30
dependabot[bot] ef7c565616 chore(deps): bump github.com/projectdiscovery/tlsx from 1.1.0 to 1.1.1 (#1274)
Bumps [github.com/projectdiscovery/tlsx](https://github.com/projectdiscovery/tlsx) from 1.1.0 to 1.1.1.
- [Release notes](https://github.com/projectdiscovery/tlsx/releases)
- [Changelog](https://github.com/projectdiscovery/tlsx/blob/main/.goreleaser.yml)
- [Commits](https://github.com/projectdiscovery/tlsx/compare/v1.1.0...v1.1.1)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/tlsx
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 16:09:53 +05:30
Dogan Can Bakir c3eb8897e7 Support multiple output format (#1242)
* support multiple output format

* output plain text when -oA

* separate the conditions

* fail output-all when it's not used with output

* update doc

* remove hashes for plain output when -hash isn't used

* add integration test

* use filepath

* fix no hash std output

* remove json/csv extension for json/csv only output

* add ext when both -csv and -json is used

* fix assertion

* commit to last commit

* print filenames

* no tmpdir

* remove files

* remove prints

* lowercase options

* test update

---------

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-07-17 16:09:10 +05:30
Doğan Can Bakır 82c7e5d6b1 Merge branch 'dev' into error_page_classifier 2023-07-17 09:57:02 +03:00
Doğan Can Bakır 2718a9aab7 use mlutils 2023-07-17 06:54:00 +00:00
dependabot[bot] 924eb5bc0c chore(deps): bump github.com/projectdiscovery/rawhttp from 0.1.15 to 0.1.17 (#1281)
chore(deps): bump github.com/projectdiscovery/rawhttp

Bumps [github.com/projectdiscovery/rawhttp](https://github.com/projectdiscovery/rawhttp) from 0.1.15 to 0.1.17.
- [Release notes](https://github.com/projectdiscovery/rawhttp/releases)
- [Commits](https://github.com/projectdiscovery/rawhttp/compare/v0.1.15...v0.1.17)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/rawhttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-10 17:18:46 +05:30
Bugra Kocabay 12db59a1d0 Feat screenshot html (#1226)
* create basic html indexing functionality

* change html style

* populate response info

* matched html response info with flags

* implement html template for screenshots

* remove unused func

* removing unused loop

* moving summary to static folder

* using file prefix on windows

* removing test output

---------

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-07-10 17:18:19 +05:30