41 Commits

Author SHA1 Message Date
ayuxsec@proton.me 299cb60871 merge: reconcile Result struct md tags with dev fields 2026-02-05 19:45:14 +05:30
Doğan Can Bakır 6399f78080 refactor: dynamic markdown header/row generation from struct tags 2026-01-03 18:05:13 +03:00
Sandeep Singh a00f9c4d0d fix: host JSON field now returns hostname instead of IP (#2333)
- Changed 'host' field to return actual hostname (e.g., example.com)
- Added new 'host_ip' field for the resolved/dialed IP address
- Fixes semantic issue where 'host' was incorrectly returning IP
2025-12-06 23:39:34 +05:30
Serizao 9c9b5d61fd Update types.go 2025-07-23 18:53:17 +02:00
Dwi Siswanto bcf643c747 feat(runner): use gocsv to marshal Result
Signed-off-by: Dwi Siswanto <git@dw1.io>
2025-04-17 07:28:56 +07:00
M. Ángel Jimeno 2fa0a70863 Ignore the empty interface when calling the fake data generator.
Fixes #2117
2025-04-15 19:45:52 +00:00
Dogan Can Bakir ace68642c8 Exclude response, request data from result (#1944) 2025-01-27 15:50:15 +05:30
Dogan Can Bakir 64396b804e Fix csv tag name (#2075)
fix csv tag name
2025-01-15 18:05:54 +05:30
Mzack9999 db72bb2902 Adding trace (#1883)
* adding trace

* using retryablehttp

* syntax error

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2024-09-16 23:56:21 +05:30
Doğan Can Bakır c861df0351 use mapstructure tag 2024-08-26 14:05:26 +03:00
Doğan Can Bakır d819697987 rename Jarm to JarmHash to avoid confusion 2024-07-11 13:31:11 +03:00
Dogan Can Bakir 7ed4cd19ae add md5 hash support for favicon (#1799) 2024-07-10 18:43:14 +05:30
Ice3man 3b5554af36 feat: added enhancements to favicon + made API public (#1774)
* more additions and enhancements to httpx

* feat: added enhancements to favicon + made API public

* update deps

* misc additions

* fix hasChain with 1 status code not working

* Revert "fix hasChain with 1 status code not working"

This reverts commit fabadcddbc.

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2024-06-24 19:07:26 +05:30
Ramana Reddy 9330887a58 Extract body_domains and body_fqdns to jsonl (#1750)
* Extract body-domains and body-fqdns

* remvove port in domains

* Add test for domains extraction

* misc update

* improve domain regex

* fix test

* extract domain inside quotes

* sanitize urls

* fix test

* minor

* do not embed

* remove js variables fp + improve regex

---------

Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2024-06-23 01:01:43 +05:30
Dogan Can Bakir 64ab42a4c8 do not omit status code (#1760) 2024-06-10 21:11:00 +05:30
Mzack9999 7bb09b1fb1 File writing ops respect filters/matchers (#1720) 2024-05-29 20:45:19 +05:30
mzack9999 f53914342c adding resolvers info 2024-05-22 16:14:23 +02:00
Ice3man 242fd734f9 feat: updated wappalyzer-go + misc additions 2024-05-14 15:42:09 +05:30
Mzack9999 020d580179 Adding AAAA dns type for ipv6 (#1668) 2024-04-16 16:59:52 +05:30
Dogan Can Bakir a4b026111a Fix content rel issues (#1630)
* do not omit content length

* fix words and lines len
2024-03-20 22:51:10 +05:30
Ramana Reddy 0153b45144 Add SNI to json output (#1423)
add sni to json output
2023-11-02 14:04:35 +05:30
Dogan Can Bakir ddad7c8eb7 fix minor screenshot issues (#1353)
* fix minor screenshot issues

* fix no file or dir err
2023-09-13 16:35:30 +05:30
JoMar 11fa743dd9 Allow to show response headers in json output without using -irh option (#1326)
* Show responses headers in JSON output

* Update ident

* Update options name

* Update option & README

* Add missing 's'

* Add missing 's'

* updated headers to header for user facing variable to keep it uniform

* updating doc

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-09-12 03:37:54 +05:30
Dogan Can Bakir d702f639f8 fix filter and match (#1346) 2023-09-07 21:28:13 +05:30
Ramana Reddy 76adadfeb4 Add flag to preview first N characters (#1316)
* Add flag to preview first N characters

* use dynamic var for body-preview flag

* strip html tags from response

* add stripe option to remove html or xml tags

* typo

* resolve merge conflicts

* add test and update readme

* update readme

* typo

* typo no 2

* small refactor

* include body preview in jsonl output

* minor changes

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-09-07 15:26:54 +05:30
Dogan Can Bakir 33709e6adb fix DSL filter and matcher (#1313) 2023-08-09 18:44:03 +05:30
Doğan Can Bakır 2b1ab2a145 Merge branch 'dev' into error_page_classifier 2023-07-10 08:57:45 +03:00
anhnmt 551e7e38de fix github.com/bxcodec/faker/v4 is deprecated: use github.com/go-faker/faker/v4 instead 2023-06-30 11:40:36 +07:00
mzack 4cfaadca16 fixing tests 2023-06-22 06:52:53 +02:00
Doğan Can Bakır 900f5623e8 add error page classifier 2023-06-20 14:13:48 +03:00
mzack b3b14b6ca0 fixing tests 2023-05-06 19:33:05 +02:00
mzack 318f9cff61 Merge branch 'dev' into sdk-code-improvements 2023-05-06 19:01:40 +02:00
Mzack9999 00d0977963 Adding Screenshot support (#1097)
* Adding Screenshot support

* adding headless body

* moving example into compilable file

* updating docs

* enabling store response with screenshot

* fixing output dir path

* fixing mod

* using native leakless

* splitting response+screenshot folders

* better handling json output

* readme update

* rel => abs path

* Added chromium into docker

* “Wipe them out. All of them.” – Darth Sidious

* utils bump

* go mod tidy

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-04-27 01:07:06 +05:30
Ice3man 0dc39fe249 Added exported ScanOptions + Raw + Err methods 2023-04-12 20:44:46 +05:30
Mzack9999 db1bc2ebba Reworking favicon hash calculation (#906)
* Reworking favicon hash calculation

* removing debug code

* bumping go to 1.19

* removing automatic follow redirect

* more edge cases

* added favicon path info
2023-01-06 18:28:08 +05:30
vrenzolaverace 686a2cced8 Update helpers libraries #850 (#851)
Use utils helpers libraries (#850)
2022-11-07 01:52:47 +05:30
Sajad faaada361f add stored_response_path to output json (#832)
* add stored_response_path to output json

* path -> filepath
2022-10-27 10:55:53 +02:00
Shubham Rasal bab68a487f AS input support +asnmap integration (#821)
* Add asnmap integration

- Use PD's asnmap lib to get asn details

* Add AS input support [WIP]

* Add AS input support

- Add AS Number input support
- Update README.md to add AS input example
- Add test cases to test `targets()` function
- Refactor target function remove if-else with switch case

* Resolve merge conflicts

* Replace - with _ in asnResponse for json

* Replace - with _ in asnResponse for csv
2022-10-20 17:54:52 +05:30
Sami 12fee4f3ee include dsl tag for all json keys (#812)
* include dsl tag for all json keys

* removed dsl tag and built list from json tag

* asn interface changed

* refactoring expression engine

- Using mapstructure for uniform mapping
- Flat key:value in expressions/variables list

* adding fields to ignore

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-10-20 13:18:01 +05:30
Sajad e31c1250a2 add dsl match/filter condtion (#782)
* add dsl match/filter condtion

* update README

* add test cases
2022-10-06 17:11:12 +05:30
Sami c90b897eba list-dsl flag to list json output keys which can be further used with matchers / filters (#768)
* flag list-dsl

* variable name update

* used reflect to dnymically access DSL variables

* aligned with the changes in dev branch

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-09-19 22:50:40 +05:30