16 Commits

Author SHA1 Message Date
Ramana Reddy 9330887a58 Extract body_domains and body_fqdns to jsonl (#1750)
* Extract body-domains and body-fqdns

* remvove port in domains

* Add test for domains extraction

* misc update

* improve domain regex

* fix test

* extract domain inside quotes

* sanitize urls

* fix test

* minor

* do not embed

* remove js variables fp + improve regex

---------

Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2024-06-23 01:01:43 +05:30
Ramana Reddy 8d31a457b8 fix edge cases 2024-05-30 16:52:12 +05:30
Ramana Reddy de9375e643 remove wildcard in domain 2024-05-30 15:03:15 +05:30
Ramana Reddy c5ca655207 exclude root domains from fqdn 2024-05-30 14:12:01 +05:30
Ramana Reddy ff262a084f Add extract-fqdn option 2024-05-30 09:16:23 +05:30
Ramana Reddy 91afa0cf76 Add fqdn to csp output 2024-05-30 08:34:58 +05:30
Mzack9999 7bb09b1fb1 File writing ops respect filters/matchers (#1720) 2024-05-29 20:45:19 +05:30
vrenzolaverace 686a2cced8 Update helpers libraries #850 (#851)
Use utils helpers libraries (#850)
2022-11-07 01:52:47 +05:30
Sami 12fee4f3ee include dsl tag for all json keys (#812)
* include dsl tag for all json keys

* removed dsl tag and built list from json tag

* asn interface changed

* refactoring expression engine

- Using mapstructure for uniform mapping
- Flat key:value in expressions/variables list

* adding fields to ignore

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-10-20 13:18:01 +05:30
Sami c90b897eba list-dsl flag to list json output keys which can be further used with matchers / filters (#768)
* flag list-dsl

* variable name update

* used reflect to dnymically access DSL variables

* aligned with the changes in dev branch

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-09-19 22:50:40 +05:30
mzack ffb2079dfb Adding CSP parsing form HTML meta 2022-03-22 16:47:55 +01:00
mzack f623a21564 removing deprecated golint directive 2021-05-25 16:23:32 +02:00
Víctor Zamanillo c1df31cb49 Fixed gocritic issues 2020-09-25 18:39:35 +02:00
Víctor Zamanillo d184548c29 Fixed golint issues 2020-09-25 18:30:38 +02:00
Mzack9999 ca20e5538c extended CSP extraction 2020-09-14 02:06:35 +02:00
Mzack9999 bac670a949 various fixes and features 2020-08-23 20:42:20 +02:00