c7456929b4
fix integration tests and upgrade deps
2023-02-08 19:50:03 +05:30
3a93d2d1e8
bump url utils to v0.0.7
2023-02-07 20:15:23 +05:30
95ca203e09
version update
2023-01-06 18:40:14 +05:30
db1bc2ebba
Reworking favicon hash calculation ( #906 )
...
* Reworking favicon hash calculation
* removing debug code
* bumping go to 1.19
* removing automatic follow redirect
* more edge cases
* added favicon path info
2023-01-06 18:28:08 +05:30
88c49b812b
added ztls flag ( #896 )
...
* added ztls to httpx
* adding missing dialtls
* updated readme.md
* add ztls functional test
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
Co-authored-by: Mzack9999 <mzack9999@protonmail.com >
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com >
2022-12-28 23:40:22 +05:30
986b2184c5
Enforcing wildcard check to prefix only ( #911 )
...
enforcing wildcard check to prefix only
2022-12-23 23:26:38 +05:30
e64587292e
chore(deps): bump github.com/projectdiscovery/ratelimit from 0.0.1 to 0.0.2 ( #890 )
...
* chore(deps): bump github.com/projectdiscovery/ratelimit
Bumps [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit ) from 0.0.1 to 0.0.2.
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases )
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.1...v0.0.2 )
---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
* fixing type
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
2022-11-29 12:19:22 +05:30
b8de450be6
bom utf8 on csv output ( #887 )
...
* implemented bom utf8 on csv
* added on csvoutput
* Removed debug code
* added output encoding flag
* using strings utils
* small refactor
* removing default encoding
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
2022-11-29 12:18:38 +05:30
20a9a930c2
adds base64 encoding support ( #813 ) ( #885 )
...
* adds base64 encoding support (#813 )
* rename b64 to base64
2022-11-24 21:50:37 +05:30
45f9f5c199
Use a random hash instead of generating an url-based filename to store ( #848 )
...
* Use a random hash instead of generating an url-based filename to store
* switching to sha1 hash generation
* removing max filename limit and reusing existing helper
* hash for filename to store improvements
* lint error fix
* used filepath to be cross platform
* used strings.Builder to prevent continous opening and closing of file
* lint error fix
* refactoring output logic
* fixing lint errors
* Using Sha1 to reduce file length
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
Co-authored-by: Mzack9999 <mzack9999@protonmail.com >
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com >
2022-11-20 17:02:24 +05:30
f06133f03b
Add delay between making httpx requests. ( #853 )
...
* Add delay between making httpx requests.
- sleep before creating goroutine to make http request
- eg.
```
cat urls.txt | httpx -delay 2s
```
```
cat urls.txt | httpx -delay 2s -port 80,443,8443
```
* Update delay help message
* Use goflags DurationVar to accept delay
* replace string with duration for delay
2022-11-15 12:23:45 +05:30
686a2cced8
Update helpers libraries #850 ( #851 )
...
Use utils helpers libraries (#850 )
2022-11-07 01:52:47 +05:30
33a8fc08fe
Append to file if output file is already created. ( #823 )
...
* Append to file if output file is already created.
* Update file permission to 0644 to 0600
* Only append if resume flag is passed otherwise create new
* Remove asn number failing test case
2022-10-29 11:06:39 +02:00
c671b1bf8e
Merge branch 'dev' into gomod-update
2022-10-28 16:26:10 +02:00
7a9a3fd593
fixing lint errors
2022-10-28 16:24:13 +02:00
18896fb9d9
resolve issue 837 failing test ( #838 )
...
Removed the failing asn IP count test case
2022-10-27 13:57:40 +02:00
e7ab403b33
readme + workflow update
2022-10-27 11:52:01 +02:00
faaada361f
add stored_response_path to output json ( #832 )
...
* add stored_response_path to output json
* path -> filepath
2022-10-27 10:55:53 +02:00
4eb398ed41
Merge branch 'dev' into pr/825
2022-10-24 10:03:40 +02:00
a90e5a140c
minor signature change
2022-10-24 10:00:54 +02:00
7d7807c832
add OnResultCallback options
2022-10-24 13:33:20 +07:00
bab68a487f
AS input support +asnmap integration ( #821 )
...
* Add asnmap integration
- Use PD's asnmap lib to get asn details
* Add AS input support [WIP]
* Add AS input support
- Add AS Number input support
- Update README.md to add AS input example
- Add test cases to test `targets()` function
- Refactor target function remove if-else with switch case
* Resolve merge conflicts
* Replace - with _ in asnResponse for json
* Replace - with _ in asnResponse for csv
2022-10-20 17:54:52 +05:30
12fee4f3ee
include dsl tag for all json keys ( #812 )
...
* include dsl tag for all json keys
* removed dsl tag and built list from json tag
* asn interface changed
* refactoring expression engine
- Using mapstructure for uniform mapping
- Flat key:value in expressions/variables list
* adding fields to ignore
Co-authored-by: Mzack9999 <mzack9999@protonmail.com >
2022-10-20 13:18:01 +05:30
6d7fd5727f
Merge pull request #802 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/goflags-0.1.1
...
chore(deps): bump github.com/projectdiscovery/goflags from 0.1.0 to 0.1.1
2022-10-12 00:21:54 +02:00
7f98e13c4a
updating goflags syntax
2022-10-12 00:15:04 +02:00
0c277240a3
updates related to projectdiscovery/ratelimit
2022-10-06 13:31:39 -05:00
76cb70f796
replaced go.uber.org/ratelimit with projectdiscovery/ratelimit
2022-10-06 13:00:39 -05:00
e31c1250a2
add dsl match/filter condtion ( #782 )
...
* add dsl match/filter condtion
* update README
* add test cases
2022-10-06 17:11:12 +05:30
42776e282d
extractRegexps -er on body and header (resp.Raw) ( #787 )
...
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io >
2022-10-01 01:03:30 +05:30
d48afd2a79
Added flag for single or comma separated stdin input values ( #737 ) ( #759 )
...
* Added flag for single or comma separated stdin input values (#737 )
* Replaced the logic in the parsing of input target hosts flag.
Using the goflags' StringSlice now.
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io >
2022-09-21 20:03:36 +05:30
c90b897eba
list-dsl flag to list json output keys which can be further used with matchers / filters ( #768 )
...
* flag list-dsl
* variable name update
* used reflect to dnymically access DSL variables
* aligned with the changes in dev branch
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com >
2022-09-19 22:50:40 +05:30
9b4a2ecb0f
Added tlsx integration for probing and grabbing ( #767 )
...
* Added tlsx integration for probing and grabbing
* Added additional TLS required fields
2022-09-15 20:33:51 +05:30
085cec4813
Header field update for JSON output ( #766 )
2022-09-14 12:44:36 +05:30
d491201eff
Issue 735+issue 739 ( #757 )
...
* adding strings.ToLower to headers
* added validation logic for flags
* validated silent flag with incompatible flags
* silent flag bug fix
* added test case
* updated test case to include multiple headers
2022-09-13 16:46:38 +05:30
d04150075e
JSON field update ( #748 )
...
Misc changes to json fields
2022-08-31 13:22:26 +05:30
e236531eac
Added profile-mem flag for memory profiling ( #738 )
2022-08-30 17:05:14 +05:30
c48909f64f
Minor fixes and improvements ( #726 )
...
* Added .idea to .gitignore
* Updated the README
* Added more verbose information on preset extractors
* removing deprecated ioutil
Co-authored-by: Mzack9999 <mzack9999@protonmail.com >
2022-08-17 03:16:06 +04:00
8c10e307e4
favicon flag improvement ( #718 )
...
* favicon flag improvement
* addressed review comments
* utilizing request object
2022-08-11 07:51:49 -07:00
10fe8a89b7
version update
2022-07-31 21:48:00 +05:30
21ca2621bd
Fixing and improving custom ports handling ( #714 )
...
* Fixing and improving custom ports
* adding test case from https://github.com/projectdiscovery/httpx/pull/713
2022-07-31 20:54:34 +05:30
931c7e25bd
replace / by [slash] instead of underscore ( #711 )
2022-07-26 18:57:04 +05:30
90a32dd65f
Added connection pooling for jarm conn + fastdialer ( #707 )
...
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io >
2022-07-25 18:40:06 +05:30
8f3ab2773e
feat(runner): expose the method process ( #700 )
...
feat(runner): expose the mothod process
to support the pipeline pattern
2022-07-21 23:05:05 +05:30
16c15aeb43
Merging Master into dev-merge-master ( #694 )
...
Exposing regex matches to json output (#668 )
* Update runner.go
Fix regex json output.
* small refactor
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io >
Co-authored-by: Dothelm <49758889+st3rv04ka@users.noreply.github.com >
2022-07-13 23:04:54 +05:30
7f8b37b837
updating goflags syntax
2022-07-12 19:37:20 +02:00
5e6b645a12
readme update
2022-07-11 03:57:11 +05:30
0d554edd1b
Fix for -er and -favicon. ( #687 )
...
* Exposing regex matches to json output (#668 )
* Update runner.go
Fix regex json output.
* small refactor
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
* Fix for -er and -favicon.
Function don't clone regex for extract.
* fixing errors
* removing redundant code
* removing unused field
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io >
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
2022-07-11 03:12:21 +05:30
8d0a34f28a
Update go.mod ( #689 )
...
* Exposing regex matches to json output (#668 )
* Update runner.go
Fix regex json output.
* small refactor
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
* Update go.mod
* fixing jarm-go reference
* removing redundant declaration
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io >
Co-authored-by: Dothelm <49758889+st3rv04ka@users.noreply.github.com >
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com >
2022-07-11 03:09:43 +05:30
89cf7396b7
modified error message with invalid ports ( #677 )
...
* modified error message with invalid ports
* updated ValidateCustomPorts function
2022-07-07 20:04:31 +05:30
e4e2aab402
Adding httpx as a library minimal example ( #670 )
2022-06-28 16:19:46 +05:30
Tarun Koyalwar