admin/projectdiscovery-httpx
1
0
Fork 0
mirror of https://github.com/projectdiscovery/httpx synced 2026-06-08 16:50:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,059 Commits 15 Branches 65 Tags
e40367d9040b29c3bc3ece1cea356352e9b03dfd
Commit Graph

232 Commits

Author SHA1 Message Date
Shubham Rasal 33a8fc08fe Append to file if output file is already created. (#823) 
* Append to file if output file is already created.

* Update file permission to 0644 to 0600

* Only append if resume flag is passed otherwise create new

* Remove asn number failing test case
 2022-10-29 11:06:39 +02:00
mzack c671b1bf8e Merge branch 'dev' into gomod-update 2022-10-28 16:26:10 +02:00
mzack 7a9a3fd593 fixing lint errors 2022-10-28 16:24:13 +02:00
Shubham Rasal 18896fb9d9 resolve issue 837 failing test (#838) 
Removed the failing asn IP count test case
 2022-10-27 13:57:40 +02:00
sandeep e7ab403b33 readme + workflow update 2022-10-27 11:52:01 +02:00
Sajad faaada361f add stored_response_path to output json (#832) 
* add stored_response_path to output json

* path -> filepath
 2022-10-27 10:55:53 +02:00
Mzack9999 4eb398ed41 Merge branch 'dev' into pr/825 2022-10-24 10:03:40 +02:00
Mzack9999 a90e5a140c minor signature change 2022-10-24 10:00:54 +02:00
lucy9x 7d7807c832 add OnResultCallback options 2022-10-24 13:33:20 +07:00
Shubham Rasal bab68a487f AS input support +asnmap integration (#821) 
* Add asnmap integration

- Use PD's asnmap lib to get asn details

* Add AS input support [WIP]

* Add AS input support

- Add AS Number input support
- Update README.md to add AS input example
- Add test cases to test `targets()` function
- Refactor target function remove if-else with switch case

* Resolve merge conflicts

* Replace - with _ in asnResponse for json

* Replace - with _ in asnResponse for csv
 2022-10-20 17:54:52 +05:30
Sami 12fee4f3ee include dsl tag for all json keys (#812) 
* include dsl tag for all json keys

* removed dsl tag and built list from json tag

* asn interface changed

* refactoring expression engine

- Using mapstructure for uniform mapping
- Flat key:value in expressions/variables list

* adding fields to ignore

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2022-10-20 13:18:01 +05:30
Mzack9999 6d7fd5727f Merge pull request #802 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/goflags-0.1.1 
chore(deps): bump github.com/projectdiscovery/goflags from 0.1.0 to 0.1.1
 2022-10-12 00:21:54 +02:00
mzack 7f98e13c4a updating goflags syntax 2022-10-12 00:15:04 +02:00
LuitelSamikshya 0c277240a3 updates related to projectdiscovery/ratelimit 2022-10-06 13:31:39 -05:00
LuitelSamikshya 76cb70f796 replaced go.uber.org/ratelimit with projectdiscovery/ratelimit 2022-10-06 13:00:39 -05:00
Sajad e31c1250a2 add dsl match/filter condtion (#782) 
* add dsl match/filter condtion

* update README

* add test cases
 2022-10-06 17:11:12 +05:30
Gwendal Le Coguic 42776e282d extractRegexps -er on body and header (resp.Raw) (#787) 
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
 2022-10-01 01:03:30 +05:30
Ismael Arias d48afd2a79 Added flag for single or comma separated stdin input values (#737) (#759) 
* Added flag for single or comma separated stdin input values (#737)

* Replaced the logic in the parsing of input target hosts flag.
Using the goflags' StringSlice now.

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
 2022-09-21 20:03:36 +05:30
Sami c90b897eba list-dsl flag to list json output keys which can be further used with matchers / filters (#768) 
* flag list-dsl

* variable name update

* used reflect to dnymically access DSL variables

* aligned with the changes in dev branch

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
 2022-09-19 22:50:40 +05:30
Ice3man 9b4a2ecb0f Added tlsx integration for probing and grabbing (#767) 
* Added tlsx integration for probing and grabbing

* Added additional TLS required fields
 2022-09-15 20:33:51 +05:30
Ice3man 085cec4813 Header field update for JSON output (#766) 2022-09-14 12:44:36 +05:30
Sami d491201eff Issue 735+issue 739 (#757) 
* adding strings.ToLower to headers

* added validation logic for flags

* validated silent flag with incompatible flags

* silent flag bug fix

* added test case

* updated test case to include multiple headers
 2022-09-13 16:46:38 +05:30
Sandeep Singh d04150075e JSON field update (#748) 
Misc changes to json fields
 2022-08-31 13:22:26 +05:30
Ice3man e236531eac Added profile-mem flag for memory profiling (#738) 2022-08-30 17:05:14 +05:30
forgedhallpass c48909f64f Minor fixes and improvements (#726) 
* Added .idea to .gitignore

* Updated the README

* Added more verbose information on preset extractors

* removing deprecated ioutil

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2022-08-17 03:16:06 +04:00
Sami 8c10e307e4 favicon flag improvement (#718) 
* favicon flag improvement

* addressed review comments

* utilizing request object
 2022-08-11 07:51:49 -07:00
sandeep 10fe8a89b7 version update 2022-07-31 21:48:00 +05:30
Mzack9999 21ca2621bd Fixing and improving custom ports handling (#714) 
* Fixing and improving custom ports

* adding test case from https://github.com/projectdiscovery/httpx/pull/713
 2022-07-31 20:54:34 +05:30
Sajad 931c7e25bd replace / by [slash] instead of underscore (#711) 2022-07-26 18:57:04 +05:30
Ice3man 90a32dd65f Added connection pooling for jarm conn + fastdialer (#707) 
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
 2022-07-25 18:40:06 +05:30
akkuman 8f3ab2773e feat(runner): expose the method process (#700) 
feat(runner): expose the mothod process

to support the pipeline pattern
 2022-07-21 23:05:05 +05:30
Mzack9999 16c15aeb43 Merging Master into dev-merge-master (#694) 
Exposing regex matches to json output (#668)

* Update runner.go

Fix regex json output.

* small refactor

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Dothelm <49758889+st3rv04ka@users.noreply.github.com>
 2022-07-13 23:04:54 +05:30
mzack 7f8b37b837 updating goflags syntax 2022-07-12 19:37:20 +02:00
sandeep 5e6b645a12 readme update 2022-07-11 03:57:11 +05:30
Dothelm 0d554edd1b Fix for -er and -favicon. (#687) 
* Exposing regex matches to json output (#668)

* Update runner.go

Fix regex json output.

* small refactor

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>

* Fix for -er and -favicon.

Function don't clone regex for extract.

* fixing errors

* removing redundant code

* removing unused field

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
 2022-07-11 03:12:21 +05:30
Its Hex ! 8d0a34f28a Update go.mod (#689) 
* Exposing regex matches to json output (#668)

* Update runner.go

Fix regex json output.

* small refactor

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>

* Update go.mod

* fixing jarm-go reference

* removing redundant declaration

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Dothelm <49758889+st3rv04ka@users.noreply.github.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
 2022-07-11 03:09:43 +05:30
Sami 89cf7396b7 modified error message with invalid ports (#677) 
* modified error message with invalid ports

* updated ValidateCustomPorts function
 2022-07-07 20:04:31 +05:30
Mzack9999 e4e2aab402 Adding httpx as a library minimal example (#670) 2022-06-28 16:19:46 +05:30
Mzack9999 14162b4576 Add self diagnostic functionality (#665) 2022-06-16 14:16:15 +05:30
M09Ic cd18edc689 support multi -extract-regex flag and json output (#529) 
* Add hashes flag, to support multi body hash type. issue:489 and issue:488

* go mod update

* Add hash type validate for -hash flag

* support multi extract regexps

* support extract regexps matches for json output

* support extract regexp preset

* extract result deduplicate

* small changes

* lint ignore

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
 2022-06-13 17:48:00 +05:30
sandeep 8a96d08aca version update 2022-06-12 09:46:52 +05:30
Sami b52da3aca6 changed warning to error if the directory does not have write permission (#650) 2022-06-02 22:58:44 +05:30
Mzack9999 daf4ad6c5a Fixing all ips probe with ports (#626) 
* Fixing all ips probe with standard ports

* using custom type for targets
 2022-05-19 14:59:07 +05:30
Sami f75729c1b9 cname with ports flag bug-fix (#625) 2022-05-17 21:50:35 +05:30
LuitelSamikshya db3a27a1ac frt/mrt improvemets 2022-05-09 15:01:38 -05:00
sandeep a0e5b0c169 misc updates 2022-05-06 13:45:09 +05:30
LuitelSamikshya bca081f35c space separated arguments for cli flag 2022-05-03 21:01:43 -05:00
LuitelSamikshya 1fdce482d5 included time unit 2022-05-03 10:35:00 -05:00
LuitelSamikshya 9ea89a4a46 match/filter response time 2022-04-29 10:24:05 -05:00
Sandeep Singh c97332eb93 Merge pull request #581 from projectdiscovery/issue-566-multi-host-sni 
Adding support for custom SNI name
 2022-04-21 13:06:36 +05:30