Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update lightgrep scanner for bulk_extractor 2.0 #421

Draft
wants to merge 31 commits into
base: main
Choose a base branch
from
Draft

Update lightgrep scanner for bulk_extractor 2.0 #421

Changes from 1 commit
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
43f5303
R - delete lightgrep scanners not ported, edit Makefile.am accordingly
juliapal Apr 11, 2023
287b882
F - skeleton of new lightgrep scanner for BE2.0
juliapal Apr 11, 2023
dc034c8
R - comment out unused phases
juliapal Apr 19, 2023
d638a2a
F!! - initialization of Lightgrep Controller
juliapal Apr 26, 2023
8ecacd1
R - If PHASE_INIT2 happens >1, Get() causes Fsm to be empty on subseq…
juliapal May 2, 2023
ee7b242
F - simplify addUserPatterns for now
juliapal May 2, 2023
7e1eefa
F - make regcomp, gotHit, HitData, and scan work with new skeleton
juliapal May 2, 2023
c629d3a
R - Prog may not be initialized before numPatterns is called
juliapal May 2, 2023
72c69a8
R - fix declarations
juliapal May 2, 2023
99bc030
F - Append lightgrep feature recorder to feature defs
juliapal May 2, 2023
1c1c4d0
Delete unused scanner
juliapal May 4, 2023
4579d9c
give write_buf good args
juliapal May 4, 2023
7553305
Result is positive upon success
juliapal May 4, 2023
a3616e0
F!! enable mulitple patterns passed through CLI
juliapal May 9, 2023
5097c1c
F - add user_files param to addUserPatterns to avoid scanner config a…
juliapal May 9, 2023
92b7f75
F - Handle user files with parsed patterns in lightgrep scanner
juliapal May 9, 2023
c553d2b
Remove unused or commented code
juliapal May 9, 2023
707466b
b - lightgrep should run even if find is disabled
juliapal May 11, 2023
48b9ca3
F - enable histogram for lightgrep
juliapaluch May 11, 2023
e7ac804
get rid of comments & unused code
juliapaluch May 11, 2023
8cdc2f1
F - delete Fsm if not deleted by regcomp
juliapaluch May 11, 2023
bb88ad8
b - don't declare initScan
juliapaluch May 11, 2023
90bb108
F - remove Scanner "global" variable
juliapaluch May 11, 2023
8c143b3
remove unused includes
juliapaluch May 11, 2023
f553e62
F - throw exception when lightgrep fails to parse pattern
juliapaluch May 11, 2023
799221b
better error messages
juliapaluch May 11, 2023
0ca43ec
F - avoid unnecessary repeated heap alloc/dealloc
juliapaluch May 12, 2023
007b9c9
F!! - Reverting use of thread local because it seems to cause a perfo…
juliapaluch May 30, 2023
fb0e42e
F - update scanner name and version
juliapaluch May 30, 2023
5e55041
a - Delete superfluous whitespace
juliapaluch May 30, 2023
16e8eeb
a - formatting, fix inaccurate comments
juliapaluch May 30, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
R - Prog may not be initialized before numPatterns is called
  • Loading branch information
@juliapal
juliapal committed May 2, 2023
commit c629d3a4eb13608b190d0ca8daaadb3039db5da8
6 changes: 3 additions & 3 deletions src/pattern_scanner.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -269,9 +269,9 @@ void LightgrepController::scan(const scanner_params& sp) {
// ((*sTbl[hit.KeywordIndex]).*(*cbPtr))(hit, sp, rcb); // ...yep...
// }

// unsigned int LightgrepController::numPatterns() const {
// return lg_pattern_map_size(PatternInfo);
// }
unsigned int LightgrepController::numPatterns() const {
return Prog ? lg_prog_pattern_count(Prog) : 0; //lg_pattern_map_size(PatternInfo);
}

// /*********************************************************/

Expand Down