Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Redo "Fix issues with queries that are bigger than 2GB" #274

Merged
merged 29 commits into from
Sep 13, 2024
Merged

Redo "Fix issues with queries that are bigger than 2GB" #274

Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
510d834
Update QuerySource hashing functions
nck-mlcnv Aug 7, 2024
02e8c89
Update hash tests
nck-mlcnv Aug 7, 2024
4a32551
Add query size limitation for reading queries as string
nck-mlcnv Aug 14, 2024
8a0474d
Put query indices in record class instead of long array
nck-mlcnv Aug 14, 2024
5399f70
Fix test
nck-mlcnv Aug 14, 2024
cdaeeb6
Delegate QueryIndex to its own class
nck-mlcnv Aug 14, 2024
d33e0db
Make InMemQueryList store queries in byte arrays instead of strings
nck-mlcnv Aug 15, 2024
af555fa
Add shallow copy for BigByteArrayOutputStream
nck-mlcnv Aug 15, 2024
87b0840
Add available methods for BigByteArrayInputStream
nck-mlcnv Aug 15, 2024
4a1278e
Fix shallow copy
nck-mlcnv Aug 15, 2024
33be64d
Fix available method
nck-mlcnv Aug 15, 2024
f8a8c16
Make BigByteArrayInputStream use a ByteBuffer
nck-mlcnv Aug 15, 2024
9302156
Change RequestFactory
nck-mlcnv Aug 15, 2024
777c1e0
Make StreamEntityProducer to not fully read in stream
nck-mlcnv Aug 15, 2024
04e5e17
Fix test
nck-mlcnv Aug 15, 2024
4d15f2a
Try to speedup indexing
nck-mlcnv Aug 16, 2024
f6bdab8
Remove hash code file
nck-mlcnv Aug 16, 2024
b117f6e
Remove unnecessary exception
nck-mlcnv Aug 16, 2024
9b164e6
Change ByteArrayListInputStream
nck-mlcnv Aug 16, 2024
dc48789
Use ByteArrayListInputStreams for storing queries instead of ByteArra…
nck-mlcnv Aug 16, 2024
0b3cd1b
Fix tests
nck-mlcnv Aug 16, 2024
3058b02
Speed up FileUtils again
nck-mlcnv Aug 16, 2024
705a56a
Add doc mentioning limitations
nck-mlcnv Aug 16, 2024
42d98b6
Fix function
nck-mlcnv Aug 19, 2024
18dc1a5
Remove unused methods and add comments
nck-mlcnv Aug 19, 2024
5fbfa3d
Use constants
nck-mlcnv Sep 6, 2024
0c04503
Change title and move paragraph
nck-mlcnv Sep 9, 2024
3f52876
Complete last commit
nck-mlcnv Sep 9, 2024
e359004
Fix test
nck-mlcnv Sep 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove unnecessary exception
  • Loading branch information
@nck-mlcnv
nck-mlcnv committed Aug 16, 2024
commit b117f6e7ac5bbcafa50be0d999929fb198fcebe6
2 changes: 1 addition & 1 deletion src/main/java/org/aksw/iguana/cc/query/handler/QueryHandler.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -178,7 +178,7 @@ public QueryStringWrapper getNextQuery(QuerySelector querySelector) throws IOExc
return new QueryStringWrapper(queryIndex, queryList.getQuery(queryIndex));
}

public QueryStreamWrapper getNextQueryStream(QuerySelector querySelector) throws IOException {
public QueryStreamWrapper getNextQueryStream(QuerySelector querySelector) {
final var queryIndex = querySelector.getNextIndex();
return new QueryStreamWrapper(queryIndex, config.caching(), () -> {
try {
Expand Down