Commits

Branch selector

 bb51179

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 25, 2014

• Update POMs for newly imported Wayback-dedup module.

  Show description for bb51179
  kngenie

  committed
  bb51179

• import Wayback-dedup modules from crawltools project to Heritrix3 contrib

  kngenie

  committed
  651de15

• move WbmPersistLoadProcessor to final location in the tree

  kngenie

  committed
  d88e197

• Merge pull request internetarchive#86 from nlevitt/remove-cruft

  Show description for 93dd896
  kngenie

  committed
  93dd896

• Merge pull request internetarchive#89 from kngenie/beanbrowser-fix

  Show description for b6599d3
  kngenie

  committed
  b6599d3

• Don’t let exception from property getter fail entire bean-browser.

  kngenie

  committed
  2a38fa0

Commits on Aug 24, 2014

• Update HQ modules and WBM-dedup module to match Heritrix 3.3.0.

  Show description for 3450cf3
  kngenie

  committed
  3450cf3

Commits on Aug 20, 2014

• Merge pull request internetarchive#88 from nlevitt/crawluri-compare-bug

  Show description for 6868a9e
  kngenie

  committed
  6868a9e

• fix bug in CrawlURI.compare() discovered by Kenji, add unit test CrawlURITest.testOrdering()

  nlevitt

  committed
  0492107

Commits on Aug 13, 2014

• remove unused Transform* classes

  nlevitt

  committed
  f1b0633

Commits on Jul 25, 2014

• Merge pull request internetarchive#83 from nlevitt/revisit-redux

  Show description for 4298c3d
  

  vonrosen

  committed
  4298c3d

• oops! count novel urls/bytes for hosts report, etc

  nlevitt

  committed
  e5ecde6

• Merge pull request internetarchive#82 from kris-sigur/HER-2071

  Show description for e7b034c
  nlevitt

  committed
  e7b034c

• Fix for HER-2071

  kris-sigur

  committed
  8edebc0

Commits on Jul 23, 2014

• Merge pull request internetarchive#81 from nlevitt/hbase-cdh5

  Show description for 1c6746c
  vinaygoel

  committed
  1c6746c

• Merge branch 'master' into hbase-cdh5

  Show description for 40eae4c
  nlevitt

  committed
  40eae4c

Commits on Jul 22, 2014

• Merge pull request internetarchive#78 from nlevitt/extract-html-no-mimetype

  Show description for ba48f96
  

  vonrosen

  committed
  ba48f96

Commits on Jul 21, 2014

• Merge pull request internetarchive#79 from nlevitt/revisit-redux

  Show description for d0ebd40
  

  Kristinn Sigurðsson

  committed
  d0ebd40

Commits on Jul 18, 2014

• treat content as html and extract links if it looks like html, even if mime type belies that

  nlevitt

  committed
  4b75dfa

Commits on Jul 14, 2014

• restore writeRevisitFor* settings, but issue warning in setter and ignore the value

  nlevitt

  committed
  cb6ac8b

Commits on Jul 11, 2014

• oops, fix 304 tests

  nlevitt

  committed
  da30439

• test 304 not modified revist profile in FetchHTTPTest

  nlevitt

  committed
  7749280

• remove deprecated unused stuff

  nlevitt

  committed
  2292ea9

• set revisit profile on 304 not modified

  nlevitt

  committed
  810ad91

• use RevisitProfile for tallying stats

  nlevitt

  committed
  905a98c

Commits on Jul 10, 2014

• Merge branch 'master' into revisit-redux

  Show description for d9fd668
  nlevitt

  committed
  d9fd668

• Merge pull request internetarchive#76 from nlevitt/HER-2039

  Show description for f101bba
  

  Kristinn Sigurðsson

  committed
  f101bba

Commits on Jul 9, 2014

• remove LinksScoper (deprecated since 2009) and remove recently added code only used in LinksScoper

  nlevitt

  committed
  ee52f48

Commits on Jul 8, 2014

• switch usage of Link to CrawlURI in heritrix-contrib

  nlevitt

  committed
  7bd9f3a

• only write WARC-Refers-To header when value is not null

  nlevitt

  committed
  6e9a0a4

• new parameter keySuffix-- If not null, keySuffix is appended to the lookup key when loading and storing digest history. Thus the key looks like {digest}{keySuffix}, e.g. "sha1:22SFHXERHNFOEY6WK7YOU…

  Show description for 2854798
  nlevitt

  committed
  2854798

Commits on Jul 7, 2014

• copy over and adjust equals(), hashCode(), compareTo() from old Link class to CrawlURI, so that tests pass

  nlevitt

  committed
  bed1e58

• ensure non-null pathFromSeed to fix some unit tests

  nlevitt

  committed
  bfac3c8

• other changes required for merge from master into HER-2039

  nlevitt

  committed
  3c2e131

• Merge branch 'master' into HER-2039

  Show description for f23a59a
  nlevitt

  committed
  f23a59a

Pagination

PreviousNext