Tags: obss/trapper
Tags
Metrics implementation (#27) * Test for actions. (main unchanged) * Code formatting. * Jury metrics added. * Test for actions. (main unchanged) * Code formatting. * Jury metrics added. * JuryMetric class added registered. * Metric class implemented, supported through Jury. - DataAdapter reworked to require "split" parameter on call to ensure label_list contains validation samples (to be evaluated). The use for the user is seamless (nothing additional required by user), only changed on test cases. - Test cases changed acordingly. * QA Adapter, appending answers changed to list from str. * jury added to requirements.txt (>=2.0.0). * Update requirements.txt * MetadataHandler introduced to save meta data from samples required for metric computation. * (Planning Phase (PP: No test implemented yet.)) MetadataHandler component implemented. - Test cases changed accordingly. - Associated components changed accordingly. * Small refactors for metadata handlers. * Updates from main branch (conflicts resolved). - Metadata handlers are introduced as handling metadata for metric evaluation (for tasks that require additional metadata for final prediction out.) - Bug fix: `qa_id` for FilteredInstance is changed to type str (from int) on question_answering_processor.py. - New requirement: jury>2.1.0. * Code formatting. * MetadataHandlerForPosTagging added for pos-tag example. - Seqeval class is removed from metrics.py. - Docstring added for MetadataHandler. * Code formatting. * README.md updated. - Unused imports removed. * Updates from main. - Name changed as metric handler. * Required changes for metric handler. * Test for MetricHandler (default implementation) added. * Metric handler test fixtures. * trapper.__init__ updated. - README.md updated. * Question answering notebook updated. * Unused class removed. * Updates from the reviews. - README.md updated. * setup.py updated. * setup.py corrected. * Updates from review. * README.md update. * README.md update. * Updates from review. * Updates from review. * Updates from reviews. - Unused import removed in question_answering_adapter.py. - Docstring added to question_answering_handler.py. - Parts regarding metric handler updated in README.md. - version updated to "0.0.5" from "0.0.4". * Updated structure of metric handlers. - MetricHandler is divided to MetricInputHandler and MetricOutputHandler to handling input for metrics and manipulating resulting output of metric computation respectively. - README.md updates. - Docstrings updated. - Test cases updated according to the changes. * version set back to 0.0.4 (from 0.0.5) * Requested changes from review. * Add `Why You Should Use Trapper` section to the README.md * Update the `Why You Should Use Trapper` section * Minor update Co-authored-by: cemilcengiz <[email protected]>
PreviousNext