Ecosyste.ms: Timeline
Browse the timeline of events for every public repo on GitHub. Data updated hourly from GH Archive.
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
Hi @KennethEnevoldsen, I added two tests in [this PR](https://github.com/embeddings-benchmark/mteb/pull/1759). However, they are not being run in the CI because the dependencies don't exist.
sam-hey opened a pull request on embeddings-benchmark/mteb
ci: run bm25 and ColBERT test in ci
ci: add tests in ci for ColBERT and bm25s ## Checklist <!-- Please do not delete this --> - [ ] Run tests locally to make sure nothing is broken using `make test`. - [x] Run the formatter ...
sam-hey opened a pull request on embeddings-benchmark/mteb
fix: bm25s
fix: bm25s match `search()` ## Checklist <!-- Please do not delete this --> - [x] Run tests locally to make sure nothing is broken using `make test`. - [x] Run the formatter to format the ...
sam-hey opened an issue on embeddings-benchmark/mteb
Generalize Custom search() Method
Currently, only BM25 uses a custom implementation of the `search()` method, achieved by checking if the model name is `bm25s`. This approach is not scalable or practical for future implementations ...
sam-hey created a comment on an issue on huggingface/datasets
 Adding a img from memray
sam-hey created a comment on an issue on embeddings-benchmark/mteb
Closed it due to the following: [Discussion on GitHub](https://github.com/embeddings-benchmark/mteb/pull/1759#discussion_r1916725155): > Given that there hasn't been strong support in #1784, I wo...
sam-hey opened an issue on joerick/pyinstrument
Track process termination by the kernel and identify memory consumption sources
I would like to know if it's possible to use pyinstrument to monitor when a process is terminated by the kernel. Specifically, I need a way to trace the source of high memory consumption to under...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
Thanks a lot to all of you, @KennethEnevoldsen, @isaac-chung, and @Samoed! I have one more question: I believe it would be beneficial to add BM25 and ColBERT tests to the pipeline. I’ve read th...
sam-hey created a comment on an issue on embeddings-benchmark/mteb
Closing this as there seems to be no interest in transitioning to Enums
sam-hey closed an issue on embeddings-benchmark/mteb
[v2] Refactor to Use Enums Instead of Literals
## Description: Currently, the codebase relies on literals to describe scoring functions and other constants (magic literals), which can make the code harder to understand and maintain. Using lite...
sam-hey created a review comment on a pull request on embeddings-benchmark/mteb
Have you reviewed the documentation and the related issue? You can find it here: https://github.com/pytest-dev/pytest/issues/9548. https://docs.pytest.org/en/7.1.x/reference/reference.html#pytes...
sam-hey created a review comment on a pull request on embeddings-benchmark/mteb
I'm totally here to improve my coding, so I really appreciate a thorough review, even if it means I have to redo parts! @Samoed, thanks for the feedback! And you're absolutely right it is not so...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
All `Enums` have been removed. The changes should be ready for merging now.
sam-hey created a review comment on a pull request on embeddings-benchmark/mteb
@Samoed, what do you think about this? Do you agree, or should I change it to my version?
sam-hey created a review comment on a pull request on embeddings-benchmark/mteb
> @KennethEnevoldsen, what do you think about merging it in its current state? I’ve kept the Enum but reverted the > changes in all the models. > This should minimize the effort required to merge ...
sam-hey pushed 9 commits to fix_contriever sam-hey/mteb
- fix: update max tokens for OpenAI (#1772) update max tokens 0c5c3a5
- ci: skip AfriSentiLID for now (#1785) * skip AfriSentiLID for now * skip relevant test case instead --------- ... 71dbd61
- 1.28.7 Automatically generated by python-semantic-release bad27a6
- ci: fix model loading test (#1775) * pass base branch into the make command as an arg * test a file that has cust... 9b117a8
- feat: Update task filtering, fixing bug which included cross-lingual tasks in overly many benchmarks (#1787) * feat:... 4a70e5d
- 1.29.0 Automatically generated by python-semantic-release 15a6812
- Merge branch 'refs/heads/main' into v2.0.0 # Conflicts: # mteb/benchmarks/benchmarks.py 8cf6178
- lint 296b9ea
- Merge remote-tracking branch 'mteb/v2.0.0' into fix_contriever 89d1ae8
sam-hey created a review comment on a pull request on embeddings-benchmark/mteb
Yes, you're right that the logic can be condensed into one line, but the example you provided changes the logic slightly: ``` meta.revision = ( _meta.revision if meta.revision is None a...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
@KennethEnevoldsen, what do you think about merging it in its current state? I’ve kept the Enum but reverted the changes in all the models. This should minimize the effort required to merge the ne...