Ecosyste.ms: Timeline
Browse the timeline of events for every public repo on GitHub. Data updated hourly from GH Archive.
sam-hey created a review comment on a pull request on embeddings-benchmark/mteb
https://github.com/stanford-futuredata/ColBERT This library is the result of the research presented in the paper
sam-hey created a comment on an issue on lightonai/pylate
Just a quick note: the target Python version for Ruff is set to 3.10 https://github.com/lightonai/pylate/blob/7d9d05e7c4a0af1a946978cbb44caab517aabbfb/ruff.toml#L34
sam-hey created a comment on an issue on embeddings-benchmark/mteb
The tests could benefit from updates to improve their effectiveness. For instance, it might be more efficient to focus on testing each model, starting with the search() function, to minimize overhe...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
I believe I’ve added everything for now and would be happy to get your review of the changes! - **Skipping pylate**: Skipped for Python 3.9. - **Updates**: - Added extra tests. - Introduc...
sam-hey opened an issue on embeddings-benchmark/mteb
Optimize the slowest test for better performance
341.42s call tests/test_benchmark/test_benchmark.py::test_mulitple_mteb_tasks[model0-tasks0] 45.39s call tests/test_benchmark/test_benchmark.py::test_prompt_name_passed_to_all_encodes[task_...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
Tests conducted on v2.0.0 with Python 3.11: checks occasionally take up to 12 minutes. This branch test runtime: 8-9 minutes. Performance benchmarks: ColBERT + BM25: Test execution on my ma...
sam-hey pushed 1 commit to ci/test_colbert_bm25s sam-hey/mteb
- skip test for pylate python < 3.10 1e37876
sam-hey pushed 1 commit to ci/test_colbert_bm25s sam-hey/mteb
- ref: use tmp_path for output_folder d0191ab
sam-hey opened an issue on lightonai/pylate
Python (3.9) Version Incompatibility with `pylate`
Hello, the `pylate` package requires Python version 3.10 or higher for proper functionality. When using Python 3.9, the following error occurs: https://github.com/lightonai/pylate/blob/7d9d05e7c4a...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
Hi @KennethEnevoldsen, I added two tests in [this PR](https://github.com/embeddings-benchmark/mteb/pull/1759). However, they are not being run in the CI because the dependencies don't exist.
sam-hey opened a pull request on embeddings-benchmark/mteb
ci: run bm25 and ColBERT test in ci
ci: add tests in ci for ColBERT and bm25s ## Checklist <!-- Please do not delete this --> - [ ] Run tests locally to make sure nothing is broken using `make test`. - [x] Run the formatter ...
sam-hey opened a pull request on embeddings-benchmark/mteb
fix: bm25s
fix: bm25s match `search()` ## Checklist <!-- Please do not delete this --> - [x] Run tests locally to make sure nothing is broken using `make test`. - [x] Run the formatter to format the ...
sam-hey opened an issue on embeddings-benchmark/mteb
Generalize Custom search() Method
Currently, only BM25 uses a custom implementation of the `search()` method, achieved by checking if the model name is `bm25s`. This approach is not scalable or practical for future implementations ...
sam-hey created a comment on an issue on huggingface/datasets
 Adding a img from memray