Ecosyste.ms: Timeline
Browse the timeline of events for every public repo on GitHub. Data updated hourly from GH Archive.
sam-hey created a review comment on a pull request on embeddings-benchmark/leaderboard
Should be fine, but I removed them to make it uniform
sam-hey created a comment on a pull request on embeddings-benchmark/leaderboard
> I think that you should update `EXTERNAL_MODEL_RESULTS.json` by deleting it and run `refresh,py` Getting: ``` 'hkunlp__hkunlp__instructor-large' File "/home/sam/Coding/mteb-leaderboard/re...
sam-hey pushed 1 commit to german sam-hey/mteb-leaderboard
- Revert "add german to leaderboard" This reverts commit a6ea180b9181f1513e548ab5bb01587e81612d31. 4b90aa4
sam-hey opened a pull request on embeddings-benchmark/leaderboard
Add German to Leaderboard (Retrieval, STS, PairClassification)
sam-hey created a review comment on a pull request on embeddings-benchmark/mteb
https://github.com/stanford-futuredata/ColBERT This library is the result of the research presented in the paper
sam-hey created a comment on an issue on lightonai/pylate
Just a quick note: the target Python version for Ruff is set to 3.10 https://github.com/lightonai/pylate/blob/7d9d05e7c4a0af1a946978cbb44caab517aabbfb/ruff.toml#L34
sam-hey created a comment on an issue on embeddings-benchmark/mteb
The tests could benefit from updates to improve their effectiveness. For instance, it might be more efficient to focus on testing each model, starting with the search() function, to minimize overhe...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
I believe I’ve added everything for now and would be happy to get your review of the changes! - **Skipping pylate**: Skipped for Python 3.9. - **Updates**: - Added extra tests. - Introduc...
sam-hey opened an issue on embeddings-benchmark/mteb
Optimize the slowest test for better performance
341.42s call tests/test_benchmark/test_benchmark.py::test_mulitple_mteb_tasks[model0-tasks0] 45.39s call tests/test_benchmark/test_benchmark.py::test_prompt_name_passed_to_all_encodes[task_...
sam-hey created a comment on a pull request on embeddings-benchmark/mteb
Tests conducted on v2.0.0 with Python 3.11: checks occasionally take up to 12 minutes. This branch test runtime: 8-9 minutes. Performance benchmarks: ColBERT + BM25: Test execution on my ma...
sam-hey pushed 1 commit to ci/test_colbert_bm25s sam-hey/mteb
- skip test for pylate python < 3.10 1e37876
sam-hey pushed 1 commit to ci/test_colbert_bm25s sam-hey/mteb
- ref: use tmp_path for output_folder d0191ab
sam-hey opened an issue on lightonai/pylate
Python (3.9) Version Incompatibility with `pylate`
Hello, the `pylate` package requires Python version 3.10 or higher for proper functionality. When using Python 3.9, the following error occurs: https://github.com/lightonai/pylate/blob/7d9d05e7c4a...