oli tool benchmarks
This page contains the latest benchmark results for oli tool use performance. These benchmarks are automatically updated with each new PR.
Tool Performance Overview
The benchmark test measures how efficiently oli's tools operate when used with local Ollama models. The benchmark evaluates every tool's performance using simple test cases.
Latest Benchmark Results
This section is automatically updated by CI/CD pipelines.
Latest Results (as of 2025-05-02 13:27:40 UTC)
Category | Details |
---|---|
Model | qwen2.5-coder:7b |
Tool Benchmark Time | 141433 ms |
Tool Tests | 7/7 tests passed |
Tool Performance Tests
- test_read_file_tool_with_llm (54216ms (54.21s))
- test_glob_tool_with_llm (11454ms (11.45s))
- test_grep_tool_with_llm (12549ms (12.54s))
- test_ls_tool_with_llm (11595ms (11.59s))
- test_edit_tool_with_llm (12854ms (12.85s))
- test_bash_tool_with_llm (29415ms (29.41s))
- test_write_tool_with_llm (9305ms (9.30s))