Optimize KV cache and compute buffers, bench results from Pi5.

1 files changed, 43 insertions, 0 deletions

diff --git a/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.1.txt b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.1.txt
new file mode 100644
index 0000000..220cce4
--- /dev/null
+++ b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.1.txt
@@ -0,0 +1,43 @@
+PROMPT: Define imperious in 'an imperious necessity drove him forward on his quest'
+
+imperious (adj) — Formal
+
+DEFINITION:
+Having a commanding or domineering character; asserting one's will with authority and arrogance.
+
+GENERAL TONE:
+The necessity was so strong that it pushed him forward, regardless of his own wishes or the opinions of others.
+SYNONYMS:
+urgent, pressing, compelling.
+
+EXAMPLES:
+1. The imperious necessity pushed him to finish his project ahead of schedule.
+2. His imperious nature made it hard for others to disagree with him.
+
+METRICS: ELAPSED: 181.21s | MAX RSS: 2592.09 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define despondency in 'he fell into a state of deep, uninterrupted despondency'
+
+despondency (noun) — Formal
+
+DEFINITION:
+deep and persistent melancholy or hopelessness.
+
+GENERAL TONE:
+The tone is somber, reflecting a profound sense of despair.
+
+SYNONYMS:
+dejection, gloom, melancholy
+
+EXAMPLES:
+1. He fell into a state of deep, uninterrupted despondency.
+2. Her friends tried to lift her out of the long period of despondency.
+
+METRICS: ELAPSED: 192.09s | MAX RSS: 2592.90 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define arduous in 'the long and arduous journey through the frozen mountains'
+