Optimize KV cache and compute buffers, bench results from Pi5.

2 files changed, 144 insertions, 0 deletions

diff --git a/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.1.txt b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.1.txt
new file mode 100644
index 0000000..220cce4
--- /dev/null
+++ b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.1.txt
@@ -0,0 +1,43 @@
+PROMPT: Define imperious in 'an imperious necessity drove him forward on his quest'
+
+imperious (adj) — Formal
+
+DEFINITION:
+Having a commanding or domineering character; asserting one's will with authority and arrogance.
+
+GENERAL TONE:
+The necessity was so strong that it pushed him forward, regardless of his own wishes or the opinions of others.
+SYNONYMS:
+urgent, pressing, compelling.
+
+EXAMPLES:
+1. The imperious necessity pushed him to finish his project ahead of schedule.
+2. His imperious nature made it hard for others to disagree with him.
+
+METRICS: ELAPSED: 181.21s | MAX RSS: 2592.09 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define despondency in 'he fell into a state of deep, uninterrupted despondency'
+
+despondency (noun) — Formal
+
+DEFINITION:
+deep and persistent melancholy or hopelessness.
+
+GENERAL TONE:
+The tone is somber, reflecting a profound sense of despair.
+
+SYNONYMS:
+dejection, gloom, melancholy
+
+EXAMPLES:
+1. He fell into a state of deep, uninterrupted despondency.
+2. Her friends tried to lift her out of the long period of despondency.
+
+METRICS: ELAPSED: 192.09s | MAX RSS: 2592.90 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define arduous in 'the long and arduous journey through the frozen mountains'
+
diff --git a/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.2.txt b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.2.txt
new file mode 100644
index 0000000..e511989
--- /dev/null
+++ b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.pi5.2.txt
@@ -0,0 +1,101 @@
+PROMPT: Define imperious in 'an imperious necessity drove him forward on his quest'
+
+imperious (adj) — Formal
+
+DEFINITION:
+Having a commanding or domineering character; asserting one's will with authority and arrogance.
+
+GENERAL TONE:
+The necessity was so strong that it pushed him forward, regardless of his own wishes or the opinions of others.
+SYNONYMS:
+urgent, pressing, compelling.
+
+EXAMPLES:
+1. The imperious necessity pushed him to finish his project ahead of schedule.
+2. His imperious nature made it hard for others to disagree with him.
+
+METRICS: ELAPSED: 191.92s | DAEMON RSS: 5.14 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define despondency in 'he fell into a state of deep, uninterrupted despondency'
+
+despondency (noun) — Formal
+
+DEFINITION:
+deep and persistent melancholy or hopelessness.
+
+GENERAL TONE:
+The tone is somber, reflecting a profound sense of despair.
+
+SYNONYMS:
+dejection, gloom, melancholy
+
+EXAMPLES:
+1. He fell into a state of deep, uninterrupted despondency.
+2. Her friends tried to lift her out of the long period of despondency.
+
+METRICS: ELAPSED: 57.79s | DAEMON RSS: 2378.18 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define arduous in 'the long and arduous journey through the frozen mountains'
+
+arduous (adjective) — Formal
+
+DEFINITION:
+Challenging or difficult to endure, especially physically.
+
+GENERAL TONE:
+The journey was tough and required a lot of effort.
+SYNONYMS:
+Difficult, strenuous, taxing, grueling
+
+EXAMPLES:
+1. The expedition through the dense jungle was an arduous task.
+2. Climbing Mount Everest is an arduous challenge for mountaineers.
+
+METRICS: ELAPSED: 55.04s | DAEMON RSS: 2364.88 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define ephemeral in 'human history appeared as a brief and ephemeral flash in cosmic time'
+
+ephemeral (adj) — Formal
+
+DEFINITION:
+lasting only a very short time; transient.
+
+GENERAL TONE:
+The phrase suggests that human history is insignificant compared to the vastness of cosmic time.
+
+SYNONYMS:
+transient, fleeting, momentary, brief.
+
+EXAMPLES:
+1. The sunset was an ephemeral display in the sky.
+2. His fame is just an ephemeral memory now.
+
+METRICS: ELAPSED: 53.64s | DAEMON RSS: 2364.31 MB
+
+------------------------------------------------------------------------
+
+PROMPT: Define austere in 'they lived under the austere discipline of their new order'
+
+austere (adj) — Formal
+
+DEFINITION:
+Strictly simple or plain; unadorned.
+
+GENERAL TONE:
+The tone is formal and precise, emphasizing the starkness of their living conditions.
+
+SYNONYMS:
+plain, simple, austonian, severe
+
+EXAMPLES:
+1. They lived under the austere discipline of their new order.
+2. The monastery was known for its austere lifestyle.
+
+METRICS: ELAPSED: 53.59s | DAEMON RSS: 2363.46 MB
+