diff options
| author | Sadeep Madurange <sadeep@asciimx.com> | 2026-08-09 07:52:24 +0800 |
|---|---|---|
| committer | Sadeep Madurange <sadeep@asciimx.com> | 2026-08-09 08:36:25 +0800 |
| commit | 22847f1b0aa680303e954c2a0cb61fbd58ff92d3 (patch) | |
| tree | 4eeb7645c9da7e10eab342f25e8e5e3e0b24c86b | |
| parent | 82ecac4a60136ec3289d3a404c99fa4829fce298 (diff) | |
| download | lex-22847f1b0aa680303e954c2a0cb61fbd58ff92d3.tar.gz | |
Improve prompt, move results to bench.
| -rw-r--r-- | bench/results_Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf.txt (renamed from results_Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf.txt) | 0 | ||||
| -rw-r--r-- | bench/results_Mistral-7B-Instruct-v0.3-Q4_K_M.gguf.txt (renamed from results_Mistral-7B-Instruct-v0.3-Q4_K_M.gguf.txt) | 0 | ||||
| -rw-r--r-- | bench/results_Phi-3.5-mini-instruct-Q4_K_M.gguf.txt (renamed from results_Phi-3.5-mini-instruct-Q4_K_M.gguf.txt) | 0 | ||||
| -rw-r--r-- | bench/results_Qwen2.5-7B-Instruct-Q4_K_M.gguf.txt (renamed from results_Qwen2.5-7B-Instruct-Q4_K_M.gguf.txt) | 0 | ||||
| -rw-r--r-- | bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt | 178 | ||||
| -rw-r--r-- | main.c | 23 | ||||
| -rw-r--r-- | results_qwen2.5-3b-instruct-q4_k_m.gguf.txt | 251 |
7 files changed, 357 insertions, 95 deletions
diff --git a/results_Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf.txt b/bench/results_Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf.txt index f7dfdb3..f7dfdb3 100644 --- a/results_Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf.txt +++ b/bench/results_Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf.txt diff --git a/results_Mistral-7B-Instruct-v0.3-Q4_K_M.gguf.txt b/bench/results_Mistral-7B-Instruct-v0.3-Q4_K_M.gguf.txt index efc5a8a..efc5a8a 100644 --- a/results_Mistral-7B-Instruct-v0.3-Q4_K_M.gguf.txt +++ b/bench/results_Mistral-7B-Instruct-v0.3-Q4_K_M.gguf.txt diff --git a/results_Phi-3.5-mini-instruct-Q4_K_M.gguf.txt b/bench/results_Phi-3.5-mini-instruct-Q4_K_M.gguf.txt index a52fe1a..a52fe1a 100644 --- a/results_Phi-3.5-mini-instruct-Q4_K_M.gguf.txt +++ b/bench/results_Phi-3.5-mini-instruct-Q4_K_M.gguf.txt diff --git a/results_Qwen2.5-7B-Instruct-Q4_K_M.gguf.txt b/bench/results_Qwen2.5-7B-Instruct-Q4_K_M.gguf.txt index 39ce2dd..39ce2dd 100644 --- a/results_Qwen2.5-7B-Instruct-Q4_K_M.gguf.txt +++ b/bench/results_Qwen2.5-7B-Instruct-Q4_K_M.gguf.txt diff --git a/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt new file mode 100644 index 0000000..6ba42b1 --- /dev/null +++ b/bench/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt @@ -0,0 +1,178 @@ +PROMPT: Define imperious as in 'an imperious necessity drove him forward on his quest' + +IMPERIOUS (adjective) — Literary + +DEFINITION: +Having a commanding or domineering attitude; asserting authority in an overbearing manner. + +WHEN TO USE: +Use when describing someone who commands respect and authority with an assertive, often domineering attitude. + +EXAMPLES: +1. An imperious necessity drove him forward on his quest. +2. The captain's imperious demeanor intimidated the crew during their voyage. + +METRICS: ELAPSED: 27.24s | MAX RSS: 3023.13 MB + +------------------------------------------------------------------------ + +PROMPT: Define despondency as in 'he fell into a state of deep, uninterrupted despondency' + +DESPONDENCY (noun) — Literary + +DEFINITION: +A state of deep and persistent depression or hopelessness. + +WHEN TO USE: +Use when describing a prolonged period of profound sadness or loss of hope. + +EXAMPLES: +1. He fell into a state of deep, uninterrupted despondency after the loss of his job. +2. The novel explores the protagonist's descent into a pit of unrelenting despondency. + +METRICS: ELAPSED: 21.89s | MAX RSS: 3234.96 MB + +------------------------------------------------------------------------ + +PROMPT: Define arduous as in 'the long and arduous journey through the frozen mountains' + +ARDUOUS (adjective) — Formal + +DEFINITION: +Challenging or difficult to endure; requiring great effort. + +WHEN TO USE: +Use when describing a journey, task, or situation that is tough and requires significant effort to complete. + +EXAMPLES: +1. The long and arduous journey through the frozen mountains was a test of endurance. +2. She undertook an arduous training regimen to prepare for her marathon. + +METRICS: ELAPSED: 22.06s | MAX RSS: 3234.83 MB + +------------------------------------------------------------------------ + +PROMPT: Define ephemeral as in 'human history appeared as a brief and ephemeral flash in cosmic time' + +EPHEREMAL (adjective) — Literary + +DEFINITION: +Lasting only a very short time; brief. + +WHEN TO USE: +Use when describing something that exists or lasts for an extremely short period of time. + +EXAMPLES: +1. Human history appeared as a brief and ephemeral flash in cosmic time. +2. The beauty of the sunset was an ephemeral moment that left a lasting impression. + +METRICS: ELAPSED: 21.26s | MAX RSS: 3234.96 MB + +------------------------------------------------------------------------ + +PROMPT: Define austere as in 'they lived under the austere discipline of their new order' + +AUSTERE (adjective) — Formal + +DEFINITION: +Strictly formal and plain; unadorned or frugal. + +WHEN TO USE: +Use when describing a lifestyle characterized by simplicity, austerity, and strictness in behavior or appearance. + +EXAMPLES: +1. The austere discipline of the monks was evident in their plain robes and simple meals. +2. The austere decor of the museum reflected its minimalist philosophy. + +METRICS: ELAPSED: 21.79s | MAX RSS: 3234.72 MB + +------------------------------------------------------------------------ + +PROMPT: Define venerable as in 'the venerable monuments of a long-forgotten civilization' + +VENERABLE (adjective) — Literary + +DEFINITION: +Of great age and respectability; venerable is used to describe something that has stood the test of time. + +WHEN TO USE: +Use when referring to ancient or historically significant structures, artifacts, or individuals who have lived long ago and are respected for their wisdom or achievements. + +EXAMPLES: +1. The venerable monuments of a long-forgotten civilization stood as silent witnesses to the past. +2. He was honored with an award for his contributions, now recognized as a venerable figure in the field. + +METRICS: ELAPSED: 25.20s | MAX RSS: 3234.81 MB + +------------------------------------------------------------------------ + +PROMPT: Define tumultuous as in 'the species endured a tumultuous period of war and renewal' + +TUMULTUOUS (adjective) — Literary + +DEFINITION: +Characterized by disorder, disturbance, or upheaval. + +WHEN TO USE: +Use when describing a period of time marked by chaos, conflict, and change. + +EXAMPLES: +1. The species endured a tumultuous period of war and renewal. +2. The political landscape was in a state of tumultuous flux following the election. + +METRICS: ELAPSED: 20.98s | MAX RSS: 3234.32 MB + +------------------------------------------------------------------------ + +PROMPT: Define imperturbable as in 'he maintained an imperturbable calm despite the surrounding chaos' + +IMPERTURBABLE (adjective) — Literary + +DEFINITION: +Unaffected by external disturbances or emotions; calm and composed. + +WHEN TO USE: +Use when describing someone who remains completely unruffled in the face of chaos or adversity. + +EXAMPLES: +1. He maintained an imperturbable calm despite the surrounding chaos. +2. The monk remained imperturbable as he faced a torrent of criticism from his peers. + +METRICS: ELAPSED: 21.85s | MAX RSS: 3235.22 MB + +------------------------------------------------------------------------ + +PROMPT: Define singular as in 'he was a man of a singular and unpredictable temperament' + +SINGULAR (adjective) — Literary + +DEFINITION: +Distinct or unique, especially in character or behavior. + +WHEN TO USE: +Use when describing a person with an unusual and unpredictable personality. + +EXAMPLES: +1. He was a man of a singular and unpredictable temperament. +2. Her approach to problem-solving is singularly innovative. + +METRICS: ELAPSED: 19.39s | MAX RSS: 3234.38 MB + +------------------------------------------------------------------------ + +PROMPT: Define enigmatic as in 'he left behind an enigmatic smile and no further explanation' + +ENIGMATIC (adjective) — Literary + +DEFINITION: +Puzzlingly mysterious or obscure in nature. + +WHEN TO USE: +Use when describing a person, situation, or statement that is difficult to understand or interpret clearly. + +EXAMPLES: +1. He left behind an enigmatic smile and no further explanation. +2. The ancient text contained many enigmatic symbols that scholars struggled to decipher. + +METRICS: ELAPSED: 20.99s | MAX RSS: 3234.38 MB + @@ -10,28 +10,19 @@ #define MODEL_PATH "qwen2.5-3b-instruct-q4_k_m.gguf" #define SYSTEM_PROMPT \ - "You are a lexicographer. Define the target word in the context provided.\n\n" \ - "Output format strictly as follows:\n" \ + "You are a dictionary assistant. Define the target word in the context provided.\n" \ + "DO NOT repeat target word in definition. Choose one or two of Formality levels.\n\n" \ + "Output format:\n" \ "<WORD> (<part of speech>) — <Formality: Conversational|Formal|Literary|Figurative|Archaic>\n\n" \ "DEFINITION:\n" \ "<terse, highly accurate definition in context>\n\n" \ "GENERAL TONE:\n" \ - "<1 terse note on emotional/attitudinal charge/register if relevant. Include standard conversational alternative where applicable.>\n\n" \ + "<One terse sentence of describing general tone. One terse sentence of standard conversational synonyms.>\n\n" \ + "SYNONYMS:\n" \ + "<Three to four standard conversational synonyms.>\n\n" \ "EXAMPLES:\n" \ "1. <example 1>\n" \ - "2. <example 2>\n\n" \ - "EXAMPLE INPUT:\n" \ - "Define tumultuous as in 'the species endured a tumultuous period of war and renewal'\n\n" \ - "EXAMPLE OUTPUT:\n" \ - "TUMULTUOUS (adjective) — Literary / Formal\n\n" \ - "DEFINITION:\n" \ - "Marked by wild disorder, chaotic disturbance, or intense emotional and political turmoil.\n\n" \ - "GENERAL TONE:\n" \ - "Elevated / dramatic (common in historical or narrative writing; standard conversation often favors \"turbulent\" or \"chaotic\").\n\n" \ - "EXAMPLES:\n" \ - "1. The species endured a tumultuous period of war and renewal.\n" \ - "2. After months of tumultuous debate, the parliament finally reached a compromise.\n\n" \ - "DO NOT add anything after the examples. DO NOT include the word in the definition." + "2. <example 2>\n\n" #define MAX_TOKENS 300 diff --git a/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt b/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt index 6ba42b1..88e913b 100644 --- a/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt +++ b/results_qwen2.5-3b-instruct-q4_k_m.gguf.txt @@ -1,178 +1,271 @@ -PROMPT: Define imperious as in 'an imperious necessity drove him forward on his quest' +PROMPT: Define imperious in 'an imperious necessity drove him forward on his quest' -IMPERIOUS (adjective) — Literary +imperious (adj) — Formal DEFINITION: -Having a commanding or domineering attitude; asserting authority in an overbearing manner. +Having a commanding or domineering character; asserting one's will with authority. -WHEN TO USE: -Use when describing someone who commands respect and authority with an assertive, often domineering attitude. +GENERAL TONE: +The necessity was so strong that it compelled him to move forward on his journey, leaving no room for resistance. + +SYNONYMS: +urgent, pressing, compelling EXAMPLES: -1. An imperious necessity drove him forward on his quest. -2. The captain's imperious demeanor intimidated the crew during their voyage. +1. The imperious necessity pushed him to finish the project. +2. His imperious nature made it hard for others to disagree with his decisions. -METRICS: ELAPSED: 27.24s | MAX RSS: 3023.13 MB +METRICS: ELAPSED: 19.89s | MAX RSS: 3222.74 MB ------------------------------------------------------------------------ -PROMPT: Define despondency as in 'he fell into a state of deep, uninterrupted despondency' +PROMPT: Define despondency in 'he fell into a state of deep, uninterrupted despondency' -DESPONDENCY (noun) — Literary +despondency (noun) — Formal DEFINITION: -A state of deep and persistent depression or hopelessness. +deep and persistent hopelessness or despair. + +GENERAL TONE: +The tone is somber, reflecting the heavy emotional state of the person experiencing despondency. -WHEN TO USE: -Use when describing a prolonged period of profound sadness or loss of hope. +SYNONYMS: +hopelessness, melancholy, gloominess EXAMPLES: -1. He fell into a state of deep, uninterrupted despondency after the loss of his job. -2. The novel explores the protagonist's descent into a pit of unrelenting despondency. +1. He fell into a state of deep, uninterrupted despondency. +2. Her friends noticed she had been in a constant state of despondency lately. -METRICS: ELAPSED: 21.89s | MAX RSS: 3234.96 MB +METRICS: ELAPSED: 22.21s | MAX RSS: 3223.14 MB ------------------------------------------------------------------------ -PROMPT: Define arduous as in 'the long and arduous journey through the frozen mountains' +PROMPT: Define arduous in 'the long and arduous journey through the frozen mountains' -ARDUOUS (adjective) — Formal +arduous (adj) — Formal DEFINITION: -Challenging or difficult to endure; requiring great effort. +Challenging or difficult, especially in a way that requires great effort. + +GENERAL TONE: +The journey through the frozen mountains was tough and required much perseverance. -WHEN TO USE: -Use when describing a journey, task, or situation that is tough and requires significant effort to complete. +SYNONYMS: +Difficult, strenuous, laborious, taxing. EXAMPLES: -1. The long and arduous journey through the frozen mountains was a test of endurance. -2. She undertook an arduous training regimen to prepare for her marathon. +1. The expedition through the dense jungle was an arduous task. +2. Climbing Mount Everest is an arduous challenge for mountaineers. -METRICS: ELAPSED: 22.06s | MAX RSS: 3234.83 MB +METRICS: ELAPSED: 21.95s | MAX RSS: 3223.10 MB ------------------------------------------------------------------------ -PROMPT: Define ephemeral as in 'human history appeared as a brief and ephemeral flash in cosmic time' +PROMPT: Define ephemeral in 'human history appeared as a brief and ephemeral flash in cosmic time' -EPHEREMAL (adjective) — Literary +ephemeral (adj) — Formal DEFINITION: -Lasting only a very short time; brief. +lasting only a very short time; transient. -WHEN TO USE: -Use when describing something that exists or lasts for an extremely short period of time. +GENERAL TONE: +The phrase suggests that human history is insignificant compared to the vastness of cosmic time. + +SYNONYMS: +transient, fleeting, momentary, brief. EXAMPLES: -1. Human history appeared as a brief and ephemeral flash in cosmic time. -2. The beauty of the sunset was an ephemeral moment that left a lasting impression. +1. The sunset was an ephemeral display in the sky. +2. His fame is just an ephemeral memory now. -METRICS: ELAPSED: 21.26s | MAX RSS: 3234.96 MB +METRICS: ELAPSED: 20.89s | MAX RSS: 3223.20 MB ------------------------------------------------------------------------ -PROMPT: Define austere as in 'they lived under the austere discipline of their new order' +PROMPT: Define austere in 'they lived under the austere discipline of their new order' -AUSTERE (adjective) — Formal +austere (adj) — Formal DEFINITION: -Strictly formal and plain; unadorned or frugal. +strictly simple or plain in style, manner, or appearance; severe and unadorned. + +GENERAL TONE: +The tone is formal, emphasizing the strictness and simplicity of their lifestyle under the new order. -WHEN TO USE: -Use when describing a lifestyle characterized by simplicity, austerity, and strictness in behavior or appearance. +SYNONYMS: +rigid, severe, plain, stark. EXAMPLES: -1. The austere discipline of the monks was evident in their plain robes and simple meals. -2. The austere decor of the museum reflected its minimalist philosophy. +1. The monastery was known for its austere lifestyle. +2. His writing style is quite austere and lacks ornamentation. -METRICS: ELAPSED: 21.79s | MAX RSS: 3234.72 MB +METRICS: ELAPSED: 22.54s | MAX RSS: 3222.46 MB ------------------------------------------------------------------------ -PROMPT: Define venerable as in 'the venerable monuments of a long-forgotten civilization' +PROMPT: Define venerable in 'the venerable monuments of a long-forgotten civilization' -VENERABLE (adjective) — Literary +venerable (adj) — Formal DEFINITION: -Of great age and respectability; venerable is used to describe something that has stood the test of time. +Respected and revered due to age or historical significance. + +GENERAL TONE: +The monuments are ancient structures that have stood the test of time, earning them respect from modern visitors. -WHEN TO USE: -Use when referring to ancient or historically significant structures, artifacts, or individuals who have lived long ago and are respected for their wisdom or achievements. +SYNONYMS: +Ancient, venerable, historic, revered. EXAMPLES: -1. The venerable monuments of a long-forgotten civilization stood as silent witnesses to the past. -2. He was honored with an award for his contributions, now recognized as a venerable figure in the field. +1. The venerable monuments of a long-forgotten civilization are now in ruins. +2. She felt a sense of reverence for the venerable old church. -METRICS: ELAPSED: 25.20s | MAX RSS: 3234.81 MB +METRICS: ELAPSED: 22.47s | MAX RSS: 3222.97 MB ------------------------------------------------------------------------ -PROMPT: Define tumultuous as in 'the species endured a tumultuous period of war and renewal' +PROMPT: Define tumultuous in 'the species endured a tumultuous period of war and renewal' -TUMULTUOUS (adjective) — Literary +tumultuous (adj) — Formality: Literary DEFINITION: -Characterized by disorder, disturbance, or upheaval. +Marked by violent disturbance or disorder; stormy. -WHEN TO USE: -Use when describing a period of time marked by chaos, conflict, and change. +GENERAL TONE: +The passage conveys a chaotic and turbulent period filled with conflict and change. + +SYNONYMS: +chaotic, tumult, stormy, tempestuous EXAMPLES: -1. The species endured a tumultuous period of war and renewal. -2. The political landscape was in a state of tumultuous flux following the election. +1. The city experienced a tumultuous period of unrest and protests. +2. During the tumultuous years of his reign, he faced numerous challenges. -METRICS: ELAPSED: 20.98s | MAX RSS: 3234.32 MB +METRICS: ELAPSED: 22.61s | MAX RSS: 3222.95 MB ------------------------------------------------------------------------ -PROMPT: Define imperturbable as in 'he maintained an imperturbable calm despite the surrounding chaos' +PROMPT: Define imperturbable in 'he maintained an imperturbable calm despite the surrounding chaos' -IMPERTURBABLE (adjective) — Literary +imperturbable (adj) — Formal DEFINITION: -Unaffected by external disturbances or emotions; calm and composed. +Unshaken or unaffected by events, circumstances, or emotions. + +GENERAL TONE: +The speaker remains composed even in chaotic situations. -WHEN TO USE: -Use when describing someone who remains completely unruffled in the face of chaos or adversity. +SYNONYMS: +calm, composed, unruffled EXAMPLES: -1. He maintained an imperturbable calm despite the surrounding chaos. -2. The monk remained imperturbable as he faced a torrent of criticism from his peers. +1. Despite the storm outside, he maintained an imperturbable calm. +2. She kept her composure during the heated argument. -METRICS: ELAPSED: 21.85s | MAX RSS: 3235.22 MB +METRICS: ELAPSED: 21.00s | MAX RSS: 3223.41 MB ------------------------------------------------------------------------ -PROMPT: Define singular as in 'he was a man of a singular and unpredictable temperament' +PROMPT: Define singular in 'he was a man of a singular and unpredictable temperament' -SINGULAR (adjective) — Literary +singular (adjective) — Formal DEFINITION: -Distinct or unique, especially in character or behavior. +Singular refers to something unique or individual, not part of a group. + +GENERAL TONE: +The term conveys uniqueness and distinctiveness without being overly formal. -WHEN TO USE: -Use when describing a person with an unusual and unpredictable personality. +SYNONYMS: +uncommon, unique, distinctive EXAMPLES: 1. He was a man of a singular and unpredictable temperament. -2. Her approach to problem-solving is singularly innovative. +2. Her approach to problem-solving is singularly effective. + +METRICS: ELAPSED: 22.41s | MAX RSS: 3222.57 MB + +------------------------------------------------------------------------ + +PROMPT: Define enigmatic in 'he left behind an enigmatic smile and no further explanation' + +enigmatic (adj) — Formal + +DEFINITION: +Mysterious and difficult to understand or interpret. + +GENERAL TONE: +The smile was a puzzle, hard to decipher. -METRICS: ELAPSED: 19.39s | MAX RSS: 3234.38 MB +SYNONYMS: +mystifying, puzzling, enigmatical + +EXAMPLES: +1. The riddle left me feeling enigmatic. +2. Her smile was so enigmatic it made everyone curious. + +METRICS: ELAPSED: 20.25s | MAX RSS: 3223.00 MB ------------------------------------------------------------------------ -PROMPT: Define enigmatic as in 'he left behind an enigmatic smile and no further explanation' +PROMPT: Define bestial in 'You submitted to be the slave of bestial men' -ENIGMATIC (adjective) — Literary +bestial (adj) — Formal DEFINITION: -Puzzlingly mysterious or obscure in nature. +Of or relating to animals; brutish. + +GENERAL TONE: +The phrase suggests a dehumanizing and brutal treatment of humans by other humans, emphasizing the inhumane nature of their actions. + +SYNONYMS: +brutal, savage, uncivilized + +EXAMPLES: +1. The treatment of prisoners was bestial. +2. He felt like a bestial creature in the eyes of his captors. + +METRICS: ELAPSED: 22.25s | MAX RSS: 3222.89 MB + +------------------------------------------------------------------------ + +PROMPT: Define flung in 'As if plunged in a stormy water, I was flung about wildly, and felt myself sinking.' + +flung (verb) — Formality: Literary + +DEFINITION: +To throw or hurl suddenly and forcefully, often with a sense of being overwhelmed. + +GENERAL TONE: +The tone is vividly descriptive, evoking a tumultuous experience. + +SYNONYMS: +Thrust, tossed, hurled, tossed about. + +EXAMPLES: +1. As if plunged in a stormy water, I was flung about wildly, and felt myself sinking. +2. The ball was flung over the fence by the batter. + +METRICS: ELAPSED: 24.50s | MAX RSS: 3224.59 MB + +------------------------------------------------------------------------ + +PROMPT: Define hewers in 'You might by this time have made the Bags hewers of wood and drawers of water' + +hewers (noun) — Formal + +DEFINITION: +People who cut wood or perform manual labor. + +GENERAL TONE: +The sentence suggests a rustic, hardworking community where physical labor is valued and necessary. -WHEN TO USE: -Use when describing a person, situation, or statement that is difficult to understand or interpret clearly. +SYNONYMS: +Cutters, woodcutters, laborers EXAMPLES: -1. He left behind an enigmatic smile and no further explanation. -2. The ancient text contained many enigmatic symbols that scholars struggled to decipher. +1. The hewers worked tirelessly in the forest. +2. In colonial times, many families were hewers and drawers of water. -METRICS: ELAPSED: 20.99s | MAX RSS: 3234.38 MB +METRICS: ELAPSED: 21.98s | MAX RSS: 3224.26 MB |
