ClaudioItaly/Templare-12B-Q4_K_M-GGUF

This model was converted to GGUF format from ClaudioItaly/Templare-12B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.

CLI:

llama-cli --hf-repo ClaudioItaly/Templare-12B-Q4_K_M-GGUF --hf-file templare-12b-q4_k_m.gguf -p "The meaning to life and the universe is"

###Summary:

"To create my Merge Templare-12B model, I used the Ties method.

The model proves to be decidedly comprehensive from the outset. I conducted a test using LMSTUDIO with a context of 4096 GPU and 100 Flash Attention enabled. The model is very fast, and the language is written correctly without spelling errors.

Here’s an example of texts using only the simple question in Chat without prompts:"

[ Temp 1, Rep Penalty 1,1 Min P Sampling 0,03 Top P 0,95 Top K 40 ] 1 - hi, can you write me a story based on the ancient Roman period?

The sun was beginning to set over the hills of Campania, casting long shadows over the ancient forum of Pompeii. The cobblestone streets were still warm from the summer sun of the late afternoon that had just passed. Merchants were closing their shops while citizens hurried home for the evening meal.

In a house at the center of the city lived Marcus, a young man of twenty with great ambitions and a desire to learn everything he could about the Roman Empire. After dining on fresh bread, olive oil, and stewed vegetables, he retired to his room where he had amassed a vast collection of parchment scrolls containing the texts of the greatest philosophers of antiquity.

Marcus unrolled the first book, which was the work of Cicero. As on many nights before, he lost track of time, immersed in the wisdom of the thoughts of the great orator and statesman. He thought about the greatness of Rome and his role as a citizen of the empire.

Suddenly, he heard a noise outside his room's open window. He approached to look and saw a solitary figure walking down the deserted street. It was a woman with her head covered by a veil, moving hurriedly as if trying to avoid something or someone.

Curious, Marcus decided to follow her discreetly from a distance. He trailed her through the dark and narrow streets until they reached the temple of Venus, goddess of beauty and love. There she stopped and turned toward an altar at the front of the temple.

Marcus watched with interest as the woman placed a small bag on the ground in front of the altar. She knelt down, took a candle from her tunic, and lit it from the torch that was there for that purpose. She placed it next to the bag and bowed her head in prayer.

Marcus wondered what could be inside the bag. Feeling a bit bold and driven by curiosity, he silently approached the kneeling woman. With a trembling hand, he opened the bag and was shocked by what he saw: shining gold coins and precious gems sparkled under the flickering glow of the candle.

"What luck!" he thought to himself. The woman clearly intended to offer valuable gifts to the goddess in exchange for protection or blessings, but it seemed she had been deceived by someone who promised to perform the ritual for her.

Feeling compelled to act courageously, Marcus decided to help the woman. He cleared his throat, drawing the attention of the frightened stranger. "Madam, allow me to assist you," he said in a gentle and reassuring voice. "I am sure you do not wish to offer these precious gifts to the goddess under false pretenses."

The woman looked up at him incredulously and gratefully. She told him her story: she had been tricked by a unscrupulous man who had offered to make a generous offering to the goddess for her in exchange for a small percentage of her hard-earned savings.

Marcus promised her that he would help restore order to her situation. Together they returned to the central forum and found the unscrupulous man chatting with a group of friends. With newfound courageous voice inspired by Cicero's words, Marcus accused the swindler before the entire gathered community.

The man attempted to deny the accusations but felt overwhelmed under the piercing gaze of the crowd. Eventually, he confessed his crime and promised to return the goods to the woman and all other victims of his deceit. Marcus was hailed as a hero by grateful spectators for safeguarding Roman virtue and honesty in their city.

As he walked home, the sun was already rising on the eastern horizon, illuminating Pompeii's streets with new light. Marcus felt that he had discovered a small part of ancient wisdom and faced challenges ahead as a Roman citizen dedicated to justice and common good. With renewed enthusiasm, he retreated into his room to continue reading Greek and Roman philosophers, eager to learn all he could to best serve his empire and people.

[ Temp 1, Rep Penalty 1,1 Min P Sampling 0,03 Top P 0,95 Top K 40 ] 2 - You write me a story about a very thoughtful woman living in 1883

In a small town in Ohio, at the beginning of the twentieth century, there lived a woman named Elizabeth. She was particularly reflective and intellectually curious.

Elizabeth spent much of her days working as an elementary school teacher, fully dedicated to educating the youth of her community. However, beyond her role in the school, she was also passionate about reading and writing, finding great comfort in exploring ideas and conveying her reflections through creative writing.

Every evening, after finishing her school commitments, Elizabeth would retreat to her room to immerse herself in novels by authors like Jane Austen or Charles Dickens. Her mind wandered among the printed words, trying to imagine the worlds described by the characters and their personal struggles.

Not only did Elizabeth read avidly, but she also wrote short stories and poetry. In her writing, she expressed her deepest thoughts and reflections on the social and moral issues surrounding her. Her works often served as an introspective exploration of life's complexities, love, and fate.

One day, Elizabeth decided to enter a local literary contest organized by the town library. With great enthusiasm, she submitted one of her favorite stories: a tale about a young woman's determination to achieve her dreams despite adversity. After weeks of anxious waiting, Elizabeth received the extraordinary news that her story had won first prize.

Her victory in the contest was a moment of immense pride and satisfaction. It not only confirmed her passion for writing but also gave her the motivation to continue nurturing her literary talents. Elizabeth resolved to dedicate more time to creative writing, harboring the secret dream of becoming a published author.

With renewed determination and the support of her loved ones, Elizabeth continued to write stories and poems whenever she had the chance. Her mind was constantly occupied with new ideas and unexplored tales. Despite the challenges and prejudices of the time against women's writing, she did not let herself be discouraged and continued to pursue her dream.

Years passed, and Elizabeth remained faithful to her love for reading and writing. She never became a famous writer or published on a large scale as she had hoped, but she continued to share her works with friends, fellow teachers, and students. Her passion inspired many young minds who saw in her an example of intellectual courage and perseverance.

At the end of her life, Elizabeth retired to the tranquility of a small house surrounded by trees and blooming gardens. She could often be seen sitting on her porch, lost in the pages of beloved books or with a notebook on her lap, capturing the thoughts and reflections of her heart.

In that small corner of the world, Elizabeth embodied the beauty of intellectual life and the importance of following one's destiny. Her love for reading and writing remained alive until her last breath, reminding us that even in the most challenging times, reflection and passion can illuminate the path.