Nature
human and material
Sophia begins to tell us
we miss cues
a fissure beyond the ridge
life’s current steals us
our boat tips over
‘exactly how she feels’
downstream we recite
a prayer of serenity
~Oppenheimer
Nature
human and material
Sophia begins to tell us
we miss cues
a fissure beyond the ridge
life’s current steals us
our boat tips over
‘exactly how she feels’
downstream we recite
a prayer of serenity
~Oppenheimer
3rd Times a Charm
3rd iteration at attempting to create a pipeline for training an LLM.
I’ve revised my strategy.
I have 4 distinct phases (models)
This order makes the process easier to understand, kind of like layers of blankets, or matrix manifolds of schema types.
Features
* All phases have warmup phases that end halfway thru the training partition.
* Constant length datasets with stride
* Sequences are processed sequentially (not shuffled) (i.e. core documents I would like to be in a serial order, datasets could be shuffled, bit due to stride not)
* Smooth transition of learning rate to continue training on validation split
* MeZO (fine tuning with forward passes) (allows a speedup)
* 4-bit quantized model (saves memory, allows greater context size and batches)
* Lora adapter (huge speedup)
* Perplexity early stopping (no more custom Trainer class, other than MeZo). Handled with callbacks, tracking the best model based on perplexity and going with the local minimum after at least 1 epoch and loads best model after 2 failed consecutive eval losses at eval/epoch.
* direct preference optimization using preferred/dispreferred special tokens
For now I’m using open_llama_3b because my setup is somewhat limited, but once I confirm my ‘theory’ works, I will expand to runpod.
Atm, the use case I’m trying to show is learning custom documents (thank you gimarereader) and attempt to transfer learn Squad_v2 question/answering. Which hopefully will transfer learn to the ‘core documents’.
Once I confirm I have the procedure down correctly, expanding to a webui that can search the internet, supports a faiss index of the core trained documents, and supports a hack of RLHF using the dpo tokens, plus continual modifications later (but I’m told it’s always pretrain then finetune, but I’m hoping I can find a decent workaround by warming up between training sessions, else I have to redo finetuning each time).
I plan on extending this to quotes, lyrics, works of philosophy, logic, analogies, etc, etc. I’ve been documenting what would be choice to go into such a model.
I can confirm the model picks up the QA ability after the training, but still confirming if it can recall pretraining.
Total time to learn is roughly 3 hours with 5 epochs at each stage learning 1 book+ 400 finetune records.
** Atempted to implement relora, but it’s not ‘there’ yet.
Pipeline for Training an LLM
Phases (Models):
Features:
By adhering to these layers, one can add one type of data at a time, rather than trying to run all pieces through at one.
It starts with core dataset (continuing pretraining from
Weights can be ‘sharpen’ the weights using a subset of all past training source (grokking) (keeping a log is key).
Challenges & Considerations:
Voting mechanism for Direct Preference Optimization w Chain of Thought Reasoning: Automated System for Continuous Improvement
Feedback Loops & Objectivity:
Model Diversity & Ensemble Learning:
Extended Inference Pipeline:
I perfected my
Retrieval Augmented Generator
I still prefer mine over the more polished ones I see in ui’s such as huggingface’s chat-ui and text-web-generation-ui
simply because I was able to code it rather than trying to mess with individual plugins or learning new interfaces.
* External Memory – In memory faiss store (all saved in jupyter)
* Using Llama-2-7b-chat-hf hosted via an api via text-web-generation-ui that I connect to from a ‘client’
* Internal Memory – Chat Window of up to past two chats
* Web search capability – Derive’s a search phrase, scrapes url’s, identifies key sentences using embeddings. Only used for generating an augmented response (see Context).
* Only the user input prompt + response are ever refed back into the window.
* Context is not saved for retrieval. Retrieval is solely based on the user prompt + response, and the sentences before and after the related sentence are also retrieved.
* When you see –Past Conversations– and –Web Results–, that is simply me printing the diagnostic statement to see the output, and see if the AI Response is taking the material into consideration, which it is.
This allows me to save on tokens with the chat window rather than refeeding in past context. This means context is only retrieved from parsed answers. If I want new web search data, I essentially have to do another \s to retrieve new web context data.
I can sit back and run a few queries through, and then view the message response history after all have been processed.
Instruction:
What can you tell me about the Philosopher Heraclitus?
Response:
Heraclitus (c. 535-475 BCE) was a pre-Socratic Greek philosopher from Ephesus, who is known for his concept of “flux” or “perpetual change.” He believed that everything is in a state of constant flux and that nothing remains the same. This idea challenged the traditional view of stability and permanence in ancient Greece, where change was seen as something negative or disruptive. Instead, Heraclitus saw change as an essential aspect of life and reality.
Heraclitus’ philosophy also emphasized the importance of understanding the interconnectedness of all things. He believed that everything is part of a larger whole, and that nothing exists independently. This idea is reflected in his famous phrase “the whole is greater than the sum of its parts,” which suggests that the value of something lies not just in its individual components but in how they relate to each other.
In addition to his ideas on change and interconnectedness, Heraclitus made significant contributions to the fields of logic, ethics, and politics. His work had a profound influence on later philosophers, including Plato and Aristotle, and continues to be studied and debated by scholars today.
Instruction:
What can you tell me about the Philosopher Poet Sapho?
Response:
Sappho (c. 630-570 BCE) was a Greek poet from the island of Lesbos, who is considered one of the greatest lyric poets of ancient Greece. She is best known for her sensual and emotional poetry, which often dealt with themes of love, desire, and longing. Despite the scarcity of surviving evidence, Sappho’s reputation as a brilliant poet has endured for centuries, and she is still widely regarded as one of the most important figures in Western literature.
Sappho’s poetry is characterized by its use of vivid imagery, rich language, and intense emotion. Many of her poems express a deep yearning for love and connection, particularly with women. While some of her works are explicitly erotic, others explore more abstract themes such as beauty, mortality, and the nature of human experience.
Despite the limited amount of information available about Sappho’s life, it is clear that she was a prominent figure in the cultural and intellectual circles of ancient Greece. Her poetry reflects her interest in music, mythology, and religion, as well as her engagement with contemporary political and social issues.
Throughout history, Sappho has been celebrated for her artistic genius and her groundbreaking exploration of gender, sexuality, and identity. Today, she remains an inspiration to many writers, artists, and thinkers around the world.
Instruction:
What can you tell me about the Philosopher Parminedes?
What can you tell me about the Philosopher Xenophon?
Response:
Xenophon (428-354/351 BCE) was a Greek philosopher, historian, and writer who was born into a wealthy Athenian family during the 5th century BCE. He is best known for his philosophical works, particularly “The Memorabilia,” which provides valuable insights into the life and teachings of Socrates. In addition to his work on Socratic philosophy, Xenophon wrote extensively on ethics, politics, and military strategy. His writings offer a unique perspective on the culture and society of ancient Greece, and have had a lasting impact on Western philosophy.
As a young man, Xenophon became a student of Socrates, and he remained close friends with Plato after Socrates’ death. This relationship allowed him access to firsthand accounts of Socratic teaching and provided the basis for much of his philosophical work. Through his writing, Xenophon sought to preserve and promote the ideas of Socrates, while also offering his own original contributions to the field of philosophy.
One of Xenophon’s key philosophical contributions was his concept of the “gentleman” or “the good citizen.” According to Xenophon, the ideal individual was someone who possessed both moral virtue and practical wisdom. This idea was closely tied to his views on education and the role of the state in promoting virtuous behavior.
In addition to his philosophical works, Xenophon was also a skilled historian and writer. He authored several books on military campaigns and tactics, including “Anabasis,” which describes the exploits of the Ten Thousand, a group of Greek mercenaries who fought against the Persians in Asia Minor.
Overall, Xenophon was a significant figure in the development of Western philosophy, and his works continue to be studied and debated by scholars today.
Instruction:
What can you tell me about the Philosopher Socrates?
Response:
Socrates (469/470 BCE – 399 BCE) was a Greek philosopher who is widely regarded as one of the founders of Western philosophy. Born in Athens, Greece, Socrates lived during a time of great social change and political upheaval. Despite his relatively humble origins, he was highly influential among the intellectual elite of his day, and his ideas have had a profound impact on Western thought ever since.
Socrates’ approach to philosophy was unconventional and often provocative. Rather than relying on written texts or complex arguments, he preferred to engage in dialogue and questioning with his interlocutors. Through this method, known as the Socratic method, he aimed to expose the contradictions and inconsistencies in people’s beliefs and values, ultimately arriving at a deeper understanding of truth and morality.
Socrates’ most famous pupil was Plato, who later went on to become one of the most important figures in Western philosophy himself. However, Socrates taught many other students as well, including Xenophon, Antisthenes, and Aristippus.
Some of Socrates’ key ideas include:
What can you tell me about the Philosopher Plato?
Response:
Plato (c. 428-348 BCE) was a Greek philosopher and student of Socrates who is widely considered one of the greatest philosophers in history. He founded the Academy in Athens, which became one of the earliest institutions of higher learning in the Western world. In addition to being a philosopher, Plato was also a mathematician, scientist, and writer.
Plato’s philosophy focused on the nature of reality, knowledge, ethics, politics, and religion. He developed several central concepts, including the theory of Forms, the idea of the soul, and the notion of the ideal society. According to Plato, the material world is only an imperfect reflection of the perfect, eternal realm of Forms, which are the true and lasting reality. The soul is immortal and pre-exists before birth, and it is the source of knowledge and moral judgment. An ideal society would be ruled by philosopher-kings who understand the eternal truths and use their knowledge to govern justly.
Plato wrote over 150 works, although many of them were lost over time. Of those that survive, around 25 are considered genuine works, while others are spurious or doubtful. Some of his most famous works include “The Republic,” “Symposium,” “Apology,” and “Phaedo.”
Plato’s influence extends far beyond ancient Greece. His ideas have shaped Western philosophy, science, mathematics, literature, and art for centuries. Many prominent philosophers throughout history have been influenced by Plato, including Aristotle, Immanuel Kant, Friedrich Nietzsche, and Martin Heidegger, to name a few.
In summary, Plato was a towering figure in Western philosophy whose ideas continue to shape our understanding of reality, knowledge, ethics, politics, and religion today.
Instruction:
What can you tell me about the Philosopher Diogenes of Sinope?
Response:
Diogenes of Sinope (c. 412-323 BCE) was a Greek philosopher known for his radical asceticism and his rejection of conventional social norms. He is often referred to as the “Cynic” philosopher because he believed in living a simple life free from societal conventions and desires.
According to legend, Diogenes was born into a wealthy family but gave up his possessions and lived in a tub or barrel instead of a house. He rejected luxury and extravagance, believing that they led to corruption and decadence. Instead, he advocated for a simple, frugal lifestyle based on self-sufficiency and personal freedom.
Diogenes was known for his wit and his ability to criticize societal hypocrisies. He famously carried a lantern during the daytime, claiming that he was looking for an honest man. When asked why he did this, he replied, “I am searching for a human being.” This anecdote highlights Diogenes’ skepticism towards conventional morality and his belief in the importance of honesty and integrity.
Despite his unconventional lifestyle, Diogenes had a significant impact on Western philosophy. His emphasis on simplicity, self-reliance, and personal virtue influenced later philosophical movements such as Stoicism and Epicureanism. His critique of societal norms and values helped pave the way for subsequent philosophical schools that sought to challenge established power structures.
Some of Diogenes’ other notable sayings and teachings include:
What can you tell me about the Philosopher Aristotle?
Response:
Aristotle (384-322 BCE) was a Greek philosopher and polymath who made significant contributions to various fields, including philosophy, science, logic, ethics, politics, and biology. He was born in Stagira, a small town in ancient Macedonia, and studied under Plato at the Academy in Athens before establishing his own school, the Lyceum, in Athens.
Philosophically, Aristotle developed a comprehensive system of thought that integrated observations from the natural world with ethical and moral principles. He believed in the concept of causality, arguing that everything has a cause and that causes lead to effects. In metaphysics, he posited that substances consist of matter and form, and that the ultimate principle of reality is the idea of potentiality actualized. Additionally, he explored the nature of time, space, and motion, developing the concepts of time as a measure of change and space as the container of objects.
In logic, Aristotle developed the syllogism, which consists of three parts: premise, conclusion, and middle term. He also introduced the concept of deduction, where one moves from specific instances to general conclusions. Furthermore, he wrote extensively on rhetoric, persuasion, and the art of reasoning.
Aristotle’s works also cover ethics, politics, and economics. In ethics, he argued that humans have a rational soul and that virtues are habits acquired through practice. In politics, he believed in the mixed constitution, where the ideal society would be a balance between monarchy, aristocracy, and democracy. Finally, in economics, he discussed the concept of exchange value and the origins of money.
Some of Aristotle’s most famous quotes include:
What can you tell me about the Philosopher Numenius?
Response:
Numenius of Apamea (fl. 1st century CE) was a Hellenistic philosopher known for his extensive writings on Stoicism. Little is known about his life beyond this, but his works provide valuable insights into the Stoic tradition during the late Roman Republic and early Empire periods. Here are some key points about Numenius:
What can you tell me about the Philosopher, teacher, and Stateswoman, Hypatia of Alexandria?
Response:
Hypatia of Alexandria (c. 370-415 CE) was a renowned mathematician, astronomer, and philosopher who played a pivotal role in the intellectual landscape of ancient Egypt. As one of the few female mathematicians and scientists of her time, she broke gender barriers and inspired future generations of women in STEM fields. Here are some key facts about Hypatia:
What can you tell me about the Philosopher Hierocles of Alexandria, Hypatia’s contemporary?
Response:
Hierocles of Alexandria (flourished c. 4th century CE) was a Greek philosopher and logician who lived contemporaneously with Hypatia of Alexandria (c. 370-415 CE). Although little is known about his personal life and works, Hierocles had significant interactions with Hypatia and other notable intellectuals of his time. Here are some interesting details about Hierocles:
What can you tell me about the Philosopher ‘Dionysius areopagite’?
Response:
The philosopher Dionysius Areopagita (flourished c. 6th century CE) was an important figure in the history of Christian philosophy. While little is known about his personal life, he made significant contributions to the fields of metaphysics, theology, and spirituality through his writings. Here are some key points about Dionysius Areopagite:
What can you tell me about the Philosopher Theologian Valentinus the Gnostic?
Response:
Valentinus the Gnostic (flourished 2nd century CE) was a prominent early Christian theologian and gnostic writer who played a significant role in shaping the development of Christian thought. Although little is known about his personal life, his teachings had a lasting impact on the evolution of Christian theology and spirituality. Here are some key points about Valentinus the Gnostic:
What can you tell me about the Philosopher Proclus?
Response:
Proclus Lycaeus (c. 412 – c. 485 CE) was a Greek Neoplatonist philosopher and mathematician who played a pivotal role in the development of late antique philosophy. As one of the most influential figures in the history of Neoplatonism, he expanded the scope of Platonism, integrating elements from various philosophical and scientific disciplines. Here are some key facts about Proclosus:
Synthesized contextual response given ‘profound philosophical ideas’
The concept of “profound philosophical ideas” is a broad and complex topic that has been explored by thinkers throughout history. At its core, philosophy seeks to understand the nature of reality, knowledge, ethics, and human existence. Here are some of the most profound philosophical ideas in history:
Each of these profound philosophical ideas offers unique insights into the human condition, challenging conventional wisdom and offering new frameworks for understanding ourselves and the world around us. Let’s delve deeper into each of these concepts to appreciate their significance and implications:
Plato’s Allegory of the Cave:
This ancient Greek philosopher’s allegory suggests that our senses deceive us, and reality lies beyond what we perceive directly. It highlights the limitations of our cognitive abilities and the need for philosophical inquiry to uncover hidden truths. By recognizing the cave as a symbol of our limited understanding, we become aware of the potential for greater knowledge and wisdom.
Aristotle’s Four Causes:
Aristotle’s causality framework provides a structure for comprehending events and objects. Understanding the material cause (substance), formal cause (structure), efficient cause (agent), and final cause (purpose) enables us to grasp the intricacies of reality more effectively. For instance, when analyzing a tree, we might consider its material cause (wooden cells), formal cause (tree-like structure), efficient cause (growth processes), and final cause (providing shelter or fuel).
Immanuel Kant’s Critique of Pure Reason:
Kant’s groundbreaking work challenged traditional assumptions regarding knowledge and reality. He proposed that our understanding is shaped by mental constructs rather than direct observation. This idea fundamentally changed modern philosophy, emphasizing the role of subjective experience in shaping our understanding of the world. By recognizing the limits of our cognition, we can better evaluate knowledge claims and foster critical thinking.
Friedrich Nietzsche’s Will to Power:
Nietzsche’s influential concept of the will to power underscores the centrality of individual agency in shaping our lives and the world around us. Recognizing the primacy of self-expression allows us to embrace creativity, pursue meaningful goals, and cultivate authentic identities. Moreover, this idea highlights the importance of embracing responsibility for our choices and actions, rather than relying solely on external authorities or deterministic forces.
Jean-Paul Sartre’s Existentialism:
Sartre’s philosophy emphasizes the uniqueness of human existence, where individuals create their own meaning without predefined values or purposes. Embracing this view empowers us to accept responsibility for our decisions and actions, acknowledging that they arise from our freely chosen choices. By recognizing the freedom and fragility of human existence, we can foster a sense of purpose and fulfillment.
Martin Heidegger’s Being-in-the-World:
Heidegger’s concept of “being-in-the-world” highlights the intimate connection between human existence and the surrounding world. Acknowledging this relationship invites us to reflect on the ways in which our lives are embedded within a broader web of social, cultural, and technological factors. By recognizing the complexity of our existence, we can deepen our appreciation for the rich tapestry of human experience.
Simone de Beauvoir’s Otherness:
De Beauvoir’s notion of “otherness” illuminates the systemic marginalization of non-dominant groups, particularly women. By recognizing the ways in which societal structures perpetuate inequality, we can work towards redressing these imbalances and fostering greater inclusion. This idea also underscores the importance of empathetic understanding and active allyship in combatting oppression.
Michel Foucault’s Power Knowledge:
Foucault’s work scrutinizes how power operates through language and knowledge production. Unpacking these mechanisms reveals how dominant narratives shape our understanding of history, science, and culture. By recognizing the subtle yet profound impact of power structures, we can critically assess information and advocate for alternative perspectives.
Jacques Derrida’s Deconstruction:
Derrida’s deconstruction challenges traditional notions of meaning and stability, highlighting the instability of signs and meanings. By exposing the multiple layers of signification beneath apparent certainties, we can develop a more nuanced understanding of language and communication. This perspective encourages us to engage in rigorous critical analysis, questioning taken-for-granted assumptions and fostering a more reflexive approach to knowledge creation.
Martha Nussbaum’s Capabilities Approach:
Nussbaum’s capabilities approach focuses on enhancing opportunities for human flourishing across various domains, including health, education, and political participation. By prioritizing expansion of capabilities, we can promote inclusive policies that ensure equal access to resources and opportunities. This approach emphasizes the importance of considering the well-being of marginalized communities and fostering a more just and equitable society.
In conclusion, these profound philosophical ideas offer valuable insights into the human condition, challenging us to reconsider our assumptions and approaches to knowledge, morality, and power dynamics. By engaging with these concepts, we can enhance our understanding of the complexities of existence and contribute to creating a more compassionate, inclusive, and just society.
The selection provides a broad overview of influential philosophical perspectives that offer insight into fundamental aspects of human existence. Here are some key takeaways about the human condition and experience based on these ideas:
Our understanding of reality is shaped by our subjective experience and cognitive limitations. We do not perceive the world objectively. (Plato, Kant)
Humans have agency and the capacity to create meaning in their lives through choice and action. Our identities and values are not predefined. (Nietzsche, Sartre, Beauvoir)
Human existence is embedded within and shaped by broader social, cultural, and technological contexts. We are relational beings. (Heidegger)
Language and knowledge are intertwined with power dynamics that can perpetuate inequality. Dominant narratives often marginalize alternative perspectives. (Foucault, Derrida)
There are systemic forms of oppression that constrain human capabilities and prevent flourishing for certain groups. Justice requires addressing these inequities. (Beauvoir, Nussbaum)
Existence is fragile and finite. We face anxiety and responsibility in making meaning without predefined purposes. Life involves confronting our freedom and limitations. (Sartre, Heidegger)
Comprehending the world requires investigating multiple levels of analysis from material to efficient to formal causes. Events have multidimensional explanations. (Aristotle)
Critical analysis, questioning assumptions, and intellectual humility are vital. There are uncertainties and complexities exceeding our cognitive grasp. (Plato, Kant, Derrida)
In summary, these perspectives highlight the challenges of making meaning, pursuing self-realization, grappling with constraints, and seeking knowledge given the complexities and fragilities of human existence. They provide conceptual tools to examine life from diverse vantage points.
Any good advice on how meaning can be derived under such circumstances?
Here are some suggestions for deriving meaning amidst the complexities and challenges of human existence, drawing from the philosophical perspectives discussed:
Engage in critical self-reflection to become aware of your subjective lens and unconscious biases. Strive to expand your perspective and challenge ingrained assumptions.
Cultivate your agency through pursuing creative endeavors, taking responsibility for choices, and determining your own path. Don’t let external authorities dictate your values.
Foster empathy and solidarity with marginalized groups. Contribute to social justice causes that expand human capabilities.
Find purpose through commitments to loved ones, contributions to society, and development of your talents and passions. Derive meaning from realization of your potentials.
Appreciate the matrix of relationships, culture, history, and language that make us who we are. Find meaning through participation in broader communities.
Embrace the unknown and be open to new ways of thinking. Allow uncertainties to inspire discovery rather than despair.
Examine events through multiple causal layers, noting how circumstances are shaped by social systems, not just individual actions. Seek deeper explanations.
Accept the fragility of existence. Make the most of each moment, living passionately and authentically without taking time for granted.
Find fulfillment through pursuing understanding, wisdom and growth. Dedicate yourself to lifelong learning and philosophical contemplation.
The human quest for meaning invariably involves grappling with paradoxes, unknowns, and dualities of freedom and limitation. By reflecting on the plurality of philosophical insights, we can discover meaningful frameworks for living.
I used some prompts
Essentially
In a realm where ancient magic resurfaces after centuries of absence, a diverse group of individuals with extraordinary abilities is brought together by an ancient prophecy. As they navigate treacherous landscapes, encounter powerful adversaries, and unravel long-lost secrets, they must confront their own flaws, forge unbreakable bonds, and face the ultimate challenge of saving their realm from impending doom. The story should incorporate elements of world-building, plot twists, epic comebacks, stories of retribution, redemption, sadness, surprises, character development, compelling conflicts, and a sense of urgency. Please describe the unique magical abilities of each character, the challenges they face, and how they come together to overcome adversity. Include fascinating creatures, hidden histories, and unexpected plot twists to captivate the reader and create a highly detailed and riveting fantasy story. Then I wrote a story given the above prompt
Then when I got a response, I followed with * Using the above as an outline. Flesh out <=1000 word responses per response, each 1000 or less words represent a chapter covering one plot point above. Most importantly. Each chapter needs to have dialogue between characters and non player characters. A fantasy story must have riveting epic and dramatic dialogue between characters. I am limited to 2048 tokens per response. I will state 'continue' inbetween your responses for you to proceed and provide another chapter. Then pass to claude Rewrite, make it darker, more in depth, longer, bloodier, more edge of your seat, less generic, and less cliche. Does that cover rewriting all the chapters? If not, continue.
and eventually got to this
Summary: Destiny calls unlikely heroes to stand against the rising darkness. A bloodthirsty huntress, a warrior fueled by vengeance, a cunning vagrant, an illusionist hungry for truth, and a healer taken far from home – fate brings together these five disparate souls to face a threat that imperils their world. Armies of blood mages march across the land, their sinister powers leaving only ravaged cities and blighted wastelands in their wake. Cultists gather in secret sites to unleash rituals that warp the fabric of reality itself. The very balance between dark and light begins to fray and unravel. Eldoria cries out for salvation. The heroes must gather the courage and skill to master their own unique gifts. Their fates intertwined, they embark upon perilous quests that will test the limits of their endurance and morality. The costs of failure are dire – enslavement or annihilation. This fellowship of champions, forged in adversity, stands as the last bastion against annihilation. Their choices will forever reshape their world as they confront sacrifices, betrayals, and earth-shattering revelations. The final, apocalyptic battle awaits as darkness threatens to eclipse Eldoria forever. Yet hope persists so long as the heroes draw breath. And they will fight to that last…Story: The Elven Forest, once a sanctuary of magic and wonder, now stood corrupted, the ancient trees warped by dark power. Elysia stalked through the shadowed woods, her fingers tense upon her bowstring. She had sworn revenge when the blood mages of Galdur massacred her kin, burning her village and unleashing foul magic. Now she hunted the mages, arrows aimed for their black hearts. A crack of thunder split the leaden sky as Elysia spotted her quarry—a robed figure bathed in sickly green light. She drew back her bow, but her target vanished, replaced by a wounded stag with twisted antlers. “Stay your hand, Elysia,” the stag spoke in a rasping voice. “The path of vengeance leads only to ruin.” Elysia wavered, then lowered her bow with a frustrated sigh. She had tracked this stag before, an ancient spirit who dispensed cryptic wisdom. “What must I do?” she asked. The stag’s milky eyes locked onto hers. “An ancient evil stirs, one that threatens all. You must seek out the Elements’ Chosen. Together, you may restore balance.” Elysia frowned, doubtful, but she revered the spirit’s counsel. With a resigned nod, she turned toward distant mountains wreathed in storm clouds, where legends said an ember burned within the heart of the world. Perhaps this “Chosen” could help purge the spreading darkness. She hoped the stag spoke true, for if the blood mages triumphed, no corner of Eldoria would remain untouched by shadow. Far south, the warrior Theron strode through streets choked with refugees fleeing the legendary city of Galdur. Ash and embers swirled on hot winds blowing from the north. Galdur had fallen. Theron had witnessed its destruction, unable to halt the blood mages’ onslaught. Their vile sorcery had ignited the city in an inferno of black flame. He had barely escaped with his life. Theron clenched his fists, fighting the urge to unleash his rage and sorrow. The magical sword at his side hummed in response. He had forged it at the hidden Emberheart Forge, imbuing the blade with the essence of the elements. It was a weapon meant to destroy the spreading evil, yet it had failed against the blood mages’ dark power. A merchant’s shouting snapped Theron from his brooding. He approached a trader’s stall draped with arcane artifacts. A glint of silver caught his eye—an amulet engraved with symbols of protection. He traded his last coins for the talisman, hoping it might shield him in battles to come. Theron knew his path led north, back to the corrupted ruins of Galdur. If any hope of defeating the blood mages remained, he had to find it there. In a far-off land, the vagabond Graven crept through the sewers beneath the city of Keldor, the lair of the notorious crimelord Shadow. Graven’s family had crossed Shadow and paid the price—death by his assassins’ blades. Now Graven aimed to repay that debt. Hidden in the reeking darkness, Graven neared his destination—a subterranean gambling den where Shadow conducted his illicit business. Slipping inside through a crack in the wall, Graven blended into the raucous crowd, the haze of opium and stench of bodies masking his presence. He peered across the den and froze. At the center sat Shadow himself, smoking a hookah and laughing coarsely. Graven tensed, fingering a dagger beneath his cloak. But revenge would have to wait. Tonight, he sought information. Graven edged closer to eavesdrop on Shadow’s conversation. A man leaned in and muttered, “The blood mages grow strong. Their magic spreads like a plague.” Shadow snorted. “Let them have their war in the north. More refugees come south every day, ripe for exploitation.” The man shook his head. “You are a fool. If the mages triumph, nowhere will be safe. Our only hope lies in—” Shadow’s blade abruptly silenced him. Graven silently withdrew, pondering the dead man’s ominous words. This “plague” in the north could eventually threaten even Keldor. Would he have to abandon his vengeance to face this greater evil? Cursing, Graven dissolved into the darkness, his path uncertain. Deep in Eldoria’s uncharted eastern forests, the healer Seraphine gathered herbs by moonlight. She hummed softly, channeling warmth into the plants to enhance their restorative properties. Nearby, her mentor, Amaria, finished tending a sickly child, his skin papery and ribcage stark beneath. The boy’s mother cradled him anxiously. “Will he recover?” she asked Amaria. “In time, though his spirit remains fragile,” Amaria replied, weariness edging her voice. She had healed many plague victims tonight. Fewer each day survived the treatments. After the mother departed, Amaria confronted Seraphine. “The balance here grows tenuous. The forest’s light fades—I feel it when I channel my gift.” Seraphine hesitated. “Perhaps we should seek answers at the temples?” Amaria sighed. “No. I fear the cause lies far from here. You must travel west, beyond Eldoria’s heart. The spirits whisper of darkness rising.” She grasped Seraphine’s hands. “Go to the ancient Stone Circle. The answers you seek will await you there.” Seraphine mutely embraced her mentor, hiding her uncertainty and dread of the path ahead. Leagues away, the illusionist Aurelia furtively explored decaying ruins, searching for forbidden knowledge of her forgotten heritage. Her violet eyes glinted with scholastic fervor as she discovered another trove of crumbling scrolls. She had taught herself to manipulate reality’s fabric, distorting perception to deceive the eye. Now she thirsted to unveil the deepest secrets of her rare gift. Hidden truths emerged as she pored over the scrolls, revealing her bloodline’s ties to a cabal of illusionists that had advised Eldoria’s ancient kings…and quietly seized power behind the throne. But their hubris had destroyed them, their deceits exposed. Aurelia shuddered, words of warning echoing in her thoughts. She had always used her talents for harmless mischief, but she felt the allure of their dangerous potential. If she followed that path, how long before it corrupted her spirit? Footsteps roused Aurelia from her brooding. She faded into the shadows, blending seamlessly into the debris as two blood mages entered the ruins. Their crimson robes marked their vile affiliation. Aurelia listened anxiously as they spoke of a convergence in the west…an event to awaken the Legion’s full power. Other believers journeyed there, they said, including Shadow, Keldor’s notorious crimelord. The mages passed from sight, but a determined Aurelia now knew her own path—west to this gathering, whatever dark purpose it portended. She must know more about this mysterious Legion. Deception could reveal truths that open inquiry might fail to uncover. Elysia crested a high mountain pass, the towering Stone Circle visible in the valley below. Massive obelisks of granite etched with runes surrounded a central altar piled with skulls. Elysia’s heart quickened. Power lingered here, old and shadowed. She moved closer, then froze at muted voices from behind an obelisk. Crouching low, she saw a gathering of robed figures. Blood mages. And the crimelord called Shadow. She overheard fragments of conversation…”summoning ritual…great one’s return…Legion’s reign.” Elysia sensed ritual magic swirling around the circle as the mages took positions around the altar. An unearthly howl split the quiet. The obelisks shuddered and blood leaked from the carved runes. The ritual had begun. Elysia knew she must act. Steeling herself, she stepped from behind the obelisk, drew back her bow, and loosed an arrow straight at Shadow’s heart. The crimelord collapsed, blood spreading across his chest. Chaos erupted as the mages scrambled for cover from Elysia’s deadly arrows. She felled two more before they unleashed convulsing tendrils of blood magic toward her. Elysia leapt behind an obelisk, the stone sizzling as the dark magic scoured it. As she readied another shot, a roar echoed overhead. An enormous winged beast wheeled above the circle, drawn by the mages’ ritual. The blood mages regrouped and resumed chanting. The ground trembled and the remaining obelisks shuddered, cracks splitting their surfaces. A noxious red mist swirled around the altar. The ritual was building toward a crescendo. “Not so fast!” shouted a new voice. A muscular warrior charged from the trees, blazing sword aloft. Theron had arrived. He hurled a blast of fire, breaking the mages’ concentration. As Theron dueled the mages in a dance of clashing blades and magic, Elysia took aim once more. Her next arrow found a mage’s eye, dropping him mid-spell. But more mages arrived, forcing Theron and Elysia back toward one another. They stood surrounded atop the altar. “I knew I’d find trouble here,” Theron grumbled to Elysia. “Yet you came anyway,” she replied tersely, arrows spent. “I don’t like leaving a job unfinished.” The blood mages closed in, savoring their impending victory. But then, chaos erupted again. With a flash of violet light, spectral blades and claws erupted among the mages, hacking and slashing. The illusionist Aurelia had arrived, veiling her attacks in phantasmal trickery. Her diversions offered Elysia and Theron the chance to break free of the trap. Together, the unlikely allies drove back the remaining mages. But ahead loomed a greater threat—the winged horror circling hungrily above. The winged beast, drawn by the dark ritual, dove toward the stone circle with a bone-chilling shriek. Elysia, Theron, and Aurelia scattered as its talons gouged the earth where they had stood. Theron slashed at the creature with his flaming blade, severing one leathery wing. The beast recoiled, thrashing in pain and fury. But its blood sprayed outward in a sizzling arc, the droplets burning like acid. Aurelia threw up an illusion to confuse the beast, but its rage was too primal. It charged through her spectral mirages toward Elysia. She rapidly fired arrows, but the shafts glanced off the beast’s armor-plated hide. As Elysia rolled away from the monster’s gnashing jaws, the air seemed to shimmer behind it. The vagabond Graven appeared, wielding an ebony stiletto. He must have been trailing the blood mages. With the beast distracted, Graven seized his chance. He drove his shadowy blade hilt-deep into the monster’s back before vanishing again. The winged horror collapsed, ichor bubbling from its wound. But more shrieks arose from the mountains – this beast had not been alone. Over a dozen more circled hungrily above, waiting to descend upon the exposed stone circle. Elysia, Theron, Aurelia, and Graven stood together, surrounded by the echoed cries of the circling predators. Their situation seemed dire. Theron raised his blade, ready to die fighting. Then a wall of light suddenly enveloped the four companions. The diving beasts veered away, repelled by its radiance. From the forest strode a woman in robes of purest white, her hands outstretched – Seraphine, come at last. Her gift had saved them, for now. But the light magic seemed to pain her. And the ritual site still crackled with sinister energy. The blood mages had not achieved their aims, but the dark power unleashed here would only spread. The unlikely band of heroes realized they faced more than beasts. The fate of Eldoria itself hung in the balance. They would need to band together to face the rising evil. But doubt shadowed their hearts. Could they triumph where an entire city had fallen? Could they master their own demons while battling the darkness without? The chill wind offered no answers. Eyes narrowed with grim determination, the five turned their gazes north, where nightmares were only just awakening.LikeCommentShare
Code: https://gist.github.com/thistleknot/22a3ee8fe20c3e12504d72a61f4d6ebc
I finished version 3 of my text to graph model.
I used spacy with manually labelled data (using Universal Data Tool) to train two models, one for entities, and one for relations. I then predict on a new dataset.
I used up my monthly limit on chatGPT to work up to this solution, but it’s there. And I have the perfect use case for it.
Now I should be able to build knowledge graphs from text data using Subject – modifier/action – object entities and relation extractor. In fact, I think I should upload my model to huggingface.
This is a big deal for me.
I just calculated Buffet’s Alpha
I could die a happy man now. Figured out the stock market.
I’ve derived indicators for CANSLIM, Piotroski, Robert Haugen’s metrics, Risk exposure factor model, CAPM model, and now Buffet’s Alpha.
I’m done. There isn’t much else for me to extract. 66 indicators so far.
Edit: There is one more thing I’m looking for. How to acquire bond ratings in a easily acquirable fashion.
This is what I went to school for.
V3
V2 https://gist.github.com/thistleknot/3695adf9114793e82f1eaddbecbd544e
I create relationships with a dataframe’s columns if a given record (in this case states) is above 1 median absolute deviation above the median towards a beneficial outcome (for example, low unemployment, population, or high income).
Here is the code to get the graph created (I used a lot of questions with chatgpt to get to this result, but I now know how to implement it properly with this POC).
I’m enjoying the ways you can slice and dice a graph database
This is showcasing states (and the regions I joined them to) that identify as being 1 median absolute deviation above the median (a binary factor derived in what would otherwise be known as a helper column, which is all etl logic done in python atm). This way of splitting the data made the most sense to me for non normal distributions (for a POC). Else median’s are too wishy washy as their center’s can change and you would get a different mix, where-as this is more akin to identifying upper and lower groups.