Trained on 70 records (10 records on average across 7 subjects)
So I finally got a decent pipeline going with this gpt-neo finetuning. A lot of trial and error with the learning_rates.
Using gpt-neo tokenizer, I built a faiss index of quotes and provide this as context to the very minimally trained LLM (atm just trained on a a sample size of 20 across ~6 different datasets, this is continuing pre-training of gpt-neo which is based on the pile)
I will randomly parse out 7 quotes from top k 50 as context for the model to respond to, and these are some of the responses I got when asked ‘What meaning can be found in life?’
Here are some of the responses
Response: It’s not like you can do anything to it. If you love a piece of text, you should love yourself. Otherwise, it’s impossible to love the text of another. But you have to learn to understand what you are saying to do. The text is the voice that brings us together. A life of love, which is all that comes before. You should not, therefore, expect to be able to live that life for yourself but should, at the same time, be in awe of the life that you may be living.
Response: Life is a series of events that happen in a given time. Events are the result of the interaction of two or more individuals. The events are not the same. Life can only be defined as the process of making a new connection with another person. Response: There is one quality to life that is worth knowing. I love you
Response: What does a person do when they are faced with an obstacle or challenge from their pasts?
My synthesis of the responses:
so in this case, I guess it’s reflecting on the meaning of life is defined by how you respond to it. The meaning of life is experienced as the defining decisions made during trials and tribulations.
I was thinking about how GAN’s have been used to create real life looking images and thought… we have chatbot’s that sound realistic enough (chatGPT). Couldn’t GAN’s be used to develop a conversation system (chatbot for lack of better word) that was validated by a GAN in much the same way as GAN’s are used to generate realistic images? The engine would just keep correcting itself until it passed the GAN’s thresholds.
Modified to include a rolling mean of the past 4 quarters return prior to inputting it into a rolling 4 period correlation
I came up with an ingenious way to find stable time series correlations.
Using panda’s rolling function.
10 years, reduce to quarterly data. corr_set = [[df.pct_change(1).rolling(4).corr()]]
then derive 2 pair combinations of corr_set.columns iterate over those pairs (this can take a long time, this is where clustering comes in handy) For a pair’s given set of correlations (for each set of 4 quarters) (i.e. rolling windows of 4 quarters means any given point is a measure of a year’s worth of correlations), which is a single list (1 value for each date). then find the median from this list. If the median correlation is critical. Then you know half the dataset has a solid correlation identified. You also know this measure is the median correlation of returns within any given year period
I also derived the percent each 4 period set had positive and negative correlations which was always above 50% for only one side of either negative or positive (all correlations converged on positive correlations). So I simply display the median correlation found.
Ideas have a life of their own Archetypes have a life of their own
Thoughts are what exist in our conscious mind But they are sourced from prima materia, the external world, aka the collective unconscious In the collective unconscious, the loadstones of thought exist as archetypes. We evolved to understand/recieve them as thoughts and instincts Something like that. Thoughts still do exist, but as a subproduct (in programming we would say higher level language) of evolution interacting with archetypes
Income High and Low based on best model picked. Clusters are based on cutoffs of prediction variable.
I use a special transform that normalizes the variable
The model vars are all significant.
The clusters more or less represent upper and low 25%, but this is a special transform that scales to a percent, but it’s based on mean, but it’s not a cumulative distribution function. It’s a minmax that does a **cumulative** sum (have to sort original values, and then map back, easier to do in python vs excel) using both polar sides of z-scores to scale to 0 (i.e. min z-score) to 50 (i.e. 0 z score) to 100%. (i.e. max z score).
R-squared (uncentered): 0.907
After using this transform method. Different results become prominent for university. The transform I’m using is non linear (also ZCA’d). It’s akin to an area under the curve calculation which allows for smoother cutoffs.
Edward Eddinger Ego and Archetype Christ as Paradigm of the Individuating Ego
I myself have been saying autonomy and dealing with the loss of a friend who I projected my anima (that I identified as Hypatia) onto. This is very consoling to read.
“The end of this passage makes clear the purpose of inciting discord. It is to achieve the solitary condition, the state of being an autonomous individual. This can be achieved only by a separation from unconscious identification with others. In the early stages, the separatio is experienced as painful strife and hostility. Parents and family are the most frequent objects of unconscious identification. Jesus singles out the father for special mention:
And call no man your father on earth, for you have one Father who is in heaven.
Parents have power over their grown children only because the latter continue to project the images of the archetypal parents to their personal parents. To call no man father means to withdraw all projections of the father archetype and discover it within…
…’…if a man will lose his ego for my sake, he will find the Self.’ [paraphrasing Jesus]
… ‘It is no easy matter to live a life that is modelled on Christ’s, but it is unspeakably harder to live one’s own life, as truly as Christ lived his.’ [Jung]
…blessed are those who are aware of their spiritual poverty and are humbly seeking what they need. Understood psychologically, the meaning would be: The ego which is aware of its own emptiness of spirit (life meaning) is in a fortunate position because it is now open to the unconscious and has the possibility of experiencing the archetypal psyche (the kingdom of heaven).
Blessed are those who mourn, for they shall be comforted. Mourning is caused by the loss of an object or person who was carrying an important projected value. In order to withdraw projections and assimilate their content into one’s own personality it is necessary to experience the loss of the projection as a prelude to rediscovering the content or value within. Therefore, mourners are fortunate because they are involved in a growth process. They will be comforted when the lost projected value has been recovered within the pysche.”
I think the reason I hypothetically upset J***, C******, and T** was in their eyes they are the gatekeepers to everyone’s hope, an opportunity at full time. So if I came in there and said I was ok with getting laid off cuz I’d still get my masters, was an insult to their opportunity which they viewed as the best they could offer anyone (exposure to CICD and C suite). They wanted me to integrate there with my masters. I truly believe the reason everyone acted the way they did by turning a blind eye to the affair was its expected in Abrahamic patriarchy culture to objectify women. Even S***** acknowledged that by turning a blind eye to my return (this I didnt know at the time) because she exhumes that lifestyle. However with me I did feel guilty and was violating the patriarchy’s unspoken rule of objectification is expected and simultaneously violated the republican rule “keep it yourself” to scandal. “Sex and the Office” says women caught sleeping their way to the top are halted generally once outted. I think it’s okay to have sex in the workplace but the way its discusses imo is from a patriarchial sanctioned “don’t ask don’t tell” POV. Which creates this anxiety in people about it and it remains very much a power move.
Selected Response: “that is absolutely true. But desperate times man… I’ve certainly been presented with the opportunity to do so, but don’t want to subjugate myself to whims of some dude on a power trip.”**
At that point all hell broke loose coupled with the fact I didn’t care for the opportunity* and was creating scandal with talk of dominatrix, I think that’s when the uppers gave their blessing to let those angry at me have at it. They did what is always done in criminal cases. Try to get former friends to turn on each other, let them do the dirty work for you. To get them to show they are hungry for an opportunity and willing to get their hands dirty. That’s my best guess. *I thought they misinterpreted me, that I didn’t want it. I did its just that I was truly mentally ill from seeing her and it was hurting me psychologically with insomnia and mania daily. But they didn’t care. It violated their world view which expected me to be a player about it. But that’s the thing. I’m a soft heart (I can be mean, though usually unintentionally by usually just walking away from a relationship (ghosting), ironically, but lately I’ve tried to be more mature about it and am on the other end of the spectrum where I can’t walk away). Idk I just can’t be mean to someone I loved (I can be passive aggressive and make things uncomfortable though). I can’t block it out. That to me is being disingenuous to oneself and I feel corporate life expects you to swallow your emotions because they wanted to prove to everyone that emotions won’t get you paid It’s kind of like saying women want to be respected but then you see classic objectifiers fucking the women you admire at work… I had a white knight savior complex only to be friend zoned and discarded which taught me that the paradigm I was using does not get me to the desired end goal (nice guys finish last) which was at least continued friendship so I had the affair and fulfilled the expectations of the very thing I didn’t like. Patriarchy. It was very traumatic for me in a way It’s a turn on to be objectified but people want to use it in certain contexts that benefit them (cost benefit analysis) **My friend confirmed it is a power move and some women think they have to sleep their way to the top So power is attraction I got the distinct impression she was doing it for power because people would tell me she got around, plus the fact that she was giving me personal time, yet when I naively told her I had feelings for her (after hanging out 1:1 multiple times). She started to distance herself. Like I was breaking some unspoken rule. I think she then classed me as a nice “married” guy who wasn’t going to make a move and lost interest cuz I obviously wasn’t a power move nor a Don Draper to her anymore
I think I touched the 3rd rail. Whoever obliged her power moves.