Artificial Intelligence
Understanding Pre-Training in Large Language Models
Pre-training is the phase where we teach a model how language works. Before a model can answer questions, write code, or chat with us,…
Blog
Practical technical articles and clear explanations.
-
-
Artificial Intelligence
An Introduction to Vision Language Model
AI application now a days are not only generating texts , but also images, audio and videos. The similar approach of transformer architecture is…
-
Artificial Intelligence
Tokens and logits relation in LLM
A token is a piece of text the model understands. It may be: a word part of a word punctuation space Now each token…
-
Artificial Intelligence
Understanding Attention Heads in LLMs
An understanding of Attention Head in LLM
-
Artificial Intelligence
How logits are formed in LLM?
The model scores (logits) come from the last neural network layer of the transformer. After many transformer layers, the model produces a vector that…
-
Artificial Intelligence
Softmax and how LLM is predicting the next word
When LLM predict the next word, it first gives scores for every possible words from the transformer stage of LLM. I like to drink…
-
General
Elevating Your Professional Profile: From Task-Oriented to Value-Driven
From Task-Oriented to Value-Driven
-
Artificial Intelligence
Epoch in model training
In the simplest terms, an Epoch represents one complete pass of your entire training dataset through the the model. Imagine you are training an…
-
Data Science
Chessboard distance aka Chebyshev distance
Euclidean distance quietly sits at the foundation of modern technology. It powers recommendation systems that suggest movies and songs. It drives machine learning models…
-
Artificial Intelligence
Loading a model in LM Studio and Running
Local LLMs (Large Language Models) are changing the game for developers, writers, and privacy advocates. Running a model on your own hardware means your…
