Artificial Intelligence
What LLM Engineers Actually Build?
Discover how LLM engineering transforms raw AI models into scalable, accurate enterprise systems using data pipelines, RAG, and optimization techniques.
Category: Artificial Intelligence
-
-
Artificial Intelligence
Understanding Pre-Training in Large Language Models
Pre-training is the phase where we teach a model how language works. Before a model can answer questions, write code, or chat with us,…
-
Artificial Intelligence
An Introduction to Vision Language Model
AI application now a days are not only generating texts , but also images, audio and videos. The similar approach of transformer architecture is…
-
Artificial Intelligence
Tokens and logits relation in LLM
A token is a piece of text the model understands. It may be: a word part of a word punctuation space Now each token…
-
Artificial Intelligence
Understanding Attention Heads in LLMs
An understanding of Attention Head in LLM
-
Artificial Intelligence
How logits are formed in LLM?
The model scores (logits) come from the last neural network layer of the transformer. After many transformer layers, the model produces a vector that…
-
Artificial Intelligence
Softmax and how LLM is predicting the next word
When LLM predict the next word, it first gives scores for every possible words from the transformer stage of LLM. I like to drink…
-
Artificial Intelligence
Epoch in model training
In the simplest terms, an Epoch represents one complete pass of your entire training dataset through the the model. Imagine you are training an…
-
Artificial Intelligence
Loading a model in LM Studio and Running
Local LLMs (Large Language Models) are changing the game for developers, writers, and privacy advocates. Running a model on your own hardware means your…
-
Artificial Intelligence
Decoding how to select a language models for local setup
Lets start with Q4_K_M. An example of it is mistralai/mistral-7b-instruct-v0.3 Lets go through each parameters, Q4 Means 4-bit quantization. Original models are usually 16-bit…
