LLM application with Microsoft Phi3 LLM.

 To give kick start to learn and understanding the LLM and LLM application using Ollama. here is the step followed to gain the confidence and keep moving.

Ollama is kind of LLM model orchestration tool to run the LLMs on your local. 

1, Downloaded the Ollama for my Ubuntu linux . This will install Ollama and CLI to pull and run the LLM.

 curl -fsSL https://ollama.com/install.sh | sh

You can get the code from github here 

https://github.com/CodethinkerSP/ai/tree/master/Simple-RAG

Terminal, type 

ollama server

ollama pull phi3:latest

ollama run phi3:latest

Then follow these steps in the Visual Studio code and any of your favourite editor. I personally prefer Jupyter in VS code extension.

Steps followed on my local machine

1. Installed Ollama and pulled the phi3:latest llm
2. Ollama CLI : ollama serve and the ollama run phi3:latest
3. Python code
   1. Load text file
   2. Chunked and embedding the data
   3. Storing the embeddings in the chromdb
   4. Hitting the Ollama API endpoint --> localhost:11434/api/generate with required "json" payload

from sentence_transformers import SentenceTransformer

import chromadb

dataset = []

# data loading

with open("output.txt", 'r', encoding='utf-8') as f:

dataset = f.readlines()

VECTOR_DB = []

EMBEDDING_MODEL = 'all-MiniLM-L6-v2'

LANGUAGE_MODEL = 'phi3:latest'

# initialize vector db

chroma_client = chromadb.PersistentClient(path="./chroma_db3")

# create collection

collection = chroma_client.get_or_create_collection(name="mydataset")

#embedding model

model = SentenceTransformer('sentence-transformers/all-MiniLM-L6-v2')

for data in dataset:

data = data.strip()

if data:

embedding = model.encode(data).tolist()

# store in vector db

VECTOR_DB.append((data, embedding))

print(f"Inserted {len(VECTOR_DB)} records into the vector database.")

Movie - I Robot scenes are come to live here

Have you watched the movie - I Robot  ? scenes from the movies are in reached its reality now.

Robots are participating the running race , football and boxing . Soon we see many things done by the Robots. 

Hope there won't be competition between human and robots for its existence.

Watch here.

 https://www.bbc.com/news/videos/cvg3mv3rz60o

Adon - AI

AdonAI !

வணக்கம் AI !
Hello  AI ,
ஏய் !

excerpt  from wise King " Solomon"
சூரியனுக்குக் கீழே நூதனமானது ஒன்றுமில்லை. ( and there is no new thing under the sun.) 


Is there any thing whereof it may be said, See, this is new? it hath been already of old time, which was before us.


I am just trying to "recollect " the knowledge which we all forgot (so I am human )  , what happened in the past

Going to scribbling on the topics of AI, What I really understood and able to do it . 

Fixing the Security vulnerabilities found on base docker image

Expected/desired solution :

Fixing the Security vulnerabilities found on base docker image without increasing the newer version of  "base docker image" due to Application stability and its dependency of its packages.

Here is the solution :

Easy way

• use the docker inspect command to see the "environment variable for the current version and its latest patch version if not available search it the Linux Official distro sites.
• Found the Patch version of the docker image and its checksum in the "Docker Hub".
• C the docker file and import with checksum or with patch vesion.
• Build your docker image from your docker file.
• Scan the docker image your created in the above step using docker security vulnerabilities scanner tools like scout , trivy , sysdig and snyk
• Count and compare the vulnerabilities on your current docker image and the previous version of the docker image.
• Finally wrap your Application Packages (WAR, JAR, nodeJS or Python) and check the application stability .

If Easy way - doesn't work , then "Hard way" - I will soon update here