Category: AI

The Agentic AI IDE !

Here are a couple official videos

Now, to install google antigravity to debian 12/13

sudo mkdir -p /etc/apt/keyrings
curl -fsSL https://us-central1-apt.pkg.dev/doc/repo-signing-key.gpg | sudo gpg --dearmor -o /etc/apt/keyrings/antigravity-repo-key.gpg

echo "deb [signed-by=/etc/apt/keyrings/antigravity-repo-key.gpg] https://us-central1-apt.pkg.dev/projects/antigravity-auto-updater-dev/ antigravity-debian main" | sudo tee /etc/apt/sources.list.d/antigravity.list > /dev/null

sudo apt update
sudo apt install antigravity

BeautifulSoup is a python package that allows you to extract data from HTML files, it is very easy and intuitive

Let us assume you have an HTML page !

First, let us assume you want the title from that HTML page….

mysoup = BeautifulSoup(response.content, 'html.parser')
title = soup.title.string if soup.title else "No title found"

Now, assuming you want to remove everything that has to do with CSS and presentation, you can remove the following things with this easy code snippet, then putting whatever is lef in a variable called text

for irrelevant in mysoup.body(["script", "style", "img", "input"]):
            irrelevant.decompose()
text = soup.body.get_text(separator="\n", strip=True)

Langchain is an abstraction layer so that you don’t have to call the APIs of every AI provider separately

Originally in Python, langchain ports such as Javascript (Official), Dart and Rust exist

Gradio is all about user interface, it is a startup that got acquired by Hugging Face !

In your python code, you execute the following line

import gradio as gr # The way people usually call it

now, here is an example that turns your text to uppercase

def to_uppercase(text):
    return text.upper()

Now, to get a user interface, run the following code

gr.Interface(fn=to_uppercase, inputs="textbox", outputs="textbox").launch()

Now, you should be getting 2 boxes, one for your input, and the other to display your text in uppercase

Now, imagine the to_uppercase function being a call to an AI, so there you have it

Here is a variant with big boxes

# Inputs and Outputs

view = gr.Interface(
    fn=to_uppercase,
    inputs=[gr.Textbox(label="Your message:", lines=6)],
    # outputs=[gr.Textbox(label="Response:", lines=8)],
    outputs=[gr.Markdown(label="Response:")],
    flagging_mode="never"
)
view.launch()

At this point, when you run this, you should get the link to the URL with that user interface !

LM studio is a great tool to run models locally on your machine, but it is somewhat more than that

According to their intro, it is…

• A desktop application for running local LLMs
• A familiar chat interface
• Search & download functionality (via Hugging Face 🤗)
• A local server that can listen on OpenAI-like endpoints
• Systems for managing local models and configurations

This is a great front end for Stable Diffusion

the official GIT repo for this is here, to install it alongside stable diffusion and everything else you need, make sure you are running in your local environment with conda or pip, and run the following command

wget -q https://raw.githubusercontent.com/AUTOMATIC1111/stable-diffusion-webui/master/webui.sh

then make it executable and run it with the following command

./webui.sh --listen --api

You can add Automatic1111 to your openwebUI (Go to settings/images)

1- Installing as docker container

• Install docker like you would, by adding its repositories or however you are used to installing it
• sudo apt install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
• docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main
• to check if it is running, run sudo docker ps
• Now, localhost:8080 should have your OpenWebUI running
• Do a signup or create account (Local instance bound), the first account you create will automatically become an admin account !

At this stage, you should be good to go,

If you don’t want to use docker ! you can simply install it with the following pip command

pip install open-webui

Once done, you can simply run it with

open-webui serve

In some cases, if Ollama was previously setup and not running, you might want to run Open WebUI with the command

ENABLE_OLLAMA_API=false open-webui serve

Otherwise, you might have it hang with the message

Now that it is running, go to http://localhost:8080 and create an account, the first account you create will automatically become the admin account

Adding OpenAI API key

The most common use for open-webui is with Ollama, but let us assume you want to install your openAI account into it !

1- Go to admin panel (Bottom left)
2- Go to settings in admin panel (center top)
3- go to connections
4-

Every model is a different story, but before you start looking into models, there are a few useful things to know, and a few useful tools that you can use.

NVIDIA

Nvidia is a very popular AI hardware provider, the cool things about modern AI models is that they can be split into layers, hence, you can have more than one card doing the work ! So, I have 2 x 4090 cards doing the work, you can combine the ram to see if your model fits on both when split in half, some models even provide an option to offload some of the model’s data onto the system ram, other have the option to load part of the data into VRAM as needed ! but that is a story for another day (Another post)…

To inspect the GPU and RAM usage of your GPUs, you can use the following command

watch -n 0.5 nvidia-smi

The command should show you what processes live in your VRAM (VRAM is your cards ram)

This page is a list of AI solutions that you can use via API for a fee (Or for free)

Vellum Leadboard: This website maintains a lead-board that compares prices !

1. OpenAI (ChatGPT)
2. Anthropic (Claude)
3. Google / Gemeni
4. DeepSeek
5. Cohere / Command R
6. Perplexity: (A search engine that can either use other models, or its own model)
7. hunyuan : by tencent.. The T1 Turbo-s hybrid transformer MAMBA architecture (Super fast (2x)), 24K input tokens and 64K output tokens ($0.14, and $0.56 respectively)… HuggingFace demo
8. Ernie 4.5 : From Baidu, china’s leading search engine (yiyan.baidu.com)
9. grok.com (By XAI, under the same company that acquired twitter)

Anthropic’s claude is probably the main competing AI to OpenAI’s ChatGPT

Anthropic has an edge over OpenAI in many areas, I personally think it is better than OpenAI for Code generation

To simply chat with Claude, you can create an account at https://claude.ai/

To obtain API keys from anthropic and access the system programmatically, you will need to get the API keys from https://console.anthropic.com/