<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Ollama on Ghafoor's Personal Blog</title><link>http://ghafoorsblog.com/tags/ollama/</link><description>Recent content in Ollama on Ghafoor's Personal Blog</description><generator>Hugo</generator><language>en</language><managingEditor>noreply@example.com (AG Sayyed)</managingEditor><webMaster>noreply@example.com (AG Sayyed)</webMaster><copyright>Copyright © 2024-2026 AG Sayyed. All Rights Reserved.</copyright><lastBuildDate>Mon, 18 May 2026 04:43:48 +0100</lastBuildDate><atom:link href="http://ghafoorsblog.com/tags/ollama/index.xml" rel="self" type="application/rss+xml"/><item><title>How to use prompts with OpenManus</title><link>http://ghafoorsblog.com/posts/ai/openmanus/usage/</link><pubDate>Thu, 15 May 2025 15:00:53 +0000</pubDate><author>noreply@example.com (AG Sayyed)</author><guid>http://ghafoorsblog.com/posts/ai/openmanus/usage/</guid><description>&lt;h2 id="openmanus-usage-guide"&gt;OpenManus Usage Guide&lt;/h2&gt;
&lt;h2 id="setup"&gt;Setup&lt;/h2&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="c1"&gt;# Clone (already done)&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;2&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="nb"&gt;cd&lt;/span&gt; ~/Documents/projects/uv/OpenManus
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;3&lt;/span&gt;&lt;span class="cl"&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;4&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="c1"&gt;# Run from OpenManus directory (recommended)&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;5&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="nb"&gt;cd&lt;/span&gt; ~/Documents/projects/uv/OpenManus &lt;span class="o"&gt;&amp;amp;&amp;amp;&lt;/span&gt; uv run main.py --prompt &lt;span class="s2"&gt;&amp;#34;your task here&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h2 id="running-from-anywhere"&gt;Running from Anywhere&lt;/h2&gt;
&lt;h3 id="option-1-full-path-easiest"&gt;Option 1: Full path (easiest)&lt;/h3&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="nb"&gt;cd&lt;/span&gt; ~/Documents/projects/uv/OpenManus &lt;span class="o"&gt;&amp;amp;&amp;amp;&lt;/span&gt; uv run main.py --prompt &lt;span class="s2"&gt;&amp;#34;your task here&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="option-2-from-this-folder-hbstack-blog"&gt;Option 2: From this folder (HBstack blog)&lt;/h3&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;uv run ~/Documents/projects/uv/OpenManus/main.py --prompt &lt;span class="s2"&gt;&amp;#34;your task here&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="option-3-interactive-mode"&gt;Option 3: Interactive mode&lt;/h3&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="nb"&gt;cd&lt;/span&gt; ~/Documents/projects/uv/OpenManus &lt;span class="o"&gt;&amp;amp;&amp;amp;&lt;/span&gt; uv run main.py
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;2&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="c1"&gt;# Then type your prompt when asked&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="option-4-planning-flow-for-complex-multi-step-tasks"&gt;Option 4: Planning flow (for complex multi-step tasks)&lt;/h3&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="nb"&gt;cd&lt;/span&gt; ~/Documents/projects/uv/OpenManus &lt;span class="o"&gt;&amp;amp;&amp;amp;&lt;/span&gt; uv run run_flow.py
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;hr&gt;
&lt;h2 id="current-config"&gt;Current Config&lt;/h2&gt;
&lt;table&gt;
 &lt;thead&gt;
 &lt;tr&gt;
 &lt;th&gt;Setting&lt;/th&gt;
 &lt;th&gt;Value&lt;/th&gt;
 &lt;/tr&gt;
 &lt;/thead&gt;
 &lt;tbody&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;strong&gt;Provider&lt;/strong&gt;&lt;/td&gt;
 &lt;td&gt;OpenRouter&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;strong&gt;Model&lt;/strong&gt;&lt;/td&gt;
 &lt;td&gt;&lt;code&gt;anthropic/claude-haiku-4.5&lt;/code&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;strong&gt;Input cost&lt;/strong&gt;&lt;/td&gt;
 &lt;td&gt;$1.00 per million tokens&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;strong&gt;Output cost&lt;/strong&gt;&lt;/td&gt;
 &lt;td&gt;$5.00 per million tokens&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;strong&gt;Max steps&lt;/strong&gt;&lt;/td&gt;
 &lt;td&gt;20 (per session)&lt;/td&gt;
 &lt;/tr&gt;
 &lt;/tbody&gt;
&lt;/table&gt;
&lt;hr&gt;
&lt;h2 id="writing-good-prompts"&gt;Writing Good Prompts&lt;/h2&gt;
&lt;h3 id="-do-be-specific-with-a-deliverable"&gt;✅ DO: Be specific with a deliverable&lt;/h3&gt;
&lt;table&gt;
 &lt;thead&gt;
 &lt;tr&gt;
 &lt;th&gt;Good Prompt&lt;/th&gt;
 &lt;th&gt;Why&lt;/th&gt;
 &lt;/tr&gt;
 &lt;/thead&gt;
 &lt;tbody&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Analyze my Hugo site at /home/ag-sayyed/Documents/projects/hbstack/ghafoors-blog and give a summary of the theme, config, and content structure&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Clear goal + output format&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Find all broken internal links in my Hugo site at /path/to/site&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Specific task, measurable result&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Add a new &amp;quot;contact&amp;quot; page with a form to my Hugo site at /path/to/site&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Concrete deliverable&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Update the homepage hero section to say &amp;quot;Welcome to my blog&amp;quot; in /path/to/site&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Small, focused change&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;List all custom shortcodes in /path/to/site and explain what each does&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Specific scope&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Suggest 3 performance improvements for my Hugo site based on /path/to/site/config.toml&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Analytical, bounded task&lt;/td&gt;
 &lt;/tr&gt;
 &lt;/tbody&gt;
&lt;/table&gt;
&lt;h3 id="-avoid-vague-prompts-with-no-deliverable"&gt;❌ AVOID: Vague prompts with no deliverable&lt;/h3&gt;
&lt;table&gt;
 &lt;thead&gt;
 &lt;tr&gt;
 &lt;th&gt;Bad Prompt&lt;/th&gt;
 &lt;th&gt;Problem&lt;/th&gt;
 &lt;/tr&gt;
 &lt;/thead&gt;
 &lt;tbody&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Explore my Hugo site&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;No goal — wanders aimlessly, wastes tokens&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Look at my site&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Same — no clear end condition&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Check my config&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Too vague, doesn&amp;rsquo;t know what to check for&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;code&gt;Help me with my site&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Way too broad&lt;/td&gt;
 &lt;/tr&gt;
 &lt;/tbody&gt;
&lt;/table&gt;
&lt;h3 id="-tips-to-save-money"&gt;💡 Tips to Save Money&lt;/h3&gt;
&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Be specific about which files&lt;/strong&gt; — instead of &amp;ldquo;analyze my site&amp;rdquo;, say &amp;ldquo;check config.toml and the homepage content&amp;rdquo;&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Set a clear output&lt;/strong&gt; — &amp;ldquo;give me a bullet list&amp;rdquo;, &amp;ldquo;write the changes to file X&amp;rdquo;, &amp;ldquo;summarize in 3 sentences&amp;rdquo;&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;One task at a time&lt;/strong&gt; — each prompt is a fresh session, so break big jobs into focused steps&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Use full paths&lt;/strong&gt; — always include the absolute path to your project so OpenManus finds it regardless of where you run from&lt;/li&gt;
&lt;/ol&gt;
&lt;hr&gt;
&lt;h2 id="cost-reference-haiku-45"&gt;Cost Reference (Haiku 4.5)&lt;/h2&gt;
&lt;table&gt;
 &lt;thead&gt;
 &lt;tr&gt;
 &lt;th&gt;Activity&lt;/th&gt;
 &lt;th&gt;Approx Cost&lt;/th&gt;
 &lt;/tr&gt;
 &lt;/thead&gt;
 &lt;tbody&gt;
 &lt;tr&gt;
 &lt;td&gt;Listing a directory + reading 2 files&lt;/td&gt;
 &lt;td&gt;~$0.02&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;Reading a whole Hugo config + summary&lt;/td&gt;
 &lt;td&gt;~$0.05&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;Creating a new page with content&lt;/td&gt;
 &lt;td&gt;~$0.10&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;Full site analysis (10+ files)&lt;/td&gt;
 &lt;td&gt;~$0.30&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;Complex multi-step task (20 steps)&lt;/td&gt;
 &lt;td&gt;~$1.00–2.00&lt;/td&gt;
 &lt;/tr&gt;
 &lt;/tbody&gt;
&lt;/table&gt;
&lt;hr&gt;
&lt;h2 id="quick-alias-optional"&gt;Quick Alias (Optional)&lt;/h2&gt;
&lt;p&gt;Add to &lt;code&gt;~/.bashrc&lt;/code&gt;:&lt;/p&gt;</description></item><item><title>OpenManus</title><link>http://ghafoorsblog.com/posts/ai/openmanus/</link><pubDate>Sun, 11 May 2025 15:00:53 +0000</pubDate><author>noreply@example.com (AG Sayyed)</author><guid>http://ghafoorsblog.com/posts/ai/openmanus/</guid><description/></item><item><title>OpenManus for Local LLMs</title><link>http://ghafoorsblog.com/posts/ai/openmanus/intro/</link><pubDate>Sun, 11 May 2025 15:00:53 +0000</pubDate><author>noreply@example.com (AG Sayyed)</author><guid>http://ghafoorsblog.com/posts/ai/openmanus/intro/</guid><description>&lt;h2 id="openmanus-installation-and-usage-guide"&gt;OpenManus Installation and Usage Guide&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a
 href="https://github.com/FoundationAgents/OpenManus"
 
 target="_blank" rel="noopener noreferrer"&gt;OpenManus&lt;/a&gt; repository on GitHub.&lt;/li&gt;
&lt;/ul&gt;
&lt;ol&gt;
&lt;li&gt;Install &lt;a
 href="https://www.uvicorn.org/"
 
 target="_blank" rel="noopener noreferrer"&gt;uvicorn&lt;/a&gt; for running the FastAPI server.&lt;/li&gt;
&lt;/ol&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;$ curl -LsSf https://astral.sh/uv/install.sh &lt;span class="p"&gt;|&lt;/span&gt; sh
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;2&lt;/span&gt;&lt;span class="cl"&gt;uv -h
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;3&lt;/span&gt;&lt;span class="cl"&gt;uv -V
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h2 id="essential-uv-commands"&gt;Essential uv Commands&lt;/h2&gt;
&lt;table&gt;
 &lt;thead&gt;
 &lt;tr&gt;
 &lt;th&gt;Category&lt;/th&gt;
 &lt;th&gt;Command&lt;/th&gt;
 &lt;th&gt;Description&lt;/th&gt;
 &lt;/tr&gt;
 &lt;/thead&gt;
 &lt;tbody&gt;
 &lt;tr&gt;
 &lt;td&gt;Environments&lt;/td&gt;
 &lt;td&gt;uv venv&lt;/td&gt;
 &lt;td&gt;Creates a new virtual environment in the .venv folder.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;source .venv/bin/activate&lt;/td&gt;
 &lt;td&gt;Activates the environment (macOS/Linux).&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;.venv\Scripts\activate&lt;/td&gt;
 &lt;td&gt;Activates the environment (Windows).&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;deactivate&lt;/td&gt;
 &lt;td&gt;Exits the currently active environment.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;Project Management&lt;/td&gt;
 &lt;td&gt;uv init&lt;/td&gt;
 &lt;td&gt;Sets up a new project with a pyproject.toml file.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;uv add &lt;code&gt;&amp;lt;package&amp;gt;&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Adds a dependency and automatically updates the environment.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;uv sync&lt;/td&gt;
 &lt;td&gt;Synchronises the environment with the lockfile (installs/removes).&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;uv run &lt;code&gt;&amp;lt;script&amp;gt;&lt;/code&gt;&lt;/td&gt;
 &lt;td&gt;Runs a script without needing to manually activate the env.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;Pip Interface&lt;/td&gt;
 &lt;td&gt;uv pip install -r reqs.txt&lt;/td&gt;
 &lt;td&gt;Fast alternative to pip install for existing requirement files.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;uv pip tree&lt;/td&gt;
 &lt;td&gt;Displays a visual tree of all installed dependencies.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;Python Versions&lt;/td&gt;
 &lt;td&gt;uv python list&lt;/td&gt;
 &lt;td&gt;Shows available Python versions you can install.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;uv python install 3.12&lt;/td&gt;
 &lt;td&gt;Downloads and installs a specific Python version automatically.&lt;/td&gt;
 &lt;/tr&gt;
 &lt;/tbody&gt;
&lt;/table&gt;
&lt;ol start="2"&gt;
&lt;li&gt;Clone the OpenManus repository and navigate to the project directory.&lt;/li&gt;
&lt;/ol&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;git clone https://github.com/FoundationAgents/OpenManus.git
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;2&lt;/span&gt;&lt;span class="cl"&gt;&lt;span class="nb"&gt;cd&lt;/span&gt; OpenManus
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;ol start="3"&gt;
&lt;li&gt;Install the required dependencies using pip.&lt;/li&gt;
&lt;/ol&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span class="line"&gt;&lt;span class="ln"&gt;1&lt;/span&gt;&lt;span class="cl"&gt;uv pip install -r requirements.txt
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h2 id="configure-toml-file"&gt;Configure toml file&lt;/h2&gt;
&lt;p&gt;OpenManus uses a &lt;code&gt;config.toml&lt;/code&gt; file to specify the LLMs and their configurations. You can create this file in the root directory of the project.&lt;/p&gt;</description></item><item><title>OpenWebUI</title><link>http://ghafoorsblog.com/posts/ai/open-web-ui/</link><pubDate>Sun, 11 May 2025 15:00:53 +0000</pubDate><author>noreply@example.com (AG Sayyed)</author><guid>http://ghafoorsblog.com/posts/ai/open-web-ui/</guid><description>&lt;p class="lead text-primary"&gt; OpenWebUI transforms how you interact with your local language models, providing a sleek, feature-rich interface that makes working with models like Llama, Mistral, and others both powerful and intuitive. &lt;/p&gt;
&lt;h2 id="what-is-openwebui"&gt;What is OpenWebUI&lt;/h2&gt;
&lt;p&gt;OpenWebUI is an open-source, browser-based graphical user interface designed specifically for interacting with local large language models (LLMs), particularly those running through Ollama. It provides a ChatGPT-like experience for your self-hosted AI models, combining the privacy benefits of running local models with the usability of commercial AI platforms.&lt;/p&gt;</description></item><item><title>Hyper Parameters</title><link>http://ghafoorsblog.com/posts/ai/hyper-parameters/</link><pubDate>Tue, 11 Feb 2025 18:55:28 +0000</pubDate><author>noreply@example.com (AG Sayyed)</author><guid>http://ghafoorsblog.com/posts/ai/hyper-parameters/</guid><description>&lt;p class="lead text-primary"&gt;
This guide covers the key hyperparameters that influence the performance of AI models, including context window size and embedding size.
&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="context-windows-size"&gt;Context Windows Size&lt;/h2&gt;
&lt;p&gt;Context window size is the maximum number of tokens the model can process in a single input. It determines the model&amp;rsquo;s ability to understand and generate text based on the context provided. If you increase the context window size, the model can consider more information when generating responses, but it may require more memory and processing power. It happens when it has to remember what was asked earlier. In other words, it&amp;rsquo;s how much of the conversation or input history the model considers when making its predictions. For example, if you&amp;rsquo;re having a conversation with the AI, the context window determines how many of the previous messages the model can &amp;ldquo;remember&amp;rdquo; and use to generate a coherent response. A larger context window means the model can take into account more of the previous conversation, leading to more contextually aware responses, but it can also require more computational resources, which can slow down performance. The context window size keep increasing as the conversation goes on.&lt;/p&gt;</description></item><item><title>AVX Technology Explained</title><link>http://ghafoorsblog.com/posts/ai/avx/index./</link><pubDate>Fri, 31 Jan 2025 21:12:40 +0000</pubDate><author>noreply@example.com (AG Sayyed)</author><guid>http://ghafoorsblog.com/posts/ai/avx/index./</guid><description>&lt;h2 id="avx-technology-explained"&gt;AVX Technology Explained&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;AVX (Advanced Vector Extensions)&lt;/strong&gt; is a CPU instruction set extension designed for high-performance computing. It was first introduced by Intel in 2011 with the Sandy Bridge processor architecture.&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="how-avx-works"&gt;How AVX Works&lt;/h2&gt;
&lt;p&gt;At its core, AVX allows a single instruction to operate on multiple data points simultaneously, following the SIMD (Single Instruction, Multiple Data) computing paradigm:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Without AVX&lt;/strong&gt;: Process data one piece at a time&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;With AVX&lt;/strong&gt;: Process multiple pieces of data in parallel with a single instruction&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="avx-versions"&gt;AVX Versions&lt;/h2&gt;
&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;AVX (2011)&lt;/strong&gt;: Original version with 256-bit wide vector operations&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;AVX2 (2013)&lt;/strong&gt;: Added more instructions and expanded integer operations&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;AVX-512 (2016+)&lt;/strong&gt;: Further expanded to 512-bit operations&lt;/li&gt;
&lt;/ol&gt;
&lt;h2 id="why-avx2-matters-for-ai-and-machine-learning"&gt;Why AVX2 Matters for AI and Machine Learning&lt;/h2&gt;
&lt;p&gt;Modern AI frameworks and LLM runtimes require AVX2 because:&lt;/p&gt;</description></item><item><title>Setting Up Text Generation WebUI (No AVX Required)</title><link>http://ghafoorsblog.com/posts/ai/web-ui-installation/index./</link><pubDate>Fri, 31 Jan 2025 21:12:40 +0000</pubDate><author>noreply@example.com (AG Sayyed)</author><guid>http://ghafoorsblog.com/posts/ai/web-ui-installation/index./</guid><description>&lt;h2 id="setting-up-text-generation-webui-no-avx-required"&gt;Setting Up Text Generation WebUI (No AVX Required)&lt;/h2&gt;
&lt;p&gt;Text Generation WebUI is a great alternative to LM Studio that offers non-AVX builds, making it compatible with older CPUs. There are several installation options available:&lt;/p&gt;
&lt;h3 id="option-1-one-click-installer-recommended"&gt;Option-1 One-Click Installer (Recommended)&lt;/h3&gt;
&lt;ol&gt;
&lt;li&gt;
&lt;p&gt;Visit the &lt;a
 href="https://github.com/oobabooga/text-generation-webui#one-click-installers"
 
 target="_blank" rel="noopener noreferrer"&gt;official GitHub repository&lt;/a&gt;&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Download the installer that specifies &amp;ldquo;Non-AVX&amp;rdquo; support:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;For Windows: &lt;code&gt;oobabooga-windows-noavx.zip&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;For Linux: &lt;code&gt;oobabooga-linux-noavx.zip&lt;/code&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Extract the zip file and run:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Windows: &lt;code&gt;start_windows.bat&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;Linux: &lt;code&gt;start_linux.sh&lt;/code&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;/ol&gt;
&lt;h3 id="option-2-manual-installation"&gt;Option-2 Manual Installation&lt;/h3&gt;
&lt;p&gt;If you prefer manual installation:&lt;/p&gt;</description></item></channel></rss>