Threading on Ghafoor's Personal Blog

Using Threads to Improve Performance

noreply@example.com (AG Sayyed) — Wed, 12 Nov 2025 22:17:40 +0000

This document provides a hands-on guide to implementing threading and multiprocessing in Python for performance optimization. Through a real-world image thumbnail generation scenario, it demonstrates converting sequential processing to parallel execution using ThreadPoolExecutor and ProcessPoolExecutor, measuring performance improvements, and understanding the differences between threads and processes in Python's execution model.

The Business Problem: E-Commerce Image Rebranding

The Scenario

A company has an e-commerce website that includes numerous images of products that are available for sale. An upcoming rebranding effort requires that all of these images be replaced with new ones.

Parallelizing Operations for Performance

noreply@example.com (AG Sayyed) — Tue, 11 Nov 2025 22:47:33 +0000

This document examines concurrency and parallel execution as performance optimization strategies. It explains how operating systems manage processes, demonstrates techniques for splitting work across multiple processes and threads, distinguishes between I/O-bound and CPU-bound operations, and provides guidance on balancing parallelism to maximize throughput without overwhelming system resources.

The Problem with Blocking I/O Operations

Understanding Blocked Execution

Reading information from disk or transferring data over the network is a slow operation. In typical scripts, while this operation is ongoing, nothing else happens. The script is blocked, waiting for input or output while the CPU sits idle.

Using Threads to Improve Performance

noreply@example.com (AG Sayyed) — Tue, 11 Nov 2025 22:17:40 +0000

The Business Problem: E-Commerce Image Rebranding

The Scenario

A company has an e-commerce website that includes numerous images of products that are available for sale. An upcoming rebranding effort requires that all of these images be replaced with new ones.