Python Hub Weekly Digest for 2024-09-15
💖 Most Popular
Multimodal Data Analysis with LLMs and Python – Tutorial
The tutorial teaches how to analyze multimodal data using Large Language Models (LLMs) and Python, covering text classification, image-based question answering, audio transcription, and creating a natural language query interface for SQL databases.
kotaemon
An open-source RAG-based tool for chatting with your documents.
Classifying all of the pdfs on the internet
The article describes an attempt to classify a massive dataset of 8.4 million PDFs from Common Crawl using various machine learning techniques. The author experiments with different approaches, including deep learning models and traditional machine learning methods like XGBoost, ultimately achieving the best performance with an XGBoost model trained on embeddings, reaching 85.26% accurac...
Why I Still Use Python Virtual Environments in Docker
The article argues for using Python virtual environments in Docker containers, citing benefits like predictability, standardization, and easier debugging. The author contends that virtual environments provide a consistent, well-understood structure for Python applications, making communication and deployment across teams more straightforward, while also simplifying Python's import behavior.
Lesser known parts of Python standard library – Trickster Dev
📖 Articles
Building LLMs from the Ground Up
This tutorial guides coders through the fundamentals of large language models (LLMs), explaining how they work and how to build them from scratch in PyTorch. It covers coding a small GPT-like model, its data pipeline, architecture, pretraining, and fine-tuning using open-source libraries.
Taming the beast that is the Django ORM - An introduction
The Django ORM, how it compares to raw SQL and gotchas that you should be aware of when using it
How to Create a Pre-Commit Hook
A step-by-step guide to developing your own pre-commit hook.
Maximizing Python Code Efficiency: Strategies to Overcome Common Performance Hurdles
This article talks about performance issues caused by nested loops and memory allocation issues. It provides strategies to overcome these issues while improving efficiency.
My Favorite Error Handling Technique
This video presents a surprising “Let it burn” approach to error handling, demonstrating how allowing code to fail fast can result in simpler, clearer, and more robust software. Discover the benefits of this method and its impact on improving overall code quality.
Shades of testing HTTP requests in Python
The post discusses various approaches to testing HTTP requests in Python applications, focusing on mocking external API calls during unit and integration testing.
Pure Python: Build a full stack ChatGPT-like UI. Reflex, Neon Postgres. Deploy with Docker to a VM
This video tutorial demonstrates how to build a full-stack ChatGPT-like UI using Reflex, a Python framework for web development, integrating it with Neon Postgres database and OpenAI. It covers the entire process from setting up the development environment to deploying the application using Docker, GitHub Actions, and Ansible on a virtual machine.
Using GPT-4o for web scraping
The article discusses using GPT-4 with OpenAI's structured outputs feature to create an AI-assisted web scraper, exploring its capabilities in parsing complex tables and generating XPaths. While the author found GPT-4 effective at extracting data from various HTML tables, they also noted challenges with merged rows, high API costs, and the need for further refinements to improve accuracy...
Tinystatus: A tiny status page generated by a Python script
Integrating Stripe Into A One-Product Django Python Shop
In the first part of this series, we created a Django online shop with htmx. In this second part, we'll handle orders using Stripe.
Create & Share Streamlit, Dash and Python Apps Online.
Python Hub Weekly Digest for 2024-09-08
Lessons learnt building a real-time audio application in Python
⚙️ Projects
pipefunc
Lightweight function pipeline (DAG) creation in pure Python for scientific workflows.
smartcut
Cut video files with minimal recoding.
nlp-zero-to-hero
A comprehensive resource for learning Natural Language Processing (NLP) from the basics to advanced topics. It contains Jupyter notebooks covering various NLP concepts, techniques, and implementations, making it a valuable guide for beginners and intermediate learners in the field of NLP.
cookiecutter-uv
A modern cookiecutter template for Python projects that use uv for dependency management.
Mini-Omni
Mini-Omni is an open-source multimodel large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
kazam
Linux Screen Recorder, Broadcaster, Capture and OCR with AI in mind.
supertree
supertree is a Python package designed to visualize decision trees in an interactive and user-friendly way within Jupyter Notebooks, Jupyter Lab, Google Colab, and any other notebooks that support HTML rendering.
uvtrick
A fun party trick to run Python code from another venv into this one.
👾 Reddits
Used Python to create public-domain US maps that can serve as desktop backgrounds
Project by Ruslan Keba. Since 2012. Powered by Python. Made in 🇺🇦Ukraine.