AI Energy Consumption
Research on the energy consumption of AI and its impact on global energy usage.
Read more
Blog
LLM Evals: Evaluation Techniques for Large Language Models
Learn about Large Language Model (LLM) evaluations, their importance, key metrics, and advanced evaluation techniques. Discover how to build effective evaluation sets, integrate human feedback, and compare LLM models.
Read more
Converting OpenAI's Swarm Framework to TypeScript Using AI
Read about how I converted OpenAI's Swarm multi-agent educational framework to TypeScript using AI. Explore the conversion process, key insights, and the resulting TypeScript version.
Read more
The Illusion of Speed: A Critique of LLM Frameworks
Recently, I encountered a situation that highlights a common issue with LLM frameworks. Here's what happened and why I ended up building my own solution.
Read more
How I saved an open-source project 90% on their AI agent LLM Costs
Learn how I coordinated code changes across two open-source projects to save an AI agent system 90% on their LLM costs. Discover the challenges, solutions, and the impact of this cost-saving initiative.
Read more
Building a Vector Database Service with OpenDevin: An LLM Code Agent Experiment
Explore the process of tasking an LLM code agent with building a vector database service using FastAPI. Learn about the challenges, iterations, and final product of this AI-driven development experiment.
Read more
Embracing Vendor Lock-In: A Startup's Secret Weapon
Learn why early-stage SAAS startups should embrace vendor lock-in with major cloud platforms. Discover the advantages, leverage cloud platform startup programs, and turbocharge your growth.
Read more
Mean Reciprocal Rank (MRR): Definition, Calculation, and Applications
Learn about Mean Reciprocal Rank (MRR), a key evaluation metric in information retrieval systems. Understand its importance, formula, calculation, and applications in search engines and QA systems.
Read more
Web Crawling Stealth: Browser Fingerprinting and Detection
Web crawling has become more challenging due to advanced browser fingerprinting techniques. Learn how websites detect and block crawlers, and discover strategies for maintaining effective data collection.
Read more
Spark Small Files Problem: Optimizing Data Processing
Learn how to conquer the Spark small files problem in large-scale web crawling. Discover a robust solution for optimizing data storage and retrieval in Spark jobs.
Read more
Understanding and Implementing Levenshtein Distance in BigQuery
Learn how to use the EDIT_DISTANCE function in BigQuery to calculate Levenshtein Distance for fuzzy string matching, data deduplication, and spell checking.
Read more
Implementing Claude Tool Use with Pydantic for Structured AI Responses
This guide demonstrates how to use Claude's tool use capability in conjunction with Pydantic to generate structured AI responses. By combining these technologies, developers can ensure consistent, type-safe output from Claude that integrates seamlessly with Python applications.
Read more
Building Reliable LLMs for Production: Structured Outputs and Data Validation
Learn how to make large language models (LLMs) behave predictably and provide structured outputs for production systems. Explore techniques for prompt engineering, JSON mode, function calling, and data validation with Pydantic.
Read more
Building an Gmail Auto Labeler With LLMs: A Step-by-Step Guide
Learn how to build an email classifier using affordable Language Models (LLMs) like GPT-4-mini and Ollama. Automate your inbox management with machine learning.
Read more
LLM System Design: A Practical Guide
Learn how to build an effective Large Language Model (LLM) system. Explore key components, building blocks, and advanced techniques for designing LLM systems.
Read more
Llama 3's Synthetic Code Generation: Developing an AI-Powered Coding Environment
Explore the technical details of Llama 3's synthetic data generation approach for code generation tasks. Learn how this self-supervised learning system generates, solves, and learns from diverse coding challenges.
Read more
Exploring BigQuery Cohort Analysis
Learn how to perform cohort analysis in BigQuery to understand user behavior and engagement over time. Discover the benefits of using BigQuery for cohort analysis and advanced techniques for analyzing user cohorts.
Read more
Exploring BigQuery Fuzzy Match Techniques
Ever wondered how the top tech companies deploy their applications so seamlessly? It all starts with an efficient CI/CD pipeline.
Read more
How to Find and Match Data in BigQuery
Learn how to effectively find and match data in BigQuery using SQL functions, joins, window functions, and user-defined functions. Explore key concepts and practical examples for efficient data matching.
Read more
Building an LLM Evaluation Tool with Synthetic Data Generation in 20 mins
Learn how to build a flexible LLM evaluation tool with dynamic schema generation, synthetic data creation, and model evaluation using Python and LLMs.
Read more
Whisper Audio to Text: Transcribing Long Audio Files with Python
Learn how to use Whisper audio to text conversion for long files with our Python script. Overcome file size limits and easily transcribe podcasts, interviews, and lectures. Step-by-step guide with code examples.
Read more
SQL for Address Standardization: An Engineer's Approach
Learn how to standardize messy addresses using SQL. This guide provides SQL macros for cleaning up street addresses, city names, states, and ZIP codes.
Read more
Building an AI Facial Recognition System for Video Analytics
Using LLMs to create a facial recognition platform for crowd analysis and recognition on protest footage.
Read more
Using LLMs to Build A Code Generation Dataset
Learn how to use LLMs, gpt-3.5-turbo, to scrape and clean code from the web
Read more
Deploy Nextjs on AWS Cloudfront and S3
Learn how to host a Nextjs static app on AWS Cloudfront and S3 using AWS CDK. Static apps are great for SEO, performance, and cost.
Read more
Alternative to Vercel Deploying a Next.js Application on AWS Amplify using AWS CDK
A guide on deploying Next.js on AWS amplify with AWS CDK
Read more
Building a CI/CD Pipeline for a Serverless Express Application with AWS CDK
Ever wondered how the top tech companies deploy their applications so seamlessly? It all starts with an efficient CI/CD pipeline.
Read more
How to build an age and gender multi-task predictor with deep learning in TensorFlow
Learn how to build a age and gender predictor using deep learning in TensorFlow
Read more
Building an image caption generator with Deep Learning in Tensorflow
In my last tutorial, you learned how to create a facial recognition pipeline in Tensorflow with convolutional neural networks. In this tutorial, you’ll learn how a convolutional neural network (CNN) and Long Short Term Memory (LSTM) can be combined to create an image caption generator and generate captions for your own images.
Read more
Building Facial Recognition in Tensorflow
Learn how to build a facial recognition pipeline with deep learning in Tensorflow. This tutorial will show you how to preprocess images, train a convolutional neural network model, and generate embeddings for use in clustering and classification tasks.
Read more