AI Energy Consumption
Research on the energy consumption of AI and its impact on global energy usage.
Research on the energy consumption of AI and its impact on global energy usage.
Learn about Large Language Model (LLM) evaluations, their importance, key metrics, and advanced evaluation techniques. Discover how to build effective evaluation sets, integrate human feedback, and compare LLM models.
Read about how I converted OpenAI's Swarm multi-agent educational framework to TypeScript using AI. Explore the conversion process, key insights, and the resulting TypeScript version.
Recently, I encountered a situation that highlights a common issue with LLM frameworks. Here's what happened and why I ended up building my own solution.
Learn how I coordinated code changes across two open-source projects to save an AI agent system 90% on their LLM costs. Discover the challenges, solutions, and the impact of this cost-saving initiative.
Explore the process of tasking an LLM code agent with building a vector database service using FastAPI. Learn about the challenges, iterations, and final product of this AI-driven development experiment.
Learn why early-stage SAAS startups should embrace vendor lock-in with major cloud platforms. Discover the advantages, leverage cloud platform startup programs, and turbocharge your growth.
Learn about Mean Reciprocal Rank (MRR), a key evaluation metric in information retrieval systems. Understand its importance, formula, calculation, and applications in search engines and QA systems.
Web crawling has become more challenging due to advanced browser fingerprinting techniques. Learn how websites detect and block crawlers, and discover strategies for maintaining effective data collection.
Learn how to conquer the Spark small files problem in large-scale web crawling. Discover a robust solution for optimizing data storage and retrieval in Spark jobs.
Learn how to use the EDIT_DISTANCE function in BigQuery to calculate Levenshtein Distance for fuzzy string matching, data deduplication, and spell checking.
This guide demonstrates how to use Claude's tool use capability in conjunction with Pydantic to generate structured AI responses. By combining these technologies, developers can ensure consistent, type-safe output from Claude that integrates seamlessly with Python applications.
Learn how to make large language models (LLMs) behave predictably and provide structured outputs for production systems. Explore techniques for prompt engineering, JSON mode, function calling, and data validation with Pydantic.
Learn how to build an email classifier using affordable Language Models (LLMs) like GPT-4-mini and Ollama. Automate your inbox management with machine learning.
Learn how to build an effective Large Language Model (LLM) system. Explore key components, building blocks, and advanced techniques for designing LLM systems.
Explore the technical details of Llama 3's synthetic data generation approach for code generation tasks. Learn how this self-supervised learning system generates, solves, and learns from diverse coding challenges.
Learn how to perform cohort analysis in BigQuery to understand user behavior and engagement over time. Discover the benefits of using BigQuery for cohort analysis and advanced techniques for analyzing user cohorts.
Ever wondered how the top tech companies deploy their applications so seamlessly? It all starts with an efficient CI/CD pipeline.
Learn how to effectively find and match data in BigQuery using SQL functions, joins, window functions, and user-defined functions. Explore key concepts and practical examples for efficient data matching.
Learn how to build a flexible LLM evaluation tool with dynamic schema generation, synthetic data creation, and model evaluation using Python and LLMs.
Learn how to use Whisper audio to text conversion for long files with our Python script. Overcome file size limits and easily transcribe podcasts, interviews, and lectures. Step-by-step guide with code examples.
Learn how to standardize messy addresses using SQL. This guide provides SQL macros for cleaning up street addresses, city names, states, and ZIP codes.
Using LLMs to create a facial recognition platform for crowd analysis and recognition on protest footage.
Learn how to use LLMs, gpt-3.5-turbo, to scrape and clean code from the web
Learn how to host a Nextjs static app on AWS Cloudfront and S3 using AWS CDK. Static apps are great for SEO, performance, and cost.
A guide on deploying Next.js on AWS amplify with AWS CDK
Ever wondered how the top tech companies deploy their applications so seamlessly? It all starts with an efficient CI/CD pipeline.
Learn how to build a age and gender predictor using deep learning in TensorFlow
In my last tutorial, you learned how to create a facial recognition pipeline in Tensorflow with convolutional neural networks. In this tutorial, you’ll learn how a convolutional neural network (CNN) and Long Short Term Memory (LSTM) can be combined to create an image caption generator and generate captions for your own images.
Learn how to build a facial recognition pipeline with deep learning in Tensorflow. This tutorial will show you how to preprocess images, train a convolutional neural network model, and generate embeddings for use in clustering and classification tasks.