Digest #136: Terraform Generation with LLM, FinOps for K8s, Postgres Hacking and CronJobs with AWS Lambda
Digest #136: Terraform Generation with LLM, FinOps for K8s, Postgres Hacking and CronJobs with AWS Lambda
Boost Lambda Performance, SOC 2 CI/CD, Docker Build Caching, Cloud Cost Optimization Tips!
Welcome to this week’s edition of the DevOps Bulletin!
Discover how to supercharge your infrastructure setup using LLMs and Terraform. Learn the insider secrets to optimizing your Lambdas for maximum performance while minimizing costs. And for those aiming for SOC 2 compliance, we've got a guide on building a GitOps CI/CD Pipeline with GitHub Actions.
And that's just the beginning! We'll also explore the ins and outs of automatically updating images to Git using Flux and GitHub Actions.
This week, we're featuring open-source projects like dotnet-subset, which helps you optimize Docker build caching, and Glasskube, a cool Kubernetes package manager designed to simplify cluster management.
We’ve got some newsworthy stories. From understanding the impact of an empty S3 bucket on AWS bills to debunking the myths surrounding Serverless, and answering the question “is it easy to hack the Postgres database?”.
And don't forget to check out our tip of the week, aimed at helping you keep your AWS costs in check 💰
Tutorials of the week
Using LLMs to Generate Terraform Code: Example workflows that showcase the use of LLMs in generating IaC configurations using Terraform.
Rightsizing Your Lambdas: How to achieve 61% performance improvement while reducing the cost for a Lambda by 25%.
Building a GitOps CI/CD Pipeline with GitHub Actions (SOC 2): This guide outlines a simple and developer-friendly GitOps-based CI/CD pipeline built on GitHub Actions, designed for SOC 2 compliance.
Automatic Image Update to Git using Flux and GitHub Actions: The process of temporarily pausing these updates to ensure application stability during incidents or any unforeseen issues.
Scaling Sidecars to Zero in Kubernetes: Discover Zero-Cost Sidecars with SpinKube.
Scalable Web Scraping with Serverless: Using Lambda, S3, SQS, and RDS, combined with Node.js libraries like node-fetch for fetching data, cheerio for parsing HTML, and node-postgres to interact with databases.
Manage Amazon GuardDuty in AWS Organizations: Learn how to manage multiple accounts in Amazon GuardDuty using delegated administration in Terraform.
SQS FIFO Queue Workaround: The solution involved leveraging AWS EventBridge Scheduler for scheduled message delivery to the queue.
Handling Execution Timeouts: Here are 3 ways to handle Step Function timeout errors automatically.
Securing sensitive data by using AWS Secrets Manager and Terraform: Best practices for using Terraform to rotate secrets, manage access to sensitive data, and store secrets in AWS Secrets Manager.
Using CloudFront functions as a REST API: How CloudFront Functions provide a lightweight solution for AWS Step Function tasks like sorting arrays by object path, bypassing Lambda complexities.
Creating AWS CloudWatch Dashboards and Alarms with CDK: How to build a CloudWatch Dashboard and Alarms to monitor a Full Stack Serverless AWS application.
Serverless Event Sourcing & CQRS: An example of event sourcing and CQRS in serverless, with code examples in TypeScript and the AWS CDK.
Mastering AWS API Gateway V2 HTTP and AWS Lambda With Terraform: The article provides insights into using AWS API Gateway and AWS Lambda with Terraform for efficient, cost-effective serverless solutions.
Experimenting Multiple triggers for Amazon SQS: Discover various triggers for Amazon SQS.
Simplify Web App Deployment: How to use LWA with CDK to simplify the deployment of your Web apps in Lambda and how to easily transition to ECS Fargate.
AI with Bedrock and Lambda: Generative AI with Amazon Bedrock and AWS Lambda Function URL Response Streaming.
Projects of the week
Highlighting cool DevOps projects to keep an eye on:
dotnet-subset: Optimize Docker build caching with a .NET tool.
Tsynamo: Simplify DynamoDB API interactions.
is_ready: Coordinate the startup of interconnected services such as Docker containers.
Glasskube: Kubernetes package manager for streamlined cluster management.
Cron Jobs Starter Kit: Set up cron jobs using AWS Lambda.
Domino: Platform for creating and monitoring data workflows.
Newsworthy Stories
Stay informed with the latest news impacting the DevOps and SRE world:
Tweet of the week
What would you do? 😅
Tip of the week
Sudden increases in the CloudWatch Logs billed amount often result from an increase in ingested or storage data in a particular log group. Well, you can easily create a widget with Tailwarden to identify the log group that's responsible for the increase in AWS costs.