Digest #132: Lambda Secrets, DuckDB vs jq, Kubernetes v1.30 and Valkey Redis fork
Securing GCP, Git Command Gems, and the Spotlight on Netflix’s Kernel Panics, MongoDB’s Big Move, and Valkey Redis Support.
Welcome to this week’s edition of the DevOps Bulletin!
This week, dive into how adding a little extra to Lambda can slow things down by 20 ms 😱, and see how DuckDB might just be the better jq for playing with JSON. Get smart with Google Cloud security, and don’t miss out on mastering those Git commands that make life easier.
Ever thought about making a knowledge base with Amazon tech or committing code without Git? We got you! Plus, we're talking about how to use Lambda for your own analytics magic, enforcing rules with Terraform in Azure, turning a SQLite database into a filesystem, and setting up an EKS dream team with Terraform and Packer.
Need to handle a Linux crisis or build a video pipeline with AWS? Check out our tips. Also, peek at eBPF for file monitoring that’s next level.
This week's cool projects? Shuk for easy S3 uploads, Pack for squishing files tight, pre-commit hooks for Terraform, Hatchet for task queues, a CLI for SQLite diagrams, and fail-safe API Gateways.
Hot off the press: GoDaddy’s big save with Amazon EMR, a look at Kubernetes v1.30, switching from MongoDB to PostgreSQL, Doctolib’s failover tricks, lessons from data disasters, Netflix’s kernel panic solutions, and why the big tech is all over Valkey Redis fork.
Tutorials of the week
The impact of Lambda environment variables on cold starts: They could increase cold start times over 20 ms? 😱
Using DuckDB as the new jq: Explore the utility of DuckDB as an alternative to jq for processing JSON data.
Mastering security on GCP: A complete roadmap to navigate the complexities of cloud security.
Popular Git config options: Pretty useful commands!
Creating a knowledge base with OpenSearch: A step-by-step guide to setting up a knowledge base using Amazon OpenSearch, Lambda, and API Gateway.
Committing without Git: Create a branch with Python and understand Git Objects!
Statistics with Lambda@Edge: Gain insights into utilizing Lambda@Edge to build your own Google Analytics:
Enforcing OPA policies with Terraform: How OPA integrates with Azure DevOps and a network-isolated self-hosted pipeline agent.
Mount a SQLite database as a Filesystem: How to turn your SQLite db into a user-friendly file system with wddbfs.
EKS optimized golden AMI with Terraform and Packer: How to deploy a Netflix clone by Argocd in EKS worker node using Terraform and Packer.
Linux crisis tools: Essential tools for crisis management in Linux environments.
Build your video processing pipeline with AWS: Building a Serverless video transcoding and analysis pipeline with Step Functions and Rekognition.
File monitoring with eBPF and Tetragon: Monitoring pod files, inline enforcement, and controlling execution.
Projects of the week
Highlighting cool DevOps projects to keep an eye on:
Shuk is used to upload files to Amazon S3 and have them shared with others.
Pack is the highest compression-to-time ratio container for files and raw data. Safe, fast, and reliable.
List of pre-commit git hooks to take care of Terraform configurations.
Hatchet is a distributed, fault-tolerant task queue that replaces traditional message brokers and pub/sub systems.
An open-source CLI to generate SQLite schema diagrams.
API Gateway Multi-Region Failover is an API Gateway multi-region active-passive public API that proxies two independent multi-region active-passive service APIs.
Newsworthy Stories
Stay informed with the latest news impacting the DevOps and SRE world:
How has GoDaddy achieved over 60% cost reduction with Amazon EMR Serverless?
How Doctolib has built an infrastructure failover checklist?
How Netflix’s connect Linux Kernel panics to Kubernetes Pods?
Why AWS, Google and Oracle are backing the Valkey Redis fork?