Security Group ID Finder

I have been working on deploying resources to a lot of AWS accounts lately where each account has the same network infrastructure. When deploying Lambdas, I had the common name of the security group but not the ID. I wrote this utility to get the security group ID for me quickly. This is a simple… Continue reading Security Group ID Finder

A Dynamo Data Migration Tool

Have you ever wanted to migrate data from one Dynamo DB table to another? I haven’t seen an AWS tool to do this so I wrote one using Python. The process is pretty simple. First, we get all of our data from our source table. We store this in a list. Next, we iterate over… Continue reading A Dynamo Data Migration Tool

Querying and Editing a Single Dynamo Object

I have a workflow that creates a record inside of a DynamoDB table as part of a pipeline within AWS. The record has a primary key of the Code Pipeline job. Later in the pipeline I wanted to edit that object to append the status of resources created by this pipeline. In order to do… Continue reading Querying and Editing a Single Dynamo Object

Pandas & NumPy with AWS Lambda

Fun fact: Pandas and NumPy don’t work out of the box with Lambda. The libraries that you might download from your development machine probably won’t work either. The standard Lambda Python environment is very barebones by default. There is no point in loading in a bunch of libraries if they aren’t needed. This is why… Continue reading Pandas & NumPy with AWS Lambda

A File Management Architecture

This post is a continuation of my article: “A File Extraction Project”. This project has been a great learning experience for both frontend and backend application architecture and design. Below you will find a diagram and an explanation of all the pieces that make this work. The entire architecture is powered by Flask on an… Continue reading A File Management Architecture

Where Is It 5 O’Clock Pt: 4

As much as I’ve scratched my head working on this project it has been fun to learn some new things and build something that isn’t infrastructure automation. I’ve learned some frontend web development some backend development and utilized some new Amazon Web Services products. With all that nice stuff said I’m proud to announce that… Continue reading Where Is It 5 O’Clock Pt: 4

Where Is It Five O’Clock Pt: 3

So I left this project at a point where I felt it needed to be re-architected based on the fact that Flask only executes the function once and not every time the page loads. I re-architected the application in my head to include an API that calls the Lambda function and returns a list of… Continue reading Where Is It Five O’Clock Pt: 3

Where Is It 5 O’Clock Pt: 2

So I spend the evening deploying this web application to Amazon Web Services. In my test environment, everything appeared to be working great because every time I reloaded the page it reloaded the function as well. When I transferred this over to a live environment I realized the Python function only ran every time I… Continue reading Where Is It 5 O’Clock Pt: 2