Skip to main content

We have to go deeper: Local PostGRES databases in Docker for development environments

 

However, I keep...not being able to enter the PostGRES database via terminal when it's running in a Docker image. 

So I scuppered my work, redownloaded the image, took clearer notes with commands and examples on how prompts should appear, and got inside, taking all of 10 minutes.

It's like entering a multi-layered vault. 


If you're starting a Docker container through the terminal, it is case-sensitive.

docker exec -it RUNTCPIP-DBRep /bin/bash is different than

docker exec -it RUNTCPIP-DBREP /bin/bash

 

 

Downloading Open Datasets Two Ways For Test Data

Heard of Kaggle? Now you have.

The first way: I took this dataset (free to use) and downloaded it to the Linux system in the container. 

I updated packages with apt-get -y and installed curl -( apt-get -y install curl).

(Keep in mind you will likely have to change the path Kaggle gives. I used a period [.] and ended up putting it in a directory I could only reach via an odd song and dance of entering and exiting a directory. I expected it to download the zip file in the directory I was currently in. That's on me.)

The second way: In the end I used the docker cp command learned here after downloading the file locally to my Docker folder on Windows 11 and it worked flawlessly. 

I also unzipped it with unzip.  

 

After talking with people in the industry, we realized that this may not be the best way to have a reusable data-testing environment; It would take too long to start up each time with the amount of data.

So I encouraged a solution where the production data was backed up to an S3 bucket every so often that people could pull from and use to test 

Comments

Popular posts from this blog

Making KPI Dashboards with PowerBI

 While this is the free tier, I cannot share or collaborate with others, nor can I publish content to other people's workspaces, but they will not stop me from screenshooting and recording these self-taught adventures,so! I'm doing this because I idly searched "Mattel careers" and "Information Technology", and seeing a bulletpoint saying the following: Analytical and reporting skills such as creating dashboards and establishing KPIs such as experience with PowerBI, Cognos, Tableau, and Google Data Lake/AWS is preferred And thought "Well, I've used Tableau, and I've heard about PowerBI,  even if its in-demandness is questionable , so how similar is it? And can I write about it?"  First, PowerBI (PIB) does have a downloadable, local version, but apparently Windows-only. I could download the .exe but I couldn't run it / drag it to applications on my MacBook.  Not a problem, we'll use the online SaaS version, and a dataset found here, ...

Connecting IoT Devices to a Registration Server (Packet Tracer, Cisco)

 If you're seeing this post, I'm helping you, and you probably have LI presence: React and share this post to help me in return.   In Packet Tracer, a demo software made by Cisco Systems. It certainly has changed a lot since 2016. It's almost an Olympic feat to even get started with it now, but it does look snazzy. This is for the new CCNA, that integrates, among other things, IoT and Automation, which I've worked on here before. Instructions here . I don't know if this is an aspect of "Let's make sure people are paying attention and not simply following blindly", or an oversight - The instructions indicate a Meraki Server, when a regular one is the working option here. I have to enable the IoT service on this server. Also, we assign the server an IPv4 address from a DHCP pool instead of giving it a static one. For something that handles our IoT business, perhaps that's safer; Getting a new IPv4 address every week or so is a minimal step against an...

AWS Infrastructure Composer

 A very brief look. The text says; Drag and drop any CloudFormation resource on a visual canvas Connect and configure enhanced components to automatically build IaC for an application architecture Seamlessly transition between authoring workflows visually with Step Functions Workflow Studio and defining resources with Infrastructure Composer Integrate your browser with your project through “local sync” or use Composer in the AWS Toolkit for Visual Studio Code In 2019 there was a similar tool to build infrastructure that would be converted to code. Nice to know they bought it back. When you enter the Composer, it's a blank space with a background reminiscent to the screen for Cloud Formation. Infrastructure Objects are to the left in a drawer;  I've selected a bucket that I can rename. I went to connect a bucket to a Dynamo DB Table, and it's not available yet. It also lost a bucket somewhere in the ether of the GUI. Ah well. I couldn't find the EC2 instance in the...