Skip to main content

We have to go deeper: Local PostGRES databases in Docker for development environments

 

However, I keep...not being able to enter the PostGRES database via terminal when it's running in a Docker image. 

So I scuppered my work, redownloaded the image, took clearer notes with commands and examples on how prompts should appear, and got inside, taking all of 10 minutes.

It's like entering a multi-layered vault. 


If you're starting a Docker container through the terminal, it is case-sensitive.

docker exec -it RUNTCPIP-DBRep /bin/bash is different than

docker exec -it RUNTCPIP-DBREP /bin/bash

 

 

Downloading Open Datasets Two Ways For Test Data

Heard of Kaggle? Now you have.

The first way: I took this dataset (free to use) and downloaded it to the Linux system in the container. 

I updated packages with apt-get -y and installed curl -( apt-get -y install curl).

(Keep in mind you will likely have to change the path Kaggle gives. I used a period [.] and ended up putting it in a directory I could only reach via an odd song and dance of entering and exiting a directory. I expected it to download the zip file in the directory I was currently in. That's on me.)

The second way: In the end I used the docker cp command learned here after downloading the file locally to my Docker folder on Windows 11 and it worked flawlessly. 

I also unzipped it with unzip.  

 

After talking with people in the industry, we realized that this may not be the best way to have a reusable data-testing environment; It would take too long to start up each time with the amount of data.

So I encouraged a solution where the production data was backed up to an S3 bucket every so often that people could pull from and use to test.

Comments

Popular posts from this blog

Making KPI Dashboards with PowerBI

 While this is the free tier, I cannot share or collaborate with others, nor can I publish content to other people's workspaces, but they will not stop me from screenshooting and recording these self-taught adventures,so! I'm doing this because I idly searched "Mattel careers" and "Information Technology", and seeing a bulletpoint saying the following: Analytical and reporting skills such as creating dashboards and establishing KPIs such as experience with PowerBI, Cognos, Tableau, and Google Data Lake/AWS is preferred And thought "Well, I've used Tableau, and I've heard about PowerBI,  even if its in-demandness is questionable , so how similar is it? And can I write about it?"  First, PowerBI (PIB) does have a downloadable, local version, but apparently Windows-only. I could download the .exe but I couldn't run it / drag it to applications on my MacBook.  Not a problem, we'll use the online SaaS version, and a dataset found here, ...

Log Sorting with AWS CloudWatch, AWS CloudWatch Insights

 The cool thing is, I was contracted to make these videos in collaboration with CloudAvail Technology Consulting to help people decide which service they wanted to use for their logging - AWS CloudWatch, AWS CloudWatch Insights, DataDog, or New Relic. I'm searching through nginx logs. I have accompanying videos of each service that you can find on the CloudAvail Youtube page; See these links to go to the DataDog and NewRelic posts.   The idea was to be subjective in the videos, but I can be objective on my personal blog.     CloudWatch     The syntax is odd, but easy to grasp. Sort log data by IP addresses, message codes, and status codes. The simplest query system, but not quite robust.   Insights       The syntax has changed - Vastly. I see major SQL influences. You can see that in how the parse function works - in this case, it's often taken pieces of a pre-existing standard - in this case, message - and breaking them into their own c...

Connecting IoT Devices to a Registration Server (Packet Tracer, Cisco)

 If you're seeing this post, I'm helping you, and you probably have LI presence: React and share this post to help me in return.   In Packet Tracer, a demo software made by Cisco Systems. It certainly has changed a lot since 2016. It's almost an Olympic feat to even get started with it now, but it does look snazzy. This is for the new CCNA, that integrates, among other things, IoT and Automation, which I've worked on here before. Instructions here . I don't know if this is an aspect of "Let's make sure people are paying attention and not simply following blindly", or an oversight - The instructions indicate a Meraki Server, when a regular one is the working option here. I have to enable the IoT service on this server. Also, we assign the server an IPv4 address from a DHCP pool instead of giving it a static one. For something that handles our IoT business, perhaps that's safer; Getting a new IPv4 address every week or so is a minimal step against an...