Skip to main content

Using AWS Data Migration Service

 Want to share this easily? 

Check out the Notion page.

By Morgan Lucas (she/her) from this video by Johnny Chivers

We use data migration services to, well, migrate data. But why would we want to do this?

 Perhaps...

  • We're moving our business to the cloud, and need to shift all of that cold storage we have onsite.
  • We want to use it as a backup in cause our infrastructure is out of commission.
  • We could have information to share with a 3rd party, and instead of giving access to on-site databases, we put it on AWS to share.
Nevertheless, let's recap what I've done.
  • Created publicly accessible, password-protected database with Amazon Aurora with PostgreSQL Compatibility to migrate to Amazon Dynamo DB
  • Managed inbound rules of security group to limit access
  • Used open source software HeidiDB to interact with database via a TCP/IP session and specific URL for DB (Not shown here for security)

 


 

  • Connected to Aurora PostgreSQL Database
    • ran queries that deleted and created tables populated with new information
  • Created publicly accessible replication instance to connect to our RDS to initiate database migration
  • Created configuration endpoints with existing instance used to migrate database User_Data to Amazon DynamoDB
  • Created role to talk to DMS (making sure to click the radio button beneath)
  • Successfully connected target (endpoint) to instance (middleman to transfer data)
  • Set up database migration task to move from Aurora PostgreSQL Database to Amazon DynamoDB

Find me on Twitter, or my blog. You can Buy Me A Coffee and help me keep writing!

Comments

Popular posts from this blog

Making KPI Dashboards with PowerBI

 While this is the free tier, I cannot share or collaborate with others, nor can I publish content to other people's workspaces, but they will not stop me from screenshooting and recording these self-taught adventures,so! I'm doing this because I idly searched "Mattel careers" and "Information Technology", and seeing a bulletpoint saying the following: Analytical and reporting skills such as creating dashboards and establishing KPIs such as experience with PowerBI, Cognos, Tableau, and Google Data Lake/AWS is preferred And thought "Well, I've used Tableau, and I've heard about PowerBI,  even if its in-demandness is questionable , so how similar is it? And can I write about it?"  First, PowerBI (PIB) does have a downloadable, local version, but apparently Windows-only. I could download the .exe but I couldn't run it / drag it to applications on my MacBook.  Not a problem, we'll use the online SaaS version, and a dataset found here, ...

A 2-week Trial of T-Mobile Home Internet

     The Xfinity app showed usage of the past 3 months: We used less than 40% each month, for about $80 USD a month.   No thanks! That cuts into the movie budget! Before we save some money (about $15/mo), let's test how T-Mobile Internet unlimited data works for 2 weeks.    There are 15 devices for this test; Smart TVs: 4 Laptops: 4 Printer: 1 Smart Home Speakers: 3 Game Consoles: 1 Phones: 1 (There are other phones in the home but they stick with data) Other: 1 Total : 15  I made tables for 3 entries a day across 3 days to test the Xfinity service we have. Here's one;   Xfinity is pretty speedy - Download times are between 227 - 236 Mbps, Latency between 24.5 - 25.5, Jitter between 5 - 6.68, and 0 packet loss.  Let's quickly define the terms in the table;    Date/Time - The date and time of the data gathered. Download (Mpbs) - How fast your network gets data. Upload (Mbps) - How fast your network uploads data. Latency ...

Recon and SSID - Mapping With VisiWave Site Survey

My laptop is refurbished. I've written about how there are a few ... quirks. Being a technology professional, I felt okay with adopting an older machine, knowing I had the skill to fix moderate issues. From dying drivers to monitor massacres, I've ID'd, solved, and documented a lot of issues.  The newest one was my Wi-Fi adapter dropping the connection to a specific extender. While troubleshooting, I was curious about doing recon of WiFi networks and broadcasting devices anyway. That issue? A power setting. It was so determined to save power, it would disconnect. The extender is also flirting with the older end of 6 years old.  The battery needs to be replaced, but that's new to me. As a Windows laptop, there are a plethora of options to pick. How do you decide which one is safest?  I am suddenly concerned about this despite having 3 unofficial, 15$ Macbook Air chargers from eBay, and no explosions. But let's move onto the Site Survey - Where can I find the stronges...