Skip to main content

Using AWS Data Migration Service

 Want to share this easily? 

Check out the Notion page.

By Morgan Lucas (she/her) from this video by Johnny Chivers

We use data migration services to, well, migrate data. But why would we want to do this?

 Perhaps...

  • We're moving our business to the cloud, and need to shift all of that cold storage we have onsite.
  • We want to use it as a backup in cause our infrastructure is out of commission.
  • We could have information to share with a 3rd party, and instead of giving access to on-site databases, we put it on AWS to share.
Nevertheless, let's recap what I've done.
  • Created publicly accessible, password-protected database with Amazon Aurora with PostgreSQL Compatibility to migrate to Amazon Dynamo DB
  • Managed inbound rules of security group to limit access
  • Used open source software HeidiDB to interact with database via a TCP/IP session and specific URL for DB (Not shown here for security)

 


 

  • Connected to Aurora PostgreSQL Database
    • ran queries that deleted and created tables populated with new information
  • Created publicly accessible replication instance to connect to our RDS to initiate database migration
  • Created configuration endpoints with existing instance used to migrate database User_Data to Amazon DynamoDB
  • Created role to talk to DMS (making sure to click the radio button beneath)
  • Successfully connected target (endpoint) to instance (middleman to transfer data)
  • Set up database migration task to move from Aurora PostgreSQL Database to Amazon DynamoDB

Find me on Twitter, or my blog. You can Buy Me A Coffee and help me keep writing!

Labels:

Comments

Post a Comment

Popular posts from this blog

Making KPI Dashboards with PowerBI

 While this is the free tier, I cannot share or collaborate with others, nor can I publish content to other people's workspaces, but they will not stop me from screenshooting and recording these self-taught adventures,so! I'm doing this because I idly searched "Mattel careers" and "Information Technology", and seeing a bulletpoint saying the following: Analytical and reporting skills such as creating dashboards and establishing KPIs such as experience with PowerBI, Cognos, Tableau, and Google Data Lake/AWS is preferred And thought "Well, I've used Tableau, and I've heard about PowerBI,  even if its in-demandness is questionable , so how similar is it? And can I write about it?"  First, PowerBI (PIB) does have a downloadable, local version, but apparently Windows-only. I could download the .exe but I couldn't run it / drag it to applications on my MacBook.  Not a problem, we'll use the online SaaS version, and a dataset found here, ...
Post a Comment
Read more

Connecting IoT Devices to a Registration Server (Packet Tracer, Cisco)

 If you're seeing this post, I'm helping you, and you probably have LI presence: React and share this post to help me in return.   In Packet Tracer, a demo software made by Cisco Systems. It certainly has changed a lot since 2016. It's almost an Olympic feat to even get started with it now, but it does look snazzy. This is for the new CCNA, that integrates, among other things, IoT and Automation, which I've worked on here before. Instructions here . I don't know if this is an aspect of "Let's make sure people are paying attention and not simply following blindly", or an oversight - The instructions indicate a Meraki Server, when a regular one is the working option here. I have to enable the IoT service on this server. Also, we assign the server an IPv4 address from a DHCP pool instead of giving it a static one. For something that handles our IoT business, perhaps that's safer; Getting a new IPv4 address every week or so is a minimal step against an...
Post a Comment
Read more

AWS Infrastructure Composer

 A very brief look. The text says; Drag and drop any CloudFormation resource on a visual canvas Connect and configure enhanced components to automatically build IaC for an application architecture Seamlessly transition between authoring workflows visually with Step Functions Workflow Studio and defining resources with Infrastructure Composer Integrate your browser with your project through “local sync” or use Composer in the AWS Toolkit for Visual Studio Code In 2019 there was a similar tool to build infrastructure that would be converted to code. Nice to know they bought it back. When you enter the Composer, it's a blank space with a background reminiscent to the screen for Cloud Formation. Infrastructure Objects are to the left in a drawer;  I've selected a bucket that I can rename. I went to connect a bucket to a Dynamo DB Table, and it's not available yet. It also lost a bucket somewhere in the ether of the GUI. Ah well. I couldn't find the EC2 instance in the...
Post a Comment
Read more