Skip to main content

Using AWS Data Migration Service

 Want to share this easily? 

Check out the Notion page.

By Morgan Lucas (she/her) from this video by Johnny Chivers

We use data migration services to, well, migrate data. But why would we want to do this?

 Perhaps...

  • We're moving our business to the cloud, and need to shift all of that cold storage we have onsite.
  • We want to use it as a backup in cause our infrastructure is out of commission.
  • We could have information to share with a 3rd party, and instead of giving access to on-site databases, we put it on AWS to share.
Nevertheless, let's recap what I've done.
  • Created publicly accessible, password-protected database with Amazon Aurora with PostgreSQL Compatibility to migrate to Amazon Dynamo DB
  • Managed inbound rules of security group to limit access
  • Used open source software HeidiDB to interact with database via a TCP/IP session and specific URL for DB (Not shown here for security)

 


 

  • Connected to Aurora PostgreSQL Database
    • ran queries that deleted and created tables populated with new information
  • Created publicly accessible replication instance to connect to our RDS to initiate database migration
  • Created configuration endpoints with existing instance used to migrate database User_Data to Amazon DynamoDB
  • Created role to talk to DMS (making sure to click the radio button beneath)
  • Successfully connected target (endpoint) to instance (middleman to transfer data)
  • Set up database migration task to move from Aurora PostgreSQL Database to Amazon DynamoDB

Find me on Twitter, or my blog. You can Buy Me A Coffee and help me keep writing!

Labels:

Comments

Post a Comment

Popular posts from this blog

Making KPI Dashboards with PowerBI

 While this is the free tier, I cannot share or collaborate with others, nor can I publish content to other people's workspaces, but they will not stop me from screenshooting and recording these self-taught adventures,so! I'm doing this because I idly searched "Mattel careers" and "Information Technology", and seeing a bulletpoint saying the following: Analytical and reporting skills such as creating dashboards and establishing KPIs such as experience with PowerBI, Cognos, Tableau, and Google Data Lake/AWS is preferred And thought "Well, I've used Tableau, and I've heard about PowerBI,  even if its in-demandness is questionable , so how similar is it? And can I write about it?"  First, PowerBI (PIB) does have a downloadable, local version, but apparently Windows-only. I could download the .exe but I couldn't run it / drag it to applications on my MacBook.  Not a problem, we'll use the online SaaS version, and a dataset found here, ...
Post a Comment
Read more

Recon and SSID - Mapping With VisiWave Site Survey

My laptop is refurbished. I've written about how there are a few ... quirks. Being a technology professional, I felt okay with adopting an older machine, knowing I had the skill to fix moderate issues. From dying drivers to monitor massacres, I've ID'd, solved, and documented a lot of issues.  The newest one was my Wi-Fi adapter dropping the connection to a specific extender. While troubleshooting, I was curious about doing recon of WiFi networks and broadcasting devices anyway. That issue? A power setting. It was so determined to save power, it would disconnect. The extender is also flirting with the older end of 6 years old.  The battery needs to be replaced, but that's new to me. As a Windows laptop, there are a plethora of options to pick. How do you decide which one is safest?  I am suddenly concerned about this despite having 3 unofficial, 15$ Macbook Air chargers from eBay, and no explosions. But let's move onto the Site Survey - Where can I find the stronges...
Post a Comment
Read more

S3 Event Notifications Using Lambda

I earned my AWS Solutions Architect Certification in Feb 2026 (🎊) but Like Smash Mouth said, "So much to do...so much to see."  I've used Lambdas that, when an object was uploaded to a bucket, sent a notification to Eventbridge, and then sent me a text and email via SNS. Now, thanks to the free project on Adrian Cantrill's GitHub , I'm going to make a small image processing eventflow. (Emoji use is for fun; Everything here written by a human being.)  What's Happening: Images uploaded to an S3 bucket are made into 5 thumbnail variations thanks to the power of Lambdas and inserted into an output bucket.   Business Use case; If you want to get quick thumbnails.  Maybe this can be scaled out to do file conversion, like .txt to .pdf.  Materials: 2 S3 buckets - one for input, one for processed output. Lambda An image!  Step 1: Bucket Creation  🪣 I made one bucket (runtcpip-source, for images to go in) and copied the settings from it to make the second...
Post a Comment
Read more