How to migrate my self service database to AWS Managed RDS using (DMS) Database Migration Service?

hello guys welcome back to my channel in this video I'll show you how to migrate a self-service manage database to AWS manage database using AWS database migration tasks so what is AWS data migration task so AWS DMS itself called as DMS and it is a managed migration and replication service that helps move your database and analytics workloads to AWS quickly securely and with minimal downtime and zero data loans and dma supports migration between 20 plus databases and analytics engines and it will be AWS manager is a maintained High availability and minimal downtime during the migration process with multi AC and ongoing data replication and one monitoring and it will also support home engineers and heterogeneous databases migrations from Oracle SQL Server postwares MySQL mongodb Mario DB another databases and almost all it has plenty of sizes like terabytes or petabytes at low cost you can migrate it and paying only for the compute resources and additional log storage used during the migration process there will be no cost effective for this DMS task so I want to move from my Amazon EC to mySQL server to AWS manager RDS MySQL so in this case I am using AWS data migration service so this is AWS data migration replication instance so it will connect Source endpoint from source and it reaches the target endpoint Target RDS using Target endpoints so we need to achieve this from easy to building a server and deploying in a magical Insider server and we need to migrate using DMS service so let's get back and achieve this so let me launch a VPC so I don't have any vpcs in my region so I am launching a VPC Northwest linear region which is cost effective so create VPC and I'll go for 10.80 series two public subnets and no private subnets same points simply create VPC so it will enable the DNS associations and subnets attaches associations and internet gateway attaching to the VPC and Red Cloud tables also entries will be added so you can see here let me go to vc2 and I'll go for RH align which is supported by MySQL 8.3 version I'll go for 9 SSD wallet [Music] medium 72 micro let me go for a laptop keypad so I have already keep it unable Bluetooth let me create a security group so this is the security group I have given DMs so I'll go by all traffic anyway there's no restrictions of the security group it's allowed on so I don't want to enable any encryption for this so let me connect to my AC to instance which is still running yeah now you can able to login let me change the background so let me check the OS version for this so we can see here 9.2 Version rhl 9 is installed you go to rho line subscription as well with the AWS manage so I have checked the OS release and I need to M Clean on so if there is any unwanted repositories or packages it will clean up no files are removed so I need to check the camera whether my subscription is added or not so I can see here a little line so Basel is an upstream has been added update to the my latest packages foreign [Music] so this is AWS architecture diagram where I have launched dc2 in public SQL so to Target RDS AWS which is AWS manage so using AWS data migration task so let me go to the MySQL page redhead Enterprise Linux The Voice version is nine this is 64-bit and I'll go for download RPM bundle which is completely all the packages copy the link paste it here so you can see here 62 by 62 is already installed and cleanup foreign so I have copied the link where https link bundle order from MySQL duplicate once again working directory so let me create a folder so there is no files here so it is saying that there is no command or a duplicate a package so we need to install double gate score prompt yes or no so it is completed you can see here upgraded all the packages python open SSL kernel network manager because it is line needed um I can see here there is a musical bundle order to using that so you can see again those are all extracted files and I need to install uh using this command you can start hyphen y so it will install MySQL what are the files it is having my SQL community given hyphen star so it will install all these packages Auto approve with hyphen y so you can see here magical Community common back is all packages whatever the MySQL wants it is installing my SQL Community server 8.0.33 let's wait for till 92 come packages need to be installed so it is completed so you can see here you just need to package it's been installed and check the status of the MySQL so it is in Red State it is not inactive state so let me started or else you can use system CTL enable space hyphen iPhone now MySQL D so it will start at the booting level at every time whenever you restart the server so let me check the status of my security so it is an icon running state and I need to grab the password of the temporary password of my circle I need to do the secure installation for this so it has been generated as my temporary as this so I need to copy this so it will be example password like this so I need to do MySQL secure installation it is asking for us to give this password let me copy the password set the password and you need to to s Anonymous users usual root login remote test database let me check once again okay it's done right I don't know how to cancel this operation so I am not a SQL or DB guy so let me take a new duplicate session or else I can use a previously rooted screen let me close this so I have checked that whether it is done or not my SQL secret installation and it has been successful so let me check this over so it is in active and running and you need to log in with mySQL inside this using the password you have set earlier so I can see here my SQL is logged in databases so you can see here information schema MySQL performance and SOS these are the system defined package and these are the databases whenever you install MySQL 8.0.33 so it will be called databases like these four let me check any other users have created or not so to check the users list you need to use this command so you can see here root MySQL system session has been created the versions of the database are import source and Target and deploy the RDS my SQL in single HD so I am using a cost efficiency for you are deploying the RDS in single AG either you can use multi-aging real-time scenarios and I need to upload this term to here so I'll use in sap for this for this I need to use I'm enabling password authentication as is why because I need to copy this file from here into the server I have restarted that my ec2 server so let me connect to the server and upload the dump so I have downloaded um so this is my sample database let me check whether the database is having some tables or any data inside that so you can see here classic models this is the database and these are the tables table structures on all these kind of data inside the database let me close this and upload this them to my SQL Server which is installed on average online let me go back to the AWS console and copy the public IP before that you need to do that you need to reset the password of ec2 user and I have reseted the easy to use the password also and give the password using the public IP I need to connect my server and it is reading remote directory for root cell copy in temp so I don't have permission directly to copy in root directory so this is them let me close this let me go to the series last time let me check the file so my file is there and I'll copy from here because I should let me go back to my DMs so you can see here my SQL database dot SQL file is already you need to upload we have uploaded the dump and make the RDS and RI with endpoint connection setup and DMS up Network parameter group and option group need to be created while deploying the RDS and we need to create a DMS parameter group for RDS and replication instance also and I need to choose 8.0 where I need to choose same version for the RDS also so you can see here my RDS is also the same version so I can see here so you can see here 8.0.33 this is the same version I need to deploy inside device sorry for that so let me deploy the RDS here So currently there is no RDS inside my AWS console so you can see here there is no databases so before that I need to create a parameter group and submit group and option group so create a parameter group and choose from MySQL 8.0 for the naming convention I can use DMS or RDS so whatever you want you can use it for the naming good convention I use DMS parameter group so this is the DMS task right so I'm using the name so let me create 8.0 DMS paragometer group is created proposal copy and paste and choose your own VPC and just do availability zones so I'll go for one a one one B so my public subnets are in one year and one b uh I'm not sure and let me check that whether my subnets are in one year and one b so these are the two units and one a and one B so I can see here the two separates public subnets and it is already attached to the subnet associations and Route tables as attached to the internet gateway so it has been done and let me show this updates list those two subnets and create a subnet group I have un parameter group okay I need to change this name so this is the subnet group and modified it so you can use the description name so it is created right so you cannot change the name so parameter group is created an option group I need to create choose MySQL version will be 8.0 which is latest and it should be matched with source and let me go to databases create a database 0.33 which is identifier as DMS RDS one and I'll go for admin password and I'll give the password as term one two three so you need to give the alphanumeric password which does not include at the rate three dot micro degree dot micro is enough for me I'll go for gp3 storage and this storage is enough no Auto scaling it will be enabled and if it should be matched two thousand and 125 iops and yeah I have named it as parameter group and I need to access the public and VPC security groups I have created it already and using available designers only primary and certificate of the test you can create whatever it is so I will go for default and 3306 is a port you need to connect to RDS and I'll go for password authentication no other monitoring or no backups needed so we need to choose VMS parameter group and DMS option group here so you can need to give as initial database name or you can ignore this still don't go for any enable any encryption no manual version upgrade no preference you know and deletion protection I need deletion protection that's it so create database so it is saying that cost so this is my password and the user admin so you can see here my RDS database is going to create and it will take so much time to create so you can verify the endpoint import it is not already created and availability answers I just was one year and VPC and two submits EMS parameter groups sorry this is subnet root I have named it as different name and ipv for address Security Group I have a test and it should be public accessible certificate authorities default and instance certificate expiration date Authority date and certificate Authority name let me go to the configuration and I choose 33.micro 2cp one GB RAM and this is the password no IMDb authentication and it is now a small DLC DMS option group is applying so whether you want to detach or attach any other option groups you can do that option group and parameter groups at any time so you can apply it uh like playing the binaries or any other parameter groups when there is no Auto scaling and storage type is dp3 so this is my DMs rds1 database and it is installed with 8.0.33 and let me check whether it is came up or not I'm creating so till the time I need to dump my file from foreign [Music] and this is the file I need to dump into my SQL so I use this command so upload to operate the dump into database I need to use my SQL icon your root hyphen P less than two your file to database so again what is sample database dot SQL so we'll ask for the password so it has been done and let me check so you can see here classic models which is my database term has been dump it into my SQL so previously there is no database like Classics classic models so here you can see here before the dump it is not there so I have already dumped it so the classic models database has been appeared so let me check the database so it is cables inside this so you can see here customers employees offices or a details orders payments production Alliance products so these are the eight tables which has been used inside the classic models so these are the tables I need to migrate from my ec22 source ec2 to RDS AWS manage using DMS migration service so I have it was currently so 8 tables so let me check whether my RDS came up or not so it has been available state so try to log into this RDS and check whether the databases or the or not default databases let me change the screen so that you can understand where I am doing so this is the source and this is the target and copy the host name of the AWS RDS username is admin G5 MB so it will prompt the password so I have given the password as one two three four let me check the databases sorry data basis so you can see here information schema MySQL performance schema these are the default databases inside the RDS so you can see here there is the sources classic models information schema MySQL performance schema and this is the target so similarly same databases but it is different databases which is managed by AWS so let me check the sizes of the databases so this is the command to check the sizes of the database you can see here 7.8.94 or something so you can see here you can compare the databases both so MySQL is in 2.694 NMB and this is RDS which is having 7.8594 and system is 0.156 and system is classic models is 0.5 triple zero and this is a 0.156 system databases like a predefined databases my my cell service and this is the RDS successfully to RDS and before that whenever you're using DMS replace instance you need to create Source endpoint and Target endpoints to check the connectivity between these two and these two so it will establish a line between this connection between a source and Target so we need to establish these two lines so let me create this line first and after that we need to create Target line so before that we need to go database migration service so you can see here there is no replication instances here so this is my replication instance which is access in a mediator or a service between the source endpoint and Target endpoint and between Target and source ec2 and Target rdss let me create an application instance just going to take a 10 minutes DMS requires instance so copy the same name and I'll go for T3 dot medium as recommended and I'll go for updated version of rdms engine version and I don't go Encore multi I need for single AC storage so I don't have any uh that much data so before that you need to create a replication subnet group also for this application instance also create a subnet group choose your own VPC and I'll provide two public subnets which I have and create a submit group so just created let me go back and refresh it is not created so let me refresh my page completely in the same settings and I'll go for 20 GB is enough I'll be before DMS update our application access subnet group I need integers for public accessible and I will say in Security Group and no encryption and on or I don't want any encryption or maintenance or backups separate application instance so you can see here it is creating in one year so My ec2 instance is in also one name so it will be no transfer cost which is in same region and which is in same availability Zone so make sure that uh we're doing any testing or r d you need to choose the same region and the same algorithm or else if the data transfer cost is between regions or between level religions it will be very high so let's wait for DMS replication group TMS application instance to be created so till the time you can check the warehouse we have already checked the connected to RDH and check the databases and we have verified the databases but not will fit the tables let me check the databases users also okay my connection is located copy this command to check the users list so these are the databases inside AWS RDS and these are the use admin magical info schemas using RDS admin so you need to create a user inside the ec2 because it should access all the privilege without the root so root has doesn't have the previous so you need to create a user with these privileges like admin user and admin at the return to the password or any other so it will acts as a source endpoint while viewing this uh passwords and all these users so it will access from the application instance Source endpoint so you need to access a grants after this we can check the three types of database migrations and one is full load and one way full loaded CDC and only CDC so let's wait for the DMS replication instance to be created and up so it is still creating foreign State and this is a VPC which I have created and D3 dot medium is in my class instance type and in generation is updated 3.5.1 and uses 20 and this is the public IP address and the private IP address and it is not created in multiag so it is created now at the timestamp and it will edit the tags and arm so let me go back to the replication instance and check the configuration everything is looks fine and you can see here there is no migration test that absolute replication instance so after that you need to create a source endpoint and Target endpoint to establish the connectivity between source and Target using replication instance so let me go to the endpoints and create endpoint so first I will create a Target endpoint the list easy so create RDS instance which is choose the RDS which is address instance in my AWS console so this is the target endpoint you can see here a Target endpoint allows AWS team is to write data on page database to other databases such as aw standard Heavies or other databases inside AWS and this is a DMS instance identifier and Target engine is bicycle and I need to choose information manually and this is the server name and this is a connection and endpoint and the port number and the username so I need to give the password so this is the password I have given to the RDS so there is no SSL layer over default and no tax this is a VPC and choose the replication instance and run test so if it is Success it will be the endpoint line is verified and the connection is successfully established between DMS application and Target IDs so you can see here it is in successful state so whenever you run the test using VPC and DMS application instance it will establish a line between DM sub creation instance and Target RDS so it is successful and let me create endpoint for this so it has been created and let me create a sourcing point also and let me copy the public IP address for my source ec2 and go to the DMs endpoint identifier as source MySQL and just for MySQL information manually so again you can give the hostname or public IP address Port should be connected and double region password so you can just check their users list to check the users list using this command here MySQL information going with the road user in chemistry for encryption so this is a password create endpoint and go to the source okay I missed the is here go to connections and you can check the details username is root and my other attributes and this is our IP address public IB and test the connection using replication instance it is still taking time to take check the connectivity so it will face the source endpoint uh source ec2 and DMS capitalization instance line so that it is whether it is uh the connection is established or not so it is still on testing so you can see here the status message is failed and test endpoint file status messages saying that 54 is not allowed to connect to this MySQL server so this replication instance is not allowed to connect to this MySQL server why because so whenever you are doing the MySQL secure installation uh using the magical secure installation command so after setting the password you have given keep all yes for all prompts so while doing that uh you have disabled the root login to access any other uh particular user to connect from outside the outside any service to AWS ec2 server inside the MySQL so this is where you need to get the error like it is not able to connect to my SQL Server so for this you need to create a user using this command so you need to create a user with privilege like admin or and using the password and it should be Grant already list on that and it should be Flash and you need to whether verify the grants is allowed or not so let me load and create a user and allocating admin okay that's not satisfy the current false requirements one second so you need not to give any passwords like this at the rate so you can go over password so let me give some make password satisfy the current policy requirements so you can see here I have given uh uppercase letters so that's what it is saying the current pulse requirements is you need to use one uppercase and one lowercase one is a special character and one number so I have used one uppercase letter a and at the rate one two three so it is affected and you can check the list of users so you can see here admin is created and you need to add all previous to admin and after that you need to flash pull this check the graph user whether it is so you can see here grams for admin Grand select insert update delete create all the grants has been added and modified and you can see here application password admin about Exempted another authentication related grants has been added so you need to use this user as Source endpoint so you click on modify a capital here click on rules you need to give admin and the password is this you don't have any action attributes to Define primary key or foreign key instance let's check whether it is verified successfully or not between the source ec2 and the DMS application instance line should be established success you can see here the status message is successful so no need to worry about that so my endpoints are verified and it has been successfully established at the line so the source endpoint is successful and the target endpoint is successful so now you need to do the database migration service using ec2 MySQL data into RDS manage AWS managed ideas so you need to use the AWS data migration service between these two let me check the databases so you can see here this is the database I want to copy from my source to RDS so I need to uh create a replication instance here in the database migration task so you need to be aggression so you will be having a three types of migration types as I have mentioned earlier so three types of database migrations one is full load and one is full load with CDC and only CDC so what happens in full load is you can see here click on info so when you are performing full load it will perform a one-time migration from The Source endpoint to the Target endpoint so whenever the data is being in the source the database been copied from source to RDS at one single time of the DMS task so this is the full load only the migration type and you can see here full load and CDC so migrating existing data and replicate ongoing changes so whenever you drop or delete any table or update any table or alter any passwords so whatever the source has been updated the changes it will reflect the same changes in the targets itself whenever you're using the migrating existing data and replicate ongoing changes full load ncdc with the migration type and this is the mediator which acts as the DMS application instance to verify all these checks and you have the third option also replicate data changes only so don't perform a one-time migration so but continue to replicate data changes from the source to the Target so it will won't perform this line so what happens in the second migration type is it will uses a full load and CDC so it will start the full load after that it will whatever the changes you have been done here so it will also it will be placed in the Target RDS so what happens in the third one is so it will only replicate the changes from the source to Target RDS using the third migration type so whatever you changes here so it will be modified using the third migration type so it won't perform any one type migration like only one full one time full load so this is the three differences between uh three types of migration types between these differences so I will go for migrate existing data and first and I'll create a second database type database migration task as replicate ongoing changes and the third one is data changes only for the third type replication task and I'll go for migrating existing data and choosing the DMS application instance and Source endpoint this is my target endpoint and you need to do nothing [Music] these are the English column surface and containing large objects so you can give 1024 or full of mode or limited life so let's just modding take this so I don't want to enable any validation or task logs and advanced data settings like control tables using schema so I'll go for creating a schema into a schema so I'll go for all and all and I don't want to include this uh information scheme of MySQL performance schemesis so I need to copy this here so I need to exclude these tables while doing the migration test so I have given the source name and the source table name it should be completely whatever the source having the data data basis you need to copy into RDS so using this task so I am giving the information schema it should be excluded from the source so and after that MySQL also should be excluded so this is information schema and this is my SQL and one more is Pokemon schema another is user you need to verify whether the spaces or not so you can see here it says performance schema and my SQL are being excluded information scheme are excluded whatever the percentage use all the databases should be replicated into the RDS so I have used and what happens is so you have the classic models so this database will migrate from Source add source ec2 to RDS so from Source RDS to so cc2 to RDS it will migrate you using DMS FPS instance database migration task so let's verify that um create the replication task and there will be there won't be any transformation with no Prime migration assessment reports so if you want to automatically uncreate you need to enable the remigation assessment report so I will go for manually later Android I don't want to enable any tags so this is the database type migration type for migrate existing data it is a full load process and do nothing and everything is as it is so if you want to go for table mappings as Json editor you can click on Json editor and you can modify whatever you want the changes to be modified in the table mappings so it is creating a full load So currently there is no databases inside the target this is the RDS and this is the Institute so in ec2 I have classic models database I want to migrate this database into RDS so I don't have any classic models in the target so let me verify the source RDS classic models and you need to use classic models database short tables so you have here eight rows inside the classic Model database so these are the eight tables I need to perform one time migration as using the migration type as full load so click on full load so the task is ready and this is the type as full load and source is my ec2 MySQL Source endpoint and this is the target endpoint using the DMS application instance here so this is a starter and progress is 100 this is a task here and creation starter task logs batch Optimizer settings this is the Json file and there is no table statistics here so you can verify the other insert delete update ddls or full address whether it is added or not in the source table and this is a mapping selection rules so you can see here this is um these are the table names is excluded you can see here excluded schema name is like performance schema is excluded schema name is like MySQL is excluded and schema like name is the information schema is excluded and percentage percentage is included so whatever the tables all the datable area levels will be added using percentage and percentage so this is the auditable statistics and inside the target RDS also you don't have any table like this so you don't want to take any skeleton backup for this so in real time you need to take a skeleton backup for this so let me start this so you don't want to enable create migration assessment report or modify or move or delete or stop so let me start this task so you can see here status message is starting and progress is zero percent I strongly recommend you to check the endpoints connectivity status whether it is connection successfully or failure so at the time only you need to create a migration task so without those it won't create any migration tasks let me go back to the database tags corner you can see the table statistics I have given my SQL as excluded but I don't know why it is included so it is running with errors let me check it is 72 percent so previously you have information schema my secret performance schema analysis so right now you have AWS DMS control and classic models databases have been imported from source to RDS so this AWS TMS control itself manager by AWS so no need to worry about this and classic models has been migrated from source to RDS let me check why MySQL is added I have given MySQL also one two three four you know I have given my SQL also let me modify this task let's check whether it is completed or not and it is 73 percent you can see here my sequel is also excluded but it has been included so the progress is in 100 so it's been done and let me modify this task and check this so this is excluded performance schema is excluded and MySQL is also excluded and percentage on information schema is also excluded percentage percentage is added so I'll give a source name as classic models so at the time it will work so I'll do one thing and drop travels On Target and after that it will start the migration task so you can see here this so whenever it is running it will drop the tables inside the target foreign statistics inside this so the table is all been dropped and go to the Target and check that in time verify the tables or databases and this database migration task is started you can see here notable status X records one it is it is taking time to delete these tables they are still starting so you can see here the DMS task is in running state so because of the error it has been came up like I have given the pre-migration repo mapping rules as sorry not immigration it has been mapping rules so inside the MySQL I have given Extra Spaces as my SQL after the space so it has been not excluded it has been included so that is the error so you can see here classic models the database has having the tables these are the tables it has been table completed and it is a running state so make sure that whenever you are giving the spaces on my SQL whenever you are giving any databases you need to copy exact the database without any copy I have copied like this so it has been made a mistake of space shuttle so MySQL pack is also installed so I have modified the task and I have created it again so you can see here it has been created at 10 51. the classic models database having tables that is replicated so we'll do uh verify the Target RDS also so you have the you don't have any classic models inside the target RDS so this is a it is in green color it is in Target RDS I have connected so let me check this so you can see here the classic models has been uh 0.3438 these are the tables sure levels so you can match here eight rows so these are the address which has been successfully migrated from ec2 to RDS so what we have done is we have spin a very easy to server in public subnet and we have set up the info on AWS TMS task like creating resource endpoint DMS application stands for C2 and deployed RDS MySQL and post confirmation on successful endpoint success status so we have created a database migration task on full load and we have migrated all whatever the data is in the ec2 server we have migrated into RDS so the first step is completed on the DMS task with full load so we can do the full load with CDC also before that I'll do one thing so I'll create one table inside the source so we can check that whether the table is added in the Target side or not so use this command to create a table inside the source so using the full load it won't copy so let's check that so database change show tables so let me create one generatable so whether it will be updated in the Target set or not so this is the table January table is being created in classic models so let me verify the tables so you can see here before it was it was and now it is variable has been added so let me check the in the Target set also whether the database table has been added or not so you can see here show tables in the classic models so customers employ January table has been updated so it has been has eight recently so this is where you need to do with a database migration task as a full load with CDC so it will perform full load and the CDC task also so let me create a DMs so there won't be any spaces here so the replication instance Source endpoint Target database endpoint and choose migrate existing data and replicate ongoing changes for a table and Target operation mode it should be so you have all the tables inside this so you need to give drop tables on target so why because it will delete the target database database tables and added again and it will perform the CDC mode from here so you can give that so or else you can go with the do nothing also so in this case I am going for do nothing so it will verify the tables and it will recreate and it will do that so it will don't need to do anything full of more should be one zero two four I have given a lot of column settings as one zero and no Cloud watch no validation so in the selection rule I need to add the schemas so whatever the source database I need to add here these are the databases I need to copy so information schema excluded so I don't need to any spaces across it and MySQL so there won't be any spaces here and it should be excluded adding selection rule as open as comma also and it should be excluded a new selection will change this and it is also should be excluded so you can see here this is and performance schema and MySQL and information schema are excluded and add this election rules percentages percentage so to copy The Source tables from ec22 source create task so the first task is full load it has been load completed and it is 100 you can see here in the table statistics so you have eight tables so I have created one full load with CDC the second task Target so you will get a generator table in here in the Target database so start the task and it is in registered there is no table statistics here these are the only details progress and status ongoing replication so this is the second task it is starting so we have performed the full load migration and we are doing the full audio CDC migration now it is now starting stage so you can see here the generator table has been added in the Target side so it is still in running state so you can see here the database migration type to folder with CDC is running and it is 100 and you can see here generate table is added so using with full load and CDC it will replicate the tables whatever in the source is having it will be replicated into the target side so let me show tables here so you can see here January table has been added from source to RDS so previously it is having eight rows here so now it is having nine rows so I generally so and I'll do one more thing also so and I want to add February table here also so whether my replication is working or not I need to check that so you can see here show tables so my February table is added so it is now 10 rows so let me check the target side also show tables tables if you have February table is also added so let's verify in the console itself Let me refresh go to table statistics so it is still in running state okay it is running as full loaded CDC and you can see here the brownie table is I also added one table product lens is got error so maybe there is having a primary key or a foreign key issue like that so you don't need to worry about that so you can see here February table is added so let me do one thing uh I'll perform a only CDC also so whether full load is with CDC is what it will do is followed after that it will duplicate the task using a replication instance whatever the data is in the source it will migrate with CDC also it's a ongoing replication and on time going changes and we can use only series also with whatever you want uh the ongoing changes to be added in the Target you can use only CDC that is the third option so let me copy uh search this so you can see here this is only table product lens maybe it is causing me due to foreign worry about that and I'll going to stop this so it is in CDC mode so I need to stop this and let me create the third one is only CDC it will migrate only the replication data whatever the ongoing changes has been done from the source side so let me create a task [Music] s so click on source application instances and Target database endpoints and choose the replicate data changes only so we have performed a full load one time activity and the second time is full load one time activate and replicate ongoing changes with full load and CDC migration resource to Target then continue to replicate data changes from the source to Target so the third option is replicate data changes only so using CDC don't perform a one-time migration but continue to replicate data changes from the source to the Target so whatever the data is coming to the source so it will automatically place into the target RDS side also so this is the option where you need to choose replicate data changes only the CDC mode replicate data changes and we need to check and you need to use a visible start you can choose for this CBC start mode for Source transactions like you need to specify the timings whether at what time interval you can do this and log sequence number require checkpoints so you need to choose all the settings and you need to verify the timestamp for this so whether doing uh migration you need to verify the instance easy to ec2 time zone and the RDS time zone should be matched perfectly and I don't want to preparation models do nothing and disable State CDC mode and limited size lock mod is one zero two four only two turn on validation logs batch optimize Cloud watch logs and add new selection rule as as it is same personalizing group and the schema classic models and it should be excluded in the next I need to click on enter add new selection rule information schema and it should be excluded okay which is a my circle I need to view here not the classic models which are the predefined package and I prefer to find databases I am I'm going to explore it exclude exclude MySQL I need to give copy my SQL is excluded information schema is excluded MySQL is excluded okay bicycle is already experience performance schema I need to give here so let me check the performance schema excluded information schema has excluded my SQL is excluded and percent age and this is not added and it should be excluded one two three four five that's it and no need to create any migration reports and create a task manually later foreign let me start this task so we have created the third task and radius replication ongoing check the other table statistics so all are completed so you hang the January and February tables these are the two tables I have added and there is no one time one time job lot so it is completely it is replication ongoing so let me do one thing and I'll create one more table I'll create much in April May June July tables should be created and it should be reflected to the Target so by default it is and previously it is having generous so now I have created much April May June July tables so let me verify the tables so now it is having 15 rows here so with using the DMS task as replication ongoing with the CDC only so let me check whether the database tables has been added inside the Target also show tables so you can see here April July June March May if tables has been added in the Target side also so this is where you get a database migration task using the Third CDC application so where you are having the three types of database migration from Full only cdcs replication ongoing so we have entered from uh doing ec2 source and RDS as Target and using DMS migration service we have migrated from The Source database to Target RDS moving the databases workloads and this is how you can modernize the database migration service and you can check the AWS documentation also so if whenever you are having any uh whenever you're having any real-time scenarios you can check the binary logs or any other you need to do like server idea hyphen equal to one and Bin log formats and whenever it is working on on premises it should be added you need to check with the database guy so this is where you can migrate your workloads from source PC2 to RDS or you can use a DMS DMS migration size from on-premises to AWS so other infrastructure you can move from other infrastructure to AWS rdsr as well so on-premises Amazon ec2 or M or Amazon or DSS also you can migrate from uh using DMS to rdss as well so that's it guys you understand my point and this is where the delay the picture is happens so this is a mediator which acts as a between source and Target so this is the DMS replication instance will work uh checking the connectivity status database migration task using DMS task you need to migrate from ec2 to RDS and you need to have a database engine itself to start this process so this is this these are the steps to do the database migration test so that's it guys thanks for watching my video please do like share and subscribe for more videos let me know if you have any queries please post in the comment box thank you

Channel: Tarun Technophile

Views: 776

Keywords: #aws #cloud #tarun #technophile

Id: TLE50SGoU54

Length: 85min 41sec (5141 seconds)

Published: Sun Jul 16 2023