TechBrothersIT is the blog spot and a video (Youtube) Channel to learn and share Information, scenarios, real time examples about SQL Server, Transact-SQL (TSQL), SQL Server Database Administration (SQL DBA), Business Intelligence (BI), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Data Warehouse (DWH) Concepts, Microsoft Dynamics AX, Microsoft Dynamics Lifecycle Services and all other different Microsoft Technologies.
How to perform CDC from GCP MySQL Instance to BigQuery by using DataStream in Google Cloud Platform Tutorial 2022, in this article we are going to learn How to perform CDC from GCP MySQL Instance to BigQuery by using DataStream in Google Cloud Platform | GCP Cloud SQL Tutorial
How to Connect to GCP SQL Server Instance by using Private IP Configuration | GCP SQL Tutorial 2022, in this video we are going to learn How to Connect to GCP SQL Server Instance by using Private IP Configuration | GCP SQL Tutorial 2022
Script:
--Postgres Instance Level Settings
cloudsql.enable_pg_cron
value= on
cron.database_name
Value : Provide your Database Name
-- check if extensions are installed
select * from pg_extension;
-- use this to create extension on db, it will create two tables job and job_run_detail
CREATE EXTENSION pg_cron;
-- list of jobs to run on schedule
Select * from cron.job;
-- Check executed jobs status
SELECT jobid, runid, job_pid, database, username, command, status, return_message, start_time, end_time
FROM cron.job_run_details;
-- Create Schedule to Delete records, insrt record or create index
SELECT cron.schedule('27 19 * * *', $$DELETE FROM public.Person$$);
SELECT cron.schedule('31 19 * * *', $$insert into public.Person values (2,'Raza',200)$$);
-- create schedule to create an index on table
SELECT cron.schedule('36 19 * * *', $$CREATE INDEX idx_pid ON public.Person(id)$$);
-- Schedule to run script on another database
-- SELECT cron.schedule('<Schedule>', '<Task>', '<Database>')
SELECT cron.schedule('40 19 * * *', 'test2','create table public.crontab(id int)' )
-- also we can insert into cron.job manually
INSERT INTO cron.job(
jobid, schedule, command, nodename, nodeport, database, username, active, jobname)
VALUES (7, '55 19 * * *', 'create table public.crontab(id int)','localhost', '5432', 'test2', 'postgres', true,'testjob');
-- Delete schedule
-- SELECT cron.unschedule(<ID of the scheduled task>) -- you will get the schedule if from cron.job
Select * from cron.job;
-- Delete the Schedule
select cron.unschedule(6)
How to Stop and Start SQL Instances on Schedule by using Cloud Schedule in GCP | GCP SQL Tutorial 2022, in this video we are going to learn How to Stop and Start SQL Instances on Schedule by using Cloud Schedule in GCP | GCP SQL Tutorial 2022
Link: https://cloud.google.com/sql/docs/mysql/start-stop-restart-instance
How to Connect to GCP SQL Server Instance by using Private IP Configuration | GCP SQL Tutorial 2022, in this video we are going to learn How to Connect to GCP SQL Server Instance by using Private IP Configuration | GCP SQL Tutorial 2022
How to Connect to MySQL Instance in Google Cloud Platform from Virtual Machine By Using Private IP GCP Tutorial 2022, in this video, we are going to learn How to Connect to MySQL Instance in Google Cloud Platform from Virtual Machine By Using Private IP | GCP Tutorial 2022
Script:
Install MySQL Client
sudo apt-get install default-mysql-client Connect to MySQL by using Private IP mysql -h IP -u root -p Connect to MySQL with private IP mysql -h 172.21.160.7 -u root -p
How to Connect to PostgreSQL Instance with Private IP by using GCP VM GCP SQL Cloud Tutorial 2022, in this video we are going to learn How to Connect to PostgreSQL Instance with Private IP by using GCP VM GCP SQL Cloud Tutorial 2022
Script:
Install psql client sudo apt-get update sudo apt-get install postgresql-client psql "host=PrivateIP port=5432 sslmode=disable dbname=postgres user=postgres" psql "host=172.21.160.12 port=5432 sslmode=disable dbname=postgres user=postgres"
How to Install PostgreSQL 14.5 on Windows Machine | How to Connect to PostgreSQL by using pgAdmin GCP Tutorial 2022, in this video we are going to learn How to Install PostgreSQL 14.5 on Windows Machine | How to Connect to PostgreSQL by using pgAdmin | GCP Tutorial 2022
How to Install psql Command line on Windows Machine and Connect to PostgreSQL Instance on GCP Tutorial 2022, in this video we are going to learn How to Install psql Command line on Windows Machine and Connect to PostgreSQL Instance on GCP | GCP Tutorial 2022
Script: command line tools
https://www.enterprisedb.com/downloads/postgres-postgresql-downloads commad line tools https://www.enterprisedb.com/downloads/postgres-postgresql-downloads
How to Enable Slow Query Logging and General Logging for MySQL to Table or File in GCP Tutorial 2022, in this video we are going to learn How to Enable Slow Query Logging and General Logging for MySQL to Table or File in GCP | GCP Tutorial 2022
How to Create PostgreSQL 14 Instance on GCP How to Connect pgAdmin From Local Computer to PostgreSQL GCP Tutorial 2022, in this video we are going to learn How to Create PostgreSQL 14 Instance on GCP How to Connect pgAdmin From Local Computer to PostgreSQL
How to Edit SQL Instance Settings on GCP | Does Restart Required if You Edit SQL Instances on GCP Tutorial 2022, in this video we are going to learn How to Edit SQL Instance Settings on GCP | Does Restart Required if You Edit SQL Instances on Google Cloud Platform.
SQL Server Error 53 Could not Open Connection On SQL Server on Google Cloud Platform GCP Tutorial 2022, in this video we are going to learn about SQL Server Error 53 Could not Open Connection On SQL Server on Google Cloud Platform | GCP Tutorial 2022.
Create MySQL Instance with Read Replicas in GCP | Promote MySQL Read Replica to Stand Alone Mode GCP Tutorial 2022, in this video we are going to learn Create MySQL Instance with Read Replicas in GCP | Promote MySQL Read Replica to Stand Alone Mode
How to Enable Point in Time Recovery for MySQL Instance in GCP | How to Restore Database with PTR GCP Tutorial 2022, in this video we are going to learn How to Enable Point in Time Recovery for MySQL Instance in GCP | How to Restore Database with PTR | GCP Tutorial 2022.
Vidoe Demo: How to Create MySQL 8.0 Instance with High Availability in Google Cloud Platform
1. ADF Interview Questions andAnswers What is Azure Data Factory and Why Do We Use Azure Data Factory
2. What is Integration Runtimein ADF And What are Types of IR | ADF Interview Questions and Answers
3. What are The Pipelines inAzure Data Factory | ADF Interview Questions and Answers
4. What is Activity in AzureData Factory | ADF Interview Questions and Answers
5. What is Schedule Trigger inAzure Data Factory | ADF Interview Questions and Answers
6. How Will you Control theFlow of Activities in Azure Data Factory Pipeline? ADF Interview Questions
7. What are Linked Services in Azure Data Factory | Azure Data Factory Interview Questions & Answers
8. What is DataSet in AzureData Factory | Azure Data Factory Interview Questions and Answers 2022
9. You need to Run SSIS Package in Azure Data Factory Where will you Save SSIS Pkg - ADF Interview Q&A
10. Which IR will you use ifyou need to Read the Data from On Prem Network to Azure Cloud-ADF Interview
11. Does Copy Activity SupportsUPSERT Operation | Azure Data Factory Interview Questions 2022
12. If your Data Factory is Deleted? How Will you Recover or Restore | Azure Data Factory Interview Q&A
13. What Are The Steps toCreate Private End Points in Azure Data Factory | ADF Interview Questions 2022
14. What is the Difference Between Parameter and Variable in Azure Data Factory | ADF Interview Q&A
15. What are ParametrizedLinked Services and Why do you use them in Azure Data Factory | ADF Interview
16. If your Self Hosted IR is running Slow what steps you will take in Azure Data Factory ADF Q&A
17. Where Will You See The Pipeline Runs and Trigger |Azure Data Factory Interview Questions & Answers
18. How to Remove Duplicate Records in Azure Data factory | ADF Interview Questions & Answers
19. Which Activity Will You Use to Delete All Files In Azure Data Factory | ADF Interview Q&A 2022
20. What are Event BasedTriggers in Azure Data Factory | ADFactory Interview Questions and Answers 2022
21. In which Modes Azure Data Factory Pipeline Can Run | Azure Data Factory Interview Q&A 2022
22. The Microsoft EventGridresource provider is not registered in subscription | ADF Tutorial 2022
23. You Need to add ExtraColumn or Derive Extra Columns from Source Columns, Can You Use Copy Activity
24. What is Tumbling Trigger inAzure Data Factory | Azure Data Factory Interview Questions and Answers
25. Explain a Few of Activities in Azure Data Factory Pipeline Which can Run Stored Procedure | ADF Q&A
26. How Will You Send an Email with File Attachment from Azure Data Factory | ADF Interview Q&A 2022
27. How will you send An Email from Azure Data Factory Pipeline | Azure Data Factory Interview Q&A 2022
28. Which Source Control Repository you will use in Azure Data Factory | ADF Interview Q&A 2022
29. Which Tool You Have Used For CI/CD For Azure Data Factory | Azure Data Factory Interview Q&A 2022
30. You are given 100s of files and you need to load them to each table and create on fly | ADF Q&A 2022
31. How Will you check if SHIR is not working | Azure Data Factory Interview Questions and Answers
32. Can a Single Self Hosted IR be Used in More than One Data Factory | Azure Data Factory Interview Q&A
33. Your Data Flow is Running Slow in ADF, What Steps Will You Take | Azure Data Factory Interview Q&A
34. How can you Backup & Restore Azure Data Factory | Azure Data Factory Interview Questions & Answers
35. How To Copy Azure Data Factory Pipeline From one Data Factory to another | ADF Interview Q&A 2022
36. How Will you keep the Execution Log History of ADF Pipelines for More than 3 Months | ADF Q&A 2022
37. Why Do You Use Azure Key Vault With Data Factory | Azure Data Factory Interview Questions & Answers
38. What Steps Will You Take if Your Pipelines are Stuck in Queue or Progress Status | ADF Interview Q&A
39. What Are Three Different Types of Variable Available in Azure Data Factory | ADF Interview Q&A 2022
40. How Will You get the Last 2 Month's Execution of Pipelines If Your pipelines have been failing
41. How to find out Which Pipeline is Billed Most | Azure Data factory Interview Question & Answers 2022
42. For load Balancing and Failover Scenario, How Many Max Nodes we can Add in SHIR | ADF Interview Q&A
43. Multiple files are loaded to Single table How you will Identify file names for each record ADF Q&A
44. What is General Purpose and Memory Optimization Mapping Data Flow | ADF Interview Question & Answer
45. How to Complete A Task Which can Not be Done with Built In Activities in Azure Data Factory | Q&A
46. What is minimum Vcore andMaximum Vcore for Mapping Data Flow | ADF Interview Questions and Answers
47. Is it Ok to create Multiple Integration Runtimes in Single Data Factory and Why? ADF Interview Q&A
48. Can the same linked Service be used in multiple Pipelines in Azure Data Factory | ADF Interview Q&A
49. To Get a List of All File from Azure Blob Storage, Which Activity You Will Use | ADF Interview Q&A
50. How will you send an emailfrom Azure data factory | ADF Interview Questions and Answers
51. How Will You Check if File Exists or does not Exists in Blob storage in Azure Data Factory | ADF Q&A
52. How Often Do You Upgrade or Update your Self Hosted Integration Runtime | ADF Interview Q&A 2022
53. What are Your Thoughts, which one is better, SSIS VS ADF Azure Data Factory Interview Q&A 2022