Ajay B.

 Highly Skilled IT Professional Experience in GCP and Azure Cloud with over 7+ years of experience working as GCP and Azure Data Engineer.  Overall, 16+ years in IT Experience. In Software Design, Development, Analysis, Testing, Data Warehouse and Business Intelligence tools.  Working within an Agile delivery methodology production implementation in iterative sprints GCP : BigQuery – Created external table on GCS Parque files, Views with Dedupe logic, Wrote the dynamic batch script to find the current/invalid parquet files in GCS 🖎 DataProc – Written in PySpark / Spark SQL program to transform data and used dataproc cluster to run the job. Implemented Delta lake 🖎 Composer, Apache Airflow – Used for workflow orchestrations. 🖎 Git – Used to maintain as a code repository 🖎 GCS – Storage used to keep processed data. Parquet/CSV files used to store data. 🖎 Programming – PySpark, Python, and Spark SQL used for script Cloud Data Platform (Azure):  Implemented standard Databricks Notebook used to load Full load and Delta load (Type 1) to process a large volume of data with all the business rules and transformation.  Used Scala and Spark SQL language to create standard Databricks Notebook  Implemented Azure Key Vault service to store all the vital credentials like Service Principal key, Database credentials, Storage connection string, and others  Knowledge of ADLA (U-SQL) replacement with Azure Databricks for data processing  Designed and implemented highly performant data ingestion ADF pipelines from multiple sources using Azure Databricks  Created some UDF for logging, History load from multiple date folders from data lake storage DW& Data Modeling:  Experience in OLTP/OLAP System Study, developing Database Schemas like Star Schema and Snowflake Schema used in relational, dimensional, and multidimensional modeling.  Experience in analysis, design, and construction of Data warehouses.  Expert Experience in Normalization, De-normalization.  Implemented Slowly Changing Dimensions - Type I & II in Dimension tables as per the requirements ETL:  Proficient in using SQL Server Integration Services to build Data Integration and Workflow Solutions, Extract, Transform and Load (ETL) solutions for Data warehousing applications.  Skilled in Business Intelligence tools like SQL Server 2008R2 Integration Services (SSIS).  Experience creating SSIS packages to automate the Import and Export of data to and from SQL Server 2008 using SSIS tools like Import and Export Wizard, Package Installation, and BIDS. T-SQL:  Extensive experience in using T-SQL (DML, DDL) in SQL Server 2012 / 2000 platforms.  Experienced in creating Tables, Stored Procedures, Views, Indexes, Cursors, Triggers, User Profiles, User Defined Functions, Relational Database Models, and Data Integrity in observing Business Rules.  Implemented Change Tracking (CT) and Change Data Capture (CDC) functionality  Extensive knowledge in tuning T-SQL, Query Optimization to improve the Stored Procedures/Functions performance and availability.