Transparent Data Encryption (TDE) was introduced in SQL 2008 as a way of protecting “at rest” data. It continues to be available in all versions of SQL right up until the present, until recently it was only available in the Read More …
CI/CD with GitHub Database Projects and Azure Pipelines
With the high pace of development, data architects/engineers must be able to keep up with our DevOps counterparts. We also want the many benefits of CI/CD for databases such as fewer errors, stable builds, better release management, and less manual Read More …
Performance Optimization Techniques on Azure Data Lake
The following article depicts performance optimization on Azure Data Lake.It is Assumed that people reading this have a general idea on ADL, U-SQL and general querying.Before we move on let’s understand key terms in determining a query performance: Analytic UnitStages in a jobJob Read More …
Dynamic Search Conditions in T‑SQL
Introduction It is very common in information systems to have functions where the users are able to search the data by selecting freely among many possible search fields. When you implement such a function with SQL Server there are two Read More …
Using Azure Data Lake to copy data from CSV file to a SQL database
Great, but what is Azure Data Lake? Azure Data Lake includes all the capabilities required to make it easy for developers, data scientists, and analysts to store data of any size, shape, and speed, and do all types of processing and analytics Read More …
SQL MERGE statement
With data processing, in performing ETL workloads to a data warehouse, some of the activities in ETL can be achieved using the MERGE statement in SQL. The MERGE statement in SQL is a special type of query in SQL Server Read More …
Split huge CSV files – Open in Excel
One of Microsoft Excel’s shortcomings is the limited size of a spreadsheet. Excel has a spreadsheet row limit of 1,048,576. If you need to open in Excel, make your Excel file smaller or split a large CSV file. To get Read More …
A Stored Procedure to generate a random token
You may have encountered a scenario where you want to generate a random token for identity verification purposes. In this article I tried to include a stored procedure in which you can easily generate a random token to be sent Read More …
U-SQL (Intro)
U-SQL is a language that unifies the benefits of SQL with the expressive power of your own code to process all data at any scale. U-SQL’s scalable distributed query capability enables you to efficiently analyze data in the store and Read More …
How to Coalesce Excel Data
The Coalesce function evaluates its arguments in order and returns the first value that isn’t blank or an empty string. Use this function to replace a blank value or empty string with a different value but leave non-blank and non-empty string values unchanged. If all of the Read More …