This revamped curriculum outlines the key areas of focus and estimated timeframes for mastering data engineering skills. Foundational Knowledge (1-3 weeks) Data Modeling (2-4 weeks) Data Storage (3-5 weeks) Data Processing (2-4 weeks) Data Integration (4-8 weeks) Data Transformation (4-6 Read More …
Python 101: A Beginner’s Guide to Python Programming
Intro Installing Python Before diving into Python programming, you need to install Python on your computer. Follow these steps: For Windows: For macOS: For Linux: Most Linux distributions come with Python pre-installed. You can check the version by running python Read More …
Introduction To Apache Kafka – Part 1
What is Apache Kafka? Kafka is a Publish-Subscribe based messaging system that is exchanging data between processes, applications, and servers. Applications may connect to this system and transfer a message onto the Topic(we will see in a moment what topic is) Read More …
Change Data Capture — CDC
Change Data Capture (CDC) is a method of identifying and capturing changes made to a database. It captures data changes and enables businesses to keep track of all modifications made to their data, including updates, inserts, and deletes. CDC is Read More …
Shell Script to auto download file from sftp server
This is a shell scrip to download a file from an sftp server with password. File names might be with datetime stamp like FileName_2022030125600.CSV. The script will get to the sftp site, download the files with current datetime stamp to Read More …
Part 5: Switch case in C++
Switch case statements are a substitute for long if statements that compare a variable to several “integral” values (“integral” values are simply values that can be expressed as an integer, such as the value of a char). The basic format Read More …
Part 4: Functions in C++
Now that you should have learned about variables, loops, and conditional statements it is time to learn about functions. You should have an idea of their uses as we have already used them and defined one in the guise of Read More …
Part 3: Loops in C++
Loops are used to repeat a block of code. Being able to have your program repeatedly execute a block of code is one of the most basic but useful tasks in programming — many programs or websites that produce extremely Read More …
Part 2: If statements in C++
The ability to control the flow of your program, letting it make decisions on what code to execute, is valuable to the programmer. The if statement allows you to control if a program enters a section of code or not Read More …
Part 1: Introduction to the C++ Language
A C++ program is a collection of commands, which tell the computer to do “something”. This collection of commands is usually called C++ source code, source code or just code. Commands are either “functions” or “keywords”. Keywords are a basic building block of the Read More …