While working as a developer, one needs to automate some of the existing SQL Queries using bash script without accessing the interactive MySQL prompt. In this blog post i will show the different ways to run sql queries using Bash Script.I will be using MySQL database in this Blog.
In this blog post we will load the retail data into MySQL instance and analyze it using Structured Query Language.SQL is one of the most popular languages among developers,data engineers,data scientists and DBAs.
REST stands for REpresentational State Transfer.It is web standards based architecture and uses HTTP Protocol for data communication. It revolves around resource where every component is a resource and a resource is accessed by a common interface using HTTP standard methods
Managing Data quality is one of the important aspect in a IT company.Accurate,consistent and timely available quality data in the relational database that organization use are essential to the management of organization today.
Normalization is the process of successively reducing relations with anomalies to produce smaller, well-structured relations.This blog post contains tutorials for database normalizations and First Normal Form, Second Normal Form, Third Normal Form, BCNF and Fourth Normal Form
A Slowly Changing Dimension is a dimension that stores and manages both current and historical data over time in a data warehouse.
When working with Big data platform like Apache Hive, certain task such as data ingestion/data preparation task needs to be scheduled daily using shell/bash scripts so that downstream application can get the new data everyday.In this blog post we will load movies data into hive tables using shell scripts
Apache Pig is a high level dataflow language for analyzing large data sets. The data flows in a pipeline step by step and data can be stored at any point in the pipeline
SQL join and Unions are the most common techniques in combining data data from two or more tables.
Apache NiFi is an open source tool for automating and managing the flow of data between systems (Databases, Sensors, Hadoop, Data Platform and other sources).