Syllabus
Job Opportunity
Data Engineering Course
- Oracle 18/21c Installation
- Basics
- Oracle Basics
- Database models
- ER Model Overview
- Data types
- Understanding Test Database
- Basics Queries
- Arithmetic and String functions
- DML Operations - Insert, Update and Delete
- FETCH command - Top N, Top % Rows
- DDL
- Tables - Create, Alter, Drop
- Indexes - Types, Create, Drop
- Constraints - Not Null, Primary Key, Unique Key, Foreign Key
- Sequence
- Synonyms
- Foreign Keys
- DML operations - Insert, Update & Delete
- Insert, Update, Delete & Truncate
- Common Operations
- Creating Tables using queries
- Bulk Data Inserts using Queries
- Writing Queries
- Filters
- DISTINCT
- BETWEEN
- IN
- LIKE
- NOT
- NULL
- AND, OR, NOT etc
- Using Complex Data Filtering Techniques
- Sorting
- Ascending Order
- Descending Order
- Complex Sorting
- Functions
- String Functions - lower case, uppercase, substring, instring, trim etc.
- Number Functions
- Date Manipulation
- Null Value Functions - NVL, NVL2, NULLIF, COALESCE
- Conditional Expressions - Case and Decode
- Groups
- Basics
- Grouping functions - AVG, MIN, MAX, COUNT, DISTINCT COUNT etc
- Grouping Filters - HAVING
- Rollups & Cubes
- Joins
- Cartesian Product
- Equi and Non-Equi Joins
- Left Outer Join
- Right Outer Join
- Full Outer Join
- Self Join
- Complex Queries - Joins & Groups Integration
- SET Operators
- Union
- Union All
- Intersect
- Minus
- Subquery
- Single Valued Row Sub Query
- Multi Valued Sub Query
- Views
- Inline Views
- ROWID & ROWNUM
- TOP N Analysis using Complex Inline View
- Transactions ( T SQL)
- Commit
- Rollback
- Savepoint
- DCL - Grant & Revoke
- Project
- PL SQL Basics
- Why PLSQL?
- Anonymous Blocks
- Data types, Variable, Composite Variables etc
- Progamming in PLSQL
- if..elsif..else block
- Control Structures
- for loop
- while loop
- loop...end loop
- PLSQL Programs
- Logic Building
- Basic Programs
- Pattern Programs
- Nested Blocks
- Using SQL in PLSQL Block
- Select
- CRUD
- Transactions etc
- Cursors & Adv. Cursors
- Implicit Cursors
- Explicit Cursors
- Cursor For Loops
- Cursor with parameters
- Reference Cursors
- Exception Handling
- Understanding Exception Handling
- Using Oracle Defined Exceptions
- Using User Defined Exceptions
- Using Exception Keyword
- Raise_Application_Error
- Raise keyword
- Pragma Exceptions
- Exception Propagation
- Procedures
- Creating Procedures
- Nested Procedures
- Overloading Procedures
- Exception handling and propagation
- Functions
- Creating Functions
- Overloading Functions
- Nesting Functions and Procedures
- Packages
- Package Basics
- Package Specification
- Package Body
- Global constants
- Writing Stored Procedures and Functions in Packages
- Procedure Overloading
- Function Overloading
- Nesting of Functions & Procedures
- Exception Handling in packages
- Using Oracle Supplied Packages
- Triggers & Adv. Triggers
- Create, Replace, Drop
- Trigger Types
- Database Triggers
- DML Triggers
- INSTEAD OF Trigger
- SECURITY Triggers
- V Arrays
- Dynamic Array or V Array
- Oracle Pipes
- Oracle Table Function
- Bulk Operations Oveview
- etc
- Case Study / Project
- Introduction & Installation
- Introdution
- Installing Python
- Installing Pycharm
- Configurations
- Programming Basics
- Variables
- Data Types
- User Inputs
- Unpacking
- Boolean Practice
- What If, Else and If, Making Decisions
- For Loops
- Break Continue Pass
- Break Vs Continue Vs Pass
- Data Structures
- List
- Tuple
- Set
- Logic Building & Programming
- Pattern Programs
- Prime Number
- Fibonacci Sequence
- Factorial
- Recursion
- Swap 2 Variables
- Data Structures
- Linear Search
- Bubble Sort
- Functions
- Creating Functions
- Functions Arguments
- Type of Arguments
- Keyworded Variable Length Arguments
- Using Built in Functions
- Global Keywords
- Passing List to Functions
- Anonymous Functions / Lambda
- Filter / Map Reduce
- Decorators
- Modules
- OOPs Programming
- Modules
- Special variable _name_
- Class & Object
- _init_ method
- Constructor, Self and Comparing Objects
- Types of Variables
- Types of Method
- Inner Class
- Inheritance
- Constructor in Inheritance
- Introduction to Polymorphism
- Duck Typing Operators Overloading
- Method Overloading
- Method Overriding
- Iterator
- Generators
- Installation
- CRUD Operations (create, read, insert, update, delete)
- Groups
- Joins
- Views
- Sorting
- Connection to Database from Python
- Writing functions to handle database operations
- CRUD Operations in python
- Beautiful SOUP library
- Parsing HTML files
- Getting Data from Any Website
- Installing & Understanding Analytics Packages
- NumPy Array Operations
- Pandas Data Frame Operations
- Data Acquisition (Import & Export)
- Indexing
- Selection
- Sorting
- Filtering
- Group By
- Binning
- Concatenation
- Merge
- Append
- Drop
- Installing Matplotlib & Seaborne libraries
- Charts & Plots
- Histogram
- Scatter Plots
- Box Plots
- Line Chart
- Bar Chart
- Pie Chart etc.
- MongoDB & NoSQL
- What is MongoDB?
- Use of MongoDB
- Introduction to NOSQL
- Queries in MongoDB
- CRUD Operation in MongoDB
- MongoDB Compass in Reactjs
- How to connect MongoDB with NodeJs
- MongoDB create Database
- MongoDb Insert
- MongoDb Find
- MongoDb Sort
- MongoDb Delete
- MongoDb Update
- MongoDb Limit
- Introduction to Hadoop & Bigdata
- HDFS - Hadoop Distributed File System
- Comparing Hadoop & SQL
- Hadoop Architecture
- Map Reduce & HDFS
- Using the Hadoop single node image (Clone)
- HDFS
- HDFS Design & Concepts
- Blocks, Name nodes and Data nodes
- HDFS High-Availability and HDFS Federation
- Hadoop DFS The Command-Line Interface
- Basic File System Operations
- Anatomy of File Read & Write
- Block Placement Policy and Modes
- More detailed explanation about Configuration files
- Metadata, FS image, Edit log, Secondary Name Node and Safe Mode
- FSCK Utility. (Block report)
- HDFS Federation
- SQOOP
- Introduction
- Import Data
- Export data
- FLUME
- Introduction
- Flume Commands
- Map Reduce
- Functional Programming Basics
- Map and Reduce Basics
- Anatomy of a Map Reduce Job Run
- Architecture
- Job Completion, Failures
- Shuffling and Sorting
- Splits, Record reader, Partition, Types of partitions & Combiner
- Speculative Execution
- Types of Schedulers and Counters
- YARN
- Sequential Files and Map Files
- Hands on Word Counter in Map/Reduce in standalone and Pseudo distribution Mode
- Hive
- Installation
- Introduction and Architecture
- Hive Services, Hive Shell, Hive Server and Hive Web Interface (HWI)
- Meta store
- Hive QL
- Derby Database
- Working with Tables
- Primitive data types and complex data types
- Working with Partitions
- Hive Bucketed Tables and Sampling
- External partitioned tables
- Differences between ORDER BY, DISTRIBUTE BY and SORT BY
- Log Analysis on Hive
- Hands on Exercises
- NoSql Database
- Introduction
- Types
- Brief Of Nosql Database
- HBase
- HBase Installation
- HBase concepts
- HBase Data Model and Comparison between RDBMS and NOSQL
- Master & Region Servers
- HBase Operations (DDL and DML) through Shell and Programming and HBase Architecture
- Catalog Tables
- Block Cache and sharing
- SPLITS
- DATA Modeling
- HBASE Filters
- Bulk Loading and Coprocessors
- Real world use case consisting of HDFS, MR and HBASE
- SPARK
- Spark and its purpose
- Components of Spark
- Using Spark with Hadoop
- Resilient Distributed Dataset (RDD)
- Working with Key-Value Pairs
- Downloading and installing Spark Standalone
- Scala Overview
- SCALA
- Fundamental Of Scala
- Basic Syntax and Operators
- Programming with Spark
- SOLR
- Fundamental Of Solr
- Installation of Solr Standalone
- Basic Solr Concept
- Demo
- Best Practise
