Syllabus
Job Opportunity
Data Engineering Course
- Oracle Installation
- Basics
- Oracle Basics
- Database models
- ER Model Overview
- Data types
- Understanding Test Database
- Basics Queries
- Arithmetic and String functions
- DML Operations - Insert, Update and Delete
- DDL
- Tables - Create, Alter, Drop
- Indexes - Types, Create, Drop
- Constraints - Not Null, Primary Key, Unique Key, Foreign Key
- Sequence
- Synonyms
- Foreign Keys
- DML operations - Insert, Update & Delete
- Insert, Update, Delete & Truncate
- Common Operations
- Creating Tables using queries
- Bulk Data Inserts using Queries
- Writing Queries
- Filters
- DISTINCT
- BETWEEN
- IN
- LIKE
- NOT
- NULL
- AND, OR, NOT etc
- Using Complex Data Filtering Techniques
- Sorting
- Ascending Order
- Descending Order
- Complex Sorting
- Functions
- String Functions - lower case, uppercase, substring, instring, trim etc.
- Number Functions
- Date Manipulation
- Null Value Functions - NVL, NVL2, NULLIF, COALESCE
- Conditional Expressions - Case and Decode
- Groups
- Basics
- Grouping functions - AVG, MIN, MAX, COUNT, DISTINCT COUNT etc
- Grouping Filters - HAVING
- Rollups & Cubes
- Joins
- Cartesian Product
- Equi and Non-Equi Joins
- Left Outer Join
- Right Outer Join
- Full Outer Join
- Self Join
- Complex Queries - Joins & Groups Integration
- SET Operators
- Union
- Union All
- Intersect
- Minus
- Subquery
- Single Valued Row Sub Query
- Multi Valued Sub Query
- Views
- Inline Views
- ROWID & ROWNUM
- TOP N Analysis using Inline Views
- Transactions ( T SQL)
- Commit
- Rollback
- Savepoint
- DCL - Grant & Revoke
- Project
- PL SQL Basics
- Why PLSQL?
- Anonymous Blocks
- Data types, Variable, Composite Variables etc
- Progamming in PLSQL
- if..elsif..else block
- Control Structures
- for loop
- while loop
- loop...end loop
- PLSQL Programs
- Logic Building
- Basic Programs
- Pattern Programs
- Nested Blocks
- Using SQL in PLSQL Block
- Select
- CRUD
- Transactions etc
- Cursors & Adv. Cursors
- Implicit Cursors
- Explicit Cursors
- Cursor For Loops
- Cursor with parameters
- Reference Cursors
- Exception Handling
- Understanding Exception Handling
- Using Oracle Defined Exceptions
- Using User Defined Exceptions
- Using Exception Keyword
- Raise_Application_Error
- Raise keyword
- Pragma Exceptions
- Exception Propagation
- Procedures
- Creating Procedures
- Nested Procedures
- Overloading Procedures
- Exception handling and propagation
- Functions
- Creating Functions
- Overloading Functions
- Nesting Functions and Procedures
- Packages
- Package Basics
- Package Specification
- Package Body
- Global constants
- Writing Stored Procedures and Functions in Packages
- Procedure Overloading
- Function Overloading
- Nesting of Functions & Procedures
- Exception Handling in packages
- Using Oracle Supplied Packages
- Triggers & Adv. Triggers
- Create, Replace, Drop
- Trigger Types
- Database Triggers
- DML Triggers
- INSTEAD OF Trigger
- SECURITY Triggers
- V Arrays
- Dynamic Array or V Array
- Oracle Pipes
- Oracle Table Function
- Bulk Operations Oveview
- etc
- Case Study / Project
- Introduction to Python
- What is Python? Features & uses
- Python installation & IDE setup (VS Code, PyCharm, Jupyter, Anaconda)
- Running Python programs (script mode vs interactive mode)
- First program: print("Hello, World!")
- Python Basics
- Variables & Data Types (int, float, str, bool)
- Input/Output functions (print(), input())
- Comments & indentation
- Type conversion & type() function
- Operators
- Arithmetic operators (+, -, *, /, //, %, **)
- Comparison operators (==, !=, <, >, <=, >=)
- Logical operators (and, or, not)
- Assignment operators (+=, -=, etc.)
- Identity operators (is, is not)
- Membership operators (in, not in)
- Control Flow
- if, elif, else statements
- Nested conditions
- for and while loops
- break, continue, pass
- Data Structures
- Strings → indexing, slicing, methods
- Lists → create, access, update, iterate, list methods
- Tuples → immutable collections
- Sets → unique values, set operations (union, intersection)
- Dictionaries → key-value pairs, methods
- Functions
- Defining & calling functions
- Function arguments (positional, keyword, default, variable-length *args, **kwargs)
- Return values
- Lambda (anonymous functions)
- Scope (local vs global variables)
- Modules & Packages
- Importing built-in modules (math, random, datetime, os)
- Creating your own modules
- Installing external libraries with pip
- File Handling
- Opening & closing files
- Reading & writing (read(), write(), with open)
- Working with CSV and JSON files
- Exception Handling
- try, except blocks
- finally, else in exceptions
- Raising exceptions (raise)
- Custom exceptions
- Object-Oriented Programming (OOP)
- Classes & objects
- Constructors (__init__)
- Instance & class variables
- Methods (instance, class, static)
- Inheritance (single, multiple, multilevel)
- Method overriding
- Encapsulation & Abstraction
- Polymorphism
- Special methods (__str__, __len__, etc.)
- Advanced Python Concepts
- Iterators & Generators (iter(), next(), yield)
- Decorators (function decorators, @staticmethod, @classmethod)
- Regular Expressions (re module)
- Working with APIs
- Sending HTTP requests with requests
- JSON handling
- Database Connectivity
- Installation
- Basic CRUD Operations (create, read, insert, update, delete)
- MySQL with connectors
- Python for Automation
- Automating tasks (file renaming, web scraping with BeautifulSoup)
- Sending emails with Python (smtplib)
- Working with Excel (openpyxl, pandas)
- Python for Data Science
- NumPy → arrays, vectorized operations
- Pandas → DataFrames, Series, CSV/Excel handling
- Python for Data Visualization
- Installing Matplotlib (pip install matplotlib)
- Basic Plots: Line chart, Bar chart, Pie chart
- Statistical Plots: Histogram, Scatter plot, Box plot
- MongoDB & NoSQL
- What is MongoDB?
- Use of MongoDB
- Introduction to NOSQL
- Queries in MongoDB
- CRUD Operation in MongoDB
- MongoDB Compass in Reactjs
- How to connect MongoDB with NodeJs
- MongoDB create Database
- MongoDb Insert
- MongoDb Find
- MongoDb Sort
- MongoDb Delete
- MongoDb Update
- MongoDb Limit
- Introduction to Hadoop & Bigdata
- HDFS - Hadoop Distributed File System
- Comparing Hadoop & SQL
- Hadoop Architecture
- Map Reduce & HDFS
- Using the Hadoop single node image (Clone)
- HDFS
- HDFS Design & Concepts
- Blocks, Name nodes and Data nodes
- HDFS High-Availability and HDFS Federation
- Hadoop DFS The Command-Line Interface
- Basic File System Operations
- Anatomy of File Read & Write
- Block Placement Policy and Modes
- More detailed explanation about Configuration files
- Metadata, FS image, Edit log, Secondary Name Node and Safe Mode
- FSCK Utility. (Block report)
- HDFS Federation
- SQOOP
- Introduction
- Import Data
- Export data
- FLUME
- Introduction
- Flume Commands
- Map Reduce
- Functional Programming Basics
- Map and Reduce Basics
- Anatomy of a Map Reduce Job Run
- Architecture
- Job Completion, Failures
- Shuffling and Sorting
- Splits, Record reader, Partition, Types of partitions & Combiner
- Speculative Execution
- Types of Schedulers and Counters
- YARN
- Sequential Files and Map Files
- Hands on Word Counter in Map/Reduce in standalone and Pseudo distribution Mode
- Hive
- Installation
- Introduction and Architecture
- Hive Services, Hive Shell, Hive Server and Hive Web Interface (HWI)
- Meta store
- Hive QL
- Derby Database
- Working with Tables
- Primitive data types and complex data types
- Working with Partitions
- Hive Bucketed Tables and Sampling
- External partitioned tables
- Differences between ORDER BY, DISTRIBUTE BY and SORT BY
- Log Analysis on Hive
- Hands on Exercises
- NoSql Database
- Introduction
- Types
- Brief Of Nosql Database
- HBase
- HBase Installation
- HBase concepts
- HBase Data Model and Comparison between RDBMS and NOSQL
- Master & Region Servers
- HBase Operations (DDL and DML) through Shell and Programming and HBase Architecture
- Catalog Tables
- Block Cache and sharing
- SPLITS
- DATA Modeling
- HBASE Filters
- Bulk Loading and Coprocessors
- Real world use case consisting of HDFS, MR and HBASE
- SPARK
- Spark and its purpose
- Components of Spark
- Using Spark with Hadoop
- Resilient Distributed Dataset (RDD)
- Working with Key-Value Pairs
- Downloading and installing Spark Standalone
- Scala Overview
- SCALA
- Fundamental Of Scala
- Basic Syntax and Operators
- Programming with Spark
- SOLR
- Fundamental Of Solr
- Installation of Solr Standalone
- Basic Solr Concept
- Demo
- Best Practise
