Coding Deep Dives

Every topic rebuilt 3Blue1Brown-style: foundations from zero, the derivation in pictures, worked examples for every scenario, graded exercises, and concept-trap question banks.

480 topics · 2365 pages — more land as generation runs

1.1

How Computers Work

2 deep-dive topics

1.1.1Binary number system — conversions from - to decimal, counting in binary

D1 · Foundations D2 · Visual walkthrough D4 · Exercises

1.1.2Hexadecimal and octal — conversions, why they're used

D1 · Foundations

1.2

Introduction to Programming (Python)

29 deep-dive topics

1.2.11String indexing and slicing — `s[0]`, `s[-1]`, `s[2 - 5]`, `s[ - 2]`

D5 · Question bank

1.2.12String methods — upper, lower, strip, split, join, replace, find, format

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.13f-strings — embedding expressions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.14Input with `input()` — always returns string, conversion needed

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.15if - elif - else — syntax, indentation rules

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.16Nested conditionals

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.17while loop — condition-based, infinite loop dangers

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.18for loop — iterating over sequences

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.19`range()` — start, stop, step

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.20break, continue, pass — when and why

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.21Lists — creation, indexing, slicing, mutability

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.22List methods — append, insert, remove, pop, sort, reverse, count, index

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.23Tuples — immutability, use cases

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.24Dictionaries — key-value pairs, access, methods (keys, values, items, get, update)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.25Sets — unique elements, set operations (union, intersection, difference)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.26Nested data structures — list of dicts, dict of lists

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.27Functions — def, parameters, return, docstrings

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.28Default parameters, keyword arguments

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.29` - args` and ` - kwargs` — flexible argument passing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.30Variable scope — LEGB rule (Local, Enclosing, Global, Built-in)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.31global and nonlocal keywords

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.32Lambda functions — anonymous, used with map - filter

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.33Built-in functions — map, filter, zip, enumerate, sorted, reversed, min, max, sum, any, all

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.34List comprehensions — `[expr for x in iterable if condition]`

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.35Dictionary and set comprehensions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.36Generator expressions — memory efficiency

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.37Recursion — call stack visualization, base case, recursive case

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.38Classic recursion — factorial, Fibonacci, binary search

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.2.39Recursion depth limit — stack overflow

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3

Python Intermediate

12 deep-dive topics

1.3.1Modules — import, from…import, as aliasing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.2Standard library — math, random, os, sys, datetime, time, collections, itertools, functools

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.3File I - O — open modes (r, w, a, rb), read, readline, readlines, write

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.4Context managers — with statement, `__enter__` - `__exit__`

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.5Exception handling — try, except (specific), else, finally

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.6Raising exceptions — raise, custom exception classes

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.7Exception hierarchy

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.8Decorators — function decorators, @, wraps

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.9Generators — yield, generator functions, send(), next()

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.10Iterators — `__iter__`, `__next__`, StopIteration

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.11Regular expressions — re module, patterns, groups, findall, sub

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

1.3.12Virtual environments — venv, pip, requirements.txt

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1

OOP Fundamentals

16 deep-dive topics

2.1.1Class vs object — blueprint vs instance

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.2`__init__` constructor — initializing attributes

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.3Instance attributes vs class attributes

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.4Instance methods, class methods (`@classmethod`), static methods (`@staticmethod`)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.5`self` — what it is and how Python passes it

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.6Encapsulation — hiding internal state, name mangling (`__name`)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.7Properties — `@property`, `@setter`, `@deleter` for controlled access

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.8Inheritance — single inheritance, method resolution order (MRO)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.9`super()` — calling parent methods

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.10Multiple inheritance — Python's C3 linearization algorithm

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.11Method overriding — when and why

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.12Polymorphism — duck typing, same interface different behavior

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.13Abstract base classes — ABC module, `@abstractmethod`

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.14Operator overloading — dunder methods (`__add__`, `__eq__`, `__lt__`, `__len__`, `__str__`, `__repr__`, `__hash__`)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.15Composition — has-a relationship vs is-a

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.1.16Dataclasses — `@dataclass` decorator, `__post_init__`

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2

Design Principles

12 deep-dive topics

2.2.1DRY — Don't Repeat Yourself

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.2KISS — Keep It Simple

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.3YAGNI — You Aren't Gonna Need It

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.4SOLID — Single Responsibility Principle

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.5SOLID — Open - Closed Principle

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.6SOLID — Liskov Substitution Principle

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.7SOLID — Interface Segregation Principle

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.8SOLID — Dependency Inversion Principle

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.9Separation of concerns

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.10Design Patterns — Creational - Singleton, Factory Method, Abstract Factory, Builder, Prototype

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.11Design Patterns — Structural - Adapter, Bridge, Composite, Decorator, Facade, Flyweight, Proxy

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

2.2.12Design Patterns — Behavioral - Observer, Strategy, Command, Iterator, State, Template Method, Chain of Responsibility,

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1

Complexity Analysis

9 deep-dive topics

3.1.1Big-O notation — formal definition, mathematical

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.2Common complexities — O(1), O(log n), O(n), O(n log n), O(n²), O(n³), O(2ⁿ), O(n!)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.3Best, worst, average case — with examples

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.4Space complexity — auxiliary vs total

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.5Amortized analysis — aggregate, accounting, potential methods

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.6Tight bounds — Θ notation; lower bounds — Ω notation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.7Master theorem — solving recurrences T(n) = aT(n - b) + f(n)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.8Substitution method for recurrences

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.1.9Recursion tree method

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2

Linear Data Structures

9 deep-dive topics

3.2.1Array — static, dynamic; cache locality; amortized O(1) append

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.2Linked list — singly - node structure, traversal, insert head - tail - middle, delete

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.3Doubly linked list — bidirectional traversal

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.4Circular linked list — applications

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.5Stack — LIFO semantics, push - pop - peek, array and linked list implementations

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.6Stack applications — balanced parentheses, infix-to-postfix, function call stack

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.7Queue — FIFO semantics, enqueue - dequeue, circular array implementation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.8Deque (double-ended queue) — operations, use cases

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.2.9Priority Queue — concept (heap-based implementation covered later)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3

Hashing

10 deep-dive topics

3.3.1Hash function — properties - deterministic, uniform, fast

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.2Hash table — structure, open addressing vs chaining

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.3Chaining — linked lists in buckets, load factor, resizing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.4Open addressing — linear probing, quadratic probing, double hashing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.5Deletion in open addressing — tombstone markers

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.6Load factor — when to resize, rehashing cost

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.7Amortized O(1) operations

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.8Universal hashing — probabilistic guarantee

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.9Python dict and set internals

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.3.10Applications — frequency counting, two-sum problem, caching (LRU)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4

Trees

16 deep-dive topics

3.4.1Tree terminology — root, leaf, height, depth, degree, subtree

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.2Binary tree — structure, traversals - preorder, inorder, postorder (recursive and iterative)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.3Level-order traversal — BFS with queue

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.4Binary Search Tree (BST) — BST property, insert, search, delete (3 cases)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.5BST — inorder gives sorted order

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.6BST — worst case O(n) — motivation for balancing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.7AVL tree — balance factor, rotations (LL, RR, LR, RL), insert, delete

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.8Red-Black tree — properties, rotations + recoloring (conceptual understanding)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.9B-tree and B+ tree — motivation (disk storage), properties

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.10Heap — max-heap and min-heap properties

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.11Heapify — bottom-up O(n) build

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.12Heap operations — insert O(log n), extract-max - min O(log n), decrease-key

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.13Heap sort — in-place, O(n log n)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.14Trie (prefix tree) — insert, search, startsWith, applications (autocomplete, spell check)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.15Segment tree — build, range query, point update

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.4.16Fenwick tree (Binary Indexed Tree) — prefix sums, O(log n) update and query

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5

Graphs

17 deep-dive topics

3.5.1Graph definitions — directed, undirected, weighted, unweighted, simple, multigraph

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.2Representations — adjacency matrix (space O(V²)), adjacency list (space O(V+E))

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.3Incidence matrix

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.4BFS — algorithm, queue-based, O(V+E), shortest path in unweighted graphs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.5DFS — algorithm, stack - recursion, O(V+E), visited array

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.6DFS applications — cycle detection (directed and undirected)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.7Topological sort — DFS-based, Kahn's algorithm (BFS-based)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.8Strongly Connected Components (SCC) — Kosaraju's algorithm, Tarjan's algorithm

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.9Articulation points and bridges — Tarjan's low-link values

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.10Dijkstra's algorithm — greedy, priority queue, O((V+E) log V) — no negative edges

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.11Bellman-Ford algorithm — DP approach, negative cycles detection, O(VE)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.12Floyd-Warshall — all-pairs shortest paths, O(V³)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.13A - algorithm — heuristic, admissibility, consistency — important for GNC

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.14Minimum Spanning Tree — Kruskal's (Union-Find), Prim's (priority queue)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.15Disjoint Set Union (Union-Find) — path compression + union by rank → α(n)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.16Network flow — max-flow min-cut theorem, Ford-Fulkerson, Edmonds-Karp

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.5.17Bipartite graphs — 2-coloring test, bipartite matching — Hopcroft-Karp

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6

Sorting & Searching

11 deep-dive topics

3.6.1Bubble sort, selection sort, insertion sort — O(n²), when insertion sort wins

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.2Merge sort — divide and conquer, O(n log n), stable, proof of correctness

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.3Quick sort — Lomuto - Hoare partition, pivot strategies, expected O(n log n), worst case

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.4Quick sort randomization — expected O(n log n)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.5Heap sort — O(n log n), in-place, not stable

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.6Counting sort — O(n + k), integer keys only

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.7Radix sort — LSD, MSD; O(d(n+k))

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.8Bucket sort — uniform distributions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.9Lower bound for comparison sorts — Ω(n log n) proof via decision trees

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.10Linear time selection — median of medians algorithm

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.6.11Binary search — iterative, recursive; O(log n); searching in sorted - rotated arrays

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7

Algorithm Paradigms

20 deep-dive topics

3.7.1Brute force — exhaustive search, when acceptable

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.2Divide and conquer — template, correctness, recurrence

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.3Greedy — exchange argument proof technique

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.4Greedy problems — activity selection, fractional knapsack, Huffman coding (full algorithm)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.5When greedy fails — 0 - 1 knapsack counter-example

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.6Dynamic programming — overlapping subproblems, optimal substructure

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.7Memoization (top-down DP) — recursive + memo dict

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.8Tabulation (bottom-up DP) — iterative

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.9DP problems — Fibonacci, coin change (count + min), 0 - 1 knapsack

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.10DP problems — Longest Common Subsequence (LCS)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.11DP problems — Longest Increasing Subsequence (LIS) — O(n²) and O(n log n)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.12DP problems — edit distance (Levenshtein)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.13DP problems — matrix chain multiplication

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.14DP problems — rod cutting, egg drop, DP on trees

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.15Bitmask DP — TSP intro

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.16Backtracking — state-space tree, pruning

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.17Backtracking problems — N-Queens, Sudoku solver, all permutations - subsets

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.18Branch and bound

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.19Randomized algorithms — Las Vegas, Monte Carlo

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.7.20Bit manipulation — XOR tricks, LSB, counting set bits

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8

String Algorithms

9 deep-dive topics

3.8.1Naive pattern matching — O(nm)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.2KMP algorithm — failure function, O(n+m) — full derivation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.3Rabin-Karp — rolling hash, O(n+m) expected

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.4Z-algorithm — Z-array construction, O(n+m)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.5Boyer-Moore — bad character, good suffix heuristics

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.6Aho-Corasick — multiple pattern search, automaton

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.7Suffix array — construction O(n log n), LCP array

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.8Suffix tree (conceptual)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

3.8.9Palindrome algorithms — Manacher's algorithm

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1

Computer Architecture (Deep)

27 deep-dive topics

4.1.1Von Neumann architecture — components, bottleneck

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.2Harvard architecture — separate instruction - data memory

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.3ISA (Instruction Set Architecture) — RISC vs CISC

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.4ARM architecture intro — used in embedded - aerospace

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.5Registers — general purpose, special (PC, SP, LR, CPSR)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.6ALU — operations, flags (zero, carry, overflow, negative)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.7Instruction formats — R-type, I-type, J-type (MIPS - RISC-V)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.8Memory addressing modes — immediate, register, direct, indirect, indexed

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.9Cache organization — direct-mapped, n-way set associative, fully associative

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.10Cache lines, tags, index, offset

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.11Replacement policies — LRU, LFU, FIFO, Random

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.12Write policies — write-through, write-back, write-allocate

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.13Cache coherence — MESI protocol in multicore

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.14Virtual memory — concept, page table, virtual-to-physical translation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.15TLB — structure, TLB miss handling

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.16Page replacement — FIFO, LRU, Clock, Optimal

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.17Working set model, thrashing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.18Pipelining — 5-stage pipeline, each stage

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.19Pipeline hazards — structural, data (RAW - WAR - WAW), control

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.20Hazard mitigation — stalling, forwarding - bypassing, branch prediction

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.21Branch prediction — static, dynamic (2-bit predictor, BTB)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.22Out-of-order execution — Tomasulo algorithm (conceptual)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.23Superscalar — multiple execution units

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.24SIMD — vector instructions, SSE - AVX

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.25GPU architecture — SIMT, warps, CUDA model

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.26Memory models — sequential consistency, TSO, relaxed

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.1.27Multicore coherence protocols

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2

Operating Systems

20 deep-dive topics

4.2.1OS roles — resource management, hardware abstraction, protection

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.2OS structure — monolithic, microkernel, hybrid

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.3System calls — user mode vs kernel mode, trap mechanism

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.4Processes — PCB, states (new - ready - running - blocked - terminated)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.5Process creation — fork(), exec(), wait(), exit()

D1 · Foundations

4.2.21Deadlock avoidance — Banker's algorithm

D5 · Question bank

4.2.22Deadlock detection and recovery

D5 · Question bank

4.2.23Memory allocation — contiguous (first-fit, best-fit, worst-fit)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D5 · Question bank

4.2.24Fragmentation — internal vs external, compaction

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises

4.2.26Multi-level page tables — why, overhead

D5 · Question bank

4.2.32File operations — open, read, write, seek, close

D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.33Directory structure — tree, DAG (hard links, symbolic links)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.34File allocation — contiguous, linked, indexed (inode)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.35ext4 structure — superblock, block groups, inodes

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.36Journaling — why, how it works

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.37I - O management — polling, interrupt-driven, DMA

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.38Disk scheduling — FCFS, SCAN, C-SCAN, LOOK

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.39RAID — levels 0, 1, 5, 6, 10 — trade-offs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.40Virtualization — type 1 and type 2 hypervisors

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.2.41Containers — namespaces, cgroups, difference from VMs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3

Computer Networks

31 deep-dive topics

4.3.1OSI model — 7 layers, responsibilities, PDU names

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.2TCP - IP model — 4 layers, mapping to OSI

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.3Physical layer — encoding (NRZ, Manchester), bandwidth, Nyquist, Shannon-Hartley

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.4Data link layer — framing, error detection (CRC computation), MAC

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.5Ethernet (IEEE 802.3) — CSMA - CD, frame format

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.6Wi-Fi (IEEE 802.11) — CSMA - CA, bands

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.7Switching — circuit, packet, virtual circuit

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.8IPv4 — address format, classes, subnetting, CIDR notation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.9Subnetting — subnet mask, network - host bits, VLSM

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.10NAT — why, how, types (SNAT, DNAT, PAT)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.11IPv6 — address format, why needed, key differences

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.12ARP — address resolution, ARP cache, gratuitous ARP

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.13Routing — forwarding table, routing table

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.14Static routing vs dynamic routing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.15Distance vector routing — RIP, Bellman-Ford, count-to-infinity

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.16Link state routing — OSPF, Dijkstra

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.17BGP — path vector, AS, policy routing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.18UDP — header, use cases, checksum

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.19TCP — header, connection (3-way handshake, 4-way termination)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.20TCP reliability — seq - ack numbers, retransmission, cumulative ACK

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.21TCP flow control — sliding window, receive buffer

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.22TCP congestion control — slow start, congestion avoidance, fast retransmit, CUBIC

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.23DNS — recursive vs iterative query, hierarchy, record types (A, AAAA, CNAME, MX, NS)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.24HTTP - 1.1 — methods, status codes, headers, persistent connections

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.25HTTP - 2 — multiplexing, header compression (HPACK), server push

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.26HTTP - 3 — QUIC, UDP-based, why

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.27HTTPS — TLS handshake, certificates, CA

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.28Socket programming — TCP server - client, UDP server - client in Python

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.29Firewalls — stateless vs stateful packet filtering

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.30NAT traversal, VPN, tunneling

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.3.31Network security — DDoS, man-in-the-middle, replay attacks, countermeasures

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4

Databases

28 deep-dive topics

4.4.1Relational model — tables, rows, columns, NULL

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.2Keys — primary, candidate, super, foreign, natural vs surrogate

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.3SQL DDL — CREATE, ALTER, DROP, TRUNCATE

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.4SQL DML — SELECT, INSERT, UPDATE, DELETE

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.5SQL clauses — WHERE, GROUP BY, HAVING, ORDER BY, LIMIT

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.6Joins — INNER, LEFT, RIGHT, FULL OUTER, CROSS, SELF

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.7Subqueries — correlated vs uncorrelated

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.8Aggregate functions — COUNT, SUM, AVG, MIN, MAX

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.9Window functions — ROW_NUMBER, RANK, DENSE_RANK, LAG, LEAD

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.10CTEs (WITH clause) — recursive CTEs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.11Views — creating, updatable views

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.12Stored procedures, triggers, functions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.13Indexing — B-tree index, hash index, full-text

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.14Composite indexes, covering indexes

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.15EXPLAIN — reading query plans, cost estimation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.16Transactions — ACID properties (each one in detail)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.17Transaction isolation levels — READ UNCOMMITTED, READ COMMITTED, REPEATABLE READ, SERIALIZABLE

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.18Concurrency anomalies — dirty read, non-repeatable read, phantom read

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.19Locking — shared, exclusive, intent locks

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.20Optimistic vs pessimistic concurrency control

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.21Normalization — 1NF, 2NF, 3NF, BCNF — anomalies each resolves

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.22Denormalization — when and why

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.23ER diagrams — entities, attributes, relationships, cardinality

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.24NoSQL — document (MongoDB), key-value (Redis), column (Cassandra), graph (Neo4j)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.25CAP theorem — consistency, availability, partition tolerance

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.26BASE vs ACID

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.27Distributed databases — sharding strategies, replication

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.4.28MVCC — multi-version concurrency control

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5

Software Engineering

24 deep-dive topics

4.5.1SDLC — waterfall, V-model, iterative, agile

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.2Agile — Scrum (sprints, roles, ceremonies), Kanban

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.3Requirements — functional vs non-functional, user stories, acceptance criteria

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.4UML — use case, class, sequence, activity, state machine, component diagrams

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.5Software architecture — layered, MVC, event-driven, microservices, serverless

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.6REST API design — resources, HTTP methods, status codes, versioning, pagination

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.7Git internals — objects (blob, tree, commit, tag), DAG structure

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.8Git operations — branch, merge, rebase, cherry-pick, stash, bisect

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.9Git workflows — Gitflow, trunk-based development

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.10CI - CD — pipeline stages, GitHub Actions - GitLab CI concepts

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.11Docker — images, containers, Dockerfile, docker-compose

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.12Kubernetes — pods, deployments, services, ingress (concepts)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.13Testing — unit, integration, system, acceptance, smoke, regression

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.14TDD — Red-Green-Refactor cycle

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.15Code coverage — line, branch, path coverage

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.16Mutation testing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.17Property-based testing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.18Code review — what to look for

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.19Refactoring — code smells, common refactorings (extract method, rename, etc.)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.20Technical debt — types, managing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.21Documentation — inline comments, docstrings, README, ADRs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.22Logging and monitoring — structured logging, metrics, alerting

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.23Security — OWASP Top 10, input validation, authentication vs authorization

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.5.24Performance profiling — CPU, memory, I - O profiling

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6

Theory of Computation

29 deep-dive topics

4.6.1Alphabet, string, language — formal definitions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.2Finite automata — DFA - formal definition (5-tuple), state diagrams

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.3NFA — formal definition, epsilon transitions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.4NFA to DFA conversion — subset construction

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.5Regular expressions — equivalence with finite automata

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.6Regular languages — closed under union, intersection, complement, concatenation, Kleene star

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.7Pumping lemma for regular languages — proof and using to show non-regularity

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.8Context-free grammars (CFG) — productions, derivations, parse trees

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.9Chomsky Normal Form (CNF) — conversion

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.10Pushdown automata (PDA) — configuration, acceptance by empty stack - final state

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.11Equivalence of CFGs and PDAs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.12Pumping lemma for CFLs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.13Turing machines — formal definition, computation, configurations

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.14Variants — multi-tape TM, non-deterministic TM, all equivalent

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.15Church-Turing thesis

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.16Universal Turing machine

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.17Decidability — decidable (recursive) and recognizable (recursively enumerable) languages

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.18Halting problem — undecidability proof by diagonalization

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.19Reducibility — many-one reductions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.20Rice's theorem

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.21Complexity — DTIME, DSPACE, complexity classes

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.22P — polynomial time

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.23NP — non-deterministic polynomial, verifier definition

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.24P vs NP — statement, why it matters

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.25NP-completeness — Cook's theorem (SAT is NP-complete), reduction

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.26NP-complete problems — 3-SAT, Vertex Cover, Clique, Hamiltonian Path, TSP, Subset Sum

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.27NP-hard — harder than NP, may not be in NP

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.28PSPACE — Quantified Boolean Formula

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

4.6.29Approximation algorithms — approximation ratio, examples

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1

C Programming

33 deep-dive topics

5.1.1C compilation — preprocessor, compiler, assembler, linker

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.2Data types — char, short, int, long, float, double, size_t

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.3Type sizes — sizeof, platform dependency, stdint.h (int32_t etc.)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.4Operators — arithmetic, relational, logical, bitwise, assignment, comma

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.5Operator precedence — full table

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.6Control flow — if - else, switch, while, do-while, for, break, continue, goto

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.7Functions — declaration vs definition, prototypes, call by value

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.8Pointers — declaration, dereferencing ( - ), address-of (&)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.9Pointer arithmetic — adding integers to pointers

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.10Arrays and pointers — array name decays to pointer

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.11Multi-dimensional arrays

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.12Pointer to pointer

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.13Function pointers — declaration, calling, use in callbacks

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.14Dynamic memory — malloc, calloc, realloc, free

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.15Memory layout — text, data, BSS, heap, stack segments

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.16Stack frames — how function calls work at the memory level

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.17Heap fragmentation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.18Common memory errors — null dereference, buffer overflow, use-after-free, double free, memory leak

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.19Valgrind — detecting memory errors

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.20String handling — char arrays, null terminator, strcpy, strcat, strlen, sprintf (dangers)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.21Safe alternatives — strncpy, snprintf, strlcpy

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.22Structures — declaration, accessing members (. and - - )

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.23Bit fields in structs

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.24Unions — overlapping memory

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.25Enumerations

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.27Preprocessor directives — #define, #ifdef, #ifndef, #include guards

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.28Macros vs inline functions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.29Variadic functions — va_list, va_start, va_arg, va_end

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.30Undefined behavior — comprehensive list, why to avoid

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.31Compile-time assertions — static_assert

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.32restrict keyword — aliasing hint

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.1.33volatile keyword — preventing optimization of hardware registers

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2

C++ Programming

32 deep-dive topics

5.2.1C++ as superset of C — key additions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.2References — lvalue references, difference from pointers

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.3const correctness — const variables, const pointers, const member functions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.4Namespaces — avoiding name collisions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.5Classes — member functions, access specifiers (public, private, protected)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.6Constructors — default, parameterized, copy, delegating

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.7Destructor — RAII principle

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.8Copy constructor and copy assignment — Rule of Three

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.9Move semantics — rvalue references (&&), std - move, std - forward

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.10Move constructor and move assignment — Rule of Five

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.11Rule of Zero — prefer compiler-generated specials

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.12Smart pointers — unique_ptr (sole ownership), shared_ptr (shared ownership, ref count), weak_ptr (break cycles)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.13RAII — resource acquisition is initialization — why it's the key idiom

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.14Templates — function templates, class templates

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.15Template specialization — full and partial

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.16Variadic templates — parameter packs, fold expressions

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.17SFINAE — substitution failure is not an error

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.18Concepts (C++20) — constraining templates

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.19STL containers — vector, list, deque, array, set, multiset, map, multimap, unordered_map, unordered_set

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.20STL algorithms — sort, find, transform, accumulate, copy, all_of, any_of

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.21Iterators — input, output, forward, bidirectional, random access, contiguous

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.22Lambda expressions — capture list (by value, by reference)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.23std - function and std - bind

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.24Concurrency — std - thread, std - mutex, std - lock_guard, std - unique_lock

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.25std - condition_variable

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.26std - atomic — lock-free operations

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.27Memory model — happens-before, acquire-release semantics

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.28std - promise and std - future

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.29Exception safety — basic, strong, no-throw guarantees

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.30noexcept specifier

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.31Inline namespaces, anonymous namespaces

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.2.32Modules (C++20) — concept and syntax

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3

Build Systems & Toolchain

17 deep-dive topics

5.3.1Compilation stages — preprocessing, compilation, assembly, linking

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.2Object files — .o - .obj, symbol table, relocation entries

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.3Static libraries — .a - .lib, creation and linking

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.4Dynamic - shared libraries — .so - .dll, dynamic linking, PIC

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.5Symbol resolution — order matters

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.6Makefiles — targets, prerequisites, recipes, variables, automatic variables

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.7Phony targets, pattern rules, implicit rules

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.8CMake — CMakeLists.txt, add_executable, add_library, target_link_libraries

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.9CMake build types — Debug, Release, RelWithDebInfo

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.10Cross-compilation — toolchains, sysroot

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.11GCC - Clang flags — optimization (-O0 to -O3, -Os), warnings (-Wall, -Wextra), sanitizers

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.12Address Sanitizer (ASan) — detecting buffer overflows at runtime

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.13Undefined Behavior Sanitizer (UBSan)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.14Thread Sanitizer (TSan)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.15GDB debugging — breakpoints, watchpoints, step, next, backtrace

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.3.16Profiling — gprof, perf, Valgrind - Callgrind

D1 · Foundations D2 · Visual walkthrough D4 · Exercises D5 · Question bank

5.3.17Disassembly — objdump, reading assembly

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D5 · Question bank

5.4

Scientific Computing (Python)

25 deep-dive topics

5.4.1NumPy — ndarray structure, dtype, shape, strides

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.2Array creation — np.zeros, np.ones, np.linspace, np.arange, np.random

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.3Indexing and slicing — basic, boolean masking, fancy indexing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.4Broadcasting — rules, why it works, gotchas

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.5Vectorization — avoiding Python loops, speed comparison

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.6NumPy linear algebra — np.linalg.solve, eig, svd, norm, det

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.7NumPy FFT — np.fft module

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.8SciPy — overview of submodules

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.9scipy.integrate — odeint, solve_ivp (RK45, DOP853), quad

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.10scipy.optimize — minimize, fsolve, curve_fit, linprog

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.11scipy.linalg — more stable than numpy.linalg, lu, qr, schur

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.12scipy.signal — filtering, convolution, FFT-based analysis

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.13scipy.sparse — sparse matrix formats (CSR, CSC), sparse solvers

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.14scipy.stats — distributions, hypothesis tests

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.15Matplotlib — figure - axes architecture

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.162D plots — line, scatter, bar, histogram, contour, imshow

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.173D plots — surface, wireframe

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.18Animation — FuncAnimation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.19Publication-quality figures — LaTeX labels, colormaps, DPI

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.20SymPy — symbolic algebra, calculus, ODE solving

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.21Pandas — Series, DataFrame, indexing, groupby, merge, pivot

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.22Floating point gotchas — catastrophic cancellation, associativity failure

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.23Implementing ODE solvers from scratch — Euler, RK4

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.24Implementing numerical integration from scratch — trapezoidal, Simpson's

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.4.25Implementing root-finding from scratch — Newton-Raphson, bisection

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5

Embedded Systems & Real-Time Software

28 deep-dive topics

5.5.1Microcontroller architecture — ARM Cortex-M series (M0, M3, M4, M7)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.2GPIO — input - output, pull-up - pull-down, interrupt on pin change

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.3Timers — PWM generation, input capture, output compare

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.4ADC - DAC — resolution, sampling rate, Nyquist

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.5Communication interfaces — UART, SPI, I2C (master - slave), CAN bus

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.6CAN bus — frame format, arbitration, error handling — critical in aerospace

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.7Interrupts — ISR design, NVIC priority, interrupt latency

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.8DMA — memory-to-memory, peripheral-to-memory without CPU

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.9RTOS concepts — task, scheduler, preemption, context switch

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.10FreeRTOS — task creation, priorities, xTaskCreate

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.11FreeRTOS IPC — queues, semaphores, mutexes, event groups

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.12Real-time constraints — hard and soft deadlines

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.13WCET (Worst Case Execution Time) analysis

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.14Priority inversion — problem and solutions (priority inheritance, priority ceiling)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.15Bare-metal vs RTOS — when to use each

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.16Startup code — vector table, reset handler, stack initialization

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.17Linker scripts — memory regions, sections (.text, .data, .bss)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.18Safety-critical standards — DO-178C (airborne software), IEC 61508, ISO 26262

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.19MISRA C — rules for safety-critical C code

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.20Software testing in embedded — unit tests on host, HIL testing

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.21Hardware-in-the-Loop (HIL) simulation — real hardware, simulated plant

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.22Software-in-the-Loop (SIL) simulation — all software, simulated hardware

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.23Watchdog timers — purpose, feeding, types

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.24Memory protection units (MPU) — preventing stack overflow, access faults

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.25Redundancy — TMR (triple modular redundancy), voting logic

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.26Fault tolerance — fail-safe vs fail-operational

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.27SpaceWire — high-speed serial link standard for spacecraft

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.5.28MIL-STD-1553 — military avionics bus

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6

Machine Learning (Aerospace Applications)

14 deep-dive topics

5.6.1Linear regression — normal equation, gradient descent derivation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.2Logistic regression — sigmoid, cross-entropy loss

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.3Regularization — L1 (lasso), L2 (ridge), dropout

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.4Bias-variance trade-off

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.5Cross-validation — k-fold

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.6Neural network fundamentals — neuron, activation functions (ReLU, sigmoid, tanh)

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.7Feedforward network — forward pass

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.8Backpropagation — chain rule, gradient computation

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.9Optimization — SGD, momentum, Adam — derivations

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.10Batch, mini-batch, stochastic gradient descent

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.11Convolutional neural networks — convolution operation, pooling

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank

5.6.12Recurrent neural networks — hidden state, BPTT

D1 · Foundations D2 · Visual walkthrough D3 · Worked examples D5 · Question bank

5.6.13LSTM — gates, cell state

D1 · Foundations D2 · Visual walkthrough D4 · Exercises

5.6.14Transformers — attention mechanism, self-attention

D2 · Visual walkthrough D3 · Worked examples D4 · Exercises D5 · Question bank