ZERO → HERO · THE COMPLETE DISCIPLINE
Robotics
Mastery
From coordinate frames and rigid-body transforms to deploying a real autonomous person-following robot — taught through FollowBot, a complete mobile manipulator you build, tune, and harden across all six stages. Failure modes before happy paths; mechanisms over incantations.
6Stages
56Lessons
56Widgets
FollowBotthread
1
Foundations: Sense, Think, Act, and Compute
9 lessons
Before any algorithm runs, a robot must be defined — as a sense-think-act loop, as a collection of rigid bodies with coordinate frames, as a ROS 2 computation graph, and as a set of imperfect sensors and actuators. This stage installs four non-negotiable mental models: the closed-loop embodied agent, the SE(3) transform as the grammar of robotics, the ROS 2 communication architecture, and sensor noise as the central engineering problem.
FollowBot milestone: FollowBot's full system architecture is defined: URDF built from scratch with correct inertial parameters, TF tree complete (map → odom → base_link → laser → camera), sensor topics publishing simulated data in Gazebo, first custom ROS 2 node running, requirements specification constraining all downstream design decisions.
2
Kinematics and Velocity: The Geometry of Motion
9 lessons
Kinematics answers the question: given joint angles or wheel velocities, where does the robot end up, and how fast does it move? This stage establishes the two kinematic models FollowBot depends on: the differential-drive mobile base and the serial manipulator arm. The Jacobian is introduced as the spine of the course — connecting configuration space to task space, velocity to force, and singularities to catastrophic failure.
FollowBot milestone: Diff-drive kinematic model implemented in Python/ROS 2: forward model (wheel velocities → robot velocity), inverse model (desired cmd_vel → wheel commands), odometry integration producing /odom. Arm FK and Jacobian derived from DH parameters; singularity monitor live; workspace visualization showing FollowBot's reachable space.
✓LESSON 2.1
Differential Drive Kinematics: FollowBot's Motion Model
The differential-drive model is elegant in theory and wrong in practice — knowing exactly how and why…
✓LESSON 2.2
Wheel Odometry: Integration, Drift, and Dead Reckoning
Odometry is always wrong — the question is how wrong, how fast, and whether your estimator accounts…
✓LESSON 2.3
Forward Kinematics and Denavit-Hartenberg Parameters
DH parameters are a compact notation — but they hide enough subtleties that a single sign error silently…
✓LESSON 2.4
The Jacobian: Velocity Kinematics and the Spine of Robotics
The Jacobian is not just 'the matrix of partial derivatives' — it is the object that connects geometry…
✓LESSON 2.5
Singularity Analysis and Manipulability
Singularities are not edge cases — every arm has them and any controller that ignores them will eventually…
✓LESSON 2.6
Inverse Kinematics: Closed-Form and Numerical Methods
IK has no general closed form — and the numerical methods that substitute for it are local, fragile,…
✓LESSON 2.7
Velocity Control in Practice: cmd_vel to Wheel Commands
Publishing cmd_vel is not controlling a robot — understanding the inner velocity control loop is what…
✓LESSON 2.8
Trajectory Parameterization: Profiles, Splines, and Jerk
A trajectory that ignores jerk limits will make the robot vibrate, excite resonances, and shake sensors…
✓LESSON 2.9
Mobile Manipulator Kinematics: When FollowBot Reaches Out
Stacking a mobile base and an arm creates redundancy — and redundancy without a null-space policy creates…
3
Dynamics and Control: Making Things Move Right
9 lessons
Kinematics tells you where the robot is; dynamics tells you how to make it go there. This stage derives the equation of motion from both Newton-Euler and Lagrangian formulations, then builds controllers in pedagogical order: stability first, then transient performance, then optimality. PID is derived from its Laplace transform. LQR is built from the Riccati equation. The sim-to-real gap between the dynamic model and real hardware is introduced here — not deferred to Stage 6.
FollowBot milestone: Full dynamics model for FollowBot's arm derived; PID velocity controller tuned to a quantitative settling-time spec using Ziegler-Nichols then refined via root locus; feedforward from inverse dynamics reducing tracking error; figure-eight trajectory tracked with measured cross-track error below spec.
4
State Estimation: Knowing Where You Are
9 lessons
State estimation is the bridge between noisy sensors and confident beliefs. A robot that does not know where it is cannot plan. This stage derives the Bayes filter from first principles, builds the Kalman filter as the MMSE solution for linear Gaussian systems, extends to the EKF for nonlinear systems, and introduces the particle filter for multimodal beliefs. Filter consistency tested via NEES and NIS is taught as a mandatory engineering practice.
FollowBot milestone: Full EKF operational on FollowBot: state vector [x, y, theta, v, omega], fusing wheel odometry + IMU + LIDAR scan-matching updates. Filter consistency validated with NEES test on recorded data. Robot localizes in a known map with position error below 0.1 m RMS. Sensor dropout behavior characterized and documented.
5
Perception and SLAM: Seeing and Mapping
10 lessons
Perception transforms raw sensor data into the structured representations that estimation, planning, and control can use. This stage starts with the geometric foundation of cameras, moves through LIDAR point-cloud processing, covers object detection and tracking for person-following, and culminates in SLAM. Every algorithm is taught with its failure mode as co-equal to its nominal behavior.
FollowBot milestone: Camera intrinsics calibrated (reprojection error < 0.5 px); LIDAR-camera extrinsic calibrated with validated residual metric; YOLOv8 person detection integrated in ROS 2; LIDAR cluster + camera bbox fusion producing stable 3D person position at 10 Hz; SLAM Toolbox building an occupancy map of the test environment; occupancy grid inflated and ready for navigation.
6
Planning, Navigation, and Deployment
10 lessons
Planning answers the question: given that the robot knows where it is and what it sees, how does it decide what to do? This final stage covers configuration space, global and local planners, the Nav2 stack, behavior trees, and the sim-to-real gap as a continuous thread. Sim-to-real failures are introduced by category and diagnosed systematically. The stage ends with a full-system capstone.
FollowBot milestone: Full Nav2 stack configured: A* global planner on SLAM map, DWA local planner with FollowBot's dynamic constraints, costmap with LIDAR obstacle layer and inflation. Behavior tree orchestrating: detect person → navigate to tracked goal → maintain following distance → handle occlusion → recover. Sim-to-real checklist signed off. Capstone: documented system architecture with honest assessment of each subsystem's real-world performance vs. simulation.
✓LESSON 6.1
Configuration Space: The Correct Abstraction for Planning
Every planner operates in configuration space whether you know it or not — misunderstanding C-space produces…
✓LESSON 6.2
Graph Search: A*, Heuristics, and Costmap Planning
A* is only as good as its heuristic — an inadmissible heuristic produces fast plans that are not optimal…
✓LESSON 6.3
Sampling-Based Planning: RRT and RRT*
RRT finds a feasible path fast but the path is usually ugly — RRT* fixes this asymptotically, and both…
✓LESSON 6.4
Local Planners: DWA, TEB, and Real-Time Obstacle Avoidance
The local planner is where theory meets friction — DWA samples velocity space and TEB optimizes an elastic…
✓LESSON 6.5
The Nav2 Stack: Architecture, Lifecycle Nodes, and Failure Modes
Nav2 is an ecosystem of composable plugins — treat it as a black box and you will tune parameters blindly…
✓LESSON 6.6
Behavior Trees: Architecture, Ticks, and Reactive Mission Management
A bad state machine cannot recover from unexpected events — a behavior tree can, but only if you design…
✓LESSON 6.7
The Sim-to-Real Gap: Taxonomy, Root Causes, and Honest Mitigations
The sim-to-real gap has four distinct failure classes — conflating them leads to applying the wrong…
✓LESSON 6.8
Hardware Bring-Up, Calibration, and Field Diagnostics
Hardware bring-up without a protocol is gambling — a systematic sequence (power → comms → sensors →…
✓LESSON 6.9
Safety Architecture: Watchdogs, E-Stops, and Speed Governors
Safety is not a feature you add at the end — a robot that cannot fail safely is not safe, regardless…
✓LESSON 6.10
Capstone: FollowBot Complete — Architecture, Gaps, and What Comes Next
The gap between a robot that works in the lab and one that can be trusted in the field is not an algorithm…
🎓
Certificate
Finish all 56 lessons to unlock
Complete every lesson across all six stages — from coordinate frames to full-system deployment — and claim your personalized certificate of completion. FollowBot's journey, your credentials.
📚
Sources & Further Reading
Canonical works behind this course
These are the real, canonical works behind this course — go deeper here. References are grouped by the stage they most directly underpin.
Foundations — Rigid-Body Geometry, ROS 2, and Sensors
- Bruno Siciliano, Lorenzo Sciavicco, Luigi Villani, Giuseppe Oriolo. Robotics: Modelling, Planning and Control. 2009. Springer. — Authoritative treatment of SE(3) transforms, kinematics, and dynamics for serial manipulators.
- Open Robotics. ROS 2 Documentation. Ongoing. ros.org. — Official reference for DDS middleware, nodes, topics, services, actions, QoS, and TF2.
- Steven M. LaValle. Planning Algorithms. 2006. Cambridge University Press. — Foundational coverage of configuration space, C-obstacles, and the geometry underpinning all path planners.
- Joan Sola, Jeremie Deray, Dinesh Atchuthan. A Micro Lie Theory for State Estimation in Robotics. 2018. arXiv:1812.01537. — Rigorous yet accessible treatment of SO(3) and SE(3) for practitioners implementing estimators and controllers.
Kinematics — Forward, Inverse, and the Jacobian
- John J. Craig. Introduction to Robotics: Mechanics and Control. 3rd ed., 2005. Pearson. — Classic derivation of DH parameters, forward kinematics, and manipulator workspace.
- Mark W. Spong, Seth Hutchinson, M. Vidyasagar. Robot Modeling and Control. 2006. Wiley. — Companion to Craig covering Jacobian derivation, manipulability, and velocity kinematics with worked examples.
- Ilya Kolmanovsky, N. H. McClamroch. "Developments in Nonholonomic Control Problems." IEEE Control Systems Magazine, 15(6), 1995. — Seminal paper on non-holonomic constraints including differential-drive models.
Dynamics and Control — PID, LQR, MPC
- Gene F. Franklin, J. David Powell, Abbas Emami-Naeini. Feedback Control of Dynamic Systems. 8th ed., 2019. Pearson. — Definitive undergraduate reference for PID, root locus, Bode plots, and stability margins.
- Jan Maciejowski. Predictive Control with Constraints. 2002. Pearson/Prentice Hall. — Foundational textbook for model predictive control with a focus on constraint handling.
- Jean-Jacques Slotine, Weiping Li. Applied Nonlinear Control. 1991. Prentice Hall. — Lyapunov stability, sliding mode, and computed-torque control; the standard graduate reference for nonlinear robot control.
State Estimation — Bayes, Kalman, EKF, Particle Filters
- Sebastian Thrun, Wolfram Burgard, Dieter Fox. Probabilistic Robotics. 2005. MIT Press. — The definitive robotics reference for Bayes filters, Kalman filters, EKF, particle filters, and occupancy grids.
- Rudolph E. Kalman. "A New Approach to Linear Filtering and Prediction Problems." Journal of Basic Engineering, 82(1), 1960. — The original Kalman filter paper; still the clearest statement of the MMSE derivation.
- Simon J. Julier, Jeffrey K. Uhlmann. "A New Extension of the Kalman Filter to Nonlinear Systems." Proc. SPIE 3068 (AeroSense), 1997. — Original UKF paper introducing sigma-point propagation as an alternative to EKF linearization.
- Timothy D. Barfoot. State Estimation for Robotics. 2nd ed., 2024. Cambridge University Press. — Modern graduate text covering Lie-group representations, IMU preintegration, and batch estimation.
Perception and SLAM — Vision, LIDAR, and Mapping
- Richard Hartley, Andrew Zisserman. Multiple View Geometry in Computer Vision. 2nd ed., 2004. Cambridge University Press. — Essential reference for camera geometry, epipolar constraints, and structure-from-motion.
- Paul J. Besl, Neil D. McKay. "A Method for Registration of 3-D Shapes." IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 1992. — Original ICP paper; foundational for LIDAR scan matching.
- Cyrill Stachniss, John J. Leonard, Sebastian Thrun. "Simultaneous Localization and Mapping." In Springer Handbook of Robotics, 2nd ed., 2016. Springer. — Authoritative SLAM survey covering EKF-SLAM, graph SLAM, and loop closure.
Planning, Navigation, and Deployment
- Steven M. LaValle. Planning Algorithms. 2006. Cambridge University Press. — Comprehensive coverage of RRT, PRM, graph search, and configuration space; freely available online.
- Dieter Fox, Wolfram Burgard, Sebastian Thrun. "The Dynamic Window Approach to Collision Avoidance." IEEE Robotics & Automation Magazine, 4(1), 1997. — Original DWA paper; foundational for real-time local planning on mobile robots.
- Michele Colledanchise, Petter Ogren. Behavior Trees in Robotics and AI. 2018. CRC Press. — Definitive reference on behavior tree architecture, reactivity, and mission management.